zycoo

For viewers to delight in material such as motion pictures, sports video games and live events to the fullest, home TVs not just require exceptional picture quality but outstanding sound quality as well. Understanding this, market leaders are pursuing 3D audio development to include a deeper level of immersion to entertainment experiences - bringing to life thrilling action scenes and capturing the quietest information of ambient noise.
vonage.com
In other words, 3D audio makes listeners feel as if they're actually in the middle of the action. Typically just supported at particular venues such as theater or taping studios, 3D audio is making its way into homes to provide audiences a brand-new method to experience their favorite content.
3cx.com
Samsung Electronics' advanced research institute Samsung Research has been making every effort to popularize 3D audio given that 2020. To this end, Samsung dealt with Google to jointly develop Immersive Audio Model and Formats (IAMF) - an innovative 3D spatial audio innovation that was adopted by the Alliance for Open Media (AOM)1 in October 2023. Samsung Newsroom took a seat with the team that developed IAMF to hear the story of how the innovation came to life.

▲ The Visual Technology Team at Samsung Research led the development of a requirement for audio technology. (From left) SungHee Hwang, JeongHoon Park and WooHyun Nam

A New Way To Enjoy 3D Audio in the house

Ambient noise exists everywhere - from the sound of shoes scraping on the pathway to the mild hum of cars and trucks driving down the roadway. While this noise may appear unneeded in media, it's important in adding depth and a sense of realness. 3D audio works to perfectly mix ambient noise with discussions and other sound impacts to develop a more dynamic and genuine home entertainment experience.

"3D audio makes you feel as if you're really in the heart of the action by changing the strength, motion and vibrance of the noise," said WooHyun Nam from the Visual Technology Team at Samsung Research. "In this method, viewers have the ability to enjoy a more full-bodied sound that catches the 3D aspects of the world around us."

▲ SungHee Hwang from Samsung Research's Visual Technology Team

Despite the advantages of 3D audio, it has been tough to apply the innovation to home audio devices due to technological limitations. "3D sound information from content can not be interpreted correctly by home audio systems such as TV speakers or sound bars, resulting in a slightly limited audio experience that does not have information from the original content," stated SungHee Hwang from the Visual Technology Team at Samsung Research.

To resolve this, Samsung worked vigilantly with Google to establish an audio solution that would permit viewers to experience content audio as meant. "If the 3D audio information can be read by gadget manufacturers, they can adjust the noise in audio gadgets - allowing for immersive audio experiences with standard TV speakers or sound bars in your home," said Nam. "By adjusting the audio to match the home device environment, listeners can experience audio simply as the creator meant with no distortions or loss in quality."

An uniform requirement is required to send and get audio information smoothly between developers and device manufacturers. "Samsung and Google's particular expertise in gadgets and content made the business ideal partners to develop IAMF technology," said JeongHoon Park, Executive Vice President and Head of Visual Technology Team at Samsung Research. "By coming together to develop this unmatched innovation, we are leading the way for consumers to take pleasure in 3D audio in their homes."

Three Characteristics of IAMF Technology: Vertical Audio, AI-Based Audio and Customized Audio

IAMF technology provides three unique functions that boost the audio experience.

▲ WooHyun Nam from Samsung Research's Visual Technology Team

1. Ability To Express Sound Vertically

Previous open-source audio codecs just supported horizontal noise expression. With IAMF technology, audio can now be expressed vertically so that noise is progressively multi-directional. "IAMF makes sound more reasonable, by allowing listeners to hear audio in front, behind or to either side and also above or listed below them," said Nam. "As such, when IAMF innovation is applied to home TV speakers and sound bars, it allows listeners to hear sounds such as birds flying over their head on their TVs in your home."

2. AI-Based Scene Analysis and 3D Audio Effects

IAMF makes use of AI and deep-learning technology to examine scenes and stress specific elements of the material - changing audio levels for more boosted sound throughout the viewing experience. "In TV and movie, there are specific scenes where the soundtrack or background music is the primary focus," said Nam. "IAMF will stabilize the sound in these instances. Similarly, the technology will fine-tune audio when there is character dialogue to enable the listener to focus on the discussion."

In addition, IAMF innovation supplies optimum noise in spite of modifications in the device environment. "By adjusting the scene analysis audio information according to the device environment, IAMF innovation makes it possible for listeners to take pleasure in the content's initial sound quality on standard home TVs," Hwang added.

3. Highly Customized Audio

Users will be able to easily change sound according to their choices with IAMF technology. Whether viewers are looking to enhance sound impacts from an action scene or enhance discussion, IAMF provides them the versatility to personalize content audio for a more customized experience.

▲ IAMF analyzes data from material and allows audiences to change and customize audio settings. When enjoying a sports game, users can straight pick whether to stress the analyst's voice or the sounds of the game itself.

3D Audio Across the Industry With Open-Source IAMF

Open source is crucial to producing a unified requirement across the market. IAMF is the first open source-based audio technology basic adopted by AOM - meaning both business and independent content developers across the market can access the innovation and expand its usage.

"In order to allow people to freely develop content with 3D audio innovation, associated technology needs to be open to all," stated Nam. "Providing a complete open-source framework for 3D audio, from development to shipment and playback, will enable for even more varied audio content experiences in the future."

Similarly, Park highlighted how IAMF technology will have a large influence on the audio landscape moving forward. "Because we reside in an era controlled by content development, IAMF will assist lead, expand and transform the 3D audio community," he said.

Success Accomplished Through Cooperation

Research on IAMF started in 2020 and took almost four years to complete. Through a combination of determination and difficult work, the team was able to achieve success.

"The job involved lots of days of nonstop work, and there were times when we needed to operate at night due to the time distinction in between our workplace and Google's," said Hwang. "Despite these obstacles, I was proud in the end. It was a terrific opportunity to deal with designers from other nations."

The groups established a sense of friendship along the method and built a solid structure of trust and understanding. "A Google worker mentioned how this collaboration with Samsung has actually been the most enjoyable partnership he had completed so far," Park recalled. "We had the ability to achieve this job since our groups trusted each other. I'm really proud of and appreciative for our staff member' efforts and their cooperation."

▲ JeongHoon Park, Corporate EVP and Head of the Visual Technology Team at Samsung Research

Additionally, Park applauded each staff member's unique skills and proficiency which helped contribute to the development of IAMF. "WooHyun Nam was important in proposing the innovation development concepts while SungHee Hwang arranged and documented our group's concepts in a specific way," he stated.

A Vision for 'Samsung Sound'

Upon its release, the Samsung Research team realized that the standardization of 3D spatial audio marked a new period of sound technology.

"Thanks to IAMF, we can start looking into technologies that will open up a world of audio possibilities," said Nam. In line with this, the Samsung Research team is presently developing a sophisticated variation of IAMF innovation that can be used to various sectors such as mobile phones, the metaverse, video games and more.

▲ With their combined efforts and relentless perseverance, the Visual Technology Team at Samsung Research was able to successfully produce a brand-new requirement for 3D audio.

Given the success of IAMF, the Samsung Research group is inspired to create much better audio innovation for customers. Each of the employee shared their aspirations for the future of 3D audio.

Nam touched on his desire to create that is more immersive. "I desire to develop a more innovative 3D audio technology that makes users feel like they are really in the scene of a film, TV show or live occasion," he stated. "I likewise wish to continue this research study up until 3D audio is used to Samsung's smart devices."

More broadly, Hwang talked about how he hopes Samsung will have the ability to develop unequaled audio technology that will position it among the ranks of other leading audio business. "My objective is to develop an innovation that consumers will have the ability to easily identify as 'Samsung Sound' when they hear it," he stated. "I am optimistic that the IAMF requirement is a stepping stone toward this dream. "

"My hope is that Samsung's sound technology will make it possible for customers to take pleasure in an updated audio experience that is on par with that of current visual experiences," stated Park. "I hope that material developers will make use of Samsung's audio technology to make 3D audio material available. Additionally, we intend to develop an encouraging environment that enables researchers to handle bold and amazing obstacles such as expanding Samsung's audio technology."

Technological standards such as IAMF will make entertainment more immersive for audiences throughout the board. The Samsung Research team is paving the way for developments that will alter the future of audio.

1 A non-profit market consortium formed to develop and share innovation for multimedia shipment, permitting developers to make use of the technology without worrying about expense. It is operated by an alliance of 38 companies including Samsung Electronics, Google, Amazon, Apple and Meta.