Held by LiveVideoStack recently
Xiao Wei, expert and researcher of Tencent multimedia laboratory
Tencent Teana audio AI technology creates end-to-end audio communication experience
The black swan incident at the beginning of the year made digital communication an important means of communication between people, and also brought a great test to the stability and communication effect of real-time audio and video communication. Xiao Wei pointed out that in order to solve the challenges in real-time audio and video application scenarios, Tencent Multimedia Laboratory has explored the technology and framework of audio communication core experience for many years. Tencent's global digital ecology conference was officially launched in Septembe
RTC scenes are complex and processing chains are long; each node affects the user's ultimate experience, Xiao said. However, the downlink terminal side is the node closest to the user's final experience; if reasonably designed, the user's ultimate experience can be improved very efficiently. Therefore, Tencent Teana proposed
Based on the leading Tencent Teana audio solution, Tencent Teana not only enables remote access to different locations, scenes and equipment terminals at the same time, making remote online communication more efficient, but also expanding the voice bandwidth of real-time audio. Compared with the traditional PSTN telephone, the audio quality after using Tencent Tianlai technology is brighter and cleaner. At the same time, the whole set of audio algorithm capability has also been targeted optimization, which can be deployed in a variety of users' clients, and ultimately improve the intelligibility, naturalness and comfort of audio communication.
In addition, taking Tencent conference as an example, Xiao Wei demonstrated the enhancement effect of speech enhancement scheme based on deep learning in real scene. In the two minute demonstration, the subway station, vegetable market, street and other noise scenes were demonstrated respectively. In these scenarios, Tencent Teana voice enhancement scheme based on deep learning can provide high-quality processing effect, and the on-site display has been widely concerned by the audience.
On the other hand, Xiao Wei emphasizes that the establishment of end-to-end quality evaluation and certification system is also very important for the experience improvement in RTC scenarios. So far, Tencent multimedia laboratory has established a complete end-to-end call quality evaluation and certification system. With the help of this system, all technologies under Tencent's Teana brand have to pass the strict test of the system before the products are launched. In addition, in the process of technology development, the test results of the system can provide researchers with very important reference information for grinding and optimization of the scheme.
From technology to public welfare, Tencent Teana
At present, Tencent Teana has been widely used in Tencent conferences, Tencent cloud, national karaoke, micro video and other internal and external products and scenes of Tencent, and has helped relevant applications obtain good user reputation in terms of audio and video experience.
Not only that, in some of Tencent's barrier-free project exchanges, Tencent's multimedia laboratory team members learned that hearing-impaired people still face noisy public environments such as airports and shopping malls, even if they wear cochlear implants
On the occasion of the International Day of the Deaf on September 27, Tencent's Multimedia Lab, in conjunction with the Tencent Charity Foundation and the Shenzhen Information Accessibility Research Association, held a press conference to announce its launch
Tencent Tianlai action release
It is worth mentioning that EarthSound's action is not once
As the top audio and video communication and processing R & D team of Tencent, Tencent multimedia laboratory is committed to real-time audio and video communication, audio and video coding and decoding frontier algorithm research, audio and video international standards, computer vision image processing, and end-to-end audio and video quality evaluation. Among them, Teana technology is one of the important achievements of its experience and technical ability accumulation.
In the 5g wave, the technology and form of multimedia are constantly changing. The high efficiency and low delay transmission brings more abundant landing scenes. In the future, Tencent's Teana audio technology will also accelerate access to the real-time audio and video demand of Tencent's financial, government, education and other industry scenarios, so that more and more rich scenes will be landed, and users will be able to enjoy the immersive experience with 5g era color.