Release notes

This page has the release notes for the following extensions:

• AI Noise Suppression
• Virtual Background

Agora charges additionally for this extension. See Pricing.

This release improves the calculation performance of the AI-powered noise suppression algorithm.

This release adds the following APIs and parameters:

• APIs:
  • checkCompatibility: Checks whether the AI Noise Suppression extension is supported on the current browser.
  • setMode: Sets the noise suppression mode as AI noise suppression or stationary noise suppression.
  • setLevel: Sets the AI noise suppression level.
• Parameters:
  • elapsedTime in onoverload: Reports the time in ms that the extension needs to process one audio frame.

For API details, see AI Noise Suppression.

This release brings the following changes:

• AI Noise Suppression supports Agora Video SDK for Web v4.15.0 or later.
• The extension has Wasm dependencies only. Because JS dependencies are removed, you need to publish the Wasm files located in the node_modules/agora-extension-ai-denoiser/external directory again. If you have enabled the Content Security Policy (CSP), you need to modify the CSP configuration. See AI Noise Suppression for details.
• The audio data is dumped in PCM format instead of WAV format.
• To adjust the intensity of noise suppression, best practice is to call setLevel.

First release.

v1.2.0 was released on December 10, 2023.

As of this version, the Virtual Background extension incorporates the necessary Wasm module. You no longer need to publish the Wasm file separately, and pass the wasmDir parameter when calling the init method to initialize the extension.

After upgrading to this version, please modify your code accordingly.

This release upgrades the background segmentation algorithm of the extension, optimizing the segmentation effects on the subject, edges, and fingers in complex static and dynamic backgrounds.

This release fixed the issue that checkCompatibility could return inaccurate results on specific devices.

The wasmDir parameter of the init method is now optional.

This release fixes the occasional issue of jagged background images on Chrome for Android.

You can now specify the fit property when calling setOptions. This sets how the background is resized to fit the container. For API details, see Virtual background.

Virtual Background supports Agora Video SDK for Web v4.15.0 or later.

You can now call checkCompatibility and test if AI Noise Suppression extension is supported on the current browser. For API details, see Virtual background.

A black bar is no longer displayed to the left of the virtual background.

You can create multiple VirtualBackgroundProcessor instances to process multiple video streams.

First release.

This page has the release notes for the following extensions:

• MetaKit
• Camera Movement

v2.2.0 was released on September 13, 2024.

Stickers

This version adds the sticker feature that uses the face capture driver and follows the character's head movements. The SDK provides subpackages for glasses (material_sticker_glass), masks (material_sticker_facemask), veils (material_sticker_veil), and dragon head hats (material_sticker_dragonhat). You can load the corresponding scene resources to quickly experience the effects of different stickers.

Portrait edge light

This release adds a new portrait edge light effect. To experience it, specify the subpackage resource as material_effect_ray when loading scene resources.

Advertising light text-to-image

This version adds a text-to-image feature for the advertising lights. When setting the advertising light effects, you can specify the text content through the text parameter and add animation effects through the animation parameter. This includes jumping, waving, or swaying, to make the text appear dynamically on the screen.

This update adds support for loadMaterial and unloadMaterial in setExtensionProperty.

• When using loadMaterial to load scene resources, you can specify the resource path of the required subpackage. The engine will automatically request the scene texture and render the scene.
• If you need to switch to another scene, just use loadMaterial again to pass in another subpackage resource path. The engine will automatically switch to the new scene.
• When you no longer need to experience the scene, use unloadMaterial to uninstall scene resources.

This improvement significantly enhances the usability of the extension. You can quickly experience different functional scenarios by simply specifying different subpackage resource paths when loading.

Added

• loadMaterial
• unloadMaterial

v2.1.0 was released on March 6, 2024.

This update optimizes the performance of the MetaKit extension and adds support for two new keys in setExtensionProperty: requestTexture and switchTextureAvatarMode. These replace the original addSceneView and switchAvatarMode functions, respectively. The new interface supports automatic generation and return of texture data, which is then directly rendered, previewed, encoded, and transmitted through the SDK. This enhancement improves rendering performance, reduces latency, and ensures more efficient operation and a better user experience.

Added

• requestTexture
• switchTextureAvatarMode

v2.0.0 was released on February 23, 2024.

This is the first release of the MetaKit extension. This extension integrates multiple AI technologies to provide users with diverse video enhancement functions in audio and video interaction scenarios.

v1.2.0 was released on April 29, 2024.

• Added support for Video SDK v4.3.x.
• Improved the performance of the Camera Movement extension, reducing potential stuttering issues on low-end devices.

v1.0.0 was released on February 23, 2024.

This is the initial release of the Agora Camera Movement extension.

The extension uses the AI technology and the intelligent camera movement algorithms to provide various features for audio and video interaction scenarios.