Other Improvements
This version also includes the following improvements:
From c2acd53921d3669bacd0b4df0861f983ff2bc660 Mon Sep 17 00:00:00 2001
From: Nero-Hu
Date: Mon, 15 Apr 2024 16:18:21 +0800
Subject: [PATCH 06/19] Speech Driven R.I.P.
---
dita/RTC-NG/API/enum_mediasourcetype.dita | 2 +-
dita/RTC-NG/API/enum_videosourcetype.dita | 2 +-
dita/RTC-NG/API/rtc_api_overview.dita | 8 --------
dita/RTC-NG/RTC_NG_API_Android.ditamap | 5 -----
dita/RTC-NG/RTC_NG_API_CPP.ditamap | 5 -----
dita/RTC-NG/RTC_NG_API_iOS.ditamap | 5 -----
dita/RTC-NG/RTC_NG_API_macOS.ditamap | 5 -----
dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap | 14 --------------
dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap | 14 --------------
.../RTC-NG/config/keys-rtc-ng-api-java.ditamap | 14 --------------
.../config/keys-rtc-ng-api-macos.ditamap | 14 --------------
.../RTC-NG/config/relations-rtc-ng-api.ditamap | 18 ------------------
dita/RTC-NG/release/release_notes.dita | 12 ------------
en-US/dita/RTC-NG/release/release_notes.dita | 14 --------------
14 files changed, 2 insertions(+), 130 deletions(-)
diff --git a/dita/RTC-NG/API/enum_mediasourcetype.dita b/dita/RTC-NG/API/enum_mediasourcetype.dita
index 9c98ab8236e..46eb49347ef 100644
--- a/dita/RTC-NG/API/enum_mediasourcetype.dita
+++ b/dita/RTC-NG/API/enum_mediasourcetype.dita
@@ -27,7 +27,7 @@
6: 自定义采集的视频源。
-
+
13: 视频源为语音驱动插件处理后的视频。
diff --git a/dita/RTC-NG/API/enum_videosourcetype.dita b/dita/RTC-NG/API/enum_videosourcetype.dita
index 7cebd886cc9..2b18e509178 100644
--- a/dita/RTC-NG/API/enum_videosourcetype.dita
+++ b/dita/RTC-NG/API/enum_videosourcetype.dita
@@ -75,7 +75,7 @@
14:(仅适用于 Windows 和 macOS)视频源为第四个屏幕。
-
+
15:视频源为语音驱动插件处理后的视频。
diff --git a/dita/RTC-NG/API/rtc_api_overview.dita b/dita/RTC-NG/API/rtc_api_overview.dita
index 1e69daa4f94..bd24c3bcf50 100644
--- a/dita/RTC-NG/API/rtc_api_overview.dita
+++ b/dita/RTC-NG/API/rtc_api_overview.dita
@@ -1061,14 +1061,6 @@
-
-
-
-
-
-
-
-
diff --git a/dita/RTC-NG/RTC_NG_API_Android.ditamap b/dita/RTC-NG/RTC_NG_API_Android.ditamap
index 2fff761567e..b8b4babbccd 100644
--- a/dita/RTC-NG/RTC_NG_API_Android.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_Android.ditamap
@@ -25,7 +25,6 @@
-
@@ -310,10 +309,6 @@
-
-
-
-
diff --git a/dita/RTC-NG/RTC_NG_API_CPP.ditamap b/dita/RTC-NG/RTC_NG_API_CPP.ditamap
index b6292f5d23a..5454d943bd3 100644
--- a/dita/RTC-NG/RTC_NG_API_CPP.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_CPP.ditamap
@@ -25,7 +25,6 @@
-
@@ -320,10 +319,6 @@
-
-
-
-
diff --git a/dita/RTC-NG/RTC_NG_API_iOS.ditamap b/dita/RTC-NG/RTC_NG_API_iOS.ditamap
index d43a72e4098..35ee7288fef 100644
--- a/dita/RTC-NG/RTC_NG_API_iOS.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_iOS.ditamap
@@ -25,7 +25,6 @@
-
@@ -317,10 +316,6 @@
-
-
-
-
diff --git a/dita/RTC-NG/RTC_NG_API_macOS.ditamap b/dita/RTC-NG/RTC_NG_API_macOS.ditamap
index c84d0a19e56..fe8f84abc9d 100644
--- a/dita/RTC-NG/RTC_NG_API_macOS.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_macOS.ditamap
@@ -24,7 +24,6 @@
-
@@ -311,10 +310,6 @@
-
-
-
-
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
index 26de3f9436a..a64b101298c 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
@@ -1295,13 +1295,6 @@
-
-
-
- registerFaceInfoObserver
-
-
-
@@ -5116,13 +5109,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
index df55a1c9a8f..add31b39a40 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
@@ -1258,13 +1258,6 @@
-
-
-
- setFaceInfoDelegate
-
-
-
@@ -4567,13 +4560,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
index 6001ef62694..66af34c3991 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
@@ -1250,13 +1250,6 @@
-
-
-
- registerFaceInfoObserver
-
-
-
@@ -4778,13 +4771,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
index 33a8be2bb3b..9bbb110fb01 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
@@ -1208,13 +1208,6 @@
-
-
-
- setFaceInfoDelegate
-
-
-
@@ -4279,13 +4272,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/dita/RTC-NG/config/relations-rtc-ng-api.ditamap b/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
index 8e35288a20a..2036227c4a2 100644
--- a/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
+++ b/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
@@ -939,14 +939,6 @@
-
-
-
-
-
-
-
-
@@ -2358,7 +2350,6 @@
-
@@ -2912,7 +2903,6 @@
-
@@ -3215,14 +3205,6 @@
-
-
-
-
-
-
-
-
diff --git a/dita/RTC-NG/release/release_notes.dita b/dita/RTC-NG/release/release_notes.dita
index 7f6efe3530c..aa22659278c 100644
--- a/dita/RTC-NG/release/release_notes.dita
+++ b/dita/RTC-NG/release/release_notes.dita
@@ -17,14 +17,6 @@
新增特性
- - 语音驱动虚拟人
-
SDK 新增语音驱动插件,可以将语音信息转换为对应口型的人脸信息,用于驱动虚拟人面部做出语音对应的口型变化。你可以通过该版本新增的 方法和 回调获取语音驱动插件处理后的人脸信息。该人脸信息为符合 ARkit 标准的 BS(Blend Shape)数据,你可以使用第三方 3D 渲染引擎对 BS 数据进一步处理。
- 语音驱动插件为可裁剪动态库,集成后 App 增加的体积等信息详见。
-
-
- - 声网 SDK 拓展插件 MetaKit 可帮助你简化语音驱动虚拟人的实现流程,无需自行搭建采集、编码和传输的框架。有关 MetaKit 的介绍和集成指导,详见 。
- - 语音驱动虚拟人功能处于公测阶段,如需使用请。
-
- 隐私清单文件 (iOS)
为满足 Apple 对于 App 发布的安全合规要求,SDK 自该版本起新增隐私清单文件 PrivacyInfo.xcprivacy,其中包含 SDK 中需要访问或使用用户数据的 API 调用说明和 SDK 采集的数据类型说明。
如果你需要将集成 v4.3.1 之前的 SDK 版本的 App 发布到苹果应用商店,则需要在 Xcode 工程中手动添加 PrivacyInfo.xcprivacy 文件。详见
@@ -201,10 +193,6 @@
- 新增
-
-
-
-
- (Android, iOS)
- (Android, iOS)
diff --git a/en-US/dita/RTC-NG/release/release_notes.dita b/en-US/dita/RTC-NG/release/release_notes.dita
index a923ae70577..4a6ee565666 100644
--- a/en-US/dita/RTC-NG/release/release_notes.dita
+++ b/en-US/dita/RTC-NG/release/release_notes.dita
@@ -17,16 +17,6 @@
New Features
- - Voice-Driven Virtual Characters
-
The SDK introduces a voice-driven plugin that converts voice information into corresponding facial expressions to animate virtual characters. You can access processed facial information through the newly added method and callback. This facial information conforms to the ARKit standard for Blend Shapes (BS), which you can further process using third-party 3D rendering engines.
- The voice-driven plugin is a trimmable dynamic library, and details about the increase in app size post-integration are available at .
-
-
- - The Agora SDK extension plugin, MetaKit, simplifies the implementation process of animating virtual characters with voice, eliminating the need to build your own framework for collection, encoding, and transmission. Detailed introduction and integration guidance for MetaKit are available at .
- - The voice-driven virtual character feature is currently in beta testing. To use it, please .
-
-
-
- Privacy manifest file (iOS)
To meet Apple's safety compliance requirements for app publication, the SDK now includes a privacy manifest file, PrivacyInfo.xcprivacy, detailing the SDK's API calls that access or use user data, along with a description of the types of data collected.
If you need to publish an app with SDK versions prior to v4.3.1 to the Apple App Store, you must manually add the PrivacyInfo.xcprivacy file to your Xcode project. For more details, see .
@@ -203,10 +193,6 @@
- adds , enhancing the spatial presence of vocals in chorus scenarios.
- is added, enhancing the spatial presence of vocals in chorus scenarios. (Android)
-
-
-
-
- (Android, iOS)
- (Android, iOS)
From 35267bd5292de87a5f3ba31a09791773f348178a Mon Sep 17 00:00:00 2001
From: Nero-Hu
Date: Mon, 15 Apr 2024 08:18:56 +0000
Subject: [PATCH 07/19] Sync cn prototype to en prototype
---
.../dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap | 14 --------------
.../dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap | 14 --------------
.../RTC-NG/config/keys-rtc-ng-api-java.ditamap | 14 --------------
.../RTC-NG/config/keys-rtc-ng-api-macos.ditamap | 14 --------------
4 files changed, 56 deletions(-)
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
index 26de3f9436a..a64b101298c 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
@@ -1295,13 +1295,6 @@
-
-
-
- registerFaceInfoObserver
-
-
-
@@ -5116,13 +5109,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
index df55a1c9a8f..add31b39a40 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
@@ -1258,13 +1258,6 @@
-
-
-
- setFaceInfoDelegate
-
-
-
@@ -4567,13 +4560,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
index 6001ef62694..66af34c3991 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
@@ -1250,13 +1250,6 @@
-
-
-
- registerFaceInfoObserver
-
-
-
@@ -4778,13 +4771,6 @@
-
-
-
- onFaceInfo
-
-
-
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
index 33a8be2bb3b..9bbb110fb01 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
@@ -1208,13 +1208,6 @@
-
-
-
- setFaceInfoDelegate
-
-
-
@@ -4279,13 +4272,6 @@
-
-
-
- onFaceInfo
-
-
-
From c11962a7ac7272205d9859118a97d58fc6f3c642 Mon Sep 17 00:00:00 2001
From: Nero-Hu
Date: Mon, 15 Apr 2024 16:26:20 +0800
Subject: [PATCH 08/19] Speech Driven R.I.P.
---
dita/RTC-NG/API/rtc_api_overview.dita | 8 ++++++++
dita/RTC-NG/RTC_NG_API_Android.ditamap | 5 +++++
dita/RTC-NG/RTC_NG_API_CPP.ditamap | 5 +++++
dita/RTC-NG/RTC_NG_API_iOS.ditamap | 5 +++++
dita/RTC-NG/RTC_NG_API_macOS.ditamap | 5 +++++
dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap | 16 +++++++++++++++-
dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap | 16 +++++++++++++++-
.../RTC-NG/config/keys-rtc-ng-api-java.ditamap | 16 +++++++++++++++-
.../config/keys-rtc-ng-api-macos.ditamap | 16 +++++++++++++++-
.../RTC-NG/config/relations-rtc-ng-api.ditamap | 18 ++++++++++++++++++
10 files changed, 106 insertions(+), 4 deletions(-)
diff --git a/dita/RTC-NG/API/rtc_api_overview.dita b/dita/RTC-NG/API/rtc_api_overview.dita
index bd24c3bcf50..55c71f3dfe7 100644
--- a/dita/RTC-NG/API/rtc_api_overview.dita
+++ b/dita/RTC-NG/API/rtc_api_overview.dita
@@ -1061,6 +1061,14 @@
+
+
+
+
+
+
+
+
diff --git a/dita/RTC-NG/RTC_NG_API_Android.ditamap b/dita/RTC-NG/RTC_NG_API_Android.ditamap
index b8b4babbccd..954b04a957f 100644
--- a/dita/RTC-NG/RTC_NG_API_Android.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_Android.ditamap
@@ -25,6 +25,7 @@
+
@@ -309,6 +310,10 @@
+
+
+
+
diff --git a/dita/RTC-NG/RTC_NG_API_CPP.ditamap b/dita/RTC-NG/RTC_NG_API_CPP.ditamap
index 5454d943bd3..aabdb72d792 100644
--- a/dita/RTC-NG/RTC_NG_API_CPP.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_CPP.ditamap
@@ -25,6 +25,7 @@
+
@@ -319,6 +320,10 @@
+
+
+
+
diff --git a/dita/RTC-NG/RTC_NG_API_iOS.ditamap b/dita/RTC-NG/RTC_NG_API_iOS.ditamap
index 35ee7288fef..7341f56ce62 100644
--- a/dita/RTC-NG/RTC_NG_API_iOS.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_iOS.ditamap
@@ -25,6 +25,7 @@
+
@@ -316,6 +317,10 @@
+
+
+
+
diff --git a/dita/RTC-NG/RTC_NG_API_macOS.ditamap b/dita/RTC-NG/RTC_NG_API_macOS.ditamap
index fe8f84abc9d..78e86ea5727 100644
--- a/dita/RTC-NG/RTC_NG_API_macOS.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_macOS.ditamap
@@ -24,6 +24,7 @@
+
@@ -310,6 +311,10 @@
+
+
+
+
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
index a64b101298c..07e829b6960 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
@@ -216,7 +216,7 @@
-
+
IFaceInfoObserver
@@ -1295,6 +1295,13 @@
+
+
+
+ registerFaceInfoObserver
+
+
+
@@ -5109,6 +5116,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
index add31b39a40..1ce0eadfc3c 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
@@ -202,7 +202,7 @@
-
+
AgoraFaceInfoDelegate
@@ -1258,6 +1258,13 @@
+
+
+
+ setFaceInfoDelegate
+
+
+
@@ -4560,6 +4567,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
index 66af34c3991..90f008a18ef 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
@@ -173,7 +173,7 @@
-
+
IFaceInfoObserver
@@ -1250,6 +1250,13 @@
+
+
+
+ registerFaceInfoObserver
+
+
+
@@ -4771,6 +4778,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
index 9bbb110fb01..238668cb79b 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
@@ -173,7 +173,7 @@
-
+
AgoraFaceInfoDelegate
@@ -1208,6 +1208,13 @@
+
+
+
+ setFaceInfoDelegate
+
+
+
@@ -4272,6 +4279,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/dita/RTC-NG/config/relations-rtc-ng-api.ditamap b/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
index 2036227c4a2..80484704c03 100644
--- a/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
+++ b/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
@@ -939,6 +939,14 @@
+
+
+
+
+
+
+
+
@@ -2350,6 +2358,7 @@
+
@@ -2903,6 +2912,7 @@
+
@@ -3205,6 +3215,14 @@
+
+
+
+
+
+
+
+
From 65e4fd71179945872b2fba30ca50aa517dbc10ba Mon Sep 17 00:00:00 2001
From: Nero-Hu
Date: Mon, 15 Apr 2024 08:27:18 +0000
Subject: [PATCH 09/19] Sync cn prototype to en prototype
---
.../RTC-NG/config/keys-rtc-ng-api-cpp.ditamap | 16 +++++++++++++++-
.../RTC-NG/config/keys-rtc-ng-api-ios.ditamap | 16 +++++++++++++++-
.../RTC-NG/config/keys-rtc-ng-api-java.ditamap | 16 +++++++++++++++-
.../RTC-NG/config/keys-rtc-ng-api-macos.ditamap | 16 +++++++++++++++-
4 files changed, 60 insertions(+), 4 deletions(-)
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
index a64b101298c..07e829b6960 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
@@ -216,7 +216,7 @@
-
+
IFaceInfoObserver
@@ -1295,6 +1295,13 @@
+
+
+
+ registerFaceInfoObserver
+
+
+
@@ -5109,6 +5116,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
index add31b39a40..1ce0eadfc3c 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
@@ -202,7 +202,7 @@
-
+
AgoraFaceInfoDelegate
@@ -1258,6 +1258,13 @@
+
+
+
+ setFaceInfoDelegate
+
+
+
@@ -4560,6 +4567,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
index 66af34c3991..90f008a18ef 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
@@ -173,7 +173,7 @@
-
+
IFaceInfoObserver
@@ -1250,6 +1250,13 @@
+
+
+
+ registerFaceInfoObserver
+
+
+
@@ -4771,6 +4778,13 @@
+
+
+
+ onFaceInfo
+
+
+
diff --git a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
index 9bbb110fb01..238668cb79b 100644
--- a/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
+++ b/en-US/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
@@ -173,7 +173,7 @@
-
+
AgoraFaceInfoDelegate
@@ -1208,6 +1208,13 @@
+
+
+
+ setFaceInfoDelegate
+
+
+
@@ -4272,6 +4279,13 @@
+
+
+
+ onFaceInfo
+
+
+
From f2e08181f5212c49fa29195acd244c32c59e9d5f Mon Sep 17 00:00:00 2001
From: Cilla-luodan <85477033+Cilla-luodan@users.noreply.github.com>
Date: Mon, 15 Apr 2024 17:43:21 +0800
Subject: [PATCH 10/19] 1
---
en-US/dita/RTC-NG/release/release_notes.dita | 14 +++++++-------
1 file changed, 7 insertions(+), 7 deletions(-)
diff --git a/en-US/dita/RTC-NG/release/release_notes.dita b/en-US/dita/RTC-NG/release/release_notes.dita
index 4a6ee565666..5d2f09fff57 100644
--- a/en-US/dita/RTC-NG/release/release_notes.dita
+++ b/en-US/dita/RTC-NG/release/release_notes.dita
@@ -139,9 +139,9 @@
- Bug Fixes
+ Issues fixed
- This version resolves the following issues:
+ This version fixed the following issues:
- Fixed an issue where SEI data output did not synchronize with video rendering when playing media streams containing SEI data using the media player.
- After joining a channel and calling , audio playback did not immediately stop. (Android)
@@ -150,7 +150,7 @@
- When a user plugged and unplugged a Bluetooth or wired headset once, the audio state change callback was triggered multiple times.
- Broadcasters using certain models of devices under speaker mode experienced occasional local audio capture failures when switching the app process to the background and then back to the foreground, causing remote users to not hear the broadcaster's audio. (Android)
- An occasional echo was observed when playing the audio stream of a specified user before mixing. (macOS, Windows)
- - During audio-video interactions, when a local user set the system default playback device to speakers using , there was no sound from the remote end. (Windows)
+ - During interactions, when a local user set the system default playback device to speakers using , there was no sound from the remote end. (Windows)
- On devices with Android 8.0, enabling screen sharing occasionally caused the app to crash. (Android)
- When sharing an Excel document window, remote users occasionally saw a green screen. (Windows)
- In scenarios using camera capture for local video, when the app was moved to the background and or was called to stop video capture, camera capture was unexpectedly activated when the app was brought back to the foreground. (Android)
@@ -161,15 +161,15 @@
API Changes
- New
+
Added
- (iOS, macOS)
- (iOS, macOS)
- (iOS)
- (iOS)
- - adds surfaceTexture and enableAlphaMask
- - adds enableAlphaMask
- - adds the following enumerations:
+
- The surfaceTexture and enableAlphaMask members in
+ - The enableAlphaMask member in
+ - The following enumerations in :
- LOCAL_VIDEO_STREAM_REASON_DEVICE_INTERRUPT
- LOCAL_VIDEO_STREAM_REASON_DEVICE_FATAL_ERROR
From f5a0f1ee3225750cbbab857a38bc60f9a583241b Mon Sep 17 00:00:00 2001
From: Nero-Hu
Date: Tue, 16 Apr 2024 10:32:22 +0800
Subject: [PATCH 11/19] add en props to speech driven
---
dita/RTC-NG/API/enum_mediasourcetype.dita | 2 +-
dita/RTC-NG/API/enum_videosourcetype.dita | 2 +-
dita/RTC-NG/API/rtc_api_overview.dita | 4 ++--
dita/RTC-NG/RTC_NG_API_Android.ditamap | 4 ++--
dita/RTC-NG/RTC_NG_API_CPP.ditamap | 4 ++--
dita/RTC-NG/RTC_NG_API_iOS.ditamap | 4 ++--
dita/RTC-NG/RTC_NG_API_macOS.ditamap | 4 ++--
dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap | 6 +++---
dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap | 6 +++---
.../RTC-NG/config/keys-rtc-ng-api-java.ditamap | 6 +++---
.../config/keys-rtc-ng-api-macos.ditamap | 6 +++---
.../RTC-NG/config/relations-rtc-ng-api.ditamap | 6 +++---
dita/RTC-NG/release/release_notes.dita | 2 +-
en-US/dita/RTC-NG/release/release_notes.dita | 18 +++++++++++++++++-
14 files changed, 45 insertions(+), 29 deletions(-)
diff --git a/dita/RTC-NG/API/enum_mediasourcetype.dita b/dita/RTC-NG/API/enum_mediasourcetype.dita
index 46eb49347ef..f465e52238b 100644
--- a/dita/RTC-NG/API/enum_mediasourcetype.dita
+++ b/dita/RTC-NG/API/enum_mediasourcetype.dita
@@ -27,7 +27,7 @@
6: 自定义采集的视频源。
-
+
13: 视频源为语音驱动插件处理后的视频。
diff --git a/dita/RTC-NG/API/enum_videosourcetype.dita b/dita/RTC-NG/API/enum_videosourcetype.dita
index 2b18e509178..f3bd99f7efc 100644
--- a/dita/RTC-NG/API/enum_videosourcetype.dita
+++ b/dita/RTC-NG/API/enum_videosourcetype.dita
@@ -75,7 +75,7 @@
14:(仅适用于 Windows 和 macOS)视频源为第四个屏幕。
-
+
15:视频源为语音驱动插件处理后的视频。
diff --git a/dita/RTC-NG/API/rtc_api_overview.dita b/dita/RTC-NG/API/rtc_api_overview.dita
index 55c71f3dfe7..16902b17f57 100644
--- a/dita/RTC-NG/API/rtc_api_overview.dita
+++ b/dita/RTC-NG/API/rtc_api_overview.dita
@@ -1061,11 +1061,11 @@
-
+
-
+
diff --git a/dita/RTC-NG/RTC_NG_API_Android.ditamap b/dita/RTC-NG/RTC_NG_API_Android.ditamap
index 954b04a957f..2a4ffc6e0b8 100644
--- a/dita/RTC-NG/RTC_NG_API_Android.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_Android.ditamap
@@ -25,7 +25,7 @@
-
+
@@ -310,7 +310,7 @@
-
+
diff --git a/dita/RTC-NG/RTC_NG_API_CPP.ditamap b/dita/RTC-NG/RTC_NG_API_CPP.ditamap
index aabdb72d792..97f342c77f6 100644
--- a/dita/RTC-NG/RTC_NG_API_CPP.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_CPP.ditamap
@@ -25,7 +25,7 @@
-
+
@@ -320,7 +320,7 @@
-
+
diff --git a/dita/RTC-NG/RTC_NG_API_iOS.ditamap b/dita/RTC-NG/RTC_NG_API_iOS.ditamap
index 7341f56ce62..80f36df8c95 100644
--- a/dita/RTC-NG/RTC_NG_API_iOS.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_iOS.ditamap
@@ -25,7 +25,7 @@
-
+
@@ -317,7 +317,7 @@
-
+
diff --git a/dita/RTC-NG/RTC_NG_API_macOS.ditamap b/dita/RTC-NG/RTC_NG_API_macOS.ditamap
index 78e86ea5727..68572596199 100644
--- a/dita/RTC-NG/RTC_NG_API_macOS.ditamap
+++ b/dita/RTC-NG/RTC_NG_API_macOS.ditamap
@@ -24,7 +24,7 @@
-
+
@@ -311,7 +311,7 @@
-
+
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
index 07e829b6960..6b5b322689b 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-cpp.ditamap
@@ -216,7 +216,7 @@
-
+
IFaceInfoObserver
@@ -1295,7 +1295,7 @@
-
+
registerFaceInfoObserver
@@ -5116,7 +5116,7 @@
-
+
onFaceInfo
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
index 1ce0eadfc3c..9e2e686a698 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-ios.ditamap
@@ -202,7 +202,7 @@
-
+
AgoraFaceInfoDelegate
@@ -1258,7 +1258,7 @@
-
+
setFaceInfoDelegate
@@ -4567,7 +4567,7 @@
-
+
onFaceInfo
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
index 90f008a18ef..c54678a5287 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-java.ditamap
@@ -173,7 +173,7 @@
-
+
IFaceInfoObserver
@@ -1250,7 +1250,7 @@
-
+
registerFaceInfoObserver
@@ -4778,7 +4778,7 @@
-
+
onFaceInfo
diff --git a/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap b/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
index 238668cb79b..3a4c499035f 100644
--- a/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
+++ b/dita/RTC-NG/config/keys-rtc-ng-api-macos.ditamap
@@ -173,7 +173,7 @@
-
+
AgoraFaceInfoDelegate
@@ -1208,7 +1208,7 @@
-
+
setFaceInfoDelegate
@@ -4279,7 +4279,7 @@
-
+
onFaceInfo
diff --git a/dita/RTC-NG/config/relations-rtc-ng-api.ditamap b/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
index 80484704c03..fe41071534d 100644
--- a/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
+++ b/dita/RTC-NG/config/relations-rtc-ng-api.ditamap
@@ -939,7 +939,7 @@
-
+
@@ -2912,7 +2912,7 @@
-
+
@@ -3215,7 +3215,7 @@
-
+
diff --git a/dita/RTC-NG/release/release_notes.dita b/dita/RTC-NG/release/release_notes.dita
index aa22659278c..a44e2a7283c 100644
--- a/dita/RTC-NG/release/release_notes.dita
+++ b/dita/RTC-NG/release/release_notes.dita
@@ -146,7 +146,7 @@
加入频道后调用 关闭音频模块,音频播放没有立即停止。(Android)
屏幕共享场景中,App 调用 开启声卡采集功能采集共享屏幕的音频,本地用户手动禁用本地音频采集设备后,声卡采集的音频发送失败,远端用户听不见共享屏幕的声音。(Windows)
在音视频互动中,如果用户将耳机插入设备并手动将系统音频输出切换为扬声器,之后 App 调用 方法指定音频播放设备为耳机,用户移除耳机后,音频输出并未按预期行为切换至扬声器。 (macOS)
- 用户插拔一次蓝牙或有线耳机,音频状态改变回调 会触发多次。
+ 用户插拔一次蓝牙或有线耳机,音频状态改变回调 会触发多次。
主播使用部分型号设备在扬声器下进行音视频互动,之后切换 App 进程到后台再切回前台,偶现本地音频采集失败,远端用户听不到主播的声音。(Android)
播放指定用户混音前的音频流时偶现回声。(macOS、Windows)
在音视频互动过程中,本地用户调用 设置系统默认播放设备为扬声器后,听远端无声。(Windows)
diff --git a/en-US/dita/RTC-NG/release/release_notes.dita b/en-US/dita/RTC-NG/release/release_notes.dita
index 5d2f09fff57..b9c88de4f4f 100644
--- a/en-US/dita/RTC-NG/release/release_notes.dita
+++ b/en-US/dita/RTC-NG/release/release_notes.dita
@@ -17,6 +17,16 @@
New Features
+ - Speech Driven Avatar
+
The SDK introduces a speech driven extension that converts speech information into corresponding facial expressions to animate avatar. You can access the facial information through the newly added method and callback. This facial information conforms to the ARKit standard for Blend Shapes (BS), which you can further process using third-party 3D rendering engines.
+ The speech driven extension is a trimmable dynamic library, and details about the increase in app size are available at .
+
+
+ - The Agora SDK extension extension, MetaKit, simplifies the implementation process of animating avatar with speech, eliminating the need to build your own framework for collection, encoding, and transmission. Detailed introduction and integration guidance for MetaKit are available at .
+ - The speech driven avatar feature is currently in beta testing. To use it, please .
+
+
+
- Privacy manifest file (iOS)
To meet Apple's safety compliance requirements for app publication, the SDK now includes a privacy manifest file, PrivacyInfo.xcprivacy, detailing the SDK's API calls that access or use user data, along with a description of the types of data collected.
If you need to publish an app with SDK versions prior to v4.3.1 to the Apple App Store, you must manually add the PrivacyInfo.xcprivacy file to your Xcode project. For more details, see .
@@ -147,7 +157,7 @@
- After joining a channel and calling , audio playback did not immediately stop. (Android)
- In screen sharing scenarios, when the app enabled sound card capture with to capture audio from the shared screen, the transmission of sound card captured audio failed after a local user manually disabled the local audio capture device, causing remote users to not hear the shared screen's audio. (Windows)
- In audio-video interactions, if a user inserted headphones into the device and manually switched the system audio output to speakers, and later the app called to specify the headphone as the audio playback device, audio output did not switch back to speakers as expected after the headphones were removed. (macOS)
- - When a user plugged and unplugged a Bluetooth or wired headset once, the audio state change callback was triggered multiple times.
+ - When a user plugged and unplugged a Bluetooth or wired headset once, the audio state change callback was triggered multiple times.
- Broadcasters using certain models of devices under speaker mode experienced occasional local audio capture failures when switching the app process to the background and then back to the foreground, causing remote users to not hear the broadcaster's audio. (Android)
- An occasional echo was observed when playing the audio stream of a specified user before mixing. (macOS, Windows)
- During interactions, when a local user set the system default playback device to speakers using , there was no sound from the remote end. (Windows)
@@ -175,6 +185,12 @@
- LOCAL_VIDEO_STREAM_REASON_DEVICE_FATAL_ERROR