Developers can use the sample to learn how to integrate NVIDIA ACE UE plugin in their software, including games, across the cloud and PC. It showcases customized speech, conversation, and animation AI models on two MetaHumans.
NVIDIA ACE reference sample currently supports Audio2Face (A2F), however NVIDIA Riva automatic speech recognition (ASR) and text-to-speech (TTS) capabilities are coming soon.
Key Features:
The NVIDIA ACE sample uses the latest ACE Unreal plugin to demonstrate sending speech clips to an NVIDIA Audio2Face service and receiving synchronized audio and ARKit-compatible facial animations. You can see MetaHuman characters have their faces animated with ARKit-compatible pose mapping.
This sample requires the plugin and connection to NVIDIA Audio2Face service. Options for connecting include: