Spotlight Sale: Save 50% on select Blueprints now through September 9.

ACE Unreal Engine Sample

NVIDIA - Code Plugins - Jul 10, 2024

Developers can use the sample to learn how to integrate NVIDIA ACE UE plugin in their software, including games, across the cloud and PC. It showcases customized speech, conversation, and animation AI models on two MetaHumans.

External Link
  • Supported Platforms
  • Supported Engine Versions
    5.4

NVIDIA ACE reference sample currently supports Audio2Face (A2F), however NVIDIA Riva automatic speech recognition (ASR) and text-to-speech (TTS) capabilities are coming soon.


Key Features:

  • NVIDIA Audio2Face allows animating in-game characters' lips to match the voice audio. 
  • Use the API key or a specific URL to connect to the A2F backend service.
  • Adjust A2F emotion parameters such as anger or joy.
  • Choose sample audio, upload your files, or record your own voice to experiment with A2F on a chosen character.
  • Use character tune parameters to adjust A2F model parameters.

Technical Details

The NVIDIA ACE sample uses the latest ACE Unreal plugin to demonstrate sending speech clips to an NVIDIA Audio2Face service and receiving synchronized audio and ARKit-compatible facial animations. You can see MetaHuman characters have their faces animated with ARKit-compatible pose mapping. 


This sample requires the plugin and connection to NVIDIA Audio2Face service. Options for connecting include:


Tags

ACEEXTERNAL LINKNVIDIAAUDIO2FACE

Related Content