Audio2Face Bone Transfer Toolkit

Together with Olivier Dral, a fellow 3rd Year student at BUas Games, I developed a system to procedurally rig and animate faces for a real-time environment, using Houdini & NVIDIA Omniverse Audio2Face, based on previous work done by David Rhodes.
This system was developed over the course of 6 weeks, for a game project that lacked the manpower to achieve facial animation for its cutscenes using traditional methods. Unfortunately, due to time constraints, this system also ended not being used in this project.

A video demonstrating the general workflow for the toolkit.

A traditional (simplified) pipeline for facial animation, highlighting the time consuming processes of rigging and animating.

The pipeline using this toolkit, which aims to replace the traditional approach to rigging and animation with more time-efficient alternatives.

There is a blog post on my ArtStation that goes into further detail about the inner workings of this toolkit and its development. I highly recommend you give it a look if you want to know more about this project!!

Previous
Previous

Tech Art Showcase - 2022/2023

Next
Next

Rubber Toy Ritual