Ubisoft’s AI lip-sync tech could have applications beyond gaming

Ubisoft's AI lip-sync tech could have applications beyond gaming

By Emma Boyle

We’re sure we’re not alone when we say that when someone mentions AI in games, our minds immediately jump to NPCs and enemies; their movements, their reactions, their, well, intelligence. All of it is part of a game’s AI.

But, as it turns out, AI is so much more than that in games. After a conversation with Yves Jacques, the head of Ubisoft’s La Forge technology research project, we gained a much better idea of how AI is being used to make game development faster and more affordable, as well as improve the immersive quality of the games we play.

We asked Jacquier to tell us about some of the prototypes being developed and used by Ubisoft and La Forge at the moment. One AI-powered project he was particularly excited to discuss was Sound Matching. This, he tells us, ”takes the wav file directly from the recorded actors and drives the facial animation” of in-game characters.

Improving facial animation

Without AI there are a few ways to do facial animation, Jacquier explains. One way is manually, the process of which can also be accelerated using motion capture, and another is to break down text into phonemes, or distinct units of sound. Using …read more

Source:: techradar.com – Gaming

Microsoft's Xbox app for Windows 10 will finally focus on PC gamers' needs Previous post Microsoft's Xbox app for Windows 10 will finally focus on PC gamers' needs Juul tightens up social media to focus on former smokers switching to e-cigs Next post Juul tightens up social media to focus on former smokers switching to e-cigs