Ubisoft, Tencent will begin using Nvidia’s AI NPC tools

Key Takeaways:

– Nvidia has expanded its AI game-making tool, Nvidia Ace, and rebranded it as Ace Production Microservices.
– The tool allows gaming companies to generate AI-generated video game characters, and major studios like Ubisoft and Tencent are already utilizing it.
– Nvidia Ace uses various tools to create non-playable characters (NPCs) with dynamic rendering, audio lip-sync, and speech-to-text and text-to-speech capabilities.
– The microservice opens up the toolset to partners, allowing them to use specific pieces of the tool rather than the full closed system.
– Other partners include Charisma, Convai, Inworld, NetEase, Ourpalm, UneeQ, and Genshin Impact developer MiHoYo.
– It is unclear what data Ace is trained on, as Nvidia uses multiple AI tools within Ace, each potentially trained on different data sets.
– The potential integration of Ace into major titles by companies like Ubisoft raises questions about the use of voice actors’ voices in AI training data.

Digital Trends:

Nvidia

Nvidia announced an expansion of its previously revealed AI game-making tool, Nvidia Ace, at CES 2024. Now available to partners as Ace Production Microservices, gaming companies will be able to use specific pieces of the multifaceted tool that’s capable of generating AI-generated video game characters. Ubisoft and Tencent are among the first major studios utilizing the process.

Nvidia Ace is a platform that allows creators to generate non-playable characters (NPCs) via AI. Nvidia achieves this with several different tools. Characters can be dynamically rendered into a game scene and an audio lip-sync tool can make it so their mouths match up with what they’re saying. The tool is also able to translate player speech to text, feed it to the AI NPC, and spit out a response via a separate text-to-speech tool. In short, it can create fully voiced, dynamic video game characters.

While Nvidia Ace itself isn’t new, the microservice opens the entire pipeline up to partners. Now, developers can use one piece of the toolset, rather than the full closed system. As part of the announcement, Nvidia announced that several big-name publishers are already on board. Both Ubisoft and Tencent are partners, though its currently unclear how each publisher intends to use the service.

Other partners include Charisma, Convai, Inworld, NetEase, Ourpalm, UneeQ and Genshin Impact developer MiHoYo.

Also unclear is what data Ace is trained on. When we asked about the data set use to generate writing and voices, Nvidia noted that there’s “no simple answer.” It pointed out that it’s using several AI tools within Ac,e and each one can be trained on different data sets.

It’s likely not the firm answer that opponents of AI in video games want to hear, even if it is a common refrain in the tech space. For instance, Nvidia’s stance leaves questions about whether or not the tool is trained on voice actors who have willingly agreed to use their voice for AI. Ace’s potential integration into major titles by a company like Ubisoft is sure to spark some conversations among artists who seemingly can’t be assured that their work isn’t part of the training data.






Source link

AI Eclipse TLDR:

Nvidia has announced the expansion of its AI game-making tool, Nvidia Ace, at CES 2024. The tool, now known as Ace Production Microservices, allows gaming companies to generate AI-generated video game characters. Major studios such as Ubisoft and Tencent are among the first partners to utilize this tool. Nvidia Ace enables creators to generate non-playable characters (NPCs) using AI, with features such as dynamic rendering, audio lip-sync, and translation of player speech to text. The microservice allows developers to access specific components of the toolset rather than the entire closed system. Other partners include Charisma, Convai, Inworld, NetEase, Ourpalm, UneeQ, and Genshin Impact developer MiHoYo. However, the specific data set used to train Ace is unclear, raising concerns about voice actors’ consent and the use of their work in the training data. The integration of Ace into major titles by companies like Ubisoft is expected to spark discussions within the artistic community.