Nvidia’s new platform will use generative AI to power humanoid robots

Nvidia on Monday announced a hardware and software platform for building human-like robots that includes generative artificial intelligence capabilities.

The new platform will include a computing system that will power the robot and AI, as well as a set of software including genAI and other tools to build human-like robots, the company said at its conference developers’ annual.

The addition of genAI will allow humanoid robots to take actions based on inputs combining language, video, “human demonstrations” and past experiences. Called Project GR00T, the genAI components will add to the company’s existing hardware and software platform for robotics.

“These smarter, faster and better robots will be deployed in heavy industries around the world,” said Rev. Lebaredian, vice president of Omniverse and simulation technologies, during a press briefing with journalists . “We are working with the entire global robot and simulation ecosystem to accelerate development and adoption.”

The powerful computer behind the genAI software is called “Jetson Thor” and is based on one of the company’s AI chips and other hardware. The computer will give the robot enough computing power to perform complex tasks and interact with people and machines, the company said.

The suite of software tools is called the “Isaac” platform, and the new GR00T genAI features are designed to work for “any robot incarnation in any environment,” it says. The tools include the ability to train the software to make better decisions over time, a process known as reinforcement learning.

Nvidia also announced that it will release pre-trained robotic models and other software that will improve robotic arm functions and multi-camera sensing capabilities.

© Thomson Reuters 2024

---