Google announces Gemini AI model that can run on robots locally

Google's DeepMind unveiled next-generation generative Artificial Intelligence (gen AI), Gemini Robotics On-Device.

It runs on the most advanced VLA (vision language action) model, which enables the robots to understand complex multi-modal queries with a mix of visual, audio and text.

It runs on-device locally without any need for cloud server connectivity to run activities. So, there won't be latency when the robots receive commands and perform the task immediately.

The astonishing aspect of the Gemini Robotic On-device is that all the commands can be just told to the robot and it will promptly complete it.

It has been tested on bi-arm robots, engineered to require minimal computational resources to perform activities like unzipping bags and folding clothes.

Further tests are also being conducted with varying degrees of complexity, such as zipping a lunch-box, drawing a card and pouring salad dressing.

Robots running Gemini Robotics on-device model to perform basic tasks such as placing a t-shirt and Rubik's cube in a gift bag.

Google Robotics On-Device model's use-cases:

These bi-arm robots have high potential to automate work in major industries such as consumer electronics, food and automobile. Companies can use them to assemble phones, TVs, cars, make beverages, snacks, stitch clothes and other consumer goods. And, most importantly, unlike humans, they can be used to run factories 24/7 with a continuous power supply.

For now, Google is offering the Gemini Robotics SDK (software development kits) to a select group of testers and companies to run their devices. They have to offer feedback and if required, Google will make appropriate course corrections to improve the new gen AI model. Interested programmers access it on Google's trusted tester program page (here).

"Gemini Robotics On-Device marks a step forward in making powerful robotics models more accessible and adaptable — and our on-device solution will help the robotics community tackle important latency and connectivity challenges," the company said.

Get the latest news on new launches, gadget reviews, apps, cybersecurity, and more on personal technology only on DH Tech.