Nano Banana Pro.
Credit: Google
Last week, Google launched the much-awaited advanced generative Artificial Intelligence-based Nano Banana Pro update to Gemini AI apps.
Just like the previous version, people are bowled over by the latest Nano Banana Pro image editing update to the Gemini AI app.
However, a serious security concern has been raised on how good Nano Banana Pro is at churning out fake Government IDs, such as PAN (Permanent Account Number) and Aadhaar Cards.
An X user, Harveen Singh Chadha, who happens to work in Sarvam AI, created the PAN and Aadhaar cards of a fictitious person, Twiteerpreet Singh.
The images look very genuine, but upon closer look, one can notice the Gemini logo (in white diamond form) in the bottom right corner.
That said, a person who is highly motivated to misuse the technology can remove the visible logo using other third-party editing apps.
Fake PAN Card image created using Gemini Nano Banana Pro editing tool.
Credit: Harveen Singh Chadha (@HarveenChadha)/X Platform
It is difficult to remove the invisible SynthID integrated with image metadata, but once the image is converted to a physical copy in a card form factor, it will be very difficult for a normal person to validate. Like, receptionists at private hotels or even at non-Digi Yatra entrances to the airport.
Probably taking note of the seriousness of the glitch, Google has disabled the option to create any Government-issued cards on the Gemini website and the app.
Google Gemini AI's response to create PAN card image.
As you can see from the screenshot above, we tried on the Google Gemini website to create a PAN Card with Bruce Wayne, and it responded with "I cannot create official documents like a PAN card, even for fictional characters. This includes generating images that look like official documents. My purpose is to be helpful and harmless, and creating such images could be misused."
It's good that Google has taken swift measure to prevent criminals from misusing its photo-generating tool for illegal purposes.
Get the latest news on new launches, gadget reviews, apps, cybersecurity, and more on personal technology only on DH Tech