Microsoft unveils Copilot Vision, Gemini Live-like feature for Windows PC

Microsoft has begun rolling out the new generative Artificial Intelligence (gen AI) ChatGPT-powered Copilot Vision with the highlights feature for Windows PCs.

It is similar to Google's interactive Gemini Live AI chatbot. The Copilot Vision can see what the user is viewing on the PC screen and intuitively offer suggestions or retrieve any particular information related to the query. Users can converse with the Copilot Vision just like people talk to each other.

For instance, if the user is working on PPT and is confused as to which cover photo to choose from multiple templates. The user can turn on the Copilot Vision to help finalise the picture. It can view and ask follow-up questions, such as what is the topic of the presentation and based on that, it can recommend an appropriate photo.

It can also help with identifying a location in a photo. For instance, you may receive a picture of an exotic place from a friend, and the latter wants you to guess it. If you can't find an answer, you can just ask Copilot Vision to help identify the place.

It can also help with finding the right clothes on an e-commerce website. You can interact with it and zero in on the correct outfit under your budget.

In some scenarios, Copilot Vision may not work if it senses there is a violation of terms and services.

For instance, if the Copilot Vision comes across websites containing harmful or adult content, it will not assist the user in getting more information. The Copilot Composer at the bottom of the screen will show a greyed-out icon and crossed eyeglasses, and the model will refuse to discuss the content of the page.

For now, the Copilot Vision is available only in the United States. Microsoft has plans to expand the availability of the new-gen AI to more regions in the coming months.

Get the latest news on new launches, gadget reviews, apps, cybersecurity, and more on personal technology only on DH Tech