The recently launched AI Mode feature from Google is gaining multimodal capabilities and can now answer complex questions about images.
Google launched the AI mode in limited preview last month. Now Google is making some improvements to its AI Mode, such as multimodal search. This means users can now also ask questions about images. Google is reportedly making AI Mode available to more users who are enrolled in Labs. Initially, the preview was only available to Google One AI Premium subscribers.
Understanding images
Google is making improvements to its recently launched AI Mode, which gives a new twist to the search experience in Google Search. Now this AI mode would be able to answer complex questions about images. These multimodal capabilities are supported by the combination of Google Lens and a customized version of Gemini.
read also
Google Search gets new AI injection with AI Mode
Additionally, Google uses the ‘query fan-out’ technique. “Using our query fan-out technique, the AI mode then executes multiple queries about the image as a whole and the objects in the image, gaining access to more breadth and depth of information than a traditional Google search,” Google stated in a blog post.
In the above example, Google shows how the AI mode analyzes a photo with books and provides more information about the books on the shelf. AI Mode offers a list of recommended books with links for more information. Moreover, you can ask follow-up questions to refine your searches.
Initially, AI Mode was only available in limited preview for users with Google One Premium, through the Lab section of Google Search. Now, multiple users who are enrolled in Labs should have access.