Google AI Image Search: Ask Complex Questions
Google Enhances AI Mode with Multimodal Search Capabilities
Google is extending the functionality of its AI Mode, a Google Search experiment, to incorporate multimodal search. This advancement allows users to pose intricate, multi-faceted questions and pursue follow-up inquiries for in-depth exploration of subjects.
Individuals with access to AI Mode can now utilize the feature to query about images they have uploaded or captured directly through their device's camera.
Leveraging Google Lens for Image Analysis
The newly integrated image analysis within AI Mode is driven by the multimodal capabilities of Google Lens, as detailed in a recent blog post by Google.
AI Mode possesses the ability to comprehensively interpret the entirety of a scene depicted in an image. This includes understanding the relationships between objects, as well as their constituent materials, colors, shapes, and spatial arrangement.
Employing a method known as “query fan-out,” AI Mode formulates multiple questions pertaining to both the image itself and the elements it contains. This process yields more detailed information compared to conventional Google searches.
Practical Applications of the New Feature
Consider, for instance, taking a photograph of a bookshelf. A user could then input the query: “If I enjoyed these, what are some similar books that are highly rated?”
AI Mode will identify each book present in the image and subsequently generate a curated list of recommended titles, complete with links for further information and potential purchase.
The system also supports follow-up questions to refine the search. For example, a user might ask, “I’m looking for a quick read. Which one of these recommendations is the shortest?”
Expanded Availability of AI Mode
Google announced on Monday that AI Mode is now being rolled out to millions of additional users who are participants in Labs, Google’s platform for experimental features and products.
Previously, access to AI Mode was restricted to subscribers of Google One AI Premium.
Competition and Future Development
Launched last month, AI Mode aims to compete with popular services such as Perplexity and OpenAI’s ChatGPT Search.
Google has stated its commitment to ongoing refinement of the user experience and expansion of the feature’s functionality.
