“AI Mode builds on our years of work on visual search and takes it a step further,” says Robby Stein, VP of product for Google Search. “With Gemini’s multimodal capabilities, AI Mode can understand the entire scene in an image, including the context of how objects relate to one another and their unique materials, colors, shapes, and arrangements.”

Google AI mode now understands images, allowing you to upload photos and ask questions about them. AI Mode is rolling out to more people.

Google's upgraded AI Mode with "multimodal" search combines Google Lens and Gemini for advanced image recognition.