On Wednesday, Google is rolling out a new update that allows users to search for things on the screen via simple gestures when browsing within the Google Chrome or Google Search app on iOS. This feature is similar to Android's built-in “Circle to Search” feature. This allows users to search for things on the screen using a variety of gestures.
At launch, iPhone users can also search for things on the screen by drawing, highlighting or tapping something through Google lenses.
For example, if you read an article and come across an image of an interesting artwork, you can quickly circle or tap the image using the lens to learn more. Or, if you watch a video and see your favorite item, you can use the lens to swivel it to find something similar.
The idea behind this feature is to allow users to quickly perform visual searches while browsing without taking screenshots or opening new tabs. It can be affected by long-term adoption of AI technology.
After highlighting or tapping something on your mobile device screen, you will see a visual match or other related results. You can then tap the Add to Search option to improve your color, brand, or other details. You can also ask follow-up questions to learn more about the topic.
To access new features in Chrome or Google Apps, you will need to open the 3-dot menu and select “Search screens using Google Lens.” In the coming months, Google says that features will be accessible via the new lens icon in the address bar.
The update continues to roll out this week and will be available worldwide on iOS.
Additionally, Google has announced that it is expanding its AI overview, which displays snapshots of information at the top of the results page.
Image credit: Google
In the past, Google has displayed AI overviews in lens searches that contain both images and text. With this latest update, users will start to see an AI overview without adding text or questions to their search.
For example, if you come across an interesting car, you can take a photo and then get an overview of AI, learn more about what you're looking for, and get links to useful resources on the web.
The update is rolling out this week for English users in countries where an AI overview begins with the Google app for Android and iOS is available.
The update will soon be rolling out to Chrome on desktop and mobile devices, the company said.