How to use visual intelligence, which is what Apple is introducing to Google Lens

the iOS 18.2 was recently released It finally brings many of the promised Apple Intelligence features, e.g Jinmoji and Photo playground. One such tool is the long awaited one Visual intelligencea feature currently reserved for the iPhone 16 Pro and Pro Max that was first introduced in September event for the company.

What is visual intelligence?

Visual Intelligence is Apple’s answer to Google Lens. It enhances the camera system and artificial intelligence Real-time image analysis And provide useful information. This can help people learn more about the world around them and is especially useful for shopping, looking up details about a restaurant or business, translating written text, summarizing text, or reading something out loud. It can also integrate with Google Image Search and ChatGPT.

Are there any caveats?

There are two warnings. The rollout of Apple Intelligence has been a convoluted mess, and that trend continues with Visual Intelligence. Right now, the tools only work with the iPhone 16 Pro and Pro Max, which are The company’s largest modern phones. Apple has indicated that the feature may eventually become available for older models. After all, Google Lens It has been around since 2017That’s when the Pixel 2 was the hottest phone of the bunch.

There’s also a waiting list, and this applies to all Apple Intelligence features. To join the list, head to Settings and search for “Apple Intelligence & Siri.” Then click “Join Waitlist.” Once approved, the software will be ready for use.

How to use visual intelligence

As of this writing, the only way to turn on Visual Intelligence is to long-press the camera control button. This is the new control interface on the bottom right side of the phone. Once you click on it, the Visual Intelligence interface will open.

Now the fun begins. Simply point your phone at an object and select ChatGPT via the bottom left icon, or Google Image Search via the bottom right icon. Alternatively, if the visible field includes text, tap the circle at the bottom of the screen. The phone can also be directed to a company for useful information.

How to interact with text

Slide the phone in front of the text, activate Visual Intelligence, then tap the circle at the bottom of the screen. This will analyze the text. Once you analyze it, there are a few options. Tap “Translate” at the bottom of the screen to translate text into another language. Tap Read Aloud if you want the text to be read aloud by Siri. Click “Summarize” for a quick summary of the transcript.

The tool will also identify contact information in the text, such as phone numbers, email addresses, and websites. Users can take actions based on text type. For example, tap the phone number to call. Other actions include starting an email, creating a calendar event, or going to a website. Press the “More” button to see all available options. Tap Close or swipe up to end the session.

How to handle business

Visual intelligence can provide details about the business right in front of you. Simply open the tool and point your camera in front of the signs. The business name should appear at the top of the screen. Click “Schedule” to see operating hours or click “Order” to purchase something. View the menu or available services by clicking on “Menu” and make a reservation by touching “Book”. To contact the company, read reviews, or view the website, click More.

Swipe up or tap Close to end the session. This feature is currently only available to US customers.

What to do with ChatGPT

Start by pointing the camera at an object. Activate Visual Intelligence and tap the ChatGPT icon at the bottom left side of the screen. Press the “Ask” button to get information about the object. We used it on a bottle of hand cream, which was correctly identified. Next, a text field for follow-up questions will appear. Users can ask whatever they want, but results may vary. We asked ChatGPT where to buy hand cream and its price. He performed admirably in this task. Yay shopping.

Press the Close button or swipe up to remove all fields, which will also turn off Visual Intelligence.

What to do with Google Image Search

Choosing Google Image Search will bring up a Safari dialog box containing similar images pulled from the web. A good use case here is finding deals. We took a photo of a bottle of hand cream and the Safari results had a lot of different price points to choose from. However, users must find the best deal and complete the purchase themselves.

Press the Close button to remove these results and then swipe up from the bottom of the screen to turn off the tool.