06.22.2023
The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Lookup feature on the iPhone and the
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.
Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in visionOS. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.
Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The Apple Vision Pro headset will be able to automatically detect text and documents, similar to how the iPhone can detect text in photos and allow it to be interacted with.
The Visual Search function was found in visionOS by Steve Moser. visionOS can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.
Related Roundups: Apple Vision Pro, visionOS
Related Forum: Apple Vision Pro
This article, "Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More" first appeared on MacRumors.com
Discuss this article in our forums
You may also be interested in this
Mira made AR headsets for…
06.06.2023
Apple has acquired Mira, a company that creates augmented reality headsets for other companies — including the US military.Apple Vision ProA day after it announced Apple Vision Pro, the Cupertino-based
Apple trademarks “xrOS” l…
05.16.2023
Macworld With less than a month to go until Apple’s WWDC keynote presentation and the expected launch of its mixed-reality headset, the company may have accidentally confirmed the name of
iOS 18.2 Includes Revampe…
10.23.2024
With the iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2 betas that came out today, Apple introduced an updated version of the Mail app with built-in categorization. Mail Categories organize
Apple’s Reality Pro heads…
05.19.2023
Macworld If there’s one persistent rumor about Apple’s upcoming AR headset, it’s the price tag. Ever since we started hearing about it, reports have pegged the MSRP at $3,000 or
How to watch Hijack on Ap…
06.28.2023
Idris Elba stars in the new seven-part thriller ‘Hijack’, streaming now on Apple TV+. The limited series features Idris Elba’s character Sam Nelson respond to an airplane hijacking. Similar to
How to get Apple TV &…
01.09.2023
You should bring creature comforts if you're stuck in a hotel for a long period of time. Here's how to get going with an Apple TV, HomePod, or both while
Vision Pro: I just tried …
06.06.2023
At WWDC 2023, Apple officially unveiled its new Vision Pro headset, which it describes as a “revolutionary spatial computer.” I was in the crowd at today’s keynote when it was
Foldable magnetic iPad mo…
05.30.2023
Aside from requiring a little muscle to move the stiff thing around, this magnetic mount for iPad is super-useful. (via Cult of Mac - Tech and culture through an Apple
