Apple has announced the long-rumored headset, which will be called Vision Pro. That suggests that one day in the not-so-distant future we will see a cheaper Vision headset, rumored to arrive in 2025.
Apple isn’t calling Vision Pro a VR headset. Rather it’s referring to the headset as its “first spatial computer” with a big emphasis on how a user will be able to stay present in the physical world while wearing it. Apple CEO Tim Cook spoke about how the Vision Pro ushers in “the beginning of a new era for computing.” Here’s everything we know about the Vision Pro headset so far.
Want to know what it’s like to wear a Vision Pro? Macworld’s Roman Loyola has and he describes the experience here: I entered Apple’s thrilling Vision Pro world and didn’t want to leave! We also discuss his experiences with the Vision Pro below.
Updated on June 12 with details of what it is like to use the Vision Pro.
Apple Vision Pro: Release date
Apple has said that the Vision Pro headset will be available “early next year” so a spring 2024 release date looks likely. The headset will initially only be available in the U.S., with other countries having to wait until “later next year”. There will likely be a dedicated event to launch the headset, much like the Apple Watch event in 2015.
Apple Vision Pro: Price
Apple has confirmed that the Vision Pro will start at $3,499, Apple hasn’t confirmed the price outside the U.S. yet. There will be an additional cost associated with any prescription lenses that are required, but we don’t yet know what that will be. We also don’t know whether there will be additional options.
Apple
Apple Vision Pro: Design
Apple has picked the materials that the Apple Vision Pro is made from to make it as “wearable” as possible. A custom aluminum alloy frame curves around the user’s face and a modular design means it can be “perfectly” tailored to fit the each user.
The Light Seal is made of a soft textile that comes in a variety of sizes and shapes to suit the user’s face for a precise fit. There are flexible straps that can be adjusted to fit the head and ensure that the Audio Pods are positioned near the ears. The cushioned Head Band is available in multiple sizes and can be changed for another size or style.
Apple Vision Pro: Prescription eyewear
Those who need glasses will be able to purchase custom optical inserts to correct their vision. These ZEISS Optical Inserts are sold separately and magnetically attach to the headset’s lenses. The additional lenses are not included in the price of the headset, so there is an additional cost associated with them.
When Macworld’s Roman Loyola tried out the Vision Pro at Apple’s hands on an optometrist measured his prescription and Apple fitted the headset with the appropriate lenses. He then removed his glasses when he put the headset on. He said he was able to see, but thought that maybe the prescription wasn’t exact, because he noticed fuzziness with text.
Apple confirmed to Loyola that when you order Vision Pro you will have to submit a prescription from your optometrist. It’s unclear as to how that will work when buying at an Apple Store. Possibly a customer will have to submit a prescription at the retail store.
Apple Vision Pro: Specs and features
The Vision Pro will, according to Apple, “deliver phenomenal compute performance.” It is powered by both an M2 processor and a new R1 chip used to process input from 12 cameras, five sensors, and six microphones, it also eliminates lag to avoid latency. Apple says it can update images at eight times faster than the blink of an eye. The headset “runs virtually silent”, according to Apple.
There are two ultra-high-resolution displays that combine to produce 23 million pixels and create a 4K display for each that could generate a display that appears to be 100 feet wide. Video can be rendered at 4K resolution and text appears sharp from any angle.
There are two individually amplified drivers inside each audio pod that can deliver Personalized Spatial Audio based on the user’s own head and ear geometry. As a result, the sound feels like it is coming from the space around you. Vision Pro also matches the sound to the room using audio raytracing. There’s also an advanced sensor array.
Inside the lenses, a high-performance eye-tracking system uses cameras and a ring of LEDs to project invisible light patterns on the user’s eyes. As a result, the Apple headset is able to tell what way the user is looking and use high-performance eye tracking to control the interface. There are no external accessories other than controllers for playing games.
The Vision Pro also recognizes the user’s iris via a new method to unlock the device and authenticate passwords and purchases called Optic ID. Like the iPhone and Mac, all data is stored on a dedicated Secure Enclave processor.
There’s also a nifty feature called EyeSight that projects the correct perspective of your eyes to the people looking at you. EyeSight also includes a visual indicator that makes it clear to others when a user is capturing a spatial photo or video.
Apple Vision Pro: Battery life
Apple says the Vision Pro’s external battery pack provides up to two hours of use. It can also used while plugged in.
Apple
Apple Vision Pro: Software and apps
With a Vision Pro headset users will be able to watch a movie, listen to music, browse photos, look at 3D objects, and even collaborate on a presentation.
The Vision Pro headset will run visionOS, an operating system that Apple has designed from the ground up for visual computing. Developers will be able to use familiar tools to create apps for this platform, according to Apple.
There will be an App Store via which users will be able to download familiar iPhone and iPad apps as well as new apps designed for Vision Pro. Apple says that there will be lots of apps available at launch, including Microsoft Office Apps, third-party video conferencing apps, and Adobe Lightroom. Apple also previewed a SkyGuide app that can “transfer” you to space.
Apple says that Vision Pro “makes new types of games possible”. Apparently, users will be able to play over 100 Apple Arcade games on a screen as large as they want with support for popular game controllers.
There will also be a number of well-known Apple apps available at launch, such as Safari, Messages, and FaceTime. Here are some of the apps you can expect to see:
Video Conferencing
FaceTime will be available for the Vision Pro and will be able to take advantage of the room around you so that you can see everyone you are talking to in life-size tiles. The participant’s voice will also come from the direction of their tile thanks to Spatial Audio.
Apple has created a novel solution to the fact that you have a mask on and don’t have a camera in front of you. It can show call participants a ‘Persona’–a digital representation of the user created using Apple’s most advanced machine-learning techniques. The Persona is based on your appearance and can even reflect face and hand movements in real-time.
Apple
TV and movies
Entertainment was a major part of the WWDC presentation, with Apple showing off an immersive experience when watching movies and TV shows. With the new Cinema Environment, you’ll be able to watch shows and movies “at the frame rate and aspect ratio the filmmaker intended with immersive Spatial Audio” and watch movies on what feels like a 100-feet screen. Vision Pro will also support 3D movies including Avatar: Way of the Water.
Photos and videos
You’ll be able to take spatial photos and spatial videos in 3D with Vision Pro, and then “relive those cherished moments like never before with immersive Spatial Audio.” And of course, you’ll be able to view your plain 2D photos and videos as well, for example, Panoramas shot on iPhone will expand and wraps around the user.
Disney+
Disney CEO Bob Iger joined Apple on stage to demonstrate his excitement about the new technology. In a video demo, he showed movies, TV shows, and sports on Vision Pro that brings entertainment to new levels, including special movie presentations, court-side views, and interactive experiences. Iger said Disney content will be available on day one.
Apple Vision Pro experience: What is is like to use Vision Pro
Macworld’s Roman Loyola was able to spend an hour wearing a Vision Pro, an experience he described as “emotional, immersive, and completely captivating.”
The device he tried on was an early beta, so it’s possible—likely even—that the hardware or software could change before next year
During the keynote presentation that introduced Vision Pro Apple said that the Vision Pro input system is controlled by a person’s eyes, hands, and voice. But the real control happens with your eyes: Vision Pro is able to detect exactly where you are looking. As a result, users can browse through apps by simply looking at them, tapping their fingers to select, flicking their wrist to scroll, or using voice to dictate. You can just look at a text input and begin dictating, for example.
Loyola confirmed that you don’t have to hold out your arms to gesture to control the interface, you navigate by looking at what you want to see, and then use hand gestures to perform actions. Loyola said he didn’t have too hard a time adjusting from a using fingers to tap icons to using his eyes and that “Eye tracking was accurate and didn’t feel like it put a strain on my eyes,” he reported. It took about 20 minutes for controlling the interface this way to feel natural, Loyola said.
When you first put on Vision Pro you see your surroundings. You can freely move apps to fill the space around you and they can expand into your space. Apple says you can control how immersed you are in Vision Pro with a twist of the Digital Crown.
Loyola described being put right in the middle of the recorded memory that “triggered memories and emotions of my own from similar moments.” He said that the immersive video gave him “thrills,” explaining: “My body reacted to situations and my mind responded to the sights and sounds.” In one demo, Loyola “got to pet a freakin’ dinosaur. Not a beast that looks like a 3D model set against an illustrated background, but a realistic-looking dinosaur that sniffed my hand and let me pet it.” It all sounds pretty impressive.
According to Loyola, you do see the headset while wearing it, though it doesn’t interfere with the sense of immersion.
While there are other headsets that can offer an immersive experience, Loyola notes that “the difference with the Apple Vision Pro is the two displays set in front of each eye. The resolution and color they display are fantastic and make things look realistic.” While Loyola did experience some pixelation and playback stutter (of the people in the room with him not of the videos) he was impressed.
If you are concerned that the Vision Pro might not fit you, fear not. Loyola, who feels that his head is large, said that “when I first put the Apple Vision Pro on, I had to tighten–not loosen–the straps to get a proper fit”. He added: “The headset had a Velcro strap that goes across the top of your head–this strap is not shown in Apple’s product photos or videos. I think that after the measurements were taken of my head, Apple determined that I would benefit from this top strap”. There is also a Light Seal that fits across the forehead where the eyebrows are, Apple said that this seal is available in multitudes of shapes and sizes to ensure the perfect fit.
After wearing the Vision Pro for an hour Loyola said that he didn’t have any fatigue in his neck or any tenderness where the headset and straps hugged his head. There were some reports of testers suffering from soreness around the top of their head, but it’s very possible they were also dealing with sunburn since Apple’s keynote had been delivered outside in bright sunlight.
Apple described one design goal of Vision Pro as being to be “Never isolated from the people around you”. It achieves this in various ways, one is by displaying your eyes when there is someone near you. This is called EyeSight and it is designed to send a clear signal to people that you can’t see them when that is the case. Similarly, if someone is near by they will appear in your view. This way it should still be easy to interact with the world around you while wearing the headset.
A user can bring Mac wirelessly into Apple Vision Pro just by looking at it. The contents of the Mac screen are then brought on to the 4K display you see through the Vision Pro. Loyola wasn’t able to test this feature.
An advanced Spatial Audio system is core to the Apple Vision Pro experience, creating the feeling that sounds are coming from the environment around the user and matching the sound to the space, according to Apple. The Vision Pro will also work seamlessly with familiar Bluetooth accessories, according to Apple.
Apple Vision Pro: Terminology
- VR = Virtual Reality (completely replaces your view)
- AR = Augmented Reality (overlays real world with graphics and information)
- MR = Mixed Reality (combining AR and VR)
- XR = Extended Reality (combining AR, VR and MR)
Apple
Apple Vision Pro: Problems and prohibitions
If you have any of the following conditions you may not be able to use an Apple headset.
Those are all standard limitations for VR headsets, but nonetheless it illustrates the fact that this headset won’t be for everyone.
