One connected lock does not a smart home make. If you want to get serious with home automation, start with a smart home platform.

When you first get started with home automation, you’ll quickly find that your smart gadgets do even more when they work together. Yes, it’s great that your smart lights can turn on automatically at sunset and your smart lock will lock itself, but what’s even better is saying “Good night” to a voice assistant and having the shades lower, the lights turn off, the door locks lock, and the alarm system arm. For this, you need a smart home platform.

As a smart home reviewer, I am often asked which is the best platform to use. Is it Apple Home, Google Home, Amazon Alexa, Samsung SmartThings, or something else? I tend to tread carefully when making a recommendation. Picking a smart home platform is a commitment. This is something you’re bringing into your home and will live with every day. I know from experience that it will make you both very happy and also drive you up the wall.

So, similar to how a therapist might guide you to the right decision, I’ll help you choose the smart home platform for you by providing the tools you need to make that decision. I’ll go over exactly what a smart home platform is, whether you need a hub, and give you my top tips for how to pick the best smart home platform for you.

What is a smart home platform, and do I need one?

Photo by Jennifer Pattison Tuohy / The Verge

A smart home platform is a software framework that controls and manages multiple devices from multiple manufacturers, usually through a smartphone or tablet app. Most smart home platforms have a hardware component, such as a hub and / or a smart speaker / display (more on hubs in a bit). Of course, if you have a smartphone, you already have a smart home platform in your hand, although you’ll want to add a hub or smart speaker for the fun stuff.

A smart speaker adds hands-free voice control to your smart home, and the voice assistant you choose will likely dictate the platform you use. A smart display also adds touch controls for smart home devices.

The main advantage of a smart home platform is organization. It allows you to put all your connected devices in one app where you can organize them by groups. This makes controlling things much easier. For example, grouping all the lights in the kitchen into a “Kitchen” group means you can hit a smart button or say, “Turn on the kitchen lights” and have all the lights turn on.

A smart home platform is also essential for creating automations (also known as scenes and routines) that make your home “smart.” These can run devices automatically based on certain triggers, such as time of day, when an action happens (motion in a hallway, a door locking), or a command to a voice assistant. Automations can do one task or many. For example, at 9PM every night, lock the back door; or, when the front door unlocks between 5PM and 8PM, have the smart speaker play a playlist, turn the lights to full brightness, and adjust the thermostat.

You don’t need a platform to use smart home devices. If you have a couple of smart gadgets that largely look after themselves, such as a smart thermostat and a smart door lock, and you don’t mind using a couple of different apps, then don’t sweat it. But if you want to manage all your devices with one app, control them in groups using your voice, and maybe connect them all together into smart home automations, then picking a platform is pretty important.

Many devices can work across multiple ecosystems — for example, Nest security cameras work with Alexa smart displays, Ring doorbells work with Samsung smart fridges, and Ecobee thermostats work with every platform. But cross-platform compatibility is still complicated. Despite the new smart home standard Matter that’s designed to fix this (more on this later), we’re sadly still a long way from the point where you can buy any smart device and plug it in, and it will just work with your smart home.

To avoid frustration, my advice is to pick one platform and stick with devices that work with it. I would also consider buying Matter devices when available, which work with all the major platforms. This means if Matter does succeed in making interoperability a nonissue, migrating to another platform will also be easier.

Four things to consider when picking a smart home platform

Photo by Jennifer Pattison Tuohy / The Verge

For most people, one of the four mainstream DIY smart home platforms — Amazon Alexa, Apple Home, Google Home, or Samsung SmartThings — is the best place to start. There are other options — the open-source Home Assistant, professionally installed solutions like Crestron, Savant, and Vivint, and smaller DIY platforms like Hubitat and Homey. But these are largely specialized, and unless you know one of these will fit your needs, I’d recommend starting with one of the generally less expensive, more mainstream options.

To help choose which one will work for you, ask yourself these questions:

Which smartphone do you use?

Your smartphone comes with a smart home platform built in. If you use an iPhone, then Apple Home is an excellent option. Samsung Galaxy users will find SmartThings integrates really well with their devices — the same with Google Pixel and the Google Home platform. While Amazon doesn’t have a phone (its Alexa app works on iOS and Android), if your family uses Amazon’s Fire tablets or already has an Echo Dot, Alexa will fit in well. But keep in mind that while you can easily use Alexa, SmartThings, or Google Home with an iPhone, you can’t use Apple Home with Android.

In short, the more personal computing devices you already have in an ecosystem — smartwatches, tablets, laptops, plus media devices like speakers or streaming sticks — the better that dedicated ecosystem will work for you. If you’re in a household with multiple different smartphone ecosystems, you’ll need a platform or platforms that works with everyone’s devices.

Which devices do you already own?

The next thing to consider is which smart devices you already own. All of the major players have key pieces of hardware that allow their platforms to do more in your home. If you have a smart speaker or streaming device from Apple, Amazon, or Google, you’ve got a good foundation for building your smart home on that platform. These add voice control and can act as a hub for controlling your devices when you’re away from home.

If you already have a smart device like an Amazon smart thermostat or Google Nest video doorbell, you should consider that platform first. Similarly, if you already have some smart lights, a smart lock, or maybe a smart security system, check to see which platforms your existing devices are compatible with before picking your platform. However, remember that many smart devices work across multiple ecosystems, so you aren’t necessarily stuck with the one you started with.

Which is your favorite voice assistant?

Do you love Alexa’s fart jokes? Are you a Google search addict? Do you like your voice assistant to be pretty but not so smart (*cough* Apple)? The three main voice assistants are Amazon’s Alexa, Apple’s Siri, and Google Assistant (sorry, Bixby!), each of which has a distinct “personality.” The one you get along with best will be key to picking the platform you want to use. (Samsung SmartThings works with both Alexa and Google Assistant),

All three work well for smart home management, letting you control connected devices with your voice. “Hey Siri, turn on the lights.” “Hey Google, turn on the TV.” “Alexa, lock the door.” All can be used with a smartphone or tablet, but for smart home control, they work better with a smart speaker or display so that anyone in your house can summon them.

Smart speakers and their screen-toting siblings also have more functions. They can work as home intercoms, listen for things happening in your home when you’re away (such as smoke alarms or glass breaking), and function as a chime for a video doorbell. With a screen, they can also show livestreams from a security camera: “Hey Google, show me who is at the front door.”

Which features do you want?

Along with automating your gadgets, a smart home platform can add new abilities to them. Deciding what you want your smart home to do for you will help you choose which platform will fit your needs. We have deep dives into each platform coming this week, but here are some examples of features each platform does well:

• Apple Home’s HomeKit Secure Video platform provides a secure way to use connected cameras in your home, with all the processing done locally on an Apple TV or HomePod before being securely stored in your iCloud account.
• Samsung’s SmartThings Energy is an energy management system that monitors your home’s energy use (through compatible devices — largely Samsung appliances for now) and provides proactive tips to help you save energy.
• Amazon’s Alexa Hunches feature uses AI to learn your routines and suggest helpful actions — such as reminding you if you’ve left your door unlocked at night.
• Google Home’s presence-sensing feature can automatically adjust your home based on whether there is anyone in it.

What’s a smart home hub, and do you need one?

Photo by Chris Welch / The Verge

You don’t need a smart home hub to run a smart home, but it can do more with one. A smart home hub is the brains of your smart home platform, managing and controlling your devices in your home. While the smart home app on your phone largely does the same thing, when you leave the house with your phone, your smart home has to rely on the cloud to operate. With a hub in your home, everything on the platform can still run automatically and, in some cases, run locally on your home network. This means your lights will still turn on even if the internet is down.

The traditional smart home hub has been a small plastic box packed with home automation radios that you plug into your router and which acts as a translator for devices that use different smart home protocols, such as Z-Wave, Zigbee, Bluetooth LE, Thread, and Wi-Fi. But the concept of a hub has changed in the last few years, and that type of multi-radio hub is more suited for advanced setups, particularly if you want to use Z-Wave devices. Some options include Hubitat, Homey, and the Aeotec Smart Home Hub.

Today, hubs have become more general-purpose, and all four platforms have variations on the concept. The Apple TV and HomePods are Apple Home Hubs, Samsung SmartThings has hubs built into its TVs and other devices, and Google’s Nest Hubs are smart displays that support Thread. Amazon Alexa’s Echo (fourth-gen) speaker and Echo Show 10 (second-gen) smart display are smart home hubs because they support Zigbee, unlike the company’s other smart speakers and displays. If you use any of these platforms, having one of these hubs will expand the functionality of your smart home.

It’s worth quickly mentioning bridges here, which are sometimes called hubs, just to confuse things further. Generally, a bridge controls one protocol and is manufacturer-specific — such as Philips Hue’s bridge which controls its Zigbee-based smart lighting system, or Aqara hubs which control its smart home devices. Bridges can connect to smart home hubs to add their devices to that platform.

All the major platforms have added Matter controller functionality to their existing hubs, meaning you may already have one in your home. Matter controllers do the same thing as a smart home hub — they connect devices (specifically, Matter devices) to each other and to the internet and allow you to control them through a smart home platform. A key benefit of Matter is that it works locally in your home over Wi-Fi and Thread protocols.

Matter is not a smart home platform, nor is it technically a protocol. Rather, it’s a new communication standard designed to make it easier for smart home devices to work together and with every platform. You can use Matter devices with Apple Home, Google Home, Amazon Alexa, Samsung SmartThings, Home Assistant, and others. This is designed to make it easier to buy connected devices because if something works with Matter, it should work with all of the major smart home platforms.

The smart home can be a daunting prospect, and a smart home platform makes it easier to get started with connected devices and to get the most out of them. Whether you choose Apple Home, Google Home, SmartThings, Amazon Alexa, or another option, picking a platform can take your home from automated to smart.

]]> https://www.latest-apple-news.com/2023/06/12/how-to-pick-a-smart-home-platform/ Mon, 12 Jun 2023 12:30:00 +0000 https://www.theverge.com/23751295/smart-home-platform-google-amazon-apple-samsung

One connected lock does not a smart home make. If you want to get serious with home automation, start with a smart home platform.

When you first get started with home automation, you’ll quickly find that your smart gadgets do even more when they work together. Yes, it’s great that your smart lights can turn on automatically at sunset and your smart lock will lock itself, but what’s even better is saying “Good night” to a voice assistant and having the shades lower, the lights turn off, the door locks lock, and the alarm system arm. For this, you need a smart home platform.

As a smart home reviewer, I am often asked which is the best platform to use. Is it Apple Home, Google Home, Amazon Alexa, Samsung SmartThings, or something else? I tend to tread carefully when making a recommendation. Picking a smart home platform is a commitment. This is something you’re bringing into your home and will live with every day. I know from experience that it will make you both very happy and also drive you up the wall.

So, similar to how a therapist might guide you to the right decision, I’ll help you choose the smart home platform for you by providing the tools you need to make that decision. I’ll go over exactly what a smart home platform is, whether you need a hub, and give you my top tips for how to pick the best smart home platform for you.

What is a smart home platform, and do I need one?

Photo by Jennifer Pattison Tuohy / The Verge

A smart home platform is a software framework that controls and manages multiple devices from multiple manufacturers, usually through a smartphone or tablet app. Most smart home platforms have a hardware component, such as a hub and / or a smart speaker / display (more on hubs in a bit). Of course, if you have a smartphone, you already have a smart home platform in your hand, although you’ll want to add a hub or smart speaker for the fun stuff.

A smart speaker adds hands-free voice control to your smart home, and the voice assistant you choose will likely dictate the platform you use. A smart display also adds touch controls for smart home devices.

The main advantage of a smart home platform is organization. It allows you to put all your connected devices in one app where you can organize them by groups. This makes controlling things much easier. For example, grouping all the lights in the kitchen into a “Kitchen” group means you can hit a smart button or say, “Turn on the kitchen lights” and have all the lights turn on.

A smart home platform is also essential for creating automations (also known as scenes and routines) that make your home “smart.” These can run devices automatically based on certain triggers, such as time of day, when an action happens (motion in a hallway, a door locking), or a command to a voice assistant. Automations can do one task or many. For example, at 9PM every night, lock the back door; or, when the front door unlocks between 5PM and 8PM, have the smart speaker play a playlist, turn the lights to full brightness, and adjust the thermostat.

You don’t need a platform to use smart home devices. If you have a couple of smart gadgets that largely look after themselves, such as a smart thermostat and a smart door lock, and you don’t mind using a couple of different apps, then don’t sweat it. But if you want to manage all your devices with one app, control them in groups using your voice, and maybe connect them all together into smart home automations, then picking a platform is pretty important.

Many devices can work across multiple ecosystems — for example, Nest security cameras work with Alexa smart displays, Ring doorbells work with Samsung smart fridges, and Ecobee thermostats work with every platform. But cross-platform compatibility is still complicated. Despite the new smart home standard Matter that’s designed to fix this (more on this later), we’re sadly still a long way from the point where you can buy any smart device and plug it in, and it will just work with your smart home.

To avoid frustration, my advice is to pick one platform and stick with devices that work with it. I would also consider buying Matter devices when available, which work with all the major platforms. This means if Matter does succeed in making interoperability a nonissue, migrating to another platform will also be easier.

Four things to consider when picking a smart home platform

Photo by Jennifer Pattison Tuohy / The Verge

For most people, one of the four mainstream DIY smart home platforms — Amazon Alexa, Apple Home, Google Home, or Samsung SmartThings — is the best place to start. There are other options — the open-source Home Assistant, professionally installed solutions like Crestron, Savant, and Vivint, and smaller DIY platforms like Hubitat and Homey. But these are largely specialized, and unless you know one of these will fit your needs, I’d recommend starting with one of the generally less expensive, more mainstream options.

To help choose which one will work for you, ask yourself these questions:

Which smartphone do you use?

Your smartphone comes with a smart home platform built in. If you use an iPhone, then Apple Home is an excellent option. Samsung Galaxy users will find SmartThings integrates really well with their devices — the same with Google Pixel and the Google Home platform. While Amazon doesn’t have a phone (its Alexa app works on iOS and Android), if your family uses Amazon’s Fire tablets or already has an Echo Dot, Alexa will fit in well. But keep in mind that while you can easily use Alexa, SmartThings, or Google Home with an iPhone, you can’t use Apple Home with Android.

In short, the more personal computing devices you already have in an ecosystem — smartwatches, tablets, laptops, plus media devices like speakers or streaming sticks — the better that dedicated ecosystem will work for you. If you’re in a household with multiple different smartphone ecosystems, you’ll need a platform or platforms that works with everyone’s devices.

Which devices do you already own?

The next thing to consider is which smart devices you already own. All of the major players have key pieces of hardware that allow their platforms to do more in your home. If you have a smart speaker or streaming device from Apple, Amazon, or Google, you’ve got a good foundation for building your smart home on that platform. These add voice control and can act as a hub for controlling your devices when you’re away from home.

If you already have a smart device like an Amazon smart thermostat or Google Nest video doorbell, you should consider that platform first. Similarly, if you already have some smart lights, a smart lock, or maybe a smart security system, check to see which platforms your existing devices are compatible with before picking your platform. However, remember that many smart devices work across multiple ecosystems, so you aren’t necessarily stuck with the one you started with.

Which is your favorite voice assistant?

Do you love Alexa’s fart jokes? Are you a Google search addict? Do you like your voice assistant to be pretty but not so smart (*cough* Apple)? The three main voice assistants are Amazon’s Alexa, Apple’s Siri, and Google Assistant (sorry, Bixby!), each of which has a distinct “personality.” The one you get along with best will be key to picking the platform you want to use. (Samsung SmartThings works with both Alexa and Google Assistant),

All three work well for smart home management, letting you control connected devices with your voice. “Hey Siri, turn on the lights.” “Hey Google, turn on the TV.” “Alexa, lock the door.” All can be used with a smartphone or tablet, but for smart home control, they work better with a smart speaker or display so that anyone in your house can summon them.

Smart speakers and their screen-toting siblings also have more functions. They can work as home intercoms, listen for things happening in your home when you’re away (such as smoke alarms or glass breaking), and function as a chime for a video doorbell. With a screen, they can also show livestreams from a security camera: “Hey Google, show me who is at the front door.”

Which features do you want?

Along with automating your gadgets, a smart home platform can add new abilities to them. Deciding what you want your smart home to do for you will help you choose which platform will fit your needs. We have deep dives into each platform coming this week, but here are some examples of features each platform does well:

• Apple Home’s HomeKit Secure Video platform provides a secure way to use connected cameras in your home, with all the processing done locally on an Apple TV or HomePod before being securely stored in your iCloud account.
• Samsung’s SmartThings Energy is an energy management system that monitors your home’s energy use (through compatible devices — largely Samsung appliances for now) and provides proactive tips to help you save energy.
• Amazon’s Alexa Hunches feature uses AI to learn your routines and suggest helpful actions — such as reminding you if you’ve left your door unlocked at night.
• Google Home’s presence-sensing feature can automatically adjust your home based on whether there is anyone in it.

What’s a smart home hub, and do you need one?

Photo by Chris Welch / The Verge

You don’t need a smart home hub to run a smart home, but it can do more with one. A smart home hub is the brains of your smart home platform, managing and controlling your devices in your home. While the smart home app on your phone largely does the same thing, when you leave the house with your phone, your smart home has to rely on the cloud to operate. With a hub in your home, everything on the platform can still run automatically and, in some cases, run locally on your home network. This means your lights will still turn on even if the internet is down.

The traditional smart home hub has been a small plastic box packed with home automation radios that you plug into your router and which acts as a translator for devices that use different smart home protocols, such as Z-Wave, Zigbee, Bluetooth LE, Thread, and Wi-Fi. But the concept of a hub has changed in the last few years, and that type of multi-radio hub is more suited for advanced setups, particularly if you want to use Z-Wave devices. Some options include Hubitat, Homey, and the Aeotec Smart Home Hub.

Today, hubs have become more general-purpose, and all four platforms have variations on the concept. The Apple TV and HomePods are Apple Home Hubs, Samsung SmartThings has hubs built into its TVs and other devices, and Google’s Nest Hubs are smart displays that support Thread. Amazon Alexa’s Echo (fourth-gen) speaker and Echo Show 10 (second-gen) smart display are smart home hubs because they support Zigbee, unlike the company’s other smart speakers and displays. If you use any of these platforms, having one of these hubs will expand the functionality of your smart home.

It’s worth quickly mentioning bridges here, which are sometimes called hubs, just to confuse things further. Generally, a bridge controls one protocol and is manufacturer-specific — such as Philips Hue’s bridge which controls its Zigbee-based smart lighting system, or Aqara hubs which control its smart home devices. Bridges can connect to smart home hubs to add their devices to that platform.

All the major platforms have added Matter controller functionality to their existing hubs, meaning you may already have one in your home. Matter controllers do the same thing as a smart home hub — they connect devices (specifically, Matter devices) to each other and to the internet and allow you to control them through a smart home platform. A key benefit of Matter is that it works locally in your home over Wi-Fi and Thread protocols.

Matter is not a smart home platform, nor is it technically a protocol. Rather, it’s a new communication standard designed to make it easier for smart home devices to work together and with every platform. You can use Matter devices with Apple Home, Google Home, Amazon Alexa, Samsung SmartThings, Home Assistant, and others. This is designed to make it easier to buy connected devices because if something works with Matter, it should work with all of the major smart home platforms.

The smart home can be a daunting prospect, and a smart home platform makes it easier to get started with connected devices and to get the most out of them. Whether you choose Apple Home, Google Home, SmartThings, Amazon Alexa, or another option, picking a platform can take your home from automated to smart.

]]> https://www.latest-apple-news.com/2023/06/10/the-vision-pros-biggest-advantage-isnt-apples-hardware/ Sat, 10 Jun 2023 13:00:00 +0000 https://www.theverge.com/2023/6/10/23755285/apple-vision-pro-developers-key-apps

Apple’s developers already have the tools they need to create apps for the system.

Apple used the Vision Pro’s $3,499 price tag to give the headset every advantage over the competition. It has dual 4K displays, runs one of the best laptop chips in the business, and comes with sophisticated eye- and hand-tracking technologies. But it also has one advantage money can’t buy: Apple’s developer ecosystem. Perhaps the headset’s single biggest advantage will be the ability for iPhone and iPad developers to easily plug their existing apps into the device’s operating system using familiar tools and frameworks.

Already, the system stands in stark contrast to headsets from Meta, Valve, PlayStation, and HTC, which mostly rely on apps and games made in Unity or OpenXR to power their virtual and augmented reality experiences. While some competitors, like the Meta Quest, have key apps like Microsoft Office, Xbox, and Netflix, offerings beyond this are limited. In the several years that Meta’s headset has been out, the Meta Quest Store has only released about 400 games and apps. That isn’t necessarily a bad thing, but it’s a sign that there’s a serious lack of content optimized for VR.

Unlike other headset ecosystems, though, Apple is promising hundreds of thousands of apps on day one, a feat it’s able to pull off thanks to work on other platforms. Apple will automatically convert iPad and iPhone apps to “a single scalable 2D window” that works on the Apple Vision Pro — with no work required from developers unless they want to make any changes. And for the developers who want to create something new for the headset, Apple is making it easy for those already acquainted with its ecosystem to create apps for visionOS, its new mixed reality operating system.

“visionOS is not so different than iPadOS with ARKit, the augmented reality kit that developers have had access to for a couple of years now,” Maximiliano Firtman, a longtime mobile and web developer, tells The Verge. “iOS and iPadOS developers will be able to use their classic UIKit apps, Unity apps, or their more recent SwiftUI apps for visionOS.”

The frameworks developers can use to build apps for iOS and iPadOS — SwiftUI, RealityKit, ARKit — have all been “extended for spatial computing,” Apple says, allowing developers to craft immersive AR and VR experiences for the Vision Pro. They can also build their apps with the tools already available to devs, including Xcode and Unity as well as Apple’s upcoming Reality Composer Pro that should let devs “preview and prepare 3D content” for visionOS apps.

Firtman adds that even though the visionOS software development kit isn’t out yet, web developers can still use “WebXR for immersive web apps and web experiences using Safari on visionOS… as most of the knowledge needed to create apps is already out there.”

This means that, in addition to Apple’s native apps, we’ll likely see a lot of iOS and iPadOS apps make their way to the Vision Pro at launch.

For developers making the jump, Apple is encouraging them to expand what their apps can do. A simple port might display an app on the Vision Pro as a “Window,” creating a floating version in mixed reality. Apps with 3D elements might present content as a “Volume” that adds depth that’s viewable from all angles. More immersive apps might build a “Space” that can take up a user’s entire view.

“Apple will want to feature apps that take advantage of the new Volume and Space app paradigms,” Steve Moser, an iOS developer and the editor-in-chief of The Tape Drive, tells The Verge. “I imagine developers will want to quickly recompile their existing iOS and iPadOS apps for visionOS so that they will be on the visionOS AppStore on day one and potentially get an opportunity to be featured by Apple.”

This is good news for Apple, which is looking to prime its App Store with services making its headset useful. But the approach falls short in one area where Apple’s competitors are strong: gaming. When the device comes out early next year, Apple says it will house over 100 games from its Arcade service, which is a nice perk, but most of these games aren’t built specifically for VR. That makes a pretty big difference, as users could just as easily whip out their iPhone or iPad to play an Arcade game, rather than put on an entire headset just to play Angry Birds Reloaded or Temple Run.

After all, people are buying the Valve Index or the Meta Quest 2 just so they can access libraries of VR-only games like Beat Saber and Half-Life: Alyx. A lack of serious VR titles risks putting the Vision Pro in the same position as the Mac — a device mainly for productivity, not a hub for gaming. While Apple is trying to coax game developers into putting their titles on macOS with a new porting tool, the fact is that most developers aren’t prioritizing Mac as a platform because the majority of gamers use Windows, and up until now, Apple didn’t exactly make it easy to bring over games from other OSes. (We’ll still have to see how well these newly ported games actually perform.)

Even though Apple’s headset might not immediately have some of the riveting experiences that come along with playing VR games like Arizona Sunshine and Blade and Sorcery, it’s not likely to make or break the headset’s success. “They seem to be nailing all of the points that Meta has been fumbling for [the] last few years, namely overall UX,” Blair Renaud, VR game developer and the director of IrisVR, tells The Verge. “They clearly aren’t focused on the current VR ecosystem and game developers like myself, but that may be the right move in the end. For the industry to move forward, we need all the things I mentioned, not just incremental hardware improvements.”

Apple’s slow, careful approach to VR is reflected within the device itself. Instead of presenting you with a somewhat jarring and unfamiliar UI that engulfs your reality, the Vision Pro surfaces a set of recognizable apps that exist atop your real-world environment thanks to video passthrough. Of course, there is the option to turn on full VR using the digital crown, but Apple mainly left this application for watching movies or replaying videos. You won’t have to worry about getting used to controllers, either, as you can navigate through the device using just your eyes and hands.

Based on first impressions of the Vision Pro, the technology is clearly there for it to succeed. But like most devices out there, the apps are what make it. Fortunately for Apple, it’s easier to build upon a foundation that’s already been established, rather than build one from scratch.

Apple’s developers already have the tools they need to create apps for the system.

Apple used the Vision Pro’s $3,499 price tag to give the headset every advantage over the competition. It has dual 4K displays, runs one of the best laptop chips in the business, and comes with sophisticated eye- and hand-tracking technologies. But it also has one advantage money can’t buy: Apple’s developer ecosystem. Perhaps the headset’s single biggest advantage will be the ability for iPhone and iPad developers to easily plug their existing apps into the device’s operating system using familiar tools and frameworks.

Already, the system stands in stark contrast to headsets from Meta, Valve, PlayStation, and HTC, which mostly rely on apps and games made in Unity or OpenXR to power their virtual and augmented reality experiences. While some competitors, like the Meta Quest, have key apps like Microsoft Office, Xbox, and Netflix, offerings beyond this are limited. In the several years that Meta’s headset has been out, the Meta Quest Store has only released about 400 games and apps. That isn’t necessarily a bad thing, but it’s a sign that there’s a serious lack of content optimized for VR.

Unlike other headset ecosystems, though, Apple is promising hundreds of thousands of apps on day one, a feat it’s able to pull off thanks to work on other platforms. Apple will automatically convert iPad and iPhone apps to “a single scalable 2D window” that works on the Apple Vision Pro — with no work required from developers unless they want to make any changes. And for the developers who want to create something new for the headset, Apple is making it easy for those already acquainted with its ecosystem to create apps for visionOS, its new mixed reality operating system.

“visionOS is not so different than iPadOS with ARKit, the augmented reality kit that developers have had access to for a couple of years now,” Maximiliano Firtman, a longtime mobile and web developer, tells The Verge. “iOS and iPadOS developers will be able to use their classic UIKit apps, Unity apps, or their more recent SwiftUI apps for visionOS.”

The frameworks developers can use to build apps for iOS and iPadOS — SwiftUI, RealityKit, ARKit — have all been “extended for spatial computing,” Apple says, allowing developers to craft immersive AR and VR experiences for the Vision Pro. They can also build their apps with the tools already available to devs, including Xcode and Unity as well as Apple’s upcoming Reality Composer Pro that should let devs “preview and prepare 3D content” for visionOS apps.

Firtman adds that even though the visionOS software development kit isn’t out yet, web developers can still use “WebXR for immersive web apps and web experiences using Safari on visionOS… as most of the knowledge needed to create apps is already out there.”

This means that, in addition to Apple’s native apps, we’ll likely see a lot of iOS and iPadOS apps make their way to the Vision Pro at launch.

For developers making the jump, Apple is encouraging them to expand what their apps can do. A simple port might display an app on the Vision Pro as a “Window,” creating a floating version in mixed reality. Apps with 3D elements might present content as a “Volume” that adds depth that’s viewable from all angles. More immersive apps might build a “Space” that can take up a user’s entire view.

“Apple will want to feature apps that take advantage of the new Volume and Space app paradigms,” Steve Moser, an iOS developer and the editor-in-chief of The Tape Drive, tells The Verge. “I imagine developers will want to quickly recompile their existing iOS and iPadOS apps for visionOS so that they will be on the visionOS AppStore on day one and potentially get an opportunity to be featured by Apple.”

This is good news for Apple, which is looking to prime its App Store with services making its headset useful. But the approach falls short in one area where Apple’s competitors are strong: gaming. When the device comes out early next year, Apple says it will house over 100 games from its Arcade service, which is a nice perk, but most of these games aren’t built specifically for VR. That makes a pretty big difference, as users could just as easily whip out their iPhone or iPad to play an Arcade game, rather than put on an entire headset just to play Angry Birds Reloaded or Temple Run.

After all, people are buying the Valve Index or the Meta Quest 2 just so they can access libraries of VR-only games like Beat Saber and Half-Life: Alyx. A lack of serious VR titles risks putting the Vision Pro in the same position as the Mac — a device mainly for productivity, not a hub for gaming. While Apple is trying to coax game developers into putting their titles on macOS with a new porting tool, the fact is that most developers aren’t prioritizing Mac as a platform because the majority of gamers use Windows, and up until now, Apple didn’t exactly make it easy to bring over games from other OSes. (We’ll still have to see how well these newly ported games actually perform.)

Even though Apple’s headset might not immediately have some of the riveting experiences that come along with playing VR games like Arizona Sunshine and Blade and Sorcery, it’s not likely to make or break the headset’s success. “They seem to be nailing all of the points that Meta has been fumbling for [the] last few years, namely overall UX,” Blair Renaud, VR game developer and the director of IrisVR, tells The Verge. “They clearly aren’t focused on the current VR ecosystem and game developers like myself, but that may be the right move in the end. For the industry to move forward, we need all the things I mentioned, not just incremental hardware improvements.”

Apple’s slow, careful approach to VR is reflected within the device itself. Instead of presenting you with a somewhat jarring and unfamiliar UI that engulfs your reality, the Vision Pro surfaces a set of recognizable apps that exist atop your real-world environment thanks to video passthrough. Of course, there is the option to turn on full VR using the digital crown, but Apple mainly left this application for watching movies or replaying videos. You won’t have to worry about getting used to controllers, either, as you can navigate through the device using just your eyes and hands.

Based on first impressions of the Vision Pro, the technology is clearly there for it to succeed. But like most devices out there, the apps are what make it. Fortunately for Apple, it’s easier to build upon a foundation that’s already been established, rather than build one from scratch.

Zuckerberg added that Apple’s announcement “really showcases the difference in the values and the vision that our companies bring to this,” noting that Meta’s goal is to offer products that are “accessible and affordable to everyone.” Vision Pro will be priced at $3,499, while the Quest 3 will be priced at $499 and the Quest Pro costs $999.

Meta’s goal with the metaverse is “fundamentally social,” whereas the Vision Pro appears to be more isolating, according to Zuckerberg. He admitted that Apple’s approach “could be the vision of the future of computing,” but is “not the one that I want.”

Zuckerberg’s full comments, as reported by The Verge:

Apple finally announced their headset, so I want to talk about that for a second. I was really curious to see what they were gonna ship. And obviously I haven’t seen it yet, so I’ll learn more as we get to play with it and see what happens and how people use it.

From what I’ve seen initially, I’d say the good news is that there’s no kind of magical solutions that they have to any of the constraints on laws and physics that our teams haven’t already explored and thought of. They went with a higher resolution display, and between that and all the technology they put in there to power it, it costs seven times more and now requires so much energy that now you need a battery and a wire attached to it to use it. They made that design trade-off and it might make sense for the cases that they’re going for.

But look, I think that their announcement really showcases the difference in the values and the vision that our companies bring to this in a way that I think is really important. We innovate to make sure that our products are as accessible and affordable to everyone as possible, and that is a core part of what we do. And we have sold tens of millions of Quests.

More importantly, our vision for the metaverse and presence is fundamentally social. It’s about people interacting in new ways and feeling closer in new ways. Our device is also about being active and doing things. By contrast, every demo that they showed was a person sitting on a couch by themself. I mean, that could be the vision of the future of computing, but like, it’s not the one that I want. There’s a real philosophical difference in terms of how we’re approaching this. And seeing what they put out there and how they’re going to compete just made me even more excited and in a lot of ways optimistic that what we’re doing matters and is going to succeed. But it’s going to be a fun journey.

Just days before WWDC, Meta previewed the Quest 3, its next-generation mixed reality headset. Launching later this year, the headset features a 40% slimmer and more comfortable design, a higher-resolution display, and up to twice the graphics performance as the Quest 2. The headset will start at $499 with 128GB of storage, and the company plans to share more details about it at an event on September 27.

Apple said the Vision Pro will be available in the U.S. in early 2024.

This article, "Mark Zuckerberg Says Apple Vision Pro Has No 'Magical Solutions'" first appeared on MacRumors.com

Discuss this article in our forums