2023 is set up to be the year of new frontiers for Apple. Reports say that Apple could release its long-awaited Reality Pro AR/VR headset as soon as this spring, a new platform for Apple that will get most of the attention for at least the rest of the year.
But just because Apple has a new platform doesn’t mean its oldest platform, the Mac, will be ignored or forgotten. In fact, Bloomberg’s Mark Gurman recently provided insight into how Apple’s AR/VR platform will work, and his report included this interesting tidbit:
The device will also have productivity features, including the ability to serve as an external monitor for a Mac. With that feature, users will be able to see their Mac’s display in virtual reality but still control the computer with their trackpad or mouse and physical keyboard.
At first blush, Gurman’s description seems befuddling. Why would anyone want to use a Mac with a display attached to their face? But if you take a step back and consider Apple’s approach and its ecosystem, it all comes into view.
Sidecar, Universal Control evolve for the headset
Each Apple platform–Mac, iPhone, iPad, Apple Watch–is great on its own, but Apple makes them part of an ecosystem that provides greater value. A lot of the interoperability relies on iCloud and the internet, but the devices also have features that directly work with each other on the hardware level, such as Sidecar and Universal Control.
Sidecar allows users to use an iPad as an external display. Universal Control allows users to control two Macs or a Mac and an iPad from one keyboard and mouse. It seems like the Mac functionality Gurman is describing will have its roots in these two systems. The Mac would presumably need to be nearby and would likely be most useful for specific tasks—meetings, video, 3D rendering apps, games—but if done right it would provide the kind of magical wow factor that Universal Control does.
Based on Gurman’s short description, it’s not clear if the headset would serve as an additional display for the Mac using AR or mirror what’s on the Mac’s primary display using VR. Maybe it’ll be able to do both. But like Universal Control and Sidecar, it could be a tremendously useful feature that only Apple can offer.
Just like Universal control lets a Mac talk to a nearby iPad, the Reality Pro headset can seamlessly connect to a Mac.
Willis Lai/IDG
It’s about convenience, too
Chances are that whoever uses Apple’s headset also uses a Mac. How I imagine it all working is like this: You’re using your Reality Pro headset to play a game and get a notification about a meeting or an important email on your Mac. Rather than taking off the gear and firing up your Mac Studio, the headset will automatically recognize your nearby Mac and pop up the Finder on the headset. Maybe you use gestures to get around or the same keyboard and mouse that’s attached to your Mac. When you’re done, you can flick away the Mac display and resume whatever you were doing.
Based on my experience with Sidecar, Universal Control, and Apple’s ecosystem, a virtual Mac desktop is just another example of how Apple understands the importance of its ecosystem and the interoperability of each device. Apple doesn’t need to bring the Mac into the AR/VR space, but it’s a way to set it apart from other competing models, with tight control and delightful convenience.
In someone else’s hands, it could be a gimmick. However, a virtual Mac display is a clear sign that Apple is thinking not just about what the headset can do, but also about how it can be incorporated into what we already do. And like everything that came before, it seems like Apple is once again on the right path.