'Spatial video' compatible with Apple Vision Pro can be shot with iOS 17.2 public beta version, what is it like when viewed on the actual device?



The MR headset '

Vision Pro ' that Apple plans to release in 2024 will be able to play 3D stereoscopic images in MR space called ' spatial video .' It has been announced that this spatial video can be shot with iPhone 15 Pro/Pro Max, and spatial video shooting became possible with public beta 2 of iOS 17.2 released on November 11, 2023. Lance Ulanoff, editor of the IT news site TechRader, reports on how he actually experienced spatial videos shot with the iPhone 15 Pro using Vision Pro.

I tried the iPhone 15 Pro's new spatial video feature, and it will be the Vision Pro's killer app | TechRadar
https://www.techradar.com/computing/virtual-reality-augmented-reality/i-tried-the-iphone-15s-new-spatial-video-feature-and-it-will-be-the-vision- pros-killer-app

techthings.cmail19.com/t/de-vhlukdk-irijhkzjj-r/
https://techthings.cmail19.com/t/de-vhlukdk-irijhkzjj-r/

Apple's Vision Pro headset just found its killer app | Laptop Mag
https://www.laptopmag.com/gaming/vr/apples-vision-pro-headset-just-found-its-killer-app

In the iPhone 15 Pro/Pro Max, the main wide-angle camera and ultra-wide-angle camera are arranged in a vertical line. This is because by holding the iPhone 15 Pro/Pro Max horizontally, you can shoot spatial videos compatible with Apple Vision Pro using both the main camera and the ultra-wide-angle camera.



It seems obvious that it is possible to capture spatial video that reproduces stereoscopic parallax by shooting simultaneously with two cameras, but Ulanov says that it is not that simple. Because the main camera and ultra-wide camera have different viewing angles, the ultra-wide camera footage must be cropped and scaled to fit the main camera frame.

According to Ulanov, the spatial video is shot in 1080p, 30fps, HEVC codec, and the file size is about 1 minute and 130MB. Although spatial video is a new media format, it appears as a 2D video when played on an iPhone or Mac. However, in order to keep the video synchronization between the two cameras intact, it seems that it cannot be edited like other movies. It is unclear how Apple technically creates a spatial video from the images of the two cameras.



In a demo to which some media and related parties were invited, an iPhone 15 Pro with the developer beta version of iOS 17 installed was used with Apple Vision Pro's spatial video enabled in the camera settings, and a 'sushi restaurant' image was displayed. It seems that I was able to take a photo of the chef making sushi.

When shooting the spatial video, they were instructed to hold the iPhone sideways, and in order to prevent the subject from being photographed as large as a giant, they were required to maintain a distance of 1.5m to 2.5m from the subject. Also, it seems that options such as level and dividing line were turned on by default. Ulanov explains that this is because if the iPhone is no longer level while shooting, the spatial video captured can cause discomfort when viewed.

In order to actually check the shot video with Vision Pro, you need to check it from a new media category called ``Spatial'' in the Vision Pro photo app. According to Ulanov, if the Vision Pro device is a registered Apple ID, spatial video recording will be automatically enabled.



Mr. Ulanoff first saw two movies that Apple shot with the iPhone 15 Pro. Both can be displayed in a window or full screen, and in the case of full screen, it seems that the scene is spreading in front of your eyes. In particular, Mr. Ulanoff testified that in the movie where the child blows bubbles, the bubbles really looked like they were floating close to his face.



Mr. Ulanov also said that the movies he shot felt the same depth as reality, and looked the same as when seen with the naked eye. However, it was not as immersive as ``standing up, approaching the spatial video, stepping on it, and moving around'', and the video was said to emphasize the three-dimensional effect. Regarding the sound, although it was not a spatial sound that reproduces three-dimensional sound, it seems that it was recorded with a clear sound quality comparable to that of general movie shooting.



In addition, Mr. Ulanov said, ``Vison Pro is very easy to operate by just pinching the area you want to select with your fingers, and even though it was only my second time experiencing it, including the time it was announced, I was able to use it immediately. He said he got used to it.

Ulanov praises the spatial video viewing experience with the Vision Pro, but says, 'Of course, the biggest deterrent is the price,' which costs $3,499, which is quite high for a standalone VR/AR device. Due to the price (approximately 530,000 yen), it is said that only a small number of people will be able to experience spatial video.

in Mobile,   Hardware, Posted by log1i_yk