VisionOS Update Gives Devs Improved Tools for VR Cloud Streaming

Apple's Vision Pro has just received a significant update that brings foveated streaming to the headset, a feature that Valve is also set to introduce with its upcoming Steam Frame headset. This update, now available in the visionOS 26.4 beta, allows developers to optimize the streamed image to serve up the highest quality at the very center of the user's view, using the headset's eye-tracking capabilities.

The News

According to VR supply chain analyst Brad Lynch, foveated streaming has arrived on Vision Pro via the latest visionOS 26.4 beta update, which landed on February 16th. This update is a significant development for developers, as it allows them to create more efficient and effective VR experiences that can be streamed to the headset.

How it Works

Foveated streaming uses the headset's eye-tracking capabilities to determine where the user is looking and only streams high-quality content to that area. This approach allows for a significant reduction in bandwidth requirements, making it possible to stream high-quality content to the headset without requiring a powerful computer or a high-speed internet connection.

Comparison to Valve's Approach

Valve's approach to foveated streaming is slightly different. Instead of using eye-tracking to determine where the user is looking, Valve's system uses a more general approach that applies foveated rendering to all Steam apps. This approach allows for improved latency in all apps, but it may not be as effective as Apple's approach, which is specifically designed to take advantage of the headset's eye-tracking capabilities.

Implications for Developers

The implications of this update are significant for developers. With foveated streaming, developers can create more efficient and effective VR experiences that can be streamed to the headset. This approach allows for a significant reduction in bandwidth requirements, making it possible to stream high-quality content to the headset without requiring a powerful computer or a high-speed internet connection.

Comparison to Other Approaches

Other companies, such as Varjo, have also been working on foveated streaming technology. Varjo's approach uses a more general approach that applies foveated rendering to all apps, rather than using eye-tracking to determine where the user is looking. This approach allows for improved latency in all apps, but it may not be as effective as Apple's approach, which is specifically designed to take advantage of the headset's eye-tracking capabilities.

Future Developments

Conclusion

In conclusion, Apple's update to visionOS 26.4 beta brings foveated streaming to the headset, a feature that Valve is also set to introduce with its upcoming Steam Frame headset. This update allows developers to optimize the streamed image to serve up the highest quality at the very center of the user's view, using the headset's eye-tracking capabilities. The implications of this update are significant for developers, and it will be interesting to see how they take advantage of this technology in the future.

Technical Details

Foveated streaming uses the headset's eye-tracking capabilities to determine where the user is looking and only streams high-quality content to that area.
This approach allows for a significant reduction in bandwidth requirements, making it possible to stream high-quality content to the headset without requiring a powerful computer or a high-speed internet connection.
Apple's approach is specifically designed to take advantage of the headset's eye-tracking capabilities, making it more effective than Valve's approach, which uses a more general approach that applies foveated rendering to all Steam apps.

Practical Insights

Developers can create more efficient and effective VR experiences that can be streamed to the headset.
This approach allows for a significant reduction in bandwidth requirements, making it possible to stream high-quality content to the headset without requiring a powerful computer or a high-speed internet connection.
The implications of this update are significant for developers, and it will be interesting to see how they take advantage of this technology in the future.

Forward-Looking Thoughts

The future of foveated streaming is exciting, with many companies working on developing this technology. Apple's update is a significant step forward, and it will be interesting to see how developers take advantage of this technology in the future. As the technology continues to evolve, we can expect to see even more efficient and effective VR experiences that take advantage of the latest advancements in foveated streaming.

Source: https://www.roadtovr.com/visionos-update-improved-vr-cloud-streaming-tools/

VisionOS Update Gives Devs Improved Tools for VR Cloud Streaming

VisionOS Update Gives Devs Improved Tools for VR Cloud Streaming