Meta's Smart Glasses SDK Is Now Available To Build With, But Not Yet To Ship
Meta's Smart Glasses SDK: Unlocking New Possibilities for Developers
Meta's Wearables Device Access Toolkit (DAT) is now available for developers to build with, marking a significant milestone in the company's efforts to bring augmented reality (AR) capabilities to the masses. The SDK allows smartphone apps to access the camera of Meta's smart glasses, enabling a range of innovative features and use cases. In this article, we'll delve into the details of the DAT, its capabilities, and the exciting possibilities it holds for developers.
What is the Wearables Device Access Toolkit?
The Wearables Device Access Toolkit is a software development kit (SDK) that enables smartphone apps to access the camera of Meta's smart glasses. This allows developers to create apps that can capture photos or initiate video streams from the glasses, and then store or process the frames received. The SDK also enables developers to combine visual capabilities with audio in and out, as Meta smart glasses function as Bluetooth audio devices.
Key Features and Limitations
The DAT offers several key features, including:
- Camera access: Developers can access the camera of Meta's smart glasses to capture photos or initiate video streams.
- Video streaming: The maximum resolution for video streaming is 720p, and the maximum frame rate is 30 FPS, due to the use of Bluetooth.
- Audio capabilities: Developers can combine visual capabilities with audio in and out, as Meta smart glasses function as Bluetooth audio devices.
However, there are also some limitations to consider:
- Bluetooth bandwidth: When Bluetooth bandwidth is limited, the resolution and frame rate will be automatically reduced.
- Supported devices: Currently, the DAT is supported on Ray-Ban Meta and Oakley Meta HSTN glasses, with support for Oakley Meta Vanguard and Meta Ray-Ban Display coming in the near future.
Early Developer Experiments
Meta provided an early version of the DAT to a handful of developers several months ago, including Twitch, Microsoft, Logitech Streamlabs, and Disney. These developers are already experimenting with the SDK to create innovative apps and features, such as:
- Livestreaming: Twitch and Logitech Streamlabs are using the DAT to let users livestream their first-person view on their platforms.
- Seeing AI: Microsoft is using the DAT for its Seeing AI platform, which helps blind people navigate and interact with the world around them.
- Golf app: 18Birdies is experimenting with using the DAT for real-time yardages and club recommendations, helping golfers without requiring them to take their phone out of their pocket.
- Personal AI guide: Disney's Imagineering team is exploring using the DAT to give guests a personal AI guide in Disney parks.
Practical Insights and Implications
The DAT has significant implications for developers, businesses, and consumers alike. Some practical insights include:
- New use cases: The DAT enables developers to create innovative apps and features that were previously not possible, such as livestreaming and real-time yardages.
- Improved accessibility: The DAT can help improve accessibility for people with disabilities, such as those who are blind or have visual impairments.
- Enhanced user experience: The DAT can enhance the user experience for consumers, making it easier to interact with the world around them.
Forward-Looking Thoughts
The DAT is a significant step forward in the development of AR capabilities, and it has the potential to revolutionize the way we interact with the world around us. As the technology continues to evolve, we can expect to see even more innovative use cases and applications emerge. Some potential future developments include:
- Improved camera capabilities: Future versions of the DAT may include improved camera capabilities, such as higher resolution and frame rates.
- New form factors: We may see new form factors emerge, such as smart glasses with built-in displays or other innovative designs.
- Expanded accessibility: The DAT could be used to create even more accessible experiences for people with disabilities, such as those who are deaf or hard of hearing.
Overall, the DAT is an exciting development that has significant implications for developers, businesses, and consumers alike. As the technology continues to evolve, we can expect to see even more innovative use cases and applications emerge.
Source: https://www.uploadvr.com/meta-wearables-device-access-toolkit-public-preview/




