Magic Leap 2 has several exciting features that can be used regardless of which development platform you use. Below you can find overviews on these features and guides on how to incorporate them into your projects.
📄️ AR Cloud
See our full section on AR Cloud
📄️ Android Sensor API
Developers can access a variety of Magic Leap 2’s sensors to obtain information about the environment and the device’s orientation, motion, and position. These sensors can be accessed via the standard Android Sensor API, which allows you to register listeners for sensor events, get sensor data, and manage sensor resources. The available sensors include:
🗃️ Display Zone and Clipping Plane
📄️ Iris Unlock
Accessing Iris Unlock for developers
Magic Leap 2 provides support for Android’s default Bluetooth stack which includes both Classic Bluetooth and Bluetooth Low Energy. Using Bluetooth, Magic Leap 2 can create personal area networks to send and receive data with nearby Bluetooth devices. Integration with Android’s standard Bluetooth API means that users can connect existing Bluetooth devices that are supported on Android without any modification. Bluetooth devices can be connected in Magic Leap 2’s system settings using the steps below.
An overview of the controller's buttons and sensors, touchpad gestures, and important changes from the Magic Leap 1 SDK.
🗃️ Hand Tracking
🗃️ Eye Tracking
🗃️ Global/Segmented Dimmer
📄️ Marker Tracking
Marker tracking is a technique that allows you to detect and track the position and orientation of physical markers in the real world using a camera.This guide provides insights into best practices for marker tracking using various cameras and markers.
The Magic Leap 2 MLCamera API allows developers to capture real and virtual content inside their applications. While the Magic Leap 2 has only one camera for capturing content, two separate streams can be access from the camera at the same time. This allows you to create applications that can stream the user's point of view, while using the camera to perform computer vision tasks.
Magic Leap 2's Occlusion API offers developers a way to enhance immersion in mixed reality applications by generating a mesh representation of nearby physical objects. This allows virtual objects to interact with the real world in a more believable way by appearing to be occluded (or "masked") by real-world objects.
📄️ Media Codecs
This section includes information about the media codecs supported on the Magic Leap 2.
🗃️ Spatial Mapping
📄️ System Capture
The Capture App allows you to take screenshots and screen recordings on the Magic Leap 2 from any app or platform. Below you'll find instructions on capturing media and accessing it on-device, in the Magic Leap Hub (ML Hub).
🗃️ Voice Commands
MagicLeap now offers full support for the WebXR Device API. It comes already installed on your Magic Leap device and should work with your standard WebXR applications out of the box. All features described in the WebXR specification are supported.