Features
Magic Leap 2 has several exciting features that can be used regardless of which development platform you use. Below you can find overviews on these features and guides on how to incorporate them into your projects.
📄️ AR Cloud
See our full section on AR Cloud
📄️ Android Sensor API
Developers can access a variety of Magic Leap 2’s sensors to obtain information about the environment and the device’s orientation, motion, and position. These sensors can be accessed via the standard Android Sensor API, which allows you to register listeners for sensor events, get sensor data, and manage sensor resources. The available sensors include:
🗃️ Intents
1 items
🗃️ Display Zone and Clipping Plane
3 items
📄️ Iris Unlock
Accessing Iris Unlock for developers
📄️ Bluetooth
Magic Leap 2 provides support for Android’s default Bluetooth stack which includes both Classic Bluetooth and Bluetooth Low Energy. Using Bluetooth, Magic Leap 2 can create personal area networks to send and receive data with nearby Bluetooth devices. Integration with Android’s standard Bluetooth API means that users can connect existing Bluetooth devices that are supported on Android without any modification. Bluetooth devices can be connected in Magic Leap 2’s system settings using the steps below.
📄️ Miracast
Miracast
📄️ Magic Leap Spectator
Magic Leap Spectator (ML Spectator) is a mobile application that makes it easy for anyone to capture and share high quality mixed reality content streamed from a Magic Leap 2 device. This powerful application supports a wide variety of use cases, for example:
📄️ Controller
An overview of the controller's buttons and sensors, touchpad gestures, and important changes from the Magic Leap 1 SDK.
🗃️ Hand Tracking
2 items
📄️ Eye Tracking
Magic Leap 2 provides a set of APIs that gives you the ability to access the user's eye data. These APIs can be used to understand the position and rotation of the eyes, as well as the ability to track what the user is looking at. This page explains how you can benefit from eye tracking for various use cases, and what to look for when designing eye-gaze-based user interactions.
🗃️ Dynamic Dimming
2 items
📄️ Headpose
Introduction
📄️ Marker Tracking
Marker tracking is a technique that allows you to detect and track the position and orientation of physical markers in the real world using a camera.This guide provides insights into best practices for marker tracking using various cameras and markers.
📄️ Camera2
The Magic Leap 2 supports the Android Camera2 NDK APIs. With Android Camera allows developers to capture real and virtual content inside their applications. While the Magic Leap 2 has only one physical, it is presented as 3 separate devices in the API. The Main Camera (Camera Id 0) and Mixed Reality Camera (Camera Id 3) are mutually exclusive, however they can be accessed even while the CV Camera (Camera Id 1) is being used.
📄️ MLCamera
The Magic Leap 2 MLCamera API allows developers to capture real and virtual content inside their applications. While the Magic Leap 2 has only one camera for capturing content, two separate streams can be access from the camera at the same time. This allows you to create applications that can stream the user's point of view, while using the camera to perform computer vision tasks.
📄️ Occlusion
Magic Leap 2's Occlusion API offers developers a way to enhance immersion in mixed reality applications by generating a mesh representation of nearby physical objects. This allows virtual objects to interact with the real world in a more believable way by appearing to be occluded (or "masked") by real-world objects.
📄️ Sensor Data
Sensor Data Access Overview
📄️ Media Codecs
This section includes information about the media codecs supported on the Magic Leap 2.
🗃️ Spatial Mapping & Localization
3 items
🗃️ Real-time World Sensing
2 items
📄️ System Capture
The Capture App allows you to take screenshots and screen recordings on the Magic Leap 2 from any app or platform. Below you'll find instructions on capturing media and accessing it on-device, in the Magic Leap Hub (ML Hub).
🗃️ Voice Commands
3 items
📄️ WebXR
Magic Leap offers support for WebXR Device API, allowing developers to build immersive augmented reality (AR) and virtual reality (VR) experiences. The API is pre-installed on Magic Leap devices and works with standard WebXR applications without additional configuration.