Audio Guidelines
In the dynamic world of AR applications, audio serves as a powerful tool that complements and enhances the visual experience, immersing users in a multisensory environment. While visuals play a crucial role in AR, audio brings an added layer of depth and realism, enabling developers to create truly immersive and engaging experiences.
Features
Magic Leap 2 has several exciting features that can be used regardless of which development platform you use. Below you can find overviews on these features and guides on how to incorporate them into your projects.
Marker Tracking
Marker tracking is a technique that allows you to detect and track the position and orientation of physical markers in the real world using a camera.This guide provides insights into best practices for marker tracking using various cameras and markers.
Media Codecs
This section includes information about the media codecs supported on the Magic Leap 2.
Meshing
Meshing is the creation of triangle-based meshes from the World Reconstruction model created by Magic Leap devices. The mesh is used for real-time occlusion rendering and for collision detection with digital content.
Migrating from ML1
This section includes useful information about API changes when migrating Magic Leap 1 applications to Magic Leap 2.
Plane Detection
Plane Extraction enables users to extract rectangular planar regions from the world reconstruction model. Plane candidates are returned as simple geometric rectangles.
Sensors
Magic Leap 2 allows developers to access the data from a variety of sensors. A general overview of what’s on each Magic Leap 2 headset is provided in this Learn More document. This guide details the different sensors available on the Magic Leap 2, as well as how you can access them. Some sensors are available through Magic Leap’s SDK, and many can be accessed through the Android Sensor API. Eventually, the sensors will all be standardized for use through the Android Sensor API.
Supported OpenXR Features
These Magic Leap 2 features are supported for Unreal Engine 5.3 with Magic Leap 2 SDK for Unreal Engine 5 (Magic Leap Unreal SDK).
System Capture
The Capture App allows you to take screenshots and screen recordings on the Magic Leap 2 from any app or platform. Below you'll find instructions on capturing media and accessing it on-device, in the Magic Leap Hub (ML Hub).
WebXR
Magic Leap offers support for WebXR Device API, allowing developers to build immersive augmented reality (AR) and virtual reality (VR) experiences. The API is pre-installed on Magic Leap devices and works with standard WebXR applications without additional configuration.
Working with App Sim Features
This section provides details for working with the Application Simulator. It goes over features you get when you use a Device vs. a Simulator target, and describes all the available panels and views.