0.53.3 - Unity SDK Release Notes
SDK Delivered via The Magic Leap Hub
- Unity Example Project
- Magic Leap 2 Unity SDK Package
- Lumin SDK Version 0.53.3
Features
- Added support for camera auto focus API.
- Added support for
MLHapticsAPI. - Added async support to
MLCameraAPI to allow developers to avoid blocking on Camera operations. - Added
MLCameraIntrinsicsOnPreviewBufferAvailablecallback. - Added better support for
OnApplicationPauseinMLWebRTCCameraVideoSourceto manage camera resources during pause and resume. - Added Trigger Hold action to MagicLeap input actions.
- Updated
LuminXrProviderwith normal permission checks. - Added boot settings for OpenXR.
- Added support for high precision marker tracking.
- Added
MediaPlayer.VideoRenderer.OnFrameRenderedcallback to media player renderer. - Added Magic Leap 2 interaction profile for OpenXR.
- Added
TargetSpaceOrigintoMLAnchor.LocalizationInfo. - Added support for indefinite
MLAnchorduration registration. - Updated integration branding with the Magic Leap Hub (formerly The Lab 2.0) and Magic Leap App Simulator (formerly Zero Iteration).
Bug Fixes
- Fixed
OnSourceEnabledwhen not using native buffers for WebRTC. - Fixed hand tracking keypoint detection under ML App Sim.
- Fixed native platform error logging.
- Fixed event delegate initialization in
MLCamera. - Fixed excessive Audio Playback allocations.
- Fixed developer build crashes caused by
WorldScalecomputations. - Fixed memory leak when pausing/resuming unity applications (requires Unity XR Package update).
- Fixed collision mesh generation on mesh blocks generated from
MeshingSubsystemComponent+ Mesh prefab. - Fixed Voice Intents configuration asset creation (fixed in 2022.2.0b4 of Unity Engine).
- Fixed crash caused by
MLDeviceinstance race condition. - Refactored
MLWebViewmouse input functions to simplify parameters. - Fixed
MLWebViewmouse drag support. - Fixed
MLWebViewcomponent null reference checks. - Fixed
MLAnchorduration checks and updated documentation. - Fixed controller Menu button and touchpad actions.
- Refactored controller action layout to remove touch point 2 and cleanup supported actions.
- Fixed
YcbcrRenderer.Cleanup()not fully cleaning up resources. - Fixed
UnityEngine.XR.Hand.TryGetFingerBonesreturning a 5th invalid Bone when only 4 are supported.
Deprecations & Removals
- Removed
MLAutoAPISingletoninheritance fromMLAudioPlayback. Uses normal singleton pattern. Callers still need to drive its lifecycle functions. - Removed automatic disabling of Strip Engine Code, this has been fixed in the 2022.2.0b4 Unity Engine.
- Removed permissions for
HEAD_POSEandCONTROLLER_POSE, these are no longer required. - Removed remaining references to Lumin platform. Magic Leap 2 is a full AOSP based platform.
Known Issues
- Image tracking, World Raycast & Hand Meshing support has been temporarily disabled in this release. None of these are currently supported on the device. Once re-enabled, developers can use some of these in ML App Sim.
- Eye blinking state is not reported either by the eye tracking API or the gaze recognition API (awaiting platform support).
- WebRTC
LocalAppDefinedAudioSourceBehavioris restricted to 1 audio channel. - To use Geometry Shaders, Force Multipass must be set in Project Settings -> XR Plug-in Management -> Magic Leap Settings -> Force Multipass. Otherwise geometry shader passes cause vulkan exception in Unity player.
- Keypoint mask values in ML App Sim are temporarily ignored and overridden to true.
- XR Framework Meshing subsystem crashes when attempting to load mesh blocks for rendering.
- Detecting simultaneous controller input buttons does not work in Unity Input System 1.2.
- Marker tracker transforms are upside down requiring users to rotate them by 180 degrees about the forward vector.
- Camera capture can freeze app after multiple captures.
MLCamera.CaptureVideoStopfails withUnspecifiedFailurewhen called by WebRTCCameraVideoSourceusingNativeBuffers. When usingYUV CaptureVideoStopreturns successfully.- Some configurations of camera capture can produce distorted images.
- WebRTC video sink rendering fails when non-white material is assigned.
MLGestureClassification's GestureTransformRotationandGestureInteractionRotationare not implemented yet and data will not be guaranteed accurate. Currently only the Positions of the Hand Transform and Interaction Point will be recommended to use.MLWebViewfirst tab creation causes framerate drop.MLWebViewhas challenges clicking on web links on page due to noisy controller position cancelling click operations (treats it as a drag operation).- If
HandTrackingis enabled, the Controller position/rotation actions fail to work properly when binding with the generic XRController and Right XRController input devices. The work around is to have your actions bind to theMagicLeapControllerinput device instead. TheMagicLeapInputsinput asset already does this with it's action fallbacks. MLAudiois not fully supported in the 2022.2.0b5 version of the Unity Engine, make sure you don't check the "MLAudio" check box in Magic Leap XR settings (to utilize the Java AudioTrack fallback). Also use the following audio settings: Sample rate to 48000, buffer size to Good Latency.- When changing audio settings Unity crashes often or starts making noises.
- Unity applications currently experience aproximately 190 MB/hr memeory leak.
MLAudioInputdelayed capture and "parroting" is not functioning.