v2.56.0#329
Merged
Merged
Conversation
* feat: selfie camera support * feat: VRODynamicGeometry — mutable per-frame vertex buffers * chore: link new files * feat: VROInputState + VROVirtualControllerRegistry foundation * fix: xcode references * chore: media capture * feat: VROVirtualController JNI bridge (Android) + fix RVCCA_AVAILABLE guard * feat: add nativeSetButton to VROVirtualController JNI * feat: add PCM streaming audio — iOS AVAudioEngine + Android AudioTrack * eat: orientation support, calibration modes, and in-place depth texture update W6+W1+W4) * feat(mono): synthesized confidence for hit-test gating (W2) + monocular world-mesh fallback (W5) * feat(F4-W1): replace stats-only callback with subscriber API in VROARWorldMesh * feat(F4-W2): persistent mesh sourcing with ARMeshAnchor + plane fallback * feat(F4-W4): smart pointer hardening for btRigidBody/btDefaultMotionState * feat(F4-W3): per-consumer decimation in VROARWorldMesh subscriber model * feat (F4-W7): Android world mesh end-to-end repair * feat (F4-W8): Depth-tested wireframe for world mesh debug draw * feat(demo-hooks): expose getWorldMesh() on VROARScene + getNativeRef() on ViroContext * feat(android): expose Scene.getNativeRef() for cross-package JNI access * fix: virodynamicmeshnode * feat: add game loop, fix particle alpha * fix: arworldmesh is not simplified * chore: skip anchor not found log * feat: use metric model for mono * feat: support monocular scale factor * feat: configurar monocular target fps * fix: wire controls and audio in android * fix: prevent corrupted meshes * Update VROPhysicsShape.cpp * chore: validate selfie camera integration and add new prop for nav mode * fix: camera flip bug * fix: SIGABRT in ARUtilsCreateJavaARAnchorFromAnchor on Android 14 * fix: shaders + extensions * chore: update changelog --------- Co-authored-by: Ernesto Mendoza <emhgerencia@gmail.com> Co-authored-by: Benito Mota <benmotanoti@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces several major AR and audio features, API improvements, and bug fixes, with a focus on AR world mesh enhancements and extensibility. The most important changes are grouped below.
AR World Mesh and Depth Mesh Improvements:
VROARWorldMeshclass now supports multiple mesh sources (LiDAR, monocular, and plane-based fallback) and exposes a public subscriber API, allowing multiple consumers to receive mesh updates with source information and stats. Mesh generation prioritizes ARMeshAnchor (LiDAR), then depth maps, then plane anchors, and supports per-consumer triangle decimation and asynchronous Bullet BVH construction for improved performance and responsiveness. [1] [2]VROARDepthMeshgains asourcefield and accessor, allowing consumers to identify the mesh source ("lidar", "monocular", "plane"). Constructors and methods are updated accordingly. [1] [2] [3] [4]VROARFrameadds new virtual methods for generating meshes from ARMeshAnchors and plane anchors, and for retrieving a debug texture transform. [1] [2]VROARSceneandVROARSessionnow notify the platform session when world mesh is enabled or disabled, allowing platform-specific activation of depth sensing. [1] [2] [3]Physics and Performance Enhancements:
Other Features and Fixes (see changelog for details):