Feature/platform extensions#328
Merged
Merged
Conversation
…re update W6+W1+W4)
…ar world-mesh fallback (W5)
Brings in ViroCameraTexture selfie/front-camera support: - VROAVCaptureController: front camera selection (iOS) - VROCameraTextureiOS: front camera capability - VROCameraTextureAndroid + CameraTexture_JNI: Android front camera texture - CameraTexture.java: Java camera texture with front/back switching
doranteseduardo
added a commit
that referenced
this pull request
Jun 5, 2026
* feat: add target details * feat: visionos driver and metal * chore: add logs for tracing bridge * feat: implement hysteresis for vr * chore: logs cleanup * Feature/platform extensions (#328) * feat: selfie camera support * feat: VRODynamicGeometry — mutable per-frame vertex buffers * chore: link new files * feat: VROInputState + VROVirtualControllerRegistry foundation * fix: xcode references * chore: media capture * feat: VROVirtualController JNI bridge (Android) + fix RVCCA_AVAILABLE guard * feat: add nativeSetButton to VROVirtualController JNI * feat: add PCM streaming audio — iOS AVAudioEngine + Android AudioTrack * eat: orientation support, calibration modes, and in-place depth texture update W6+W1+W4) * feat(mono): synthesized confidence for hit-test gating (W2) + monocular world-mesh fallback (W5) * feat(F4-W1): replace stats-only callback with subscriber API in VROARWorldMesh * feat(F4-W2): persistent mesh sourcing with ARMeshAnchor + plane fallback * feat(F4-W4): smart pointer hardening for btRigidBody/btDefaultMotionState * feat(F4-W3): per-consumer decimation in VROARWorldMesh subscriber model * feat (F4-W7): Android world mesh end-to-end repair * feat (F4-W8): Depth-tested wireframe for world mesh debug draw * feat(demo-hooks): expose getWorldMesh() on VROARScene + getNativeRef() on ViroContext * feat(android): expose Scene.getNativeRef() for cross-package JNI access * fix: virodynamicmeshnode * feat: add game loop, fix particle alpha * fix: arworldmesh is not simplified * chore: skip anchor not found log * feat: use metric model for mono * feat: support monocular scale factor * feat: configurar monocular target fps * fix: wire controls and audio in android * fix: prevent corrupted meshes * Update VROPhysicsShape.cpp * chore: validate selfie camera integration and add new prop for nav mode * fix: camera flip bug * fix: SIGABRT in ARUtilsCreateJavaARAnchorFromAnchor on Android 14 * fix: shaders + extensions * chore: update changelog --------- Co-authored-by: Ernesto Mendoza <emhgerencia@gmail.com> Co-authored-by: Benito Mota <benmotanoti@gmail.com> --------- Co-authored-by: Ernesto Mendoza <emhgerencia@gmail.com> Co-authored-by: Benito Mota <benmotanoti@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces a significant set of improvements and new features to the AR world mesh and depth pipeline, focusing on multi-source mesh generation, robust physics integration, and a new public subscriber API for AR meshes. The changes enhance mesh sourcing flexibility (LiDAR, monocular, and plane fallback), improve physics performance with asynchronous processing, and provide a more extensible and thread-safe architecture for AR mesh consumers.
AR World Mesh & Depth Pipeline Enhancements:
VROARWorldMesh, prioritizing LiDAR (ARMeshAnchor), depth maps (LiDAR or monocular), and plane anchors as a fallback. Mesh source is now tagged and exposed viaVROARDepthMesh::getSource(). [1] [2] [3] [4] [5] [6]VROARFrame:generateMeshAnchorMesh()(LiDAR),generatePlaneMesh()(plane fallback), and a debug texture transform for overlays. [1] [2]Physics Integration Improvements:
World Mesh Subscriber API & Lifecycle:
VROARWorldMeshnow supports a public subscriber API, allowing multiple consumers to receive mesh updates with source and stats. Mesh updates notify all subscribers, and the mesh can be retrieved viaVROARScene::getWorldMesh(). [1] [2]Platform Activation & Session Coordination:
Documentation & Changelog:
CHANGELOG.mdhas been updated to reflect all new features, improvements, and bug fixes, including the AR world mesh subscriber API, mesh source tagging, and physics enhancements.