Skip to content

feat: add simulator audio to WebRTC streams#74

Open
DjDeveloperr wants to merge 2 commits into
mainfrom
add-simulator-audio-streaming
Open

feat: add simulator audio to WebRTC streams#74
DjDeveloperr wants to merge 2 commits into
mainfrom
add-simulator-audio-streaming

Conversation

@DjDeveloperr
Copy link
Copy Markdown
Collaborator

@DjDeveloperr DjDeveloperr commented May 31, 2026

Summary

  • Add simulator and Android emulator audio to the WebRTC live stream as a PCMU audio track alongside video.
  • Capture per-simulator host audio with Core Audio process taps scoped to the selected iOS simulator or Android emulator process tree.
  • Suppress direct simulator/emulator hardware output while the tap is active, so audible playback comes through the browser WebRTC audio element when Sound is unmuted.
  • Add a web menu Sound toggle that is muted by default, plus docs for WebRTC audio behavior and Android emulator audio capture.

Notes

  • macOS 14.2+ is required for Core Audio process taps.
  • Android emulators launched by SimDeck keep host audio enabled so there is audio for the process tap to capture; the active tap mutes direct hardware output and routes samples into WebRTC.
  • The legacy H.264 WebSocket fallback remains video-only.

Testing

  • cargo fmt --manifest-path packages/server/Cargo.toml --check
  • cargo clippy --manifest-path packages/server/Cargo.toml --all-targets -- -D warnings
  • cargo test --manifest-path packages/server/Cargo.toml
  • npx prettier --check .
  • npm run --prefix packages/client typecheck
  • npm run --prefix packages/client test
  • npm run --prefix packages/client build
  • npm run build:cli
  • npm run build:packages
  • npm run package:vscode-extension
  • npm run test:github-actions
  • npm run test:studio-provider
  • npm run test:integration-harness
  • npm run test:integration:fixture
  • GitHub Actions CI run 26724651601 passed all jobs

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 31, 2026

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 3798bf83-c91f-4bcd-bc7e-987bd673d877

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch add-simulator-audio-streaming

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@DjDeveloperr DjDeveloperr changed the title feat: switch live stream client to WebRTC transport feat: add simulator audio to WebRTC streams Jun 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant