Add two-way audio (talk) support via Baichuan protocol - #165
Open
fredrsat wants to merge 4 commits into
Open
Conversation
Implement sending audio to camera speakers using the Baichuan TCP protocol (cmd_ids 10, 11, 201, 202). This addresses the long-standing request for two-way audio support (starkillerOG#161). New files: - baichuan/audio.py: Pure-Python IMA ADPCM (DVI-4) encoder and BcMedia frame builder. No external dependencies (audioop was removed in 3.13). - tests/test_talk.py: 30 unit tests covering ADPCM encoding, BcMedia framing, talk frame header construction, and talk() orchestration. Modified files: - baichuan/xmls.py: Add BINARY_EXTENSION_XML (with binaryData flag for binary payloads) and TALK_CONFIG_XML templates. - baichuan/baichuan.py: - Parse and cache audio config from TalkAbility (cmd_id=10) response - Add _send_talk_frame(): fire-and-forget method that AES-encrypts the extension XML but sends the audio payload as raw binary - Add talk(): public method that starts a talk session (TalkConfig), encodes PCM to ADPCM, sends BcMedia frames paced to audio duration, and resets the session (TalkReset). Handles 422 (busy) gracefully. Protocol details: - Audio format: IMA ADPCM, 16-bit, mono, 8000/16000 Hz (from TalkAbility) - cmd_id 202 uses mixed encryption: AES-encrypted extension + raw payload - BcMedia frames use "01wb" magic with 8-byte aligned padding - Up to 4 ADPCM blocks packed per Baichuan message for efficiency Tested against Reolink Home Hub with Argus 4 Pro cameras.
6 tasks
- Fix two_way_audio capability detection: cameras using "followVideoStream" (e.g. Reolink E1) were not being marked as capable; now any camera that returns an audioConfig in TalkAbility is correctly detected - Fix cmd_id=10 not called during init on standalone cameras: add `or self.http_api.baichuan_only` guard so TalkAbility is always queried during channel discovery on baichuan-only devices - Add split API: get_talk_ability() / start_talk() / stop_talk() / send_talk_data() on both Baichuan and Host, plus build_bcmedia_adpcm() static helper for BcMedia ADPCM framing - Add TalkConfigSet XML template with all audio fields parameterized - Rename _send_talk_frame() → send_binary_no_reply() with generalized signature (cmd_id, channel, binary_body); talk() updated to use it - Update tests: rename TestSendTalkFrame → TestSendBinaryNoReply, add TestBuildBcmediaAdpcm, TestSplitTalkApi, TestTwoWayAudioCapability (52 tests total, all passing) Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Fix standalone camera support and add split talk API
Author
|
Updated with contributions from @lorek123: E1 standalone camera bugfix (baichuan_only guard for cmd_id=10), followVideoStream capability detection, and a split talk API (start_talk/send_talk_data/stop_talk). 52 tests passing. |
|
@fredrsat Thank you for the awesome work!! I have tested it and it works great on my camera. |
…ebhook templates)
|
I built a Home Assistant custom integration (ha-reolink-talk) around this
Happy to help test against my hardware if useful. This would be a great |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Implements two-way audio (talk) for Reolink cameras via the Baichuan protocol, resolving #161.
audioopmodule (Python 3.13+)New files
reolink_aio/baichuan/audio.py— IMA ADPCM encoder + BcMedia frame builder (188 lines)tests/test_talk.py— 30 unit tests covering encoding, framing, header construction, and session lifecycle (392 lines)Modified files
reolink_aio/baichuan/baichuan.py—talk(),_send_talk_frame(), TalkAbility config storage (+149 lines)reolink_aio/baichuan/xmls.py—TALK_CONFIG_XMLandBINARY_EXTENSION_XMLtemplates (+24 lines)Public API
await host.baichuan.talk(channel=0, audio_data=pcm_bytes)
Where audio_data is raw PCM (16-bit signed LE, mono) at the camera's sample rate. Optional sample_rate and block_size overrides.
Protocol reference
Based on reverse-engineering from the https://github.com/QuantumEntangledAndy/neolink project (Rust).
Test plan
Closes #161