I use speech-to-speech translation in multilingual meetings, and I think a genuinely local, session-only mode should be a baseline feature—not a premium privacy setting. Raw audio, voice embeddings, partial transcripts, and translation intermediates should remain on the device, with encrypted ephemeral buffers and deletion at session end. The hard part is proving that “not stored” includes logs, retries, diagnostics, and vendor-side processing rather than just the final recording.
The trade-off is real: local models may use too much battery or memory and can struggle more with code-switching, accents, or less-supported languages. Cloud processing may be faster and better, so I understand making it the default in some contexts. But privacy-sensitive meetings need a reliable fallback, even if it is visibly less accurate. Would you accept noticeably worse translations to avoid sending conversational audio to a vendor? I’d especially like examples of tools or architectures that handle this trade-off honestly.