高级语音AI工程师
Senior Voice AI Engineer
职位描述
作为一支小型对话AI团队的创始工程师，你将负责实时语音层，从语音输入、AI推理到语音回复的全流程。你将帮助确保自然、响应迅速的语音交互在生产环境中稳定运行，重点关注端到端延迟。
你将负责的工作包括：
- 构建并维护流式语音转文本、LLM轮换、文本转语音以及电话或WebRTC传输。
- 测量并减少延迟，在实际通话中实现首次音频低于800毫秒的目标。
- 处理中断、插话、静音检测、重叠语音、音频质量差、口音和句子中间的更改。
- 从录音通话、转录文本和评分回合中构建评估工具，以检测回归问题并指导产品决策。
- 通过基于证据的测试比较语音供应商和模型，并根据结果做出调整。
- 为生产系统添加指标，包括回合延迟、转录置信度、流失率和每分钟成本。
- 直接与创始人合作，在快速发展的团队中做出技术决策。
我们寻找的人才包括：
- 至少5年构建生产软件的经验，其中至少2年有交付语音、语音或实时音频系统经验。
- 具备构建和交付端到端实时语音流程的经验，包括流式语音识别、LLM轮换、语音合成以及电话或WebRTC。
- 强大的Python或TypeScript技能，并能在两者之间自如工作。
- 具有音频栈的实际操作经验，如LiveKit、Pipecat、Vapi、Twilio Media Streams、Daily或自定义WebSocket实现。
- 具备在帧级别调试音频的经验，包括采样率、编解码器、抖动和语音活动检测阈值。
- 具备构建LLM评估工具的经验，针对现实世界目标优化延迟，并使用评估结果做出产品决策。
- 清晰的英文书面表达能力，适合异步沟通。有语音模型服务或微调、SIP、电话或LLM编排框架经验者优先。
薪酬与福利
年薪96,000美元，无论所在地区。不提供签证赞助。
地点
完全远程，全球任何地方。核心团队重叠时间为UTC时间13:00至17:00。
查看英文原文
ABOUT THE ROLE
As a founding engineer on a small conversational AI team, you will own the real-time voice layer, from incoming speech through AI reasoning to spoken responses. You will help make natural, responsive voice interactions work reliably in production, with a focus on end-to-end latency.
WHAT YOU'LL DO
- Build and own streaming speech-to-text, LLM turn-taking, text-to-speech, and telephony or WebRTC transport.
- Measure and reduce latency, targeting first audio under 800 milliseconds on real calls.
- Address interruptions, barge-in, silence detection, overlapping speech, poor audio, accents, and mid-sentence changes.
- Build an evaluation harness from recorded calls, transcripts, and scored turns to detect regressions and guide product decisions.
- Compare voice providers and models through evidence-based testing, and make changes based on results.
- Instrument production systems for turn latency, transcription confidence, drop-offs, and cost per minute.
- Work directly with founders and make technical decisions in a fast-moving team.
WHAT WE'RE LOOKING FOR
- At least 5 years building production software, including 2 or more years shipping voice, speech, or real-time audio systems.
- Experience building and shipping end-to-end real-time voice pipelines, including streaming speech recognition, LLM turn-taking, speech synthesis, and telephony or WebRTC.
- Strong Python or TypeScript skills and comfort working in both.
- Hands-on experience with an audio stack such as LiveKit, Pipecat, Vapi, Twilio Media Streams, Daily, or a custom WebSocket implementation.
- Experience debugging audio at the frame level, including sample rates, codecs, jitter, and voice activity detection thresholds.
- Experience building LLM evaluation harnesses, optimizing latency against real-world targets, and using evaluation results to make product decisions.
- Clear written English for asynchronous communication. Experience with speech model serving or fine-tuning, SIP, telephony, or LLM orchestration frameworks is a plus.
COMPENSATION & BENEFITS
Compensation is $96,000 USD annually, regardless of location. Visa sponsorship is not available.
LOCATION
Fully remote, anywhere in the world. Core team overlap is 13:00 to 17:00 UTC.