voice-ai-engine-development – Agents & Automation skill for AI agents

Voice AI Engine Development

Detailed Guide

Read [the detailed guide](references/detailed-guide.md) before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely.

When to Use This Skill

Use this skill when:

• Building real-time voice conversation systems
• Implementing voice assistants or chatbots
• Creating voice-enabled customer service agents
• Developing voice AI applications with interrupt capabilities
• Integrating multiple transcription, LLM, or TTS providers
• Working with streaming audio processing pipelines
• The user mentions Vocode, voice engines, or conversational AI

Limitations

• Use this skill only when the task clearly matches the scope described above.
• Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
• Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.

Example

Design a local synthetic-audio worker pipeline, verify cancellation and queue pressure offline, then separately implement and test explicitly selected provider adapters. Do not infer a working microphone or vendor connection from the mocks.

Data and execution boundaries

Obtain authorization for recording and each external audio/text destination, disclose retention and cost, and use synthetic audio for initial tests. Keep secrets out of code and logs, do not log raw transcripts by default, bound session duration/queues/history, and protect authenticated WebSocket upgrades before deployment. Voice cloning requires rights and the speaker’s consent.