LiveKit Agents

Active
GitHub Python Apache-2.0

Description

LiveKit Agents is LiveKit's real-time voice and multimodal agent framework for phone, assistant, and interactive use cases that need low-latency experiences.

Key Features

  • Flexible STT/LLM/TTS/Realtime API integrations — mix and match providers per use case
  • Semantic turn detection using a transformer model to reduce user interruptions
  • Native MCP support — integrate MCP server tools with one line of code
  • Telephony integration via LiveKit SIP stack for phone call agents
  • Built-in job scheduling and dispatch APIs to connect end users to agents
  • Fully open-source stack including LiveKit WebRTC media server

Use Cases

💡 Real-time voice assistants with low-latency speech-to-speech interaction
💡 Multi-agent handoff workflows for customer service and IVR systems
💡 Telephony bots that make and receive phone calls via SIP integration
💡 Multimodal agents that see, hear, and understand in real time
💡 Building and testing voice AI applications with the built-in test framework

Quick Start

pip install 'livekit-agents[openai,silero,deepgram,cartesia,turn-detector]' && export LIVEKIT_URL=<url> LIVEKIT_API_KEY=<key> LIVEKIT_API_SECRET=<secret> && python my_agent.py start

Related Projects

Related Articles