You can now power your Telnyx AI Assistants with any OpenAI-compatible chat completions endpoint including models hosted on AWS Bedrock, Azure OpenAI, Baseten, or your own self-hosted inference servers (vLLM, sglang, TGI, etc.).
This update adds a “Use Custom LLM” option under the Agent tab in the Mission Control Portal. When enabled, your assistant routes all model requests to your chosen endpoint while Telnyx continues to handle real-time voice orchestration, speech recognition, and synthesis.
Many enterprises already run fine-tuned or region-specific models and need to keep inference within their own infrastructure or compliance boundaries. This feature removes that blocker, letting you bring your own model without rebuilding the voice stack.
You can now:
Run inference on your preferred cloud or GPU cluster.
Maintain data residency and compliance control.
Use fine-tuned or proprietary models with Telnyx voice AI.
The only requirement: your endpoint must support the OpenAI /v1/chat/completions spec.
