---
title: Run Telnyx Voice AI with Any OpenAI-Compatible LLM
canonical: https://telnyx.com/release-notes/enable-custom-llm-for-telnyx-assistants
---
# Run Telnyx Voice AI with Any OpenAI-Compatible LLM

[Release notes](https://telnyx.com/release-notes)

# Enable Custom LLMs for Telnyx AI Assistants

### 24, Oct 2025

## What’s new

You can now power your Telnyx AI Assistants with **any OpenAI-compatible chat completions endpoint** including models hosted on AWS Bedrock, Azure OpenAI, Baseten, or your own self-hosted inference servers (vLLM, sglang, TGI, etc.).

This update adds a **“Use Custom LLM”** option under the **Agent** tab in the [Mission Control Portal](https://portal.telnyx.com). When enabled, your assistant routes all model requests to your chosen endpoint while Telnyx continues to handle real-time voice orchestration, speech recognition, and synthesis.

## Why it matters

Many enterprises already run fine-tuned or region-specific models and need to keep inference within their own infrastructure or compliance boundaries. This feature removes that blocker, letting you bring your own model without rebuilding the voice stack.

You can now:

* Run inference on your preferred cloud or GPU cluster.
* Maintain data residency and compliance control.
* Use fine-tuned or proprietary models with Telnyx voice AI.

## How to use it

1. Go to **Mission Control → AI Assistants → Agent**.
2. Check **Use Custom LLM**.
3. Enter your model’s **Base URL** and create an **Integration Secret** for the API key.
4. Optionally validate the connection and save.

The only requirement: your endpoint must support the OpenAI `/v1/chat/completions` spec.

## Learn more

📘 [Using a Custom LLM - Developer Docs](https://developers.telnyx.com/docs/inference/ai-assistants/custom-llm/)

[Start building](https://telnyx.com/sign-up)

### Ask AI

* [![GPT](https://d2efw2akbx8gaf.cloudfront.net/https://dotcom-payload-assets-prod.s3.us-east-1.amazonaws.com/cms-media/chatgpt_icon-ea55e09d.jpeg?width=92&format=webp)](https://chat.openai.com/?q=What makes Telnyx's global network different, breakdown call quality for normal phone calls and voice AI calls.)
* [![Claude](https://d2efw2akbx8gaf.cloudfront.net/https://dotcom-payload-assets-prod.s3.us-east-1.amazonaws.com/cms-media/claude_icon-c7c8eef3.webp?width=92&format=webp)](https://claude.ai/new?q=What makes Telnyx's global network different, breakdown call quality for normal phone calls and voice AI calls.)
* [![Perplexity](https://d2efw2akbx8gaf.cloudfront.net/https://dotcom-payload-assets-prod.s3.us-east-1.amazonaws.com/cms-media/perplexity_icon-cd5b74f1.webp?width=92&format=webp)](https://www.perplexity.ai/search?q=What makes Telnyx's global network different, breakdown call quality for normal phone calls and voice AI calls.)
* [![Gemini](https://d2efw2akbx8gaf.cloudfront.net/https://dotcom-payload-assets-prod.s3.us-east-1.amazonaws.com/cms-media/gemini_icon-4ff1cbf4.webp?width=92&format=webp)](https://www.google.com/search?udm=50&aep=11&q=What makes Telnyx's global network different, breakdown call quality for normal phone calls and voice AI calls.)
* [![Grok](https://d2efw2akbx8gaf.cloudfront.net/https://dotcom-payload-assets-prod.s3.us-east-1.amazonaws.com/cms-media/grok_icon-e588e5bd.webp?width=92&format=webp)](https://x.com/i/grok?text=What makes Telnyx's global network different, breakdown call quality for normal phone calls and voice AI calls.)