--- title: LLM Library | Choose 20+ open source large language models canonical: https://telnyx.com/products/llm-library --- # LLM Library | Choose 20+ open source large language models # LLM Library for Voice AI Run leading proprietary and open-source LLMs, text-to-speech, and voice AI on low-latency infrastructure built for natural human + AI conversations. [Start building](https://telnyx.com/sign-up)[GET Available Models](https://developers.telnyx.com/api-reference/chat/get-available-models) **ABOUT** ## Deploy models on a network built for natural conversational AI Telnyx operates GPU infrastructure across our owned-and-operated network spanning 100+ PoPs globally. We peer directly with major ISPs and cloud providers at IXPs, eliminating multiple network hops. Deploy models from OpenAI, Anthropic, Meta, Mistral, and more, on the same platform you use for voice, messaging, and connectivity. One vendor, one network, one bill. ## Explore Our LLM Library Discover the power and diversity of large language models available with Telnyx. Explore the options below to find the perfect model for your project. ### DeepSeek-V4-Flash-0731 OrganizationTelnyx Model NameDeepSeek-V4-Flash-0731 Taskstext generation Languages SupportedEnglish Context Length1,048,576 Parameters284.0B Model Tierunlisted Licensemit ### DeepSeek-V4.1-Flash ### gemma-2b-it ### gemma-4-26B-A4B-it ### gemma-4-31B-it ### Llama-3.3-70B-Instruct ### Meta-Llama-3.1-70B-Instruct ### Meta-Llama-3.1-8B-Instruct ### MiniMax-M2.7 ### MiniMax-M3-MXFP8 ### Kimi-K2.5 ### Kimi-K2.6 ### Kimi-K3 ### personaplex-7b-v1 ### Laguna-S-2.1 ### Qwen3-235B-A22B ### Qwen3.8-27B ### GLM-5.1-FP8 ### GLM-5.2 ### GLM-5.3 ### GLM-5.3-Flash ### claude-haiku-4-5 ### gemini-2.5-flash ### gemini-3.7-flash ### gpt-oss-120b ### gpt-4.1 ### gpt-4o ### gpt-4o-mini ### gpt-5 ### gpt-5.1 ### gpt-5.2 ### gpt-5.4 ### gpt-5.4-mini ### gpt-5.6-luna ### gpt-5.6-sol ### gpt-live-1 | Organization | Model Name | Tasks | Languages Supported | Context Length | Parameters | Model Tier | License | | ------------ | ----------------------------------------------------------------------- | ---------------- | ------------------- | -------------- | ---------- | ---------- | ------------------------- | | Telnyx | DeepSeek-V4-Flash-0731 | text generation | English | 1,048,576 | 284.0B | unlisted | mit | | Telnyx | DeepSeek-V4.1-Flash | text generation | English | 1,048,576 | 552.0B | small | mit | | google | [gemma-2b-it](https://telnyx.com/llm-library/gemma-2b-it) | text generation | English | 8,192 | 2.5B | small | gemma | | google | gemma-4-26B-A4B-it | text to-text | Multilingual | 262,144 | 25.8B | small | apache-2.0 | | google | gemma-4-31B-it | text generation | Multilingual | 131,072 | 30.7B | small | apache-2.0 | | meta-llama | [Llama-3.3-70B-Instruct](https://telnyx.com/llm-library/llama-3.3-70b-instruct) | text generation | Multilingual | 99,000 | 70.6B | large | llama3.3 | | meta-llama | [Meta-Llama-3.1-70B-Instruct](https://telnyx.com/llm-library/meta-llama-3-1-70b-instruct) | text generation | Multilingual | 99,000 | 70.6B | large | llama3.1 | | meta-llama | [Meta-Llama-3.1-8B-Instruct](https://telnyx.com/llm-library/meta-llama-3.1-8b-instruct) | text generation | Multilingual | 131,072 | 8.0B | small | llama3.1 | | minimaxai | MiniMax-M2.7 | text generation | Multilingual | 200,000 | 0 | large | minimaxai | | minimaxai | MiniMax-M3-MXFP8 | text generation | Multilingual | 1,000,000 | 428.0B | small | minimax-community | | moonshotai | [Kimi-K2.5](https://telnyx.com/llm-library/kimi-k2.5) | text generation | Multilingual | 256,000 | 1.0T | large | modified-mit | | moonshotai | Kimi-K2.6 | text generation | Multilingual | 262,144 | 1.0T | medium | modified-mit | | moonshotai | Kimi-K3 | text generation | English | 1,000,000 | 2.8M | large | MIT Modified | | nvidia | personaplex-7b-v1 | speech to-speech | English | 3,000 | 7.0B | small | nvidia-open-model-license | | poolside | Laguna-S-2.1 | text generation | English | 1,048,576 | 117.6B | unlisted | OpenMDW-1.1 | | Qwen | [Qwen3-235B-A22B](https://telnyx.com/llm-library/qwen3-235b-a22b) | text generation | English | 32,768 | 235.1B | large | apache-2.0 | | Telnyx | Qwen3.8-27B | text generation | English | 262,144 | 27.0B | small | Apache 2.0 | | zai-org | GLM-5.1-FP8 | text generation | Multilingual | 202,752 | 753.9B | large | mit | | zai-org | GLM-5.2 | text generation | English | 1,000,000 | 753.9B | medium | MIT | | Telnyx | GLM-5.3 | text generation | English | 1,048,576 | 753.0B | medium | glm-5.3 | | zai-org | GLM-5.3-Flash | text generation | English | 1,048,576 | 320.0B | small | mit | | anthropic | [claude-haiku-4-5](https://telnyx.com/llm-library/claude-haiku-4-5) | text generation | Multilingual | 400,000 | 0 | large | openai | | google | [gemini-2.5-flash](https://telnyx.com/llm-library/gemini-2.5-flash) | text generation | Multilingual | 400,000 | 0 | large | openai | | google | gemini-3.7-flash | text generation | Multilingual | 400,000 | 0 | large | openai | | groq | [gpt-oss-120b](https://telnyx.com/llm-library/gpt-oss-120b) | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-4.1 | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | [gpt-4o](https://telnyx.com/llm-library/gpt-4-omni) | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | [gpt-4o-mini](https://telnyx.com/llm-library/gpt-4o-mini) | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-5 | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-5.1 | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | [gpt-5.2](https://telnyx.com/llm-library/gpt-5.2) | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-5.4 | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-5.4-mini | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-5.6-luna | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-5.6-sol | text generation | Multilingual | 400,000 | 0 | large | openai | | openai | gpt-live-1 | speech to-speech | Multilingual | 400,000 | 0 | large | openai | ## INFRA AT THE EDGE ## AI on Telecom Infrastructure Deploy OpenAI, Anthropic, Meta, and open-source models on the same carrier-grade infrastructure handling your voice and messaging traffic. 50+ ## models available ## Limitless potential Build your entire RAG pipeline on a single AI platform, and focus on what you do best 1 ## platform HOW IT WORKS ## Selecting LLMs for Voice AI [GET Available Models](https://developers.telnyx.com/api-reference/chat/get-available-models) ### Create an account Create a [Telnyx account](https://telnyx.com/sign-up) with a valid business email address. ### Create an AI Assistant Navigate to [Voice AI Assistants](https://portal.telnyx.com/#/ai/assistants) and click **Create New Assistant** ### Enter your API key If you’re using a proprietary model, you’ll need your API key before prompting the LLM. Our vast selection of OS models allow you to get started right away. ### Prompt the LLM Navigate back to your AI Assistant and click **Agent**. Click the **Model** dropdown and select a model. Step 1/4 **RESOURCES** ## Get started Check out our helpful tools to help get you started. * ### Test in the portal Easily browse and select your preferred model in the AI Playground. [Test today](https://portal.telnyx.com/#/ai/assistants) * ### Explore the docs Don’t wait to scale, start today with our public API endpoints. [Get started](https://developers.telnyx.com/api-reference/assistants/list-assistants) * ### Stay up to date Keep an eye on our AI changelog so you don't miss a beat. [See updates](https://telnyx.com/release-notes) ## Sign up and start building [Sign up](https://telnyx.com/sign-up)[Contact sales](https://telnyx.com/contact-us) **Resources, Docs, Support** ## LLMs for High-Def Voice AI * ### Inference API Quickstart | Telnyx Introduction [Read more](https://developers.telnyx.com/docs/inference/getting-started) * ### AI Playground Quickstart | Telnyx Tutorial for AI Playground Quickstart. Start building on Telnyx today. [Read more](https://developers.telnyx.com/docs/inference/quickstart) * ### Function Calling | Telnyx In this tutorial, you'll learn how to connect large language models to external tools using our chat completions API. This includes: [Read more](https://developers.telnyx.com/docs/inference/functions) * ### Dynamic Variables | Telnyx Dynamic variables let you configure a template for your agent's behavior. You can re-use the same general instructions while dynamically personalizing every conversation your agent has. [Read more](https://developers.telnyx.com/docs/inference/ai-assistants/dynamic-variables) * ### Embeddings | Telnyx In this tutorial, you'll learn how to: [Read more](https://developers.telnyx.com/docs/inference/embeddings) * ### Inference APIs | Telnyx Incorporate AI into your applications with ease. [Read more](https://developers.telnyx.com/api/inference) * ### Get available models API | Telnyx This endpoint returns a list of Open Source and OpenAI models that are available for use. **Note**: Model `id`'s will be in the form `{source}/{model_name}`. For example `openai/gpt-4` or `mistralai/Mistral-7B-Instruct-v0.1` consistent with HuggingFace naming conventions. [Read more](https://developers.telnyx.com/api/inference/inference-embedding/get-models-public-models-get) * ### Create a chat completion API | Telnyx Chat with a language model. This endpoint is consistent with the [OpenAI Chat Completions API](https://platform.openai.com/docs/api-reference/chat) and may be used with the OpenAI JS or Python SDK. [Read more](https://developers.telnyx.com/api/inference/inference-embedding/chat-public-chat-completions-post) * ### Embed documents API | Telnyx Perform embedding on a Telnyx Storage Bucket using the a embedding model. [Read more](https://developers.telnyx.com/api/inference/inference-embedding/post-embedding) * ### List assistants API | Telnyx Retrieve a list of all AI Assistants configured by the user. [Read more](https://developers.telnyx.com/api/inference/inference-embedding/get-assistants-public-assistants-get) * ### Your guide to the 6 best open-source LLMs in 2025 Explore the best open-source LLMs of 2025 in this comprehensive guide. Learn about top models, features, and how to choose the right one for your needs. [Read more](https://telnyx.com/resources/best-open-source-llms) * ### What is an open-source LLM? Definition and applications Learn how using open-source LLMs can improve your AI applications by making them smarter, more flexible, and better suited to your needs. [Read more](https://telnyx.com/resources/what-is-open-source-llm) * ### What are open-source language models in AI? Learn how open-source language models have influenced AI development and how you can leverage them to create innovative AI applications. [Read more](https://telnyx.com/resources/open-source-language-models-ai) * ### Build on the Telnyx AI Platform to create next-gen apps Explore how the Telnyx AI Platform can elevate your next-gen applications with ease, speed, and flexibility. Discover what sets Telnyx apart. [Read more](https://telnyx.com/resources/telnyx-ai-platform) * ### How to use inference APIs to drive AI adoption Inference APIs drive AI adoption by enabling real-time applications, multimodal systems, and personalized solutions with speed and scalability. [Read more](https://telnyx.com/resources/inference-api-ai-adoption) * ### Telnyx Blog | CPaas & UCaaS Resources Find data-driven research, comprehensive guides and all things SIP trunking, voice and SMS APIs, wireless and more. [Read more](https://telnyx.com/resources/topic/inference) * ### What is machine learning inference? You’ve heard of AI, but have you heard of machine learning inference? Learn what ML inference is and how you can apply it to innovate in your industry. [Read more](https://telnyx.com/resources/machine-learning-inference) * ### How AI-powered voice tools elevate customer conversations Learn how voice AI is changing customer communication, improving efficiency, and reducing costs. [Read more](https://telnyx.com/resources/enhance-voice-solutions-with-ai) * ### What is open-source AI? - Telnyx Explore the many advantages of open-source AI, such as increased accessibility, cost savings, and agility. [Read more](https://telnyx.com/resources/what-is-open-source-ai) * ### The evolution of AI systems infrastructure AI systems are changing the world. But where did these systems originate from, and where are they headed next? [Read more](https://telnyx.com/resources/evolution-ai-infrastructure) * ### The Better Twilio Alternative - Telnyx Switch to Telnyx for a better Twilio alternative. Benefit from our competitive pricing, private global network, and award-winning support. [Read more](https://telnyx.com/the-better-twilio-alternative) * ### Top 5 Twilio Verify API alternatives Looking for the best verification API for your business? Don’t just default to Twilio Verify API. Consider some of these great options instead. [Read more](https://telnyx.com/resources/twilio-verify-api-alternatives) * ### What is Telnyx? | Telnyx Help Center Wondering exactly what Telnyx is? Here we will give you a brief overview so you can determine if we are the right solution for you. [Read more](https://support.telnyx.com/en/articles/1130637-what-is-telnyx) * ### Getting Started | Telnyx Help Center Get Started with a Mission Control Account. Start building on Telnyx today. [Read more](https://support.telnyx.com/en/collections/1512966-getting-started) * ### General - Telnyx Portal & Account | Telnyx Help Center Discover Telnyx's Mission Control for account management, billing, and more. [Read more](https://support.telnyx.com/en/collections/133094-general-telnyx-portal-account) * ### Specifications | Telnyx Help Center Telnyx's technical specs: Whitelisting, SIP protocols, STUN server, DTMF, and more. [Read more](https://support.telnyx.com/en/collections/1513300-specifications) * ### Telnyx SMS Guide | Telnyx Help Center Here you will find a collection of links that will explain how to build applications using our SMS offering. [Read more](https://support.telnyx.com/en/collections/133103-telnyx-sms-guide) * ### Telnyx Flow | Telnyx Help Center Your one stop shop and user interface for controlling your Telnyx workflows [Read more](https://support.telnyx.com/en/collections/9526270-telnyx-flow) * ### AI and Machine Learning \[Use Cases\] See how AI and machine learning can enhance your projects. Explore Telnyx use cases today. [Read more](https://telnyx.com/use-cases/ai-and-machine-learning) * ### Conversational AI \[Integration\] Use Cases Boost engagement and efficiency through Telnyx's Conversational AI. Start integrating now. [Read more](https://telnyx.com/use-cases/conversational-ai) [Start building](https://telnyx.com/sign-up)