LLM Library for Voice AI

Run leading proprietary and open-source LLMs, text-to-speech, and voice AI on low-latency infrastructure built for natural human + AI conversations.

ABOUT

Deploy models on a network built for natural conversational AI

Telnyx operates GPU infrastructure across our owned-and-operated network spanning 100+ PoPs globally.


We peer directly with major ISPs and cloud providers at IXPs, eliminating multiple network hops. Deploy models from OpenAI, Anthropic, Meta, Mistral, and more, on the same platform you use for voice, messaging, and connectivity. One vendor, one network, one bill.

Explore Our LLM Library

Discover the power and diversity of large language models available with Telnyx. Explore the options below to find the perfect model for your project.

Organizationgoogle
Model Namegemma-2b-it
Taskstext generation
Languages SupportedEnglish
Context Length8,192
Parameters2.5B
Model Tiersmall
Licensegemma

INFRA AT THE EDGE

AI on Telecom Infrastructure

Deploy OpenAI, Anthropic, Meta, and open-source models on the same carrier-grade infrastructure handling your voice and messaging traffic.

50+

models available

Limitless potential

Build your entire RAG pipeline on a single AI platform, and focus on what you do best

1

platform

HOW IT WORKS

Selecting LLMs for Voice AI

RESOURCES

Get started

Check out our helpful tools to help get you started.

  • Icon Resources ebook

    Test in the portal

    Easily browse and select your preferred model in the AI Playground.

  • Icon Resources Docs

    Explore the docs

    Don’t wait to scale, start today with our public API endpoints.

  • Icon Resources Article

    Stay up to date

    Keep an eye on our AI changelog so you don't miss a beat.

Sign up and start building

Resources, Docs, Support

LLMs for High-Def Voice AI

  • Article icon

    Inference API Quickstart | Telnyx

    Introduction

  • Article icon

    AI Playground Quickstart | Telnyx

    Tutorial for AI Playground Quickstart. Start building on Telnyx today.

  • Article icon

    Function Calling | Telnyx

    In this tutorial, you'll learn how to connect large language models to external tools using our chat completions API. This includes:

  • Article icon

    Dynamic Variables | Telnyx

    Dynamic variables let you configure a template for your agent's behavior. You can re-use the same general instructions while dynamically personalizing every conversation your agent has.

  • Article icon

    Embeddings | Telnyx

    In this tutorial, you'll learn how to:

  • Article icon

    Inference APIs | Telnyx

    Incorporate AI into your applications with ease.

  • Article icon

    Get available models API | Telnyx

    This endpoint returns a list of Open Source and OpenAI models that are available for use.

    Note: Model id's will be in the form {source}/{model_name}. For example openai/gpt-4 or mistralai/Mistral-7B-Instruct-v0.1 consistent with HuggingFace naming conventions.

  • Article icon

    Create a chat completion API | Telnyx

    Chat with a language model. This endpoint is consistent with the OpenAI Chat Completions API and may be used with the OpenAI JS or Python SDK.

  • Article icon

    Embed documents API | Telnyx

    Perform embedding on a Telnyx Storage Bucket using the a embedding model.

  • Article icon

    List assistants API | Telnyx

    Retrieve a list of all AI Assistants configured by the user.

  • Article icon

    Your guide to the 6 best open-source LLMs in 2025

    Explore the best open-source LLMs of 2025 in this comprehensive guide. Learn about top models, features, and how to choose the right one for your needs.

  • Article icon

    What is an open-source LLM? Definition and applications

    Learn how using open-source LLMs can improve your AI applications by making them smarter, more flexible, and better suited to your needs.

  • Article icon

    What are open-source language models in AI?

    Learn how open-source language models have influenced AI development and how you can leverage them to create innovative AI applications.

  • Article icon

    Build on the Telnyx AI Platform to create next-gen apps

    Explore how the Telnyx AI Platform can elevate your next-gen applications with ease, speed, and flexibility. Discover what sets Telnyx apart.

  • Article icon

    How to use inference APIs to drive AI adoption

    Inference APIs drive AI adoption by enabling real-time applications, multimodal systems, and personalized solutions with speed and scalability.

  • Article icon

    Telnyx Blog | CPaas & UCaaS Resources

    Find data-driven research, comprehensive guides and all things SIP trunking, voice and SMS APIs, wireless and more.

  • Article icon

    What is machine learning inference?

    You’ve heard of AI, but have you heard of machine learning inference? Learn what ML inference is and how you can apply it to innovate in your industry.

  • Article icon

    How AI-powered voice tools elevate customer conversations

    Learn how voice AI is changing customer communication, improving efficiency, and reducing costs.

  • Article icon

    What is open-source AI? - Telnyx

    Explore the many advantages of open-source AI, such as increased accessibility, cost savings, and agility.

  • Article icon

    The evolution of AI systems infrastructure

    AI systems are changing the world. But where did these systems originate from, and where are they headed next?

  • Article icon

    The Better Twilio Alternative - Telnyx

    Switch to Telnyx for a better Twilio alternative. Benefit from our competitive pricing, private global network, and award-winning support.

  • Article icon

    Top 5 Twilio Verify API alternatives

    Looking for the best verification API for your business? Don’t just default to Twilio Verify API. Consider some of these great options instead.

  • Article icon

    What is Telnyx? | Telnyx Help Center

    Wondering exactly what Telnyx is? Here we will give you a brief overview so you can determine if we are the right solution for you.

  • Article icon

    Getting Started | Telnyx Help Center

    Get Started with a Mission Control Account. Start building on Telnyx today.

  • Article icon

    General - Telnyx Portal & Account | Telnyx Help Center

    Discover Telnyx's Mission Control for account management, billing, and more.

  • Article icon

    Specifications | Telnyx Help Center

    Telnyx's technical specs: Whitelisting, SIP protocols, STUN server, DTMF, and more.

  • Article icon

    Telnyx SMS Guide | Telnyx Help Center

    Here you will find a collection of links that will explain how to build applications using our SMS offering.

  • Article icon

    Telnyx Flow | Telnyx Help Center

    Your one stop shop and user interface for controlling your Telnyx workflows

  • Article icon

    AI and Machine Learning [Use Cases]

    See how AI and machine learning can enhance your projects. Explore Telnyx use cases today.

  • Article icon

    Conversational AI [Integration] Use Cases

    Boost engagement and efficiency through Telnyx's Conversational AI. Start integrating now.