What is an LLM API?

An LLM API lets your application send a conversation, as a list of messages and on many models with images, video or documents, to a large language model and receive its generated text. You choose the model per request, and usage is counted in input and output tokens.

Model types

What an LLM API does

A large language model (LLM) is a model trained to read and write text. An LLM API makes that model available over HTTPS: your application sends a request with a model ID and a list of messages, and the API returns the model's reply. Each message has a role. A system message sets standing instructions, user messages carry the person's input, and assistant messages hold earlier replies, so the model sees the conversation it is continuing.

Many text models accept more than text. Depending on the model, a message can include images, video, audio or documents, and the model answers in text. Models read and write text as tokens, and the context window limits how many tokens one request can hold. Context windows differ by model, and some text models accept 1M tokens.

How a request works

You send a POST request with your API key in the Authorization header. The body names the model and the messages, plus optional settings such as max_tokens, temperature or tools. The response contains the reply and a usage object that counts the input and output tokens of the request.

The API does not remember earlier requests. To continue a conversation, send the previous messages again together with the new one. To show a long reply while it is being written, set stream to true: the reply arrives as Server-Sent Events, a few tokens at a time, and the usage arrives at the end of the stream.

What developers build with LLM APIs

  • Assistants and support chat. Answer questions inside your product, following your own instructions.
  • Summaries and extraction. Condense documents, transcripts and emails, or pull fields out of them as JSON with structured output.
  • Agents. With function calling, the model asks your code to run a function, such as a database lookup, and uses the result in its answer.
  • Coding. Generate, explain and review code, or run a coding agent in your editor.
  • Answers from your own content. Find relevant passages with an embeddings API and include them in the prompt.

What to compare between text models

  • Quality on your task. Run the same prompts through a few candidates and read the answers. Side-by-side model comparisons help narrow the list.
  • Reasoning. A reasoning model works through a problem before it answers. This helps with math, planning and code, but takes longer and produces more output tokens. Many models let you set the reasoning effort or a thinking budget.
  • Context window. Long documents, large codebases and long chat histories need a large window.
  • Inputs and features. Check whether the model reads images, video, audio or documents, and whether it supports tool calling, structured output or web search.
  • Speed. The time to the first token and the output speed decide how quickly a chat interface responds.
  • Price. Most text models are billed per million input tokens and per million output tokens, and output tokens often cost more. Some models bill cached input at a lower rate (see prompt caching), and some also run through the Batch API for large jobs that do not need an immediate answer (see batch inference).

Try and call a text model on EmpirioLabs AI

Browse the text models, then open the Playground to chat with one before you write code. To call a model from your application, create an API key in the dashboard and send a request to https://api.empiriolabs.ai/v1/chat/completions. Most text models also accept the request formats of /v1/responses and /v1/messages. The chat endpoint is OpenAI-compatible, so an existing OpenAI SDK integration works once you change the base URL and the key.

The getting started guide walks through a first request. A response that needs more time than an HTTP request allows can run over the WebSocket mode for long responses.

Pay as you go, or choose a plan with weekly allowances. Each model's current rates are on the pricing page.

Text Generation models on EmpirioLabs AI

74 models, cheapest first where they share a billing unit. Each model's page has its full rate card, parameters and code.

Endpoints

POST /v1/chat/completions POST /v1/responses POST /v1/messages POST /v1/completions POST /v1/audio/speech POST /v1/audio/speech:stream

Per 1M tokens, by input rate

ModelInputOutput
GLM 4.5 Flash Z.aiFreeFree
GLM 4.6V Flash Z.aiFreeFree
GLM 4.7 Flash Z.aiFreeFree
Qwen3.7 Flash Alibaba Cloud<=32K $0.03 32K-256K $0.10 256K-1M $0.20<=32K $0.13 32K-256K $0.40 256K-1M $0.80
Qwen3.5 4B Alibaba Cloud$0.04$0.07
Nova Micro 1.0 Amazon$0.040$0.16
GLM 4.6V FlashX Z.ai$0.04$0.40
Gemma 4 26B-A4B Google$0.15$0.05$0.50$0.29
Show all 71 models
ModelInputOutput
Qwen3.5 35B-A3B Alibaba Cloud$0.25 <=128K $0.057 $0.25 128K-256K $0.229$2.00 <=128K $0.459 $2.00 128K-256K $1.835
Nova Lite 1.0 Amazon$0.069$0.28
GLM 4.7 FlashX Z.ai$0.07$0.40
Qwen3.6 35B A3B Alibaba Cloud$0.248$0.07$1.485$0.42
GLM 5.3 Flash Z.ai$0.075$0.25
Qwen3.5 27B Alibaba Cloud$0.30 <=128K $0.086 $0.30 128K-256K $0.258$2.40 <=128K $0.688 $2.40 128K-256K $2.064
Qwen3.5 9B Alibaba Cloud$0.10$0.09$0.15$0.13
Qwen3.5 Flash Alibaba Cloud$0.10$0.090$0.40$0.368
Step 3.5 Flash StepFun$0.10$0.30
Step 3.5 Flash 2603 StepFun$0.10$0.30
MiniMax M3.1 Flash MiniMax$0.15$0.1125$0.60$0.45
Qwen3.5 122B-A10B Alibaba Cloud$0.40 <=128K $0.115 $0.40 128K-256K $0.287$3.20 <=128K $0.917 $3.20 128K-256K $2.294
Seed 2.0 Mini ByteDance<=128K $0.12 128K-256K $0.24<=128K $0.50 128K-256K $1.00
MiMo V2.6 Flash Xiaomi$0.14$0.28
Mistral Small 4 Mistral AI$0.15$0.60
Qwen3.8 Flash Alibaba Cloud$0.16$0.47
Qwen3.8 27B Alibaba Cloud$0.45$0.17$3.20$0.50
Qwen3.5 397B-A17B Alibaba Cloud$0.60 <=128K $0.172 $0.60 128K-256K $0.43$3.60 <=128K $1.032 $3.60 128K-256K $2.58
DeepSeek V4.1 Flash 1017 DeepSeek$0.20$0.80
Muse Glimmer 30B Meta AI$0.35$0.20$1.50$0.80
Step 3.7 Flash StepFun$0.20$1.15
MiniMax M3 MiniMax$0.30 <=512K $0.225 $0.60 >512K $0.45$1.20 <=512K $0.90 $2.40 >512K $1.80
Qwen3.6 Flash Alibaba Cloud<=256K $0.25 256K-1M $1.00<=256K $1.50 256K-1M $4.00
Qwen3.8 Omni Flash Alibaba Cloud$0.30$0.94
Seed 2.0 Lite ByteDance<=128K $0.31 128K-256K $0.62<=128K $2.50 128K-256K $5.00
Qwen3.5 Plus Alibaba Cloud$0.40 <=256K $0.36 $0.50 256K-1M $0.45$2.40 <=256K $2.21 $3.00 256K-1M $2.76
Nova Lite 2 Amazon$0.38$3.16
Qwen3.7 Plus Alibaba Cloud<=256K $0.40 256K-1M $1.20<=256K $1.60 256K-1M $4.80
Seed 2.0 Code ByteDance<=128K $0.40 128K-256K $0.80<=128K $2.40 128K-256K $4.80
Qwen3.6 27B Alibaba Cloud$0.60$0.412564$3.60$2.475384
DeepSeek V4 Flash 0731 DeepSeek$0.424$1.272
MiMo V2.6 Pro Xiaomi$0.435$0.87
Qwen3.6 Plus Alibaba Cloud<=256K $0.50 256K-1M $2.00<=256K $3.00 256K-1M $6.00
Seed 2.1 Turbo ByteDance$0.63$3.13
Seed 2.0 Pro ByteDance<=128K $0.63 128K-256K $1.26<=128K $3.79 128K-256K $7.58
Qwen3.5 Omni Flash Alibaba Cloud$0.80$4.40
GLM 5.1 Z.ai$1.40 <=32K $0.825 $1.40 32K-200K $1.10$4.40 <=32K $3.301 $4.40 32K-200K $3.851
Kimi K2.6 Moonshot AI$0.95$0.8939$4.00$3.7131
Kimi K2.7 Code Moonshot AI$0.95$4.00
Step 5 Preview StepFun$1.00$2.70
Muse Spark 1.1 Meta AI$1.25$4.25
Muse Spark 1.2 Meta AI$1.25$4.25
Muse Spark 1.3 Meta AI$1.25$4.25
DeepSeek V4 Pro 0813 DeepSeek$1.32$3.96
GLM 5.2 Z.ai$1.40$4.40
GLM 5.3 Z.ai$1.40$4.40
StepAudio 2.5 Chat StepFun$1.50$3.50
StepAudio 3 Chat StepFun$1.50$3.50
Qwen4 Max Alibaba Cloud$1.50$4.50
DeepSeek V4 Pro DeepSeek$1.74$1.65$3.48$3.30
Kimi K2.7 Code Highspeed Moonshot AI$1.90$8.00
Fugu Max Sakana AI$2.00$6.00
Qwen3.8 Max Alibaba Cloud$2.00$6.00
Qwen3.8 Max 0902 Alibaba Cloud$2.00$6.00
Kimi K3.1 Pro Moonshot AI$2.00$10.00
Nova Pro 1.0 Amazon$2.40$9.60
Qwen3.7 Max Alibaba Cloud$2.50$7.50
Qwen3.5 Omni Plus Alibaba Cloud$2.80$16.60
Kimi K3 Moonshot AI$3.00$15.00
MiMo V2.6 Pro UltraSpeed Xiaomi$4.35$8.70
Fugu Ultra v1.1 Sakana AI<=272K $5.00 >272K $10.00<=272K $30.00 >272K $45.00
Fugu Ultra v2.0 Sakana AI<=272K $5.00 >272K $10.00<=272K $30.00 >272K $45.00
Fugu Ultra v1.0 Sakana AI<=272K $7.50 >272K $15.00<=272K $45.00 >272K $67.50

Also available: DeepReasoning, Gemma 3 27B, Mistral Small 3.1

Frequently asked questions

What is the difference between an LLM and an LLM API?

An LLM is the trained model. An LLM API is the interface your code calls to send the model a request and receive its output, so you can use the model without running it yourself.

How is an LLM API billed?

Most text models are billed by tokens, with one rate per million input tokens and another per million output tokens, so longer prompts and longer answers cost more. On EmpirioLabs AI you can pay as you go or choose a plan with weekly allowances.

Does an LLM API remember the conversation?

No. Each request stands alone, so you send the earlier messages with every new request. The model's context window limits how much history fits in one request.

What does streaming mean in an LLM API?

With streaming, the API sends the reply in small pieces while the model writes it, instead of one response at the end. Set stream to true on a chat request to receive the reply as Server-Sent Events.

Can I use the OpenAI SDK with EmpirioLabs AI?

Yes. Set the SDK's base URL to https://api.empiriolabs.ai/v1, use your EmpirioLabs AI API key, and pass a model ID from the catalog.

Which Text Generation model costs the least on EmpirioLabs AI?

GLM 4.5 Flash, GLM 4.6V Flash, GLM 4.7 Flash share the lowest input rate of the 71 Text Generation models priced that way. The price table on this page shows each model's lowest rate and what it applies to.

Ready to use better endpoints?

Check out our pricing or reach out if you want your own model deployed on our stack.