Identify the right model for your use case by filtering available foundation models by capabilities and price.
Inference
Last verified 13 Jul 2026
Inference provides a single control plane for managing inference workflows. It includes a Model Catalog where you can view available foundation models, including both DigitalOcean-hosted and third-party commercial models, compare model capabilities and pricing, use routing to match inference requests to the best-fit model, and run inference using serverless or dedicated deployments.
Test and compare foundation models in the Model Playground.
Send API requests directly to foundation models without creating an AI agent or managing infrastructure.
Deploy open-source and commercial LLMs on dedicated GPUs as an inference endpoint.
Route serverless inference requests to foundation models using rules.
Determine which model best fits your specific use case.
Batch Inference lets you run large collections of LLM requests as a single asynchronous job.
Use to build fully-managed AI agents with knowledge bases for retrieval-augmented generation, multi-agent routing, guardrails, and more.
Latest Updates
27 August 2026
-
The following Z.ai model is now available on DigitalOcean Inference for serverless inference, Agent Development Kit, and agents:
For more information, see the Available Models page.
20 August 2026
-
Qwen3.8-2.4T-A95B model available on DigitalOcean Inference has been upgraded to Qwen3.8-Max. Qwen3.8-Max supports vision and video input and a 1M-token context window. For more information, see the Available Models page.
19 August 2026
-
Inference Router now uses cache-aware routing to maximize prompt cache reuse and automatically applies prompt caching to eligible Anthropic requests. You can opt out of prompt caching for supported models with
X-Model-Affinity: noneand control cache-aware model switching with thex-routing-max-switch-spend-pctheader. For more information, see Use Prompt Caching.
For more information, see the full release notes.