Identify the right model for your use case by filtering available foundation models by capabilities and price.
Inference
Last verified 13 Jul 2026
Inference provides a single control plane for managing inference workflows. It includes a Model Catalog where you can view available foundation models, including both DigitalOcean-hosted and third-party commercial models, compare model capabilities and pricing, use routing to match inference requests to the best-fit model, and run inference using serverless or dedicated deployments.
Test and compare foundation models in the Model Playground.
Send API requests directly to foundation models without creating an AI agent or managing infrastructure.
Deploy open-source and commercial LLMs on dedicated GPUs as an inference endpoint.
Route serverless inference requests to foundation models using rules.
Determine which model best fits your specific use case.
Batch Inference lets you run large collections of LLM requests as a single asynchronous job.
Use to build fully-managed AI agents with knowledge bases for retrieval-augmented generation, multi-agent routing, guardrails, and more.
Latest Updates
23 July 2026
-
We now support prompt caching for Gemma 4 for serverless inference.
-
The server-side model synthesis tool is available in public preview on DigitalOcean Inference. The model synthesis tool is an API-only multi-model tool that runs up to eight analysis models in parallel on the same task, compares their results, and returns one synthesized answer. You can use the model synthesis tool with serverless inference, dedicated inference, and inference routers on the Chat Completions, Responses, and Messages APIs. Opt in from the Feature Preview page. For more information, see Use Server-Side Tools.
-
The following OpenAI model is deprecated from DigitalOcean Inference as of 23 July 2026:
Migrate to GPT-5.3-Codex (
openai-gpt-5.3-codex) to avoid service disruption. For information on our model deprecation policy and recommended replacement models, see Model Support Policy.
15 July 2026
-
The Gradient AI TypeScript SDK is deprecated. Use the official DigitalOcean TypeScript SDK (DoTs) or the DigitalOcean API directly. For installation and quickstart examples, see SDK and Client Libraries.
-
The Gradient AI Python SDK is deprecated. Use the official DigitalOcean Python SDK (PyDo) or the DigitalOcean API directly. For installation and quickstart examples, see SDK and Client Libraries.
-
The Gradient AI Go Library is deprecated. Use the official DigitalOcean Go SDK (Godo) or the DigitalOcean API directly. For installation and quickstart examples, see SDK and Client Libraries.
10 July 2026
-
The following OpenAI models are now available on DigitalOcean Inference for serverless inference:
For more information, see the Available Models page.
For more information, see the full release notes.