Inference SDK Reference

Last verified 11 Nov 2026

Inference provides a single control plane for managing inference workflows. It includes a Model Catalog where you can view available foundation models, including both DigitalOcean-hosted and third-party commercial models, compare model capabilities and pricing, use routing to match inference requests to the best-fit model, and run inference using serverless or dedicated deployments.

Copy page as Markdown View page as Markdown

Use the official DigitalOcean client libraries to manage Serverless Inference, Dedicated Inference, Batch Inference, agents, and knowledge bases from code:

  • PyDo (Python): Serverless Inference, Dedicated Inference, Agent Platform, and Agent Inference modules.

  • DoTs (TypeScript): Serverless Inference, Dedicated Inference, Batch Inference, Agent Platform, and Agent Inference modules.

  • Godo (Go): Serverless Inference, Dedicated Inference, Batch Inference, and Agent Platform services.

For client libraries in other languages, see SDK and Client Libraries.

We can't find any results for your search.

Try using different keywords or simplifying your search terms.