Inference Godo SDK Reference
Last verified 11 Nov 2026
Inference provides a single control plane for managing inference workflows. It includes a Model Catalog where you can view available foundation models, including both DigitalOcean-hosted and third-party commercial models, compare model capabilities and pricing, use routing to match inference requests to the best-fit model, and run inference using serverless or dedicated deployments.
Godo is the official DigitalOcean Go client library. Install it with go get github.com/digitalocean/godo.
The Inference services are:
-
Dedicated Inference: Manage dedicated inference endpoints, including their accelerators, CA certificate, sizes, GPU model configuration, and access tokens. Dedicated Inference is available in public preview. You can opt in from the Feature Preview page.
-
Serverless Inference: Access and use serverless inference models.
-
Batch Inference: Submit and manage asynchronous batch inference jobs.
-
Agent Platform: Build agents with pre-built or custom foundation models, add function and agent routes, and create retrieval pipelines backed by knowledge bases.
For install instructions and quickstart examples, see Godo.