DigitalOcean Evaluations Reference

Last verified 12 Oct 2026

DigitalOcean Evaluations measure model, Inference Router, and agent performance using dataset evaluations and simulations.

The DigitalOcean API

The DigitalOcean API lets you manage resources programmatically with standard HTTP requests. All actions available in the control panel are also available through the API.

The Agent Platform API includes the endpoints for evaluation datasets, evaluation runs, scenario sets, the Common Scenario & Goal Library, and simulation runs.

The DigitalOcean Command Line Client, doctl

doctl is the command-line interface for the DigitalOcean API. It supports most of the same actions available in the API and DigitalOcean Control Panel.

The doctl evaluation commands manage dataset evaluations and simulations:

  • Dataset: Create, list, and delete evaluation datasets.

  • Model run: Create, list, update, cancel, and delete evaluation runs, and get a download URL for run results.

  • Metric and custom metric: List built-in evaluation metrics, and create, update, and delete custom metrics.

  • Preset: List, get, and delete evaluation presets.

  • Scenario set: Create, generate, list, update, and delete scenario sets, and list their scenarios.

  • Scenario library: Browse library entries and their scenarios, and import an entry as a scenario set.

  • Simulation run: Create, list, update, cancel, and delete simulation runs, and get their episodes and trajectories.

See the doctl documentation or run a command with --help for more information.

The DigitalOcean MCP Server

The DigitalOcean Evaluations MCP tools let you use natural language prompts to manage evaluation datasets, run evaluations against agent deployments, and monitor results.

We can't find any results for your search.

Try using different keywords or simplifying your search terms.