DigitalOcean Evaluations Pricing
Last verified 12 Oct 2026
DigitalOcean Evaluations measure model, Inference Router, and agent performance using dataset evaluations and simulations.
DigitalOcean Evaluations charges depend on the models and inference resources used during an evaluation.
Dataset Evaluation Pricing
Dataset evaluations can use a model, Inference Router, or supported agent as the candidate.
Evaluations that use candidate models deployed on Serverless Inference are charged at the same token rates as serverless inference. Judge model usage is charged at the applicable model token rates.
Candidate models deployed on Dedicated Inference don’t incur additional evaluation-specific token charges.
Multi-turn dataset evaluations don’t use a candidate model because the responses being evaluated are already included in the dataset. Judge model usage still applies.
Simulation Pricing public
Simulations don’t have a per-run charge. Instead, you pay for the tokens that the simulation’s models use and for the agent you evaluate:
- User simulator and judge models: Input and output tokens are charged at the same token rates as serverless inference, and appear on your invoice as Evaluations token usage. The evaluation configuration displays the input and output token pricing for each available model. Tokens used before a run fails or is cancelled are charged.
- Scenario generation: When you generate a scenario set from a goal, the generation model’s tokens are charged at the model’s token rates, whether or not you use the scenario set in a run.
- Agent under test: The agent’s side of the generated conversations is charged as Harness Runtime usage, the same as other managed agent sessions. This applies to managed agents and to agents that the simulation creates from a model or Inference Router.
Storage
Storage for evaluation datasets and results is currently provided at no additional charge. DigitalOcean may introduce or modify storage fees in the future.