How to Create a Dataset Evaluation
Create and run a dataset evaluation to measure the performance of a model, Inference Router, or supported agent against a fixed evaluation dataset.
DigitalOcean Evaluations How-Tos
Generated on 13 Oct 2026
DigitalOcean Evaluations measure model, Inference Router, and agent performance using dataset evaluations and simulations.
Manage Dataset Evaluations
How to Create, Upload, and Manage an Evaluation Dataset
Create, format, upload, preview, download, and delete single-turn and multi-turn evaluation datasets.
How to Compare DigitalOcean Evaluations
Compare evaluation results, configurations, metrics, token usage, latency, and per-entry outputs.
Manage Simulations
How to Create a Simulation
Create and run a simulation to test agent behavior across generated, multi-turn conversations.
How to Generate and Manage a Scenario Set
Generate, upload, import, preview, edit, download, duplicate, rename, and delete scenario sets for simulations using the Control Panel or the API.