---
title: Evaluations Release Notes
product: Release Notes
url: https://docs.digitalocean.com/release-notes/evaluations/
last_updated: "2026-10-12"
---

> **For AI agents:** The documentation index is at [https://docs.digitalocean.com/llms.txt](https://docs.digitalocean.com/llms.txt). Markdown versions of pages use the same URL with `index.html.md` in place of the HTML page (for example, append `index.html.md` to the directory path instead of opening the HTML document).

# Evaluations Release Notes

## October 2026

### 12 October

- [Simulation](https://docs.digitalocean.com/products/evaluations/how-to/create-simulation/index.html.md) is now available in [public preview](https://docs.digitalocean.com/platform/product-lifecycle/index.html.md#public-preview). Simulation tests agent behavior through generated, multi-turn conversations using scenario sets, user simulator models, judge models, and conversational metrics.

## June 2026

### 30 June

- The following agent evaluation metrics are deprecated and should no longer be used:

  - Tone
  - Retrieved Chunk Usage
  - Prompt Perplexity

  Use the currently supported metrics listed in [Agent Evaluation Metrics](https://docs.digitalocean.com/products/inference/reference/agent-evaluation-metrics/index.html.md) instead. To monitor deployed agent behavior outside of evaluations, use [Agent Metrics and Runtime Logs](https://docs.digitalocean.com/products/inference/how-to/view-agent-observability/index.html.md).
- Agent evaluations support for the Agent Development Kit (ADK), previously in preview, is now removed.

  To evaluate agents, use [agent evaluations via the DigitalOcean Control Panel](https://docs.digitalocean.com/products/inference/how-to/evaluate-agents/index.html.md) for supported agent types. To monitor ADK agent behavior, use [Agent Metrics and Runtime Logs](https://docs.digitalocean.com/products/inference/how-to/view-agent-observability/index.html.md).
- The Agent Evaluations MCP server tool has been renamed to [Evaluations](https://docs.digitalocean.com/reference/mcp/evaluations-mcp-tools/index.html.md).
- Custom metrics are now available for [DigitalOcean Evaluations](https://docs.digitalocean.com/products/evaluations/how-to/create-dataset-evaluations/index.html.md). You can define your own metrics to evaluate model behavior against criteria specific to your use case.
- [DigitalOcean Evaluations](https://docs.digitalocean.com/products/evaluations/how-to/create-dataset-evaluations/index.html.md) is now generally available. Use Evaluations to create test cases, run evaluation datasets, and measure model performance against selected metrics.
- Presets are now available for [DigitalOcean Evaluations](https://docs.digitalocean.com/products/evaluations/how-to/create-dataset-evaluations/index.html.md). You can save and reuse evaluation configurations, including the candidate model, system prompt, hyperparameters, judge model, and metrics.
- Model Evaluations is now renamed to [DigitalOcean Evaluations](https://docs.digitalocean.com/products/evaluations/how-to/create-dataset-evaluations/index.html.md).

## April 2026

### 28 April

- You can now evaluate models available for serverless inference, inference routers, and dedicated inference deployments using a judge model. Scoring includes metrics such as correctness, completeness, ground truth faithfulness, and safety metrics. This feature is in [public preview](https://docs.digitalocean.com/platform/product-lifecycle/index.html.md#public-preview). You can opt in from the [**Feature Preview** page](https://cloud.digitalocean.com/account/feature-preview). For more information, see [Create a Dataset Evaluation](https://docs.digitalocean.com/products/evaluations/how-to/create-dataset-evaluations/index.html.md).