For AI agents: The documentation index is at https://docs.digitalocean.com/llms.txt. Markdown versions of pages use the same URL with index.html.md in place of the HTML page (for example, append index.html.md to the directory path instead of opening the HTML document).
DigitalOcean Inference supports more than 70 foundation, embeddings, and reranking models, including OpenAI (GPT-5.x and open-weight gpt-oss), Anthropic Claude, Meta Llama, DeepSeek, Alibaba Qwen, Moonshot AI Kimi, NVIDIA Nemotron, and Z.ai GLM. All text models are served through OpenAI-compatible endpoints, so you can use an existing OpenAI SDK or client by changing the base URL to https://inference.do-ai.run and authenticating with a DigitalOcean API key. For endpoint details, see Serverless Inference Endpoints.
For pricing information, see the pricing page.
We regularly update our model offerings to provide the most performant and efficient models, and deprecate older models. For information on our model deprecation policy and recommended model replacements, see Model Support Policy.
Models by Provider
The following table summarizes the model providers and model family. For a model’s ID, context window, max output tokens, and supported features, see Foundation Models.
| Provider |
Models |
| Alibaba |
Includes Qwen 3.5 397B A17B, Qwen3-32B, Qwen3 Coder Flash, and Qwen 2.5 14B Instruct, plus the Qwen 3 text-to-speech and Wan text-to-video models. |
| Anthropic |
Includes Claude Fable 5, Claude Sonnet 5.x and 4.x, Claude Opus 4.x, and Claude Haiku 4.x with prompt caching, tool calling, and input context windows of up to 1M tokens on supported models. |
| DeepSeek |
Includes DeepSeek V4 Pro and V4 Flash (with input context windows of up to 1M tokens), DeepSeek V3.2, DeepSeek V3, and DeepSeek R1 Distill Llama 70B. |
| Meta |
Includes Llama 4 Maverick and Llama 3.3 Instruct 70B for serverless or dedicated inference, and Llama 3.1 Instruct 8B for dedicated inference only. |
| Moonshot AI |
Includes Kimi K3, K2.6, and K2.5 for serverless and dedicated inference, with prompt caching. All are multimodal with vision support. |
| NVIDIA |
Includes Nemotron 3 Ultra, Nemotron 3 Super 120B (Public Preview), and the Nemotron Nano models, including the Nano Omni and Nano 12B v2 VL multimodal variants. |
| OpenAI |
Includes GPT-5.6 family (Sol, Terra, and Luna), GPT-5.5, the GPT-5.4 family, GPT-5.3-Codex, GPT-5.2, GPT-5, GPT-4.1, GPT-4o, the o-series reasoning models, and the GPT Image models. The open-weight gpt-oss-120b and gpt-oss-20b models run on DigitalOcean-hosted infrastructure for both serverless and dedicated inference. |
| Additional providers (open and multimodal models) |
Includes Z.ai GLM 5.x, Xiaomi MiMo V2.5, MiniMax M2.5, Google Gemma 4, Mistral and Ministral models, Arcee Trinity Large, and media generation models from Stability AI, fal, and ElevenLabs for image, audio, and video workloads. |
Foundation Models
Inference supports both open source and commercial foundation models. Open source models are generally published by research labs, available under open licenses. Commercial models are proprietary such as OpenAI and Anthropic models. All models are offered using DigitalOcean API access keys, but you can also bring your own provider’s API keys to access the commercial models.
We offer the following foundation models, subject to the AI Model Terms, our Service Terms, and the Terms of Service Agreement.
You can use these models in serverless inference, dedicated inference, inference routers, batch inference, agents, or Agent Development Kit (ADK). See the model-specific usage information below.
Anthropic Models
Anthropic models available on DigitalOcean Inference support tool (function) calling, prompt caching, adaptive thinking, fast mode, dynamic workflows, mid-conversation system messages, and other features. See the usage notes in the following table for details. Refer to the provider documentation for other supported features.
| Model |
Model ID |
Context Window |
Max Output Tokens |
Serverless Inference |
ADK |
Agents |
Usage Notes |
Tentative End-of-Support |
| Claude Fable 5 |
anthropic-claude-fable-5 |
1,000,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens ✔️ Prompt caching ✔️ Tool calling ✔️ Adaptive thinking ℹ️ Requires a mandatory 30-day data retention of prompts and completions for trust and safety reviews. |
|
| Claude Haiku 4.5 |
anthropic-claude-haiku-4.5 |
200,000 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
No sooner than October 2026 |
| Claude Opus 5 |
anthropic-claude-opus-5 |
1,000,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling ✔️ Fast mode ✔️ Adaptive thinking ✔️ Cyber safeguards enabled by default with safety classifiers ℹ️ Thinking is on by default in the API, a breaking change from previous Opus models. To keep it off, set thinking: off. |
|
| Claude Opus 4.8 |
anthropic-claude-opus-4.8 |
1,000,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model ✔️ Input context window of up to 1M tokens ✔️ Prompt caching ✔️ Tool calling ✔️ Fast mode ✔️ Adaptive thinking ✔️ Dynamic workflows ✔️ Mid-conversation system messages |
No sooner than May 2027 |
| Claude Opus 4.7 |
anthropic-claude-opus-4.7 |
200,000 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens (beta) ✔️ Prompt caching ✔️ Tool calling |
No sooner than April 2027 |
| Claude Opus 4.6 |
anthropic-claude-opus-4.6 |
200,000 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens (beta) ✔️ Prompt caching ✔️ Tool calling |
No sooner than February 2027 |
| Claude Opus 4.5 |
anthropic-claude-opus-4.5 |
200,000 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
No sooner than November 2026 |
| Claude Opus 4.1 |
anthropic-claude-4.1-opus |
200,000 |
8,192 |
✔️ |
✔️ |
|
✔️ Prompt caching ✔️ Tool calling |
No sooner than August 2026 |
| Claude Sonnet 5 |
anthropic-claude-5-sonnet |
1,000,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens ✔️ Prompt caching ✔️ Tool (function) calling ✔️ Adaptive thinking (API default: on, effort high) ✔️ Effort levels: low, medium, high, max, x-high |
|
| Claude Sonnet 4.6 |
anthropic-claude-4.6-sonnet |
200,000 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model ✔️ Input context window of up to 1M tokens (beta) ✔️ Prompt caching ✔️ Tool (function) calling |
No sooner than February 2027 |
| Claude Sonnet 4.5 |
anthropic-claude-4.5-sonnet |
200,000 |
Not published |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens (beta) ✔️ Prompt caching ✔️ Tool calling |
No sooner than September 2026 |
Arcee Models
fal Models
| Model |
Model ID |
Type |
Use for |
Usage Notes |
| Fast SDXL |
fal-ai/fast-sdxl |
Image generation |
✔️ Serverless inference ✔️ ADK |
ℹ️ Multimodal and generative model |
| Flux Schnell |
fal-ai/flux/schnell |
Image generation |
✔️ Serverless inference ✔️ ADK |
ℹ️ Multimodal and generative model |
| Stable Audio 2.5 |
fal-ai/stable-audio-25/text-to-audio |
Text-to-audio |
✔️ Serverless inference ✔️ ADK |
ℹ️ Multimodal and generative model |
| Multilingual TTS v2 |
fal-ai/elevenlabs/tts/multilingual-v2 |
Text-to-speech |
✔️ Serverless inference ✔️ ADK |
ℹ️ Multimodal and generative model |
OpenAI Models
OpenAI models available on DigitalOcean Inference support tool (function) calling, prompt caching, and other features. See the usage notes in the following table for details. Refer to the provider documentation for other supported features.
| Model |
Model ID |
Context Window |
Max Output Tokens |
Serverless Inference |
ADK |
Agents |
Usage Notes |
| GPT-5.6 Sol |
openai-gpt-5.6-sol |
1,050,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1.05M tokens ✔️ Only the Chat Completions API for sending prompts for serverless inference ✔️ Prompt caching with explicit breakpoints and 30-minute minimum cache life; cache writes billed at 1.25× uncached input rate; cache reads at 90% discount ✔️ Tool calling ✔️ max reasoning effort ✔️ Cyber safeguards enabled by default with real-time classifiers |
| GPT-5.6 Terra |
openai-gpt-5.6-terra |
1,050,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1.05M tokens ✔️ Only the Chat Completions API for sending prompts for serverless inference ✔️ Prompt caching with explicit breakpoints and 30-minute minimum cache life; cache writes billed at 1.25× uncached input rate; cache reads at 90% discount ✔️ Tool calling |
| GPT-5.6 Luna |
openai-gpt-5.6-luna |
1,050,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1.05M tokens ✔️ Only the Chat Completions API for sending prompts for serverless inference ✔️ Prompt caching with explicit breakpoints and 30-minute minimum cache life; cache writes billed at 1.25× uncached input rate; cache reads at 90% discount ✔️ Tool calling ✔️ ultra mode for subagents |
| GPT-5.5 |
openai-gpt-5.5 |
1,000,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model ✔️ Input context window of up to 1M tokens ✔️ Only the Responses API for sending prompts for serverless inference ✔️ Prompt caching ✔️ Tool calling |
| GPT-5.4 |
openai-gpt-5.4 |
400,000 |
128,000 |
✔️ |
✔️ |
|
✔️ Evaluations judge model ✔️ Input context window of up to 1M tokens (beta) ✔️ Only the Responses API for sending prompts for serverless inference ✔️ Prompt caching ✔️ Tool calling |
| GPT-5.4 mini |
openai-gpt-5.4-mini |
400,000 |
128,000 |
✔️ |
✔️ |
|
✔️ Only the Responses API for sending prompts for serverless inference ✔️ Prompt caching ✔️ Tool calling |
| GPT-5.4 nano |
openai-gpt-5.4-nano |
400,000 |
128,000 |
✔️ |
✔️ |
|
✔️ Only the Responses API for sending prompts for serverless inference ✔️ Prompt caching ✔️ Tool calling |
| GPT-5.4 pro |
openai-gpt-5.4-pro |
1,050,000 |
128,000 |
✔️ |
✔️ |
|
✔️ Evaluations judge model ✔️ Only the Responses API for sending prompts for serverless inference ✔️ Tool calling |
| GPT-5.3-Codex |
openai-gpt-5.3-codex |
400,000 |
128,000 |
✔️ |
✔️ |
|
✔️ Prompt caching ✔️ Tool calling |
| GPT-5.2 |
openai-gpt-5.2 |
400,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| GPT-5.2 pro |
openai-gpt-5.2-pro |
400,000 |
128,000 |
✔️ |
✔️ |
|
✔️ Prompt caching ✔️ Tool calling |
| GPT-5 |
openai-gpt-5 |
400,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| GPT-5 mini |
openai-gpt-5-mini |
400,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| GPT-5 nano |
openai-gpt-5-nano |
400,000 |
128,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| GPT-4.1 |
openai-gpt-4.1 |
1,047,576 |
32,768 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| GPT-4o |
openai-gpt-4o |
128,000 |
16,384 |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model ✔️ Prompt caching ✔️ Tool calling |
| GPT-4o mini |
openai-gpt-4o-mini |
128,000 |
16,384 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| o1 |
openai-o1 |
200,000 |
100,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| o3 |
openai-o3 |
200,000 |
100,000 |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model ✔️ Prompt caching ✔️ Tool calling |
| o3-mini |
openai-o3-mini |
200,000 |
100,000 |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching ✔️ Tool calling |
| GPT Image 1 |
openai-gpt-image-1 |
Not published |
16,384 |
✔️ |
✔️ |
|
✔️ Prompt caching ✔️ Tool calling |
| GPT Image 1.5 |
openai-gpt-image-1.5 |
Not published |
16,384 |
✔️ |
✔️ |
|
|
| GPT Image 2 |
openai-gpt-image-2 |
Not published |
16,384 |
✔️ |
✔️ |
|
|
DigitalOcean-Hosted Models
| Provider |
Model |
Model ID |
Parameters |
Context Window |
Max Output Tokens |
Serverless Inference |
Dedicated Inference |
ADK |
Agents |
Usage Notes |
| Alibaba |
Qwen 2.5 14B Instruct |
qwen-2.5-14b-instruct |
14 billion |
32,768 |
8,192 |
|
✔️ |
|
|
|
| Alibaba |
Qwen3-32B |
alibaba-qwen3-32b |
32.8 billion |
32,768 |
6,554 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model |
| Alibaba |
Qwen3 Coder Flash |
qwen3-coder-flash |
30 billion |
262,144 |
52,429 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching |
| Alibaba |
Qwen 3.5 397B A17B |
qwen3.5-397b-a17b |
397 billion |
131,072 |
26,214 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching. ✔️ Evaluations judge model |
| Alibaba |
Qwen 3 TTS (1.7B) |
qwen3-tts-voicedesign |
1.7 billion |
32,768 |
Not Applicable |
✔️ |
|
✔️ |
|
ℹ️ Text-to-speech. Multimodal and generative model. |
| Alibaba |
Wan2.2-T2V-A14B |
wan2-2-t2v-a14b |
14 billion |
100 |
Not Applicable |
✔️ |
|
✔️ |
|
ℹ️ Text-to-video. Multimodal and generative model. |
| DeepSeek |
DeepSeek R1 Distill Llama 70B |
deepseek-r1-distill-llama-70b |
70 billion |
32,678 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ |
ℹ️ When using in a user-facing agent, we strongly recommend adding all available guardrails for a safer conversational experience. |
| DeepSeek |
DeepSeek V4 Pro |
deepseek-v4-pro |
1.6 trillion |
262,144 |
52,429 |
✔️ |
|
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens ✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching |
| DeepSeek |
DeepSeek V4 Flash |
deepseek-4-flash |
284 billion |
262,144 |
52,429 |
✔️ |
|
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens ✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching |
| DeepSeek |
DeepSeek V3.2 |
deepseek-3.2 |
680 billion |
163,840 |
32,768 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching |
| DeepSeek |
DeepSeek V3 |
deepseek-v3 |
671 billion |
163,840 |
Not published |
|
✔️ |
|
|
|
| Google |
Gemma 4 |
gemma-4-31B-it |
31 billion |
256,000 |
8,192 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching |
| MiniMax |
M2.5 (Public Preview) |
minimax-m2.5 |
230 billion |
65,536 |
13,107 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ℹ️ Use is subject to Public Preview Terms including MiniMax Model License. |
| Moonshot AI |
Kimi K3 |
kimi-k3 |
Not published |
Not published |
Not published |
✔️ |
|
✔️ |
✔️ |
✔️ Chat Completions API for sending prompts for serverless inference. ✔️ Prompt caching ✔️ Native vision (text, images) ℹ️ Use is subject to the model license. |
| Moonshot AI |
Kimi K2.6 |
kimi-k2.6 |
1 trillion |
262,144 |
52,429 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ℹ️ Use is subject to a Modified MIT license. |
| Moonshot AI |
Kimi K2.5 |
kimi-k2.5 |
1 trillion |
262,144 |
52,429 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ℹ️ Use is subject to a Modified MIT license. |
| Meta |
Llama 3.1 Instruct (8B) |
llama3-8b-instruct |
80 billion |
131,072 |
Not published |
|
✔️ |
|
|
|
| Meta |
Llama 3.3 Instruct-70B |
llama3.3-70b-instruct |
70 billion |
128,000 |
4,096 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model |
| Meta |
Llama 4 Maverick 17B 128E Instruct |
llama-4-maverick |
400 billion |
128,000 |
16,384 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. |
| Mistral AI |
Ministral 3 8B Instruct |
ministral-3-8b-instruct-2512 |
8.92 billion |
262,144 |
Not published |
|
✔️ |
|
|
|
| Mistral AI |
Ministral 3 14B Instruct |
mistral-3-14B |
14 billion |
262,144 |
Not published |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. |
| Mistral AI |
Mistral 7B Instruct v0.3 |
mistral-7b-instruct-v0.3 |
7 billion |
32,768 |
Not published |
|
✔️ |
|
|
|
| NVIDIA |
Nemotron 3 Ultra |
nemotron-3-ultra-550b |
550 billion |
131,072 |
26,214 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Evaluations judge model ✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. |
| NVIDIA |
Nemotron-3-Super-120B (Public Preview) |
nvidia-nemotron-3-super-120b |
120 billion |
1,000,000 |
32,768 |
✔️ |
|
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ℹ️ Use is subject to Public Preview Terms including NVIDIA Model License. |
| NVIDIA |
Nemotron 3 Nano 30B A3B |
nemotron-3-nano-30b |
30 billion |
262,144 |
Not published |
|
✔️ |
|
|
|
| NVIDIA |
Nemotron 3 Nano Omni |
nemotron-3-nano-omni |
30 billion |
65,536 |
13,107 |
✔️ |
|
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ℹ️ Context window 65,536 tokens. |
| NVIDIA |
Nemotron Nano 12B v2 VL |
nemotron-nano-12b-v2-vl |
12 billion |
128,000 |
16,384 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. |
| OpenAI |
gpt-oss-120b |
openai-gpt-oss-120b |
Not published |
128,000 |
4,096 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Prompt caching |
| OpenAI |
gpt-oss-20b |
openai-gpt-oss-20b |
Not published |
128,000 |
4,096 |
✔️ |
✔️ |
✔️ |
✔️ |
|
| Stability AI |
Stable Diffusion 3.5 Large |
stable-diffusion-3.5-large |
8 billion |
256 |
Not Applicable |
✔️ |
|
✔️ |
|
ℹ️ Image generation. Multimodal and generative model. |
| Xiaomi |
MiMo V2.5 |
mimo-v2.5 |
Not published |
262,144 |
52,429 |
✔️ |
|
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens ✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ✔️ Tool calling ✔️ Structured outputs ✔️ Reasoning ✔️ Multilingual ℹ️ Use is subject to the MIT License. |
| Xiaomi |
MiMo V2.5 Pro |
mimo-v2.5-pro |
1 trillion |
262,144 |
52,429 |
✔️ |
✔️ |
|
|
✔️ Input context window of up to 1M tokens ✔️ Text only ✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ✔️ Tool calling ✔️ Structured outputs ✔️ Reasoning ✔️ Multilingual ℹ️ Use is subject to the MIT License. |
| Z.ai |
GLM-5.2 |
glm-5.2 |
Not published |
262,144 |
52,429 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Input context window of up to 1M tokens ✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ✔️ Text only ✔️ Tool calling ✔️ Structured outputs ✔️ Reasoning ✔️ Multilingual ℹ️ Use is subject to the MIT License. |
| Z.ai |
GLM-5.1 |
glm-5.1 |
754 billion |
163,840 |
32,768 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ✔️ Text only ✔️ Tool calling ✔️ Structured outputs ✔️ Reasoning ✔️ Multilingual ℹ️ Use is subject to the MIT License. |
| Z.ai |
GLM 5 |
glm-5 |
744 billion |
64,000 |
12,800 |
✔️ |
✔️ |
✔️ |
✔️ |
✔️ Chat Completions and Responses APIs for sending prompts for serverless inference. ✔️ Prompt caching ℹ️ Use is subject to the MIT License. |
Embeddings Models
An embedding model converts data into vector embeddings. DigitalOcean stores vector embeddings in an OpenSearch database cluster for use with agent knowledge bases. The following embeddings models are available on the platform, along with their token windows and recommended chunking ranges.
Alibaba Models
BAAI Models
| Model |
Parameters |
Token Window |
Chunk Size Range |
Parent Chunk Range |
Child Chunk Range |
| BGE M3 |
568M |
8192 tokens |
0-8192 |
Not Specified |
Not Specified |
Intfloat Models
| Model |
Parameters |
Token Window |
Chunk Size Range |
Parent Chunk Range |
Child Chunk Range |
| E5 Large (multilingual) |
560 million |
514 tokens |
0-512 |
100-512 |
100-500 |
| E5 Large (v2) |
Not available |
512 tokens |
0-512 |
Not Specified |
Not Specified |
UKP Lab (Technical University of Darmstadt) Models
| Model |
Parameters |
Token Window |
Chunk Size Range |
Parent Chunk Range |
Child Chunk Range |
| All-MiniLM-L6-v2 |
22 million |
256 tokens |
0-256 |
100-256 |
100-200 |
| Multi-QA-mpnet-base-dot-v1 |
109 million |
512 tokens |
0-512 |
100-512 |
100-500 |
Reranking Models
Reranking models reorder retrieved results to improve relevance after the initial retrieval step, and can also be used with vector databases. DigitalOcean supports the following reranking model for knowledge base retrieval:
BAAI Models
| Model |
Parameters |
Usage Notes |
| BGE Reranker (v2) M3 |
Not available |
Can be enabled at knowledge base creation, updated after creation. |