For AI agents: The documentation index is at https://docs.digitalocean.com/llms.txt. Markdown versions of pages use the same URL with index.html.md in place of the HTML page (for example, append index.html.md to the directory path instead of opening the HTML document).

Batch Inference is an asynchronous processing capability designed to help you scale high-volume AI projects more efficiently. Ideal for heavy-duty workloads like large-scale data classification, evaluations, and content enrichment, you can submit thousands or even millions of requests in a single job with a guaranteed results window of 24 hours. By utilizing off-peak GPU capacity, Batch Inference provides high-performance LLM access at a significantly reduced price point compared to standard synchronous APIs, making it a cost-effective choice for non-interactive workloads.

inferenceClient.batches.cancel()

Cancel a Batch Inference Job

inferenceClient.batches.files.create()

Create a Batch Inference Input File

inferenceClient.batches.create()

Create a Batch Inference Job

inferenceClient.batches.results()

Get Batch Inference Results Download Links

inferenceClient.batches.list()

List Batch Inference Jobs

inferenceClient.batches.retrieve()

Retrieve a Batch Inference Job

dots.upload_url.put()

Upload a Batch Inference Input File