DigitalOcean GenAI Platform lets you build GPU-powered AI agents with fully-managed deployment. Agents can use pre-built or custom foundation models, incorporate function and agent routes, and implement RAG pipelines with knowledge bases.
Agents are artificial intelligence (AI) production-ready, task-specific APIs that interact with users.
To create an agent:
Go to the DigitalOcean Control Panel, on the left side menu, click GenAI Platform, click Create Agent to open the Create an Agent page.
Name your agent. Names that explicitly define what this agent’s job or its domain expertise is can help if you’re planning on using multiple agents for agent routing.
Specify your agent instructions. Agent instructions tell your agent what you want it to do and how it should do it.
You can adjust these instructions in the agent playground after creation.
Choose a model. We offer several foundation models pre-trained on large datasets and adaptable to various tasks.
If needed, you can test and compare models in the Model Playground before creating your agent. This environment allows you to evaluate performance and adjust settings like Max Tokens, Temperature, and Top P.
Optionally, add a knowledge base to enable RAG for your agent. Models using RAG incorporate information from a knowledge base in addition to the original training data to produce more accurate, contextually relevant responses.
Select the project you want your agent to belong to and optionally, add tags to organize and relate resources for your agent.
Review your agent configurations and the estimated cost of your agent, and then click Create Agent.
After creating your agent, test its performance. For more information, see Create Agents.
To use an agent in your application:
Go to the DigitalOcean Control Panel, on the left side menu, click GenAI Platform, then select the agent you want to use.
On the agent’s page, click the Endpoint tab and set the endpoint to public.
The agent endpoint is automatically generated and is in private mode by default. Setting the endpoint to public makes it accessible to external traffic and displays a Chatbot section with a JavaScript code snippet.
Copy and paste the code snippet into your application.
For more information, see Use Agents.
GenAI Platform provides pre-configured example agents that model best practices for agent design and how retrieval-augmented generation works with a knowledge base. You can also use these example agents as a starting point for your custom agent.
The example agents are for specific use cases and are configured with default foundation models, pre-attached knowledge bases, and well-designed agent instructions. To get started with an example agent, open the Example Agents page in the DigitalOcean Control Panel.