Skip to main content
Agents are automated models that run on your data within Encord — pre-labeling assets, reviewing annotations, or performing custom actions.

​
Agent Catalog

The Agents Catalog is the central place to discover, configure, and deploy agents in Encord — from off-the-shelf integrations to fully Custom Agents.

​
Agent Types

  • Catalog agents: Built-in agents that you configure in a few simple steps (for example, OpenAI or Google Document AI). See available Agents for a full list.
  • Custom agents: Configured using the Agents Catalog. See Custom Agents for details.

​
Enable Agents

  1. Navigate to Agents in the left-hand navigation. The Agents catalog tab opens by default.
  2. Browse or search for agents:
    • Built-in agents are shown as tiles you can configure with API keys and simple options.
    • The Custom agent tile lets you register your own HTTPS endpoint as an agent.
    • A Request agent tile lets you ask Encord to add a new integration.
  3. Click Add to enable an agent.
  4. Give the Agent a meaningful name.
  5. Add Ontology and label target information, and any required external credentials if necessary.
  6. Click Add agent to save the configuration and enable the agent for use in your Projects.

​
External Credentials

Many catalog agents require external credentials, such as OpenAI API keys or Google service accounts. You can add and manage these credentials in two ways:
  • While creating an agent: When you configure a catalog agent, you can choose or create the required external credential directly in the form.
  • From workspace settings: Go to Workspace settings > External credentials to create, reuse, or revoke credentials across agents.
Once configured, credentials can be reused by multiple agents without re-entering secrets.

​
Ontology & Label Targets

  • Ontology - The Ontology the Agent uses.
  • Label Targets - The specific classes within the Ontology that the Agent writes its output to. Only classes that the Agent template supports as outputs are available for selection.
The Agent can only be attached to projects that use the same Ontology. When creating an Agent directly from a Workflow stage, the Project’s Ontology is pre-filled automatically.