> ## Documentation Index
> Fetch the complete documentation index at: https://benchgen.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# BenchGen AI agent overview

> What the BenchGen AI agent is, where to open it, what it can see in your account, and how every conversation is traced.

The **BenchGen AI agent** is the built-in platform assistant. It is the default agent in the chat,
works on your own account (benchmarks, runs, datasets, training jobs, agent connections, credits)
and does the work for you: it creates benchmarks, runs models, reads the results, fixes what is
wrong and trains a better model, all from plain language.

> [!TIP]
>
> Looking for something to paste? The [prompt library](/docs/self-improvement-agent.md) has ready-to-use
> prompts for every task, each with a copy button.

## Open the chat

Click **New Chat** in the left sidebar, or open the agent from **My Agents → BenchGen AI**, then
click **Open chat**.

![BenchGen AI agent overview page](https://mintcdn.com/benchgen-8fc81371/ow_wgTpd42vp2xGn/images/agentspace/benchgen-ai-agent/01-overview.png?fit=max\&auto=format\&n=ow_wgTpd42vp2xGn\&q=85\&s=6ee89b8226e2dfa7e6c8a14faa91fcd0)

The BenchGen AI agent's overview page, with account ownership and status

## What it can do

> **[Create benchmarks](/docs/skills/create-a-benchmark.md)**
>
> From a topic you describe, from a bundle you already have, or from a folder in your git repository.

> **[Run models](/docs/skills/run-a-benchmark.md)**
>
> Launch a run on any model in the catalogue or your own, and report the score with a link.

> **[Explain results](/docs/skills/analyze-results.md)**
>
> Read a run question by question, find out why answers were marked wrong, and prove a fix first.

> **[Fix benchmarks](/docs/skills/edit-a-benchmark.md)**
>
> Change questions, scoring, leaderboard columns and settings, each checked before it is applied.

> **[Train models](/docs/skills/train-a-model.md)**
>
> Fine-tune, reinforcement learning and distillation on what a benchmark revealed.

> **[Version in git](/docs/skills/version-a-benchmark.md)**
>
> Save every version to your own GitHub or GitLab repository, review changes, go back.

## Ask in plain language

The home screen greets you by name and suggests a few starting points, but you can ask anything
about your account in your own words and in your own language:

* "What benchmarks do we have?"
* "How many credits do I have left?"
* "Create a dataset from my last benchmark run"
* "Fine-tune a model on my dataset"
* "Connect my agent for tracing"
* "How do credits and API keys work?"

![BenchGen AI home screen with an example question](https://mintcdn.com/benchgen-8fc81371/ow_wgTpd42vp2xGn/images/agentspace/benchgen-ai-agent/03-example-question.png?fit=max\&auto=format\&n=ow_wgTpd42vp2xGn\&q=85\&s=fa1c95a85b792bfd3b4a0efdff72a48f)

The BenchGen AI home screen with suggested prompts and a question typed in

## Example conversation

Ask a question and the agent pulls live data from your account (benchmarks owned, recent runs,
datasets, training jobs and credit balance), then offers a next step.

![Example BenchGen AI chat conversation](https://mintcdn.com/benchgen-8fc81371/ow_wgTpd42vp2xGn/images/agentspace/benchgen-ai-agent/04-chat-conversation.png?fit=max\&auto=format\&n=ow_wgTpd42vp2xGn\&q=85\&s=0b0ae01fc5698124f4ee2412bf096cf0)

A real conversation: asking what benchmarks are available and getting an account snapshot back

## It asks before it changes anything

Anything that changes your account or spends credits is shown to you first: a preview of the
questions before a benchmark is created, a plan before training starts, a diff before a repository
change goes live. Nothing happens until you confirm. It can never delete a benchmark.
[What the agent is allowed to do](/docs/skills/what-the-agent-may-do.md) lists the exact limits.

## Every message is traced

Every message is logged as a trace, viewable from the agent's **Traces** tab.

![BenchGen AI Traces tab](https://mintcdn.com/benchgen-8fc81371/ow_wgTpd42vp2xGn/images/agentspace/benchgen-ai-agent/05-traces.png?fit=max\&auto=format\&n=ow_wgTpd42vp2xGn\&q=85\&s=751cbc424f68c6fa472d0d9a02a11e02)

Every message to the BenchGen AI agent is recorded as a trace

## Next steps

> **[Prompt library](/docs/self-improvement-agent.md)**
>
> Ready-to-use prompts for every task. Copy, paste, send.

> **[Working with the agent](/docs/guides/benchgen-ai-agent/working-with-the-agent.md)**
>
> A task-by-task guide, from the first benchmark to a trained model.

> **[Fix a benchmark that scores wrong](/docs/guides/benchgen-ai-agent/fixing-a-benchmark.md)**
>
> The whole conversation, with the proof and the before and after.

> **[Benchmarks in git](/docs/guides/benchgen-ai-agent/benchmarks-in-git.md)**
>
> Keep every version in your own repository.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.