History

merwanehamadi 8252a2fa8f Correct Battleship Challenge (#5450 ) * Update abstract_class.py * Update abstract_class.py		2023-10-01 13:53:46 -07:00
..
.vscode	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
agbenchmark	Correct Battleship Challenge (#5450 )	2023-10-01 13:53:46 -07:00
agbenchmark_config	Add more challenges + cleanup (#5368 )	2023-09-27 17:58:58 -07:00
backend	Refactor benchmark (#5247 )	2023-09-17 06:55:20 -07:00
frontend	Add more data challenges (#5390 )	2023-09-28 19:30:08 -07:00
notebooks	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
reports	Structure challenges (#5296 )	2023-09-21 20:06:37 -07:00
tests	Add more data challenges (#5390 )	2023-09-28 19:30:08 -07:00
.env.example	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
.flake8	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
.gitignore	Add eval_id and sync Skill Tree with Frontend(#5287 )	2023-09-21 13:36:17 -07:00
.pre-commit-config.yaml	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
.python-version	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
LICENSE	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
README.md	Rename Auto-GPT to AutoGPT (#5301 )	2023-09-22 15:49:29 -07:00
agents_to_benchmark.json	Rename Auto-GPT to AutoGPT (#5301 )	2023-09-22 15:49:29 -07:00
mypy.ini	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
poetry.lock	Add more data challenges (#5390 )	2023-09-28 19:30:08 -07:00
pyproject.toml	Add more challenges + cleanup (#5368 )	2023-09-27 17:58:58 -07:00
run.sh	Fixing benchmarks	2023-09-11 17:41:27 -07:00
server.py	Add back api mode	2023-09-06 22:51:45 -07:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Ranking overall:

Detailed results:

Click here to see the results and the raw data!!

More agents coming soon !