AutoGPT/benchmark
Silen Naihin b881189651 adding visualizations 2023-09-06 00:36:21 -07:00
..
.vscode Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
agbenchmark Fix forge and benchmark 2023-09-05 16:58:09 -07:00
backend Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
frontend Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
notebooks Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
paper adding visualizations 2023-09-06 00:36:21 -07:00
reports Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.env.example Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.flake8 Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.gitignore Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.gitmodules Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.pre-commit-config.yaml Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.python-version Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
LICENSE Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
README.md Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
mypy.ini Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
poetry.lock Fix forge and benchmark 2 2023-09-05 17:05:45 -07:00
pyproject.toml Fix forge and benchmark 2 2023-09-05 17:05:45 -07:00
run.sh Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
server.py Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Screenshot 2023-07-25 at 10 35 01 AM

Ranking overall:

Detailed results:

Screenshot 2023-07-25 at 10 42 15 AM

Click here to see the results and the raw data!!

More agents coming soon !