Significant-Gravitas
/
AutoGPT
mirror of https://github.com/Significant-Gravitas/AutoGPT.git
1
0
Fork 1
Code Issues Packages Projects Releases Wiki Activity
AutoGPT/benchmark
History
merwanehamadi fa9fc18e22
Validate skill tree so the UI never breaks (#5306) 
Validate skill tree to prevent it from breaking the UI

Signed-off-by: Merwane Hamadi <merwanehamadi@gmail.com>
 		2023-09-22 17:32:05 -07:00
..
.vscode Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
agbenchmark Validate skill tree so the UI never breaks (#5306) 2023-09-22 17:32:05 -07:00
agbenchmark_config Fix skill tree (#5303) 2023-09-22 13:09:57 -07:00
backend Refactor benchmark (#5247) 2023-09-17 06:55:20 -07:00
frontend Validate skill tree so the UI never breaks (#5306) 2023-09-22 17:32:05 -07:00
notebooks Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
reports Structure challenges (#5296) 2023-09-21 20:06:37 -07:00
tests Validate skill tree so the UI never breaks (#5306) 2023-09-22 17:32:05 -07:00
.env.example Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.flake8 Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.gitignore Add eval_id and sync Skill Tree with Frontend(#5287) 2023-09-21 13:36:17 -07:00
.pre-commit-config.yaml Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.python-version Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
LICENSE Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
README.md Rename Auto-GPT to AutoGPT (#5301) 2023-09-22 15:49:29 -07:00
agents_to_benchmark.json Rename Auto-GPT to AutoGPT (#5301) 2023-09-22 15:49:29 -07:00
mypy.ini Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
poetry.lock Make agbenchmark a proxy of the evaluated agent (#5279) 2023-09-20 16:06:00 -07:00
pyproject.toml Make agbenchmark a proxy of the evaluated agent (#5279) 2023-09-20 16:06:00 -07:00
run.sh Fixing benchmarks 2023-09-11 17:41:27 -07:00
server.py Add back api mode 2023-09-06 22:51:45 -07:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Screenshot 2023-07-25 at 10 35 01 AM

Ranking overall:

Detailed results:

Screenshot 2023-07-25 at 10 42 15 AM

Click here to see the results and the raw data!!

More agents coming soon !