AutoGPT/classic/benchmark
Reinier van der Leer d638c1f484
Fix Poetry v2.0.0 compatibility (#9197)
Make all changes necessary to make everything work with Poetry v2.0.0.

- Resolves #9196

## Changes
- Removed `--no-update` flag from `poetry lock` command in codebase
- Removed extra path arguments from `poetry -C [path] run [command]`
occurrences
- Regenerated all lock files in hierarchical order
- Added workaround for Poetry bug where `packages.[i].format` is now
suddenly required

Additionally:
- Fixed up .dockerignore
  - Fixes .venv being erroneously copied over from local
  - Fixes build context bloat (300MB -> 2.5MB)
- Fixed warnings about entrypoint script not being installed in docker
builds

### Relevant (breaking) changes in v2.0.0
- `--no-update` flag no longer exists for `poetry lock` as it has become
default behavior
- The `-C` option now actually changes the directory, so any path
arguments in `poetry run` commands can/must be removed
- Poetry v2.0.0 uses the new v2.1 lock file spec, so all lock files have
to be regenerated to avoid false-positive lock file updates and checks
on future PRs
- **BUG:** when specifying `poetry.tool.packages`, `format` is required
now
  - python-poetry/poetry#9961

Full Poetry v2.0.0 release notes and change log:
https://python-poetry.org/blog/announcing-poetry-2.0.0
2025-01-06 23:34:49 +01:00
..
agbenchmark refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
agbenchmark_config refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
backend refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
frontend refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
reports refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
tests refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
.env.example refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
.flake8 refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
.gitignore refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
LICENSE refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
README.md refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
agents_to_benchmark.json refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
poetry.lock Fix Poetry v2.0.0 compatibility (#9197) 2025-01-06 23:34:49 +01:00
pyproject.toml refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00
run.sh refactor: AutoGPT Platform Stealth Launch Repo Re-Org (#8113) 2024-09-20 16:50:43 +02:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Screenshot 2023-07-25 at 10 35 01 AM

Ranking overall:

Detailed results:

Screenshot 2023-07-25 at 10 42 15 AM

Click here to see the results and the raw data!!

More agents coming soon !