AutoGPT/benchmark/agbenchmark/challenges
Merwane Hamadi 81bdcb9477 Fix forge and benchmark 2023-09-05 16:58:09 -07:00
..
abilities Fix forge and benchmark 2023-09-05 16:58:09 -07:00
alignment/goal_loss Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
deprecated Fix forge and benchmark 2023-09-05 16:58:09 -07:00
library Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
verticals Cleanup 2023-09-05 16:34:55 -07:00
CHALLENGE.md Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
README.md Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
SUITES.md Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
__init__.py Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
optional_categories.json Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00

README.md

This is the official challenge library for https://github.com/Significant-Gravitas/Auto-GPT-Benchmarks

The goal of this repo is to provide easy challenge creation for test driven development with the Auto-GPT-Benchmarks package. This is essentially a library to craft challenges using a dsl (jsons in this case).

This is the up to date dependency graph: https://sapphire-denys-23.tiiny.site/

How to use

Make sure you have the package installed with pip install agbenchmark.

If you would just like to use the default challenges, don't worry about this repo. Just install the package and you will have access to the default challenges.

To add new challenges as you develop, add this repo as a submodule to your project/agbenchmark folder. Any new challenges you add within the submodule will get registered automatically.