Add Issue template and clear .github folder (#5161)
merwanehamadi
GitHub
commit
63213bc74d
|
|
@ -0,0 +1,164 @@
|
||||||
|
name: Bug report 🐛
|
||||||
|
description: Create a bug report for Auto-GPT.
|
||||||
|
labels: ['status: needs triage']
|
||||||
|
body:
|
||||||
|
- type: markdown
|
||||||
|
attributes:
|
||||||
|
value: |
|
||||||
|
### ⚠️ Before you continue
|
||||||
|
* Check out our [backlog], [roadmap] and join our [discord] to discuss what's going on
|
||||||
|
* If you need help, you can ask in the [discussions] section or in [#tech-support]
|
||||||
|
* **Thoroughly search the [existing issues] before creating a new one**
|
||||||
|
* Read our [wiki page on Contributing]
|
||||||
|
[backlog]: https://github.com/orgs/Significant-Gravitas/projects/1
|
||||||
|
[roadmap]: https://github.com/orgs/Significant-Gravitas/projects/2
|
||||||
|
[discord]: https://discord.gg/autogpt
|
||||||
|
[discussions]: https://github.com/Significant-Gravitas/Auto-GPT/discussions
|
||||||
|
[#tech-support]: https://discord.com/channels/1092243196446249134/1092275629602394184
|
||||||
|
[existing issues]: https://github.com/Significant-Gravitas/Auto-GPT/issues?q=is%3Aissue
|
||||||
|
[wiki page on Contributing]: https://github.com/Significant-Gravitas/Nexus/wiki/Contributing
|
||||||
|
|
||||||
|
- type: checkboxes
|
||||||
|
attributes:
|
||||||
|
label: ⚠️ Search for existing issues first ⚠️
|
||||||
|
description: >
|
||||||
|
Please [search the history](https://github.com/Torantulino/Auto-GPT/issues)
|
||||||
|
to see if an issue already exists for the same problem.
|
||||||
|
options:
|
||||||
|
- label: I have searched the existing issues, and there is no existing issue for my problem
|
||||||
|
required: true
|
||||||
|
|
||||||
|
- type: markdown
|
||||||
|
attributes:
|
||||||
|
value: |
|
||||||
|
Please confirm that the issue you have is described well and precise in the title above ⬆️.
|
||||||
|
A good rule of thumb: What would you type if you were searching for the issue?
|
||||||
|
|
||||||
|
For example:
|
||||||
|
BAD - my auto-gpt keeps looping
|
||||||
|
GOOD - After performing execute_python_file, auto-gpt goes into a loop where it keeps trying to execute the file.
|
||||||
|
|
||||||
|
⚠️ SUPER-busy repo, please help the volunteer maintainers.
|
||||||
|
The less time we spend here, the more time we can spend building AutoGPT.
|
||||||
|
|
||||||
|
Please help us help you by following these steps:
|
||||||
|
- Search for existing issues, adding a comment when you have the same or similar issue is tidier than "new issue" and
|
||||||
|
newer issues will not be reviewed earlier, this is dependent on the current priorities set by our wonderful team
|
||||||
|
- Ask on our Discord if your issue is known when you are unsure (https://discord.gg/autogpt)
|
||||||
|
- Provide relevant info:
|
||||||
|
- Provide commit-hash (`git rev-parse HEAD` gets it) if possible
|
||||||
|
- If it's a pip/packages issue, mention this in the title and provide pip version, python version
|
||||||
|
- If it's a crash, provide traceback and describe the error you got as precise as possible in the title.
|
||||||
|
|
||||||
|
- type: dropdown
|
||||||
|
attributes:
|
||||||
|
label: Which Operating System are you using?
|
||||||
|
description: >
|
||||||
|
Please select the operating system you were using to run Auto-GPT when this problem occurred.
|
||||||
|
options:
|
||||||
|
- Windows
|
||||||
|
- Linux
|
||||||
|
- MacOS
|
||||||
|
- Docker
|
||||||
|
- Devcontainer / Codespace
|
||||||
|
- Windows Subsystem for Linux (WSL)
|
||||||
|
- Other
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
|
nested_fields:
|
||||||
|
- type: text
|
||||||
|
attributes:
|
||||||
|
label: Specify the system
|
||||||
|
description: Please specify the system you are working on.
|
||||||
|
|
||||||
|
- type: dropdown
|
||||||
|
attributes:
|
||||||
|
label: Which version of Auto-GPT are you using?
|
||||||
|
description: |
|
||||||
|
Please select which version of Auto-GPT you were using when this issue occurred.
|
||||||
|
If you downloaded the code from the [releases page](https://github.com/Significant-Gravitas/Auto-GPT/releases/) make sure you were using the latest code.
|
||||||
|
**If you weren't please try with the [latest code](https://github.com/Significant-Gravitas/Auto-GPT/releases/)**.
|
||||||
|
If installed with git you can run `git branch` to see which version of Auto-GPT you are running.
|
||||||
|
options:
|
||||||
|
- Latest Release
|
||||||
|
- Stable (branch)
|
||||||
|
- Master (branch)
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
|
|
||||||
|
- type: dropdown
|
||||||
|
attributes:
|
||||||
|
label: Do you use OpenAI GPT-3 or GPT-4?
|
||||||
|
description: >
|
||||||
|
If you are using Auto-GPT with `--gpt3only`, your problems may be caused by
|
||||||
|
the [limitations](https://github.com/Significant-Gravitas/Auto-GPT/issues?q=is%3Aissue+label%3A%22AI+model+limitation%22) of GPT-3.5.
|
||||||
|
options:
|
||||||
|
- GPT-3.5
|
||||||
|
- GPT-4
|
||||||
|
- GPT-4(32k)
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
|
|
||||||
|
- type: dropdown
|
||||||
|
attributes:
|
||||||
|
label: Which area covers your issue best?
|
||||||
|
description: >
|
||||||
|
Select the area related to the issue you are reporting.
|
||||||
|
options:
|
||||||
|
- Installation and setup
|
||||||
|
- Memory
|
||||||
|
- Performance
|
||||||
|
- Prompt
|
||||||
|
- Commands
|
||||||
|
- Plugins
|
||||||
|
- AI Model Limitations
|
||||||
|
- Challenges
|
||||||
|
- Documentation
|
||||||
|
- Logging
|
||||||
|
- Agents
|
||||||
|
- Other
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
|
autolabels: true
|
||||||
|
nested_fields:
|
||||||
|
- type: text
|
||||||
|
attributes:
|
||||||
|
label: Specify the area
|
||||||
|
description: Please specify the area you think is best related to the issue.
|
||||||
|
|
||||||
|
- type: textarea
|
||||||
|
attributes:
|
||||||
|
label: Describe your issue.
|
||||||
|
description: Describe the problem you are experiencing. Try to describe only the issue and phrase it short but clear. ⚠️ Provide NO other data in this field
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
|
|
||||||
|
#Following are optional file content uploads
|
||||||
|
- type: markdown
|
||||||
|
attributes:
|
||||||
|
value: |
|
||||||
|
⚠️The following is OPTIONAL, please keep in mind that the log files may contain personal information such as credentials.⚠️
|
||||||
|
|
||||||
|
"The log files are located in the folder 'logs' inside the main auto-gpt folder."
|
||||||
|
|
||||||
|
- type: textarea
|
||||||
|
attributes:
|
||||||
|
label: Upload Activity Log Content
|
||||||
|
description: |
|
||||||
|
Upload the activity log content, this can help us understand the issue better.
|
||||||
|
To do this, go to the folder logs in your main auto-gpt folder, open activity.log and copy/paste the contents to this field.
|
||||||
|
⚠️ The activity log may contain personal data given to auto-gpt by you in prompt or input as well as
|
||||||
|
any personal information that auto-gpt collected out of files during last run. Do not add the activity log if you are not comfortable with sharing it. ⚠️
|
||||||
|
validations:
|
||||||
|
required: false
|
||||||
|
|
||||||
|
- type: textarea
|
||||||
|
attributes:
|
||||||
|
label: Upload Error Log Content
|
||||||
|
description: |
|
||||||
|
Upload the error log content, this will help us understand the issue better.
|
||||||
|
To do this, go to the folder logs in your main auto-gpt folder, open error.log and copy/paste the contents to this field.
|
||||||
|
⚠️ The error log may contain personal data given to auto-gpt by you in prompt or input as well as
|
||||||
|
any personal information that auto-gpt collected out of files during last run. Do not add the activity log if you are not comfortable with sharing it. ⚠️
|
||||||
|
validations:
|
||||||
|
required: false
|
||||||
|
|
@ -0,0 +1,28 @@
|
||||||
|
name: Feature request 🚀
|
||||||
|
description: Suggest a new idea for Auto-GPT!
|
||||||
|
labels: ['status: needs triage']
|
||||||
|
body:
|
||||||
|
- type: markdown
|
||||||
|
attributes:
|
||||||
|
value: |
|
||||||
|
First, check out our [wiki page on Contributing](https://github.com/Significant-Gravitas/Nexus/wiki/Contributing)
|
||||||
|
Please provide a searchable summary of the issue in the title above ⬆️.
|
||||||
|
- type: checkboxes
|
||||||
|
attributes:
|
||||||
|
label: Duplicates
|
||||||
|
description: Please [search the history](https://github.com/Torantulino/Auto-GPT/issues) to see if an issue already exists for the same problem.
|
||||||
|
options:
|
||||||
|
- label: I have searched the existing issues
|
||||||
|
required: true
|
||||||
|
- type: textarea
|
||||||
|
attributes:
|
||||||
|
label: Summary 💡
|
||||||
|
description: Describe how it should work.
|
||||||
|
- type: textarea
|
||||||
|
attributes:
|
||||||
|
label: Examples 🌈
|
||||||
|
description: Provide a link to other implementations, or screenshots of the expected behavior.
|
||||||
|
- type: textarea
|
||||||
|
attributes:
|
||||||
|
label: Motivation 🔦
|
||||||
|
description: What are you trying to accomplish? How has the lack of this feature affected you? Providing context helps us come up with a solution that is more useful in the real world.
|
||||||
|
|
@ -1,17 +1,49 @@
|
||||||
### Background
|
<!-- ⚠️ At the moment any non-essential commands are not being merged.
|
||||||
|
If you want to add non-essential commands to Auto-GPT, please create a plugin instead.
|
||||||
|
We are expecting to ship plugin support within the week (PR #757).
|
||||||
|
Resources:
|
||||||
|
* https://github.com/Significant-Gravitas/Auto-GPT-Plugin-Template
|
||||||
|
-->
|
||||||
|
|
||||||
<!-- IF YOU MAKE A PR FROM A FORK, THE mini-agi TEST WON'T PASS, so ignore it.-->
|
<!-- 📢 Announcement
|
||||||
|
We've recently noticed an increase in pull requests focusing on combining multiple changes. While the intentions behind these PRs are appreciated, it's essential to maintain a clean and manageable git history. To ensure the quality of our repository, we kindly ask you to adhere to the following guidelines when submitting PRs:
|
||||||
|
|
||||||
|
Focus on a single, specific change.
|
||||||
|
Do not include any unrelated or "extra" modifications.
|
||||||
|
Provide clear documentation and explanations of the changes made.
|
||||||
|
Ensure diffs are limited to the intended lines — no applying preferred formatting styles or line endings (unless that's what the PR is about).
|
||||||
|
For guidance on committing only the specific lines you have changed, refer to this helpful video: https://youtu.be/8-hSNHHbiZg
|
||||||
|
|
||||||
|
Check out our [wiki page on Contributing](https://github.com/Significant-Gravitas/Nexus/wiki/Contributing)
|
||||||
|
|
||||||
|
By following these guidelines, your PRs are more likely to be merged quickly after testing, as long as they align with the project's overall direction. -->
|
||||||
|
|
||||||
|
### Background
|
||||||
|
<!-- Provide a concise overview of the rationale behind this change. Include relevant context, prior discussions, or links to related issues. Ensure that the change aligns with the project's overall direction. -->
|
||||||
|
|
||||||
### Changes
|
### Changes
|
||||||
|
|
||||||
<!-- Describe the specific, focused change made in this pull request. Detail the modifications clearly and avoid any unrelated or "extra" changes. -->
|
<!-- Describe the specific, focused change made in this pull request. Detail the modifications clearly and avoid any unrelated or "extra" changes. -->
|
||||||
|
|
||||||
### PR Quality Checklist
|
### Documentation
|
||||||
|
<!-- Explain how your changes are documented, such as in-code comments or external documentation. Ensure that the documentation is clear, concise, and easy to understand. -->
|
||||||
|
|
||||||
|
### Test Plan
|
||||||
|
<!-- Describe how you tested this functionality. Include steps to reproduce, relevant test cases, and any other pertinent information. -->
|
||||||
|
|
||||||
|
### PR Quality Checklist
|
||||||
|
- [ ] My pull request is atomic and focuses on a single change.
|
||||||
|
- [ ] I have thoroughly tested my changes with multiple different prompts.
|
||||||
|
- [ ] I have considered potential risks and mitigations for my changes.
|
||||||
|
- [ ] I have documented my changes clearly and comprehensively.
|
||||||
|
- [ ] I have not snuck in any "extra" small tweaks changes. <!-- Submit these as separate Pull Requests, they are the easiest to merge! -->
|
||||||
- [ ] I have run the following commands against my code to ensure it passes our linters:
|
- [ ] I have run the following commands against my code to ensure it passes our linters:
|
||||||
```shell
|
```shell
|
||||||
black . --exclude test.py
|
black .
|
||||||
isort .
|
isort .
|
||||||
mypy .
|
mypy
|
||||||
autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring --in-place agbenchmark
|
autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring autogpt tests --in-place
|
||||||
```
|
```
|
||||||
|
|
||||||
|
<!-- If you haven't added tests, please explain why. If you have, check the appropriate box. If you've ensured your PR is atomic and well-documented, check the corresponding boxes. -->
|
||||||
|
|
||||||
|
<!-- By submitting this, I agree that my pull request should be closed if I do not fill this out or follow the guidelines. -->
|
||||||
|
|
|
||||||
|
|
@ -1,301 +0,0 @@
|
||||||
name: CI
|
|
||||||
defaults:
|
|
||||||
run:
|
|
||||||
working-directory: ./benchmark/
|
|
||||||
|
|
||||||
on:
|
|
||||||
workflow_dispatch:
|
|
||||||
branches: [master]
|
|
||||||
inputs:
|
|
||||||
agents:
|
|
||||||
description: 'Agents to run (comma-separated)'
|
|
||||||
required: false
|
|
||||||
default: 'gpt-engineer,smol-developer,Auto-GPT,mini-agi,beebot,BabyAGI,PolyGPT,Turbo' # Default agents if none are specified
|
|
||||||
schedule:
|
|
||||||
- cron: '0 8 * * *'
|
|
||||||
push:
|
|
||||||
branches: [master, ci-test*]
|
|
||||||
paths-ignore:
|
|
||||||
- 'reports/**'
|
|
||||||
pull_request:
|
|
||||||
branches: [stable, master, release-*, develop]
|
|
||||||
|
|
||||||
jobs:
|
|
||||||
lint:
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
env:
|
|
||||||
min-python-version: '3.10'
|
|
||||||
|
|
||||||
steps:
|
|
||||||
- name: Checkout repository
|
|
||||||
uses: actions/checkout@v3
|
|
||||||
with:
|
|
||||||
fetch-depth: 0
|
|
||||||
ref: ${{ github.event.pull_request.head.ref }}
|
|
||||||
repository: ${{ github.event.pull_request.head.repo.full_name }}
|
|
||||||
submodules: true
|
|
||||||
|
|
||||||
- name: Set up Python ${{ env.min-python-version }}
|
|
||||||
uses: actions/setup-python@v2
|
|
||||||
with:
|
|
||||||
python-version: ${{ env.min-python-version }}
|
|
||||||
|
|
||||||
- id: get_date
|
|
||||||
name: Get date
|
|
||||||
run: echo "date=$(date +'%Y-%m-%d')" >> $GITHUB_OUTPUT
|
|
||||||
|
|
||||||
- name: Install Poetry
|
|
||||||
run: |
|
|
||||||
curl -sSL https://install.python-poetry.org | python -
|
|
||||||
|
|
||||||
- name: Install dependencies
|
|
||||||
run: |
|
|
||||||
export POETRY_VIRTUALENVS_IN_PROJECT=true
|
|
||||||
poetry install -vvv
|
|
||||||
|
|
||||||
- name: Lint with flake8
|
|
||||||
run: poetry run flake8
|
|
||||||
|
|
||||||
- name: Check black formatting
|
|
||||||
run: poetry run black . --exclude test.py --check
|
|
||||||
if: success() || failure()
|
|
||||||
|
|
||||||
- name: Check isort formatting
|
|
||||||
run: poetry run isort . --check
|
|
||||||
if: success() || failure()
|
|
||||||
|
|
||||||
- name: Check for unused imports and pass statements
|
|
||||||
run: |
|
|
||||||
cmd="poetry run autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring agbenchmark"
|
|
||||||
$cmd --check || (echo "You have unused imports or pass statements, please run '${cmd} --in-place'" && exit 1)
|
|
||||||
if: success() || failure()
|
|
||||||
matrix-setup:
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
outputs:
|
|
||||||
matrix: ${{ steps.set-matrix.outputs.matrix }}
|
|
||||||
env-name: ${{ steps.set-matrix.outputs.env-name }}
|
|
||||||
steps:
|
|
||||||
- id: set-matrix
|
|
||||||
run: |
|
|
||||||
if [ "${{ github.event_name }}" == "schedule" ]; then
|
|
||||||
echo "::set-output name=env-name::production"
|
|
||||||
echo "::set-output name=matrix::[ 'gpt-engineer', 'smol-developer', 'Auto-GPT', 'mini-agi', 'beebot', 'BabyAGI', 'PolyGPT', 'Turbo' ]"
|
|
||||||
elif [ "${{ github.event_name }}" == "workflow_dispatch" ]; then
|
|
||||||
IFS=',' read -ra matrix_array <<< "${{ github.event.inputs.agents }}"
|
|
||||||
matrix_string="[ \"$(echo "${matrix_array[@]}" | sed 's/ /", "/g')\" ]"
|
|
||||||
echo "::set-output name=env-name::production"
|
|
||||||
echo "::set-output name=matrix::$matrix_string"
|
|
||||||
else
|
|
||||||
echo "::set-output name=env-name::testing"
|
|
||||||
echo "::set-output name=matrix::[ 'mini-agi' ]"
|
|
||||||
fi
|
|
||||||
|
|
||||||
tests:
|
|
||||||
environment:
|
|
||||||
name: '${{ needs.matrix-setup.outputs.env-name }}'
|
|
||||||
needs: matrix-setup
|
|
||||||
env:
|
|
||||||
GH_TOKEN: ${{ github.event_name == 'pull_request' && github.token || secrets.PAT }}
|
|
||||||
min-python-version: '3.10'
|
|
||||||
name: '${{ matrix.agent-name }}'
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
timeout-minutes: 50
|
|
||||||
strategy:
|
|
||||||
fail-fast: false
|
|
||||||
matrix:
|
|
||||||
agent-name: ${{fromJson(needs.matrix-setup.outputs.matrix)}}
|
|
||||||
steps:
|
|
||||||
- name: Print Environment Name
|
|
||||||
run: |
|
|
||||||
echo "Matrix Setup Environment Name: ${{ needs.matrix-setup.outputs.env-name }}"
|
|
||||||
|
|
||||||
- name: Checkout repository
|
|
||||||
uses: actions/checkout@v3
|
|
||||||
with:
|
|
||||||
fetch-depth: 0
|
|
||||||
ref: ${{ github.event.pull_request.head.ref }}
|
|
||||||
repository: ${{ github.event.pull_request.head.repo.full_name }}
|
|
||||||
submodules: true
|
|
||||||
token: ${{ env.GH_TOKEN }}
|
|
||||||
|
|
||||||
- name: Setup Chrome and ChromeDriver
|
|
||||||
run: |
|
|
||||||
sudo apt-get update
|
|
||||||
sudo apt-get install -y wget
|
|
||||||
wget https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb
|
|
||||||
sudo dpkg -i google-chrome-stable_current_amd64.deb
|
|
||||||
sudo apt-get install -f
|
|
||||||
|
|
||||||
- name: Set up Python ${{ env.min-python-version }}
|
|
||||||
uses: actions/setup-python@v2
|
|
||||||
with:
|
|
||||||
python-version: ${{ env.min-python-version }}
|
|
||||||
|
|
||||||
- id: get_date
|
|
||||||
name: Get date
|
|
||||||
run: echo "date=$(date +'%Y-%m-%d')" >> $GITHUB_OUTPUT
|
|
||||||
|
|
||||||
- name: Install Poetry
|
|
||||||
run: |
|
|
||||||
curl -sSL https://install.python-poetry.org | python -
|
|
||||||
|
|
||||||
- name: Install dependencies
|
|
||||||
run: |
|
|
||||||
poetry install -vvv
|
|
||||||
poetry build
|
|
||||||
|
|
||||||
- name: Run regression tests
|
|
||||||
run: |
|
|
||||||
cd agent/$AGENT_NAME
|
|
||||||
prefix=""
|
|
||||||
if [ "$AGENT_NAME" == "gpt-engineer" ]; then
|
|
||||||
make install
|
|
||||||
source venv/bin/activate
|
|
||||||
elif [ "$AGENT_NAME" == "Auto-GPT" ]; then
|
|
||||||
python -m venv venv
|
|
||||||
source venv/bin/activate
|
|
||||||
pip install -r requirements.txt
|
|
||||||
pip uninstall agbenchmark -y
|
|
||||||
elif [ "$AGENT_NAME" == "mini-agi" ]; then
|
|
||||||
python -m venv venv
|
|
||||||
source venv/bin/activate
|
|
||||||
pip install -r requirements.txt
|
|
||||||
cp .env_example .env
|
|
||||||
elif [ "$AGENT_NAME" == "smol-developer" ]; then
|
|
||||||
python -m venv venv
|
|
||||||
source venv/bin/activate
|
|
||||||
pip install -r requirements.txt
|
|
||||||
elif [ "$AGENT_NAME" == "BabyAGI" ]; then
|
|
||||||
python -m venv venv
|
|
||||||
source venv/bin/activate
|
|
||||||
pip install -r requirements.txt
|
|
||||||
elif [ "$AGENT_NAME" == "SuperAGI" ]; then
|
|
||||||
cp config_template.yaml config.yaml
|
|
||||||
sed -i 's/OPENAI_API_KEY:.*/OPENAI_API_KEY: "'"${{ secrets.OPENAI_API_KEY }}"'"/' config.yaml
|
|
||||||
docker-compose up -d --build
|
|
||||||
elif [ "$AGENT_NAME" == "beebot" ]; then
|
|
||||||
poetry install
|
|
||||||
poetry run playwright install
|
|
||||||
poetry run uvicorn beebot.initiator.api:create_app --factory --timeout-graceful-shutdown=1 &
|
|
||||||
prefix="poetry run "
|
|
||||||
elif [ "$AGENT_NAME" == "PolyGPT" ]; then
|
|
||||||
cp .env.template .env
|
|
||||||
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.1/install.sh | bash
|
|
||||||
export NVM_DIR=$HOME/.nvm
|
|
||||||
source $NVM_DIR/nvm.sh
|
|
||||||
nvm install && nvm use
|
|
||||||
yarn install
|
|
||||||
export NODE_TLS_REJECT_UNAUTHORIZED=0
|
|
||||||
elif [ "$AGENT_NAME" == "Turbo" ]; then
|
|
||||||
python -m venv venv
|
|
||||||
source venv/bin/activate
|
|
||||||
pip install -r requirements.txt
|
|
||||||
cp .env.template .env
|
|
||||||
sed -i 's/your-openai-api-key/${{ secrets.OPENAI_API_KEY }}/g' .env
|
|
||||||
else
|
|
||||||
echo "Unknown agent name: $AGENT_NAME"
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
|
|
||||||
pip install ../../dist/*.whl
|
|
||||||
|
|
||||||
bash -c "$(curl -fsSL https://raw.githubusercontent.com/merwanehamadi/helicone/b7ab4bc53e51d8ab29fff19ce5986ab7720970c6/mitmproxy.sh)" -s start
|
|
||||||
|
|
||||||
if [ "${GITHUB_EVENT_NAME}" == "pull_request" ] || [ "${{ github.event_name }}" == "push" ]; then
|
|
||||||
set +e # Ignore non-zero exit codes and continue execution
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --maintain --mock"
|
|
||||||
${prefix}agbenchmark start --maintain --mock
|
|
||||||
EXIT_CODE=$?
|
|
||||||
set -e # Stop ignoring non-zero exit codes
|
|
||||||
# Check if the exit code was 5, and if so, exit with 0 instead
|
|
||||||
if [ $EXIT_CODE -eq 5 ]; then
|
|
||||||
echo "regression_tests.json is empty."
|
|
||||||
fi
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --mock"
|
|
||||||
${prefix}agbenchmark start --mock
|
|
||||||
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --mock --category=retrieval"
|
|
||||||
${prefix}agbenchmark start --mock --category=retrieval
|
|
||||||
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --mock --category=interface"
|
|
||||||
${prefix}agbenchmark start --mock --category=interface
|
|
||||||
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --mock --category=code"
|
|
||||||
${prefix}agbenchmark start --mock --category=code
|
|
||||||
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --mock --category=memory"
|
|
||||||
${prefix}agbenchmark start --mock --category=memory
|
|
||||||
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --mock --suite TestRevenueRetrieval"
|
|
||||||
${prefix}agbenchmark start --mock --suite TestRevenueRetrieval
|
|
||||||
|
|
||||||
echo "Running the following command: ${prefix}agbenchmark start --test=TestWriteFile"
|
|
||||||
${prefix}agbenchmark start --test=TestWriteFile
|
|
||||||
|
|
||||||
cd ../..
|
|
||||||
poetry install
|
|
||||||
poetry run uvicorn server:app --reload &
|
|
||||||
sleep 5
|
|
||||||
export AGENT_NAME=mini-agi
|
|
||||||
echo "poetry run agbenchmark start --mock --api_mode --host=http://localhost:8000"
|
|
||||||
poetry run agbenchmark start --mock --api_mode --host=http://localhost:8000
|
|
||||||
else
|
|
||||||
echo "${prefix}agbenchmark start"
|
|
||||||
${prefix}agbenchmark start || echo "This command will always return a non zero exit code unless all the challenges are solved."
|
|
||||||
fi
|
|
||||||
|
|
||||||
cd ../..
|
|
||||||
|
|
||||||
env:
|
|
||||||
GITHUB_EVENT_NAME: ${{ github.event_name }}
|
|
||||||
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
|
|
||||||
AGENT_NAME: ${{ matrix.agent-name }}
|
|
||||||
PROMPT_USER: false # For mini-agi. TODO: Remove this and put it in benchmarks.py
|
|
||||||
HELICONE_API_KEY: ${{ secrets.HELICONE_API_KEY }}
|
|
||||||
BASERUN_API_KEY: ${{ secrets.BASERUN_API_KEY }}
|
|
||||||
REQUESTS_CA_BUNDLE: /etc/ssl/certs/ca-certificates.crt
|
|
||||||
HELICONE_CACHE_ENABLED: false
|
|
||||||
HELICONE_PROPERTY_AGENT: ${{ matrix.agent-name }}
|
|
||||||
REPORT_LOCATION: ${{ format('../../reports/{0}', matrix.agent-name) }}
|
|
||||||
WOLFRAM_ALPHA_APPID: ${{ secrets.WOLFRAM_ALPHA_APPID }}
|
|
||||||
SERPER_API_KEY: ${{ secrets.SERPER_API_KEY }}
|
|
||||||
BING_SUBSCRIPTION_KEY: ${{ secrets.BING_SUBSCRIPTION_KEY }}
|
|
||||||
|
|
||||||
- name: Upload reports
|
|
||||||
if: always()
|
|
||||||
uses: actions/upload-artifact@v3
|
|
||||||
with:
|
|
||||||
name: ${{ matrix.agent-name }}
|
|
||||||
path: reports/${{ matrix.agent-name }}
|
|
||||||
|
|
||||||
- name: Authenticate and Push to Branch
|
|
||||||
if: (success() || failure()) && (github.event_name == 'schedule' || github.event_name == 'workflow_dispatch')
|
|
||||||
run: |
|
|
||||||
git config --global user.email "github-bot@agpt.co"
|
|
||||||
git config --global user.name "Auto-GPT-Bot"
|
|
||||||
|
|
||||||
git add reports/* || echo "nothing to commit"
|
|
||||||
commit_message="${{ matrix.agent-name }}-$(date +'%Y%m%d%H%M%S')"
|
|
||||||
git commit -m "${commit_message}"
|
|
||||||
git stash
|
|
||||||
current_branch=${{ github.ref_name }}
|
|
||||||
attempts=0
|
|
||||||
max_attempts=3
|
|
||||||
|
|
||||||
while [ $attempts -lt $max_attempts ]; do
|
|
||||||
git fetch origin $current_branch
|
|
||||||
git rebase origin/$current_branch
|
|
||||||
if git push origin HEAD; then
|
|
||||||
echo "Success!"
|
|
||||||
poetry run python reports/send_to_googledrive.py || echo "Failed to upload to Google Drive"
|
|
||||||
exit 0
|
|
||||||
else
|
|
||||||
echo "Attempt $(($attempts + 1)) failed. Retrying..."
|
|
||||||
attempts=$(($attempts + 1))
|
|
||||||
fi
|
|
||||||
done
|
|
||||||
|
|
||||||
echo "Failed after $max_attempts attempts."
|
|
||||||
env:
|
|
||||||
GDRIVE_BASE64: ${{ secrets.GDRIVE_BASE64 }}
|
|
||||||
GITHUB_REF_NAME: ${{ github.ref_name }}
|
|
||||||
Loading…
Reference in New Issue