Commit Graph

543 Commits (bf24cd9508316031b2f914359460363d2fb75c04)

Author SHA1 Message Date
Richard Beales dabaa9d6a8
Merge pull request #965 from nolan23/master
pull image if it's not found locally
2023-04-13 07:26:30 +01:00
Richard Beales 49b65590ea
Merge pull request #781 from chozzz/fix/refactor-code
Remove duplicated unnecessary codes
2023-04-13 07:17:37 +01:00
Richard Beales 8e30edba2c
Merge pull request #463 from muellerberndt/shellcommands
Add capability to execute shell commands
2023-04-13 07:16:52 +01:00
Peter Edwards 5cec481711
Merge branch 'Torantulino:master' into more_azure 2023-04-13 08:13:03 +02:00
Peter Edwards bcdb4e476f Merge remote-tracking branch 'upstream/master' into more_azure 2023-04-13 08:12:29 +02:00
Bernhard Mueller f79c7c4d1e Fix linter errors 2023-04-13 12:43:25 +07:00
Bernhard Mueller 946700fcf7 Change workdir logic 2023-04-13 11:27:43 +07:00
Bernhard Mueller 3ff2323450 Rename command & functions to execute_shell 2023-04-13 11:04:26 +07:00
Alrik Olson a3eedfcd2f Merge branch 'master' into prompt-generator 2023-04-12 19:48:33 -07:00
Kory Becker db9f8a2749 Added config option for OPENAI_API_TYPE=azure_ad 2023-04-12 22:14:51 -04:00
Merwane Hamadi 84c128fd0f Create NoMemory provider as a memory provider that does not store any data 2023-04-12 17:48:11 -07:00
Merwane Hamadi 62bd93a4d2 Import NoMemory and add it as a memory_backend option in get_memory function 2023-04-12 17:48:08 -07:00
vadi c594200195 Remove duplicated unnecessary config instance 2023-04-13 10:01:52 +10:00
Merwane Hamadi f4831348e8 Use configured temperature value in create_chat_completion function 2023-04-12 16:27:11 -07:00
Merwane Hamadi 4faba1fdd8 Add temperature configuration option to Config class 2023-04-12 16:27:01 -07:00
Joseph C. Miller, II a5d4ffd945 Merge branch 'master' into continuous-mode-limit 2023-04-12 15:50:05 -06:00
Joseph C. Miller, II d706a3436d Make configuration similar to other arguments. 2023-04-12 15:39:25 -06:00
Joseph C. Miller, II 12e1fcca92 Correct the checking for continuous limit without continuous mode 2023-04-12 15:36:35 -06:00
Maiko Bossuyt 36d455c20e split_file() rework
rework the split_file function to make it simple and only have one yield while providing an overlap at the start and end of each chunk
2023-04-12 23:31:26 +02:00
Joseph C. Miller, II 5badde2c27 Add message to explain exit. 2023-04-12 15:30:34 -06:00
Maiko Bossuyt 3a2ccbd02f
Merge branch 'master' into add_website_memory 2023-04-12 23:18:09 +02:00
Itamar Friedman 3e53e976a5 flake8 style 2023-04-13 00:06:23 +03:00
Itamar Friedman bf3c76ced7 flake8 style 2023-04-13 00:04:08 +03:00
Itamar Friedman 9f972f4ee9 flake8 style 2023-04-13 00:00:33 +03:00
Maiko Bossuyt 2c8b42307b
Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 22:52:08 +02:00
Itamar Friedman 54478b35f2 Merge branch 'master' into browse_scrape_links_test_and_validate 2023-04-12 23:51:53 +03:00
Eesa Hamza 76b5b95744 Attempt to fix Linter issues 2023-04-12 23:49:32 +03:00
Maiko Bossuyt 2e0b44ae05 fix chunk creation
the last chunk wasn't correctly created, this commit fix that issue.
2023-04-12 22:46:49 +02:00
Eesa Hamza 8c51fe8373 Added new logging function as an error or warning message 2023-04-12 23:38:53 +03:00
Eesa Hamza 5d871f04e6 Added pinecone connectivity check and added relevant logging 2023-04-12 23:29:54 +03:00
Eesa Hamza a850c27dd5 Improved logging on connection fail to redis 2023-04-12 23:13:34 +03:00
Drikus Roor 1f837968ff fix: Fix flake8 errors based on the flake8 command with a narrower definition of errors 2023-04-12 22:12:25 +02:00
Itamar Friedman 57bca3620e minor style 2023-04-12 23:04:43 +03:00
Itamar Friedman c63645cbba redo suggested changes. move unit test files to the fitting directory 2023-04-12 22:41:23 +03:00
Itamar Friedman 7c0c896600 Merge branch 'master' into browse_scrape_links_test_and_validate 2023-04-12 22:31:51 +03:00
Richard Beales 7e3ff66494
Merge pull request #913 from chozzz/bugfix-823
Bugfix for #840 - Local memory fix
2023-04-12 20:07:50 +01:00
Maiko Bossuyt 4c30b47bbc Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 20:40:41 +02:00
Maiko Bossuyt 2afc89a1a4
Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 20:40:11 +02:00
Richard Beales 0528aacfb7
Merge pull request #827 from PierreBastiani/user_input-quality_of_life
check for authorise 'y' without trailing space
2023-04-12 19:36:58 +01:00
Richard Beales bc75c74eef
Merge pull request #957 from cryptidv/master
Adds a '--use-memory' flag to choose memory backend at runtime
2023-04-12 19:33:30 +01:00
Maiko Bossuyt 280647ff38 Update data_ingestion.py
move the search_file function inside the data_ingestion script
add memory initialisation argument
add overlap argument
add chunk max_length argument
2023-04-12 20:19:36 +02:00
Maiko Bossuyt 4465486ea3 Update file_operations.py
move the search_file function inside the data_ingestion script
2023-04-12 20:19:27 +02:00
Fabrice Hong 9f8b9db7bb fix(global): fix wrong calls 2023-04-12 20:08:47 +02:00
Fabrice Hong 0f3c85335c fix(logger): fix file handler not outputing DEBUG 2023-04-12 19:57:22 +02:00
Fabrice Hong 158c576a87 refactor(logger): rename the typewriter log function from 'log' to 'typewriter_log' 2023-04-12 19:57:17 +02:00
Fabrice Hong 862d44ea39 fix(logger): fix typewriter simulation doesn't work well with Typing spinner 2023-04-12 19:54:03 +02:00
Maiko Bossuyt 8faa6ef949 Create data_ingestion.py
This script is use when we want to seed Auto-GPT memory with one or multiple documents.

The document are read, split into chunks and store in the memory.
2023-04-12 19:47:51 +02:00
Maiko Bossuyt c91117616f Update file_operations.py
revert change in import as we don't need them
2023-04-12 19:46:58 +02:00
Fabrice Hong 1f5049a9c4 doc(logger): added class documentation 2023-04-12 19:41:11 +02:00
Fabrice Hong 43c006d71c feat(global): errors logs are logged as debug level and activated with program argument 'debug' 2023-04-12 19:41:08 +02:00
Maiko Bossuyt 137751f95c
Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 19:36:40 +02:00
Richard Beales 0e004f5c14
Merge pull request #697 from Wladastic/fix-user-feedback-json-error
fix json parser
2023-04-12 18:22:47 +01:00
Richard Beales 364e2a4ba1
Merge branch 'master' into add-unit-tests-workflow 2023-04-12 18:14:37 +01:00
Maiko Bossuyt d7609b3095 Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 19:13:26 +02:00
Maiko Bossuyt 0dddc94bda Add file ingestion methode in file_operations.py
Add the following functions to ingest data into memory before Auto-GPT run.

- split_file: given a content, split it in chunks of max_length with (or without) a specified overlap

- ingest_file: read a file, use split_file to split it in chunks and load each chunk in memory

- ingest_directory: ingest all files in a directory in memory
2023-04-12 19:13:04 +02:00
Richard Beales 9c9758c720
Merge pull request #700 from Rokniel/azure-deployment-additions
Add required env parameters for azure usage
2023-04-12 18:08:54 +01:00
Richard Beales c98471e333
Merge pull request #685 from STRML/fix/json-parsing
Fix various JSON input bugs
2023-04-12 18:03:34 +01:00
Bernhard Mueller 940772b502 Merge branch 'shellcommands' of github.com:muellerberndt/Auto-GPT into shellcommands 2023-04-12 23:47:16 +07:00
Bernhard Mueller affe77e18c Call subprocess.run with shell=True 2023-04-12 23:46:55 +07:00
Richard Beales a7176cd229
Merge pull request #215 from slavakurilyak/security-and-robustness-improvements
Improve Security and Robustness in browse.py
2023-04-12 17:37:44 +01:00
Bernhard Mueller 9e8d35277b
Update scripts/commands.py
Co-authored-by: Peter Stalman <sarkedev@gmail.com>
2023-04-12 23:32:17 +07:00
Bernhard Mueller cc9723c26e Make chdir code more robust 2023-04-12 23:30:35 +07:00
Bernhard Mueller 15dffed6e5 Merge branch 'master' of github.com:Torantulino/Auto-GPT into shellcommands 2023-04-12 23:15:31 +07:00
Maiko Bossuyt 8baa0769b1 Update config.py 2023-04-12 18:03:59 +02:00
Maiko Bossuyt a615e57061 Revert "Update main.py"
This reverts commit c785352ed2.
2023-04-12 18:00:17 +02:00
profound c5f0cb3d3f fix read config file encoding that broke Chinese 2023-04-12 23:38:30 +08:00
roby.parapat 730fbf591f pull image if it's not found locally 2023-04-12 22:15:22 +07:00
Maiko Bossuyt 5bb551db95 add the url variable in the get_text_summary function to pass it to the memory
By sending the url along when calling browse.summarize_text, we can then add it along the chunk in memory.
2023-04-12 16:42:14 +02:00
Maiko Bossuyt b20c0117c5 Add memory management to browse.py
- Change the way User-Agent is handle when calling requests to browse website

- Add chunk to memory before and after summary. We do not save the "summary of summaries" as this wasn't performing great and caused noise when the "question" couldn't be answered.

- Use the newly added config parameters for max_length and max_token
2023-04-12 16:38:49 +02:00
Maiko Bossuyt c986e87135 Edit config Class to manage browse_website command chunk size and summary size
I added two new config parameters:

- browse_chunk_max_length: define the max_length of a chunk being sent to the memory and to FAST_LLM_MODEL for summarizing

- browse_summary_max_token: define the max_token passed to the model use for summary creation. Changing this can help with complex subject, allowing the agent to be more verbose in its attemps to summarize the chunk and the chunks summary.

I've also edited the way the user_agent is handle.
2023-04-12 16:36:27 +02:00
Samuel Reed 434f27fb51 Fix various JSON input bugs in correction
By not having correct_json(json_str) in the try/except,
it was still easily possible to throw Invalid JSON errors.

When responses were received with no JSON at all, parsing
would fail on attempting to locate the braces.
2023-04-12 10:34:33 -04:00
Alrik Olson 2ef9928a2e Merge remote-tracking branch 'origin/master' into prompt-generator 2023-04-12 07:33:36 -07:00
Maiko Bossuyt c785352ed2 Update main.py
clean trailing whitespace
2023-04-12 16:23:09 +02:00
Eesa Hamza ec6918ab48 Added some comments 2023-04-12 16:59:50 +03:00
Eesa Hamza 083ccb6bd3 Added a memory backend argument 2023-04-12 16:58:39 +03:00
Wlad 0105dd340a Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-12 15:01:24 +02:00
Peter Edwards 6fa9501251
Merge branch 'Torantulino:master' into more_azure 2023-04-12 13:28:23 +02:00
Gull Man c932087997 add encoding to open file 2023-04-12 12:13:18 +02:00
sarango 16b37fff1d Fix to LocalCache add method, created integration test for it 2023-04-12 21:49:23 +12:00
Peter Edwards 650e2dcd6d cleaned up .env to move Azure config to separate azure.yaml file
updated README.md to explain new config
added Azure yaml loader to config class
centralized model retrieval into config class
this commit effectively combines and replaces #700 and #580
2023-04-12 11:27:37 +02:00
Itamar Friedman 1a7159095a Merge remote-tracking branch 'upstream/master' into browse_scrape_links_test_and_validate 2023-04-12 12:18:16 +03:00
Richard Beales 3ea57ca326
Merge pull request #888 from chozzz/bugfix
Bugfix for #803 - Debug mode
2023-04-12 10:06:04 +01:00
Wlad c6605b06c5 Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-12 10:58:09 +02:00
Wlad 4063483b87 add my fixes 2023-04-12 10:56:54 +02:00
Richard Beales 4dbf72159d
Merge pull request #542 from ccheney/attr-error-lower
command_name null check before calling .lower()
2023-04-12 09:54:05 +01:00
Itamar Friedman e8b7a117da Merge remote-tracking branch 'origin/master' into browse_scrape_links_test_and_validate 2023-04-12 11:51:43 +03:00
Itamar Friedman 98778cea73 Merge remote-tracking branch 'upstream/master' 2023-04-12 11:48:55 +03:00
Richard Beales a0cebb02db
Merge pull request #733 from keenborder786/gpt_4_only_option
GPT-4 Only Option
2023-04-12 09:36:45 +01:00
Richard Beales 56ed3eed9b
Merge pull request #871 from Legionof7/typofix
Changed spelling from "GTP" to "GPT". Also removed the 3 as this can run on GPT4.
2023-04-12 09:25:43 +01:00
Drikus Roor f34751a0c3 revert: Revert relative imports in scripts and fix imports in tests 2023-04-12 10:16:00 +02:00
Drikus Roor d0ae72e63b refactor: Refactor imports to be compatible with unit tests 2023-04-12 10:16:00 +02:00
Richard Beales c765b345b4
Merge pull request #904 from endolith/typos
Fix some typos
2023-04-12 08:50:06 +01:00
Toran Bruce Richards 429317e6b2
Merge pull request #910 from dillweed/Elevenlabs-Voice-ID-ENV
Elevenlabs voice ID
2023-04-12 19:26:12 +12:00
Toran Bruce Richards 4c6f18bc59
Merge pull request #878 from Androbin/patch-1
Fix Spinner
2023-04-12 19:22:31 +12:00
Peter Edwards 17b037faf7
Merge branch 'Torantulino:master' into more_azure 2023-04-12 09:18:17 +02:00
Toran Bruce Richards e4bb730826
Merge pull request #759 from BillSchumacher/fix-too-specific-except
Fix case where index throws value error.
2023-04-12 18:51:57 +12:00
vadi 7736762b5a Fix #840 - Add defensive coding for local memory to load the JSON file that was gitignored at 54101c7997
- Added unit test placholder for local cache test
- Removed unused imports from local cache unit test placeholder
2023-04-12 16:38:53 +10:00
vadi bc6f34d7dc Fixes #803
- Brings back debug mode
- Replaces all calls from cfg.debug to cfg.debug_mode that was updated on 5b2d6010dc
- Remove unnecessary config instance at main.py
2023-04-12 16:32:16 +10:00
Dill f8438aabc2 Added option for custom elevenlabs voice IDs. 2023-04-11 21:37:03 -07:00
endolith cf8b06f11f Fix some typos 2023-04-12 00:11:24 -04:00
Chris Cheney 3ffff9f112 Merge branch 'master' of github.com:Torantulino/Auto-GPT into attr-error-lower 2023-04-11 22:51:53 -05:00
Robin Richtsfeld afc7fa6e26
Fix JSON formatting in prompt.txt 2023-04-12 03:09:08 +02:00
Robin Richtsfeld 8d7e0153f0
Fix Spinner 2023-04-12 02:26:30 +02:00
JZ 9725c727da
Changed spelling from "GTP" to "GPT". Also removed the 3 as this can run on GPT4. 2023-04-11 16:22:26 -07:00
Denis Mozhayskiy 990297b463 Easy run bat files with requirements check 2023-04-12 02:18:07 +03:00
Wlad edf364efe8 Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-11 23:32:31 +02:00
meta-fx 570f76bd51 Removed trailing spaces and fixed CRLF being removed 2023-04-11 14:44:22 -05:00
Alrik Olson 7a0c9e8a9d fix attempts to import a non-existent module 2023-04-11 10:30:53 -07:00
Alrik Olson 72d4783a1d formatting 2023-04-11 09:21:20 -07:00
Alrik Olson b73bca6b2d Merge remote-tracking branch 'origin/master' into prompt-generator 2023-04-11 09:17:36 -07:00
Alrik Olson fd1cfd2eff Add docs and format code 2023-04-11 09:15:45 -07:00
Alrik Olson b19eb74874 Refactor the seed prompt to be generated programmatically
This removes the tedium of having to re-number every numbered item in the prompt.txt if you want to add/remove commands.
2023-04-11 09:09:59 -07:00
Slava Kurilyak (slavakurilyak.eth) e9e4f11b4a
Merge branch 'master' into security-and-robustness-improvements 2023-04-11 09:32:51 -06:00
kinance e0cb648858 Make the cfg.debug to cfg.debug_mode consistent across files 2023-04-11 23:01:49 +09:00
PierreBastiani dbb78b636f check for authorise 'y' without trailing space 2023-04-11 14:57:29 +01:00
meta-fx efd6a7ecf5
Merge branch 'master' into added-new-voice 2023-04-11 08:39:15 -05:00
meta-fx 3cdde2d49c Resolved conflicts in config.py and speak.py 2023-04-11 08:15:58 -05:00
Toran Bruce Richards d7b747600d
Merge pull request #782 from onekum/patch-1
Change "an" to "a"
2023-04-11 12:55:27 +01:00
Peter Edwards 23f46adc61
Merge branch 'Torantulino:master' into more_azure 2023-04-11 13:54:07 +02:00
Itamar Friedman 1210ba41d0 Merge remote-tracking branch 'upstream/master' 2023-04-11 14:47:28 +03:00
Peter Edwards 9d33a75083 Changes for Azure embedding handling 2023-04-11 13:45:37 +02:00
coditamar f6c8a0f289
Merge branch 'master' into browse_scrape_links_test_and_validate 2023-04-11 14:43:57 +03:00
Toran Bruce Richards 186a8c615e
Merge pull request #678 from kinance/kinance-resolve-debug-config-conflict
Resolve the conflict around debug mode flag after pull merge
2023-04-11 12:34:01 +01:00
Toran Bruce Richards ff7c000c83
Merge pull request #786 from kinance/kiannce-remove-duplicate-debug-mode
Remove duplicates of set debug mode func
2023-04-11 12:31:44 +01:00
kinance b06974904c Remove duplicates of set debug mode func 2023-04-11 19:26:23 +09:00
Rokniel 63d3238c6c
Merge branch 'master' into azure-deployment-additions 2023-04-11 12:21:46 +03:00
onekum b90f355e7d
Change "an" to "a"
Grammar error: In English, only words starting with (a, e, i, o, u) get "an".
2023-04-11 05:01:02 -04:00
Itamar Friedman 64c21ee8f7 browse: make scrape_links() & scrape_text() "status_code >= 400" error message the same 2023-04-11 11:40:52 +03:00
Itamar Friedman 2d5d0131bb browse: (1) apply validation also to scrape_links(), (2) add tests for scrape_links() 2023-04-11 11:17:07 +03:00
Andy Melnikov d12da33e55 Fix flake8 W293 and W391 2023-04-11 07:53:32 +02:00
Toran Bruce Richards 5a6e565c52
Merge pull request #706 from Sma-Das/remove_imports
[Cleanup] Removed unneeded imports
2023-04-11 06:17:44 +01:00
BillSchumacher 66d316a19c
Fix case where index throws value error. 2023-04-10 21:55:35 -05:00
Toran Bruce Richards 3ed3f16d14
Merge pull request #242 from bituq/master
Fixed speech blocking main thread
2023-04-11 03:31:04 +01:00
Bernhard Mueller aba7956f10
Merge branch 'master' into shellcommands 2023-04-11 09:25:53 +07:00
meta-fx 3ee62211db Fixed formatting issues 2023-04-10 20:56:27 -05:00
Toran Bruce Richards 95f9380f13
Merge pull request #747 from BillSchumacher/fix-json-error
Update json_utils.py
2023-04-11 02:06:15 +01:00
meta-fx 0cf790b633 Added new env variable and speech function for alternative TTS voice 2023-04-10 20:00:43 -05:00
BillSchumacher efcc6a3f76
Update json_utils.py
This was used differently in a local branch and an error.
2023-04-10 19:50:40 -05:00
Wlad 365ef9b50b cleanup 2023-04-11 01:57:49 +02:00
BillSchumacher 1b128a1ef0
Use UTF-8 encoding for Windows users. 2023-04-10 18:50:54 -05:00
kinance 3695c1e0e6
Merge branch 'Torantulino:master' into kinance-resolve-debug-config-conflict 2023-04-11 08:49:43 +09:00
Wlad a86948fa23 include broken json in error log 2023-04-11 01:31:18 +02:00
Wlad 87a2cf029d try another fix 2023-04-11 01:30:07 +02:00
Wlad e80091c482 Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-11 01:27:27 +02:00
Wlad 82379bb416 fix dump 2023-04-11 01:02:45 +02:00
Dylan N 6ab197a9c5
Merge branch 'master' into master 2023-04-11 00:52:28 +02:00
Bituq 353785d23d Fix macos_tts_speech merge conflict 2023-04-11 00:50:57 +02:00
Toran Bruce Richards ed581461df
Merge pull request #712 from nponeccop/pr-whitespace2
Remove trailing whitespace throughout
2023-04-10 23:02:31 +01:00
Toran Bruce Richards 78d2d57b8d
Merge pull request #702 from yoshikouki/clean-up-command
Remove unnecessary assignments
2023-04-10 23:00:15 +01:00
Toran Bruce Richards 7c5e3b03c5
Merge pull request #690 from onekum/patch-2
Restrict browse from accessing local files
2023-04-10 22:57:02 +01:00