Commit Graph

670 Commits (4c30b47bbca4503a61fc6bad37afb7764ffb91b4)

Author SHA1 Message Date
Maiko Bossuyt 4c30b47bbc Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 20:40:41 +02:00
Maiko Bossuyt 2afc89a1a4
Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 20:40:11 +02:00
Richard Beales 0528aacfb7
Merge pull request #827 from PierreBastiani/user_input-quality_of_life
check for authorise 'y' without trailing space
2023-04-12 19:36:58 +01:00
Richard Beales bc75c74eef
Merge pull request #957 from cryptidv/master
Adds a '--use-memory' flag to choose memory backend at runtime
2023-04-12 19:33:30 +01:00
Richard Beales 5bb77a8751
Merge pull request #794 from crimson-knight/add-documentation-for-caching-types
Adds information on how to use the other cache methods available
2023-04-12 19:31:23 +01:00
Seth T d24c4af37d
Merge branch 'master' into add-documentation-for-caching-types 2023-04-12 14:27:07 -04:00
Maiko Bossuyt 280647ff38 Update data_ingestion.py
move the search_file function inside the data_ingestion script
add memory initialisation argument
add overlap argument
add chunk max_length argument
2023-04-12 20:19:36 +02:00
Maiko Bossuyt 4465486ea3 Update file_operations.py
move the search_file function inside the data_ingestion script
2023-04-12 20:19:27 +02:00
Richard Beales f9d8f728fa
Merge pull request #981 from fabricehong/feat_log-activity-and-error-in-files-3
logging activity and error in log files in addition to the console - attempt 2
2023-04-12 19:14:05 +01:00
Fabrice Hong 9f8b9db7bb fix(global): fix wrong calls 2023-04-12 20:08:47 +02:00
Fabrice Hong 0f3c85335c fix(logger): fix file handler not outputing DEBUG 2023-04-12 19:57:22 +02:00
Fabrice Hong 158c576a87 refactor(logger): rename the typewriter log function from 'log' to 'typewriter_log' 2023-04-12 19:57:17 +02:00
Fabrice Hong 862d44ea39 fix(logger): fix typewriter simulation doesn't work well with Typing spinner 2023-04-12 19:54:03 +02:00
Maiko Bossuyt 8faa6ef949 Create data_ingestion.py
This script is use when we want to seed Auto-GPT memory with one or multiple documents.

The document are read, split into chunks and store in the memory.
2023-04-12 19:47:51 +02:00
Maiko Bossuyt c91117616f Update file_operations.py
revert change in import as we don't need them
2023-04-12 19:46:58 +02:00
Maiko Bossuyt 7975c184a5 Update .gitignore
add new log file to gitignore
2023-04-12 19:46:39 +02:00
Fabrice Hong 1f5049a9c4 doc(logger): added class documentation 2023-04-12 19:41:11 +02:00
Fabrice Hong 43c006d71c feat(global): errors logs are logged as debug level and activated with program argument 'debug' 2023-04-12 19:41:08 +02:00
Maiko Bossuyt 137751f95c
Merge branch 'Torantulino:master' into add_ingest_documents_script 2023-04-12 19:36:40 +02:00
Richard Beales 0e004f5c14
Merge pull request #697 from Wladastic/fix-user-feedback-json-error
fix json parser
2023-04-12 18:22:47 +01:00
Richard Beales 0270696616
Merge pull request #865 from drikusroor/add-unit-tests-workflow
Add unit tests workflow
2023-04-12 18:15:40 +01:00
Richard Beales 364e2a4ba1
Merge branch 'master' into add-unit-tests-workflow 2023-04-12 18:14:37 +01:00
Maiko Bossuyt d7609b3095 Merge branch 'add_ingest_documents_script' of https://github.com/maiko/Auto-GPT into add_ingest_documents_script 2023-04-12 19:13:26 +02:00
Maiko Bossuyt 0dddc94bda Add file ingestion methode in file_operations.py
Add the following functions to ingest data into memory before Auto-GPT run.

- split_file: given a content, split it in chunks of max_length with (or without) a specified overlap

- ingest_file: read a file, use split_file to split it in chunks and load each chunk in memory

- ingest_directory: ingest all files in a directory in memory
2023-04-12 19:13:04 +02:00
Richard Beales 9c9758c720
Merge pull request #700 from Rokniel/azure-deployment-additions
Add required env parameters for azure usage
2023-04-12 18:08:54 +01:00
Richard Beales c98471e333
Merge pull request #685 from STRML/fix/json-parsing
Fix various JSON input bugs
2023-04-12 18:03:34 +01:00
Richard Beales a7176cd229
Merge pull request #215 from slavakurilyak/security-and-robustness-improvements
Improve Security and Robustness in browse.py
2023-04-12 17:37:44 +01:00
Samuel Reed 434f27fb51 Fix various JSON input bugs in correction
By not having correct_json(json_str) in the try/except,
it was still easily possible to throw Invalid JSON errors.

When responses were received with no JSON at all, parsing
would fail on attempting to locate the braces.
2023-04-12 10:34:33 -04:00
Eesa Hamza ec6918ab48 Added some comments 2023-04-12 16:59:50 +03:00
Eesa Hamza 083ccb6bd3 Added a memory backend argument 2023-04-12 16:58:39 +03:00
Wlad 0105dd340a Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-12 15:01:24 +02:00
sarango 16b37fff1d Fix to LocalCache add method, created integration test for it 2023-04-12 21:49:23 +12:00
Richard Beales ae6adb4ade
Merge pull request #770 from honeykjoule/update-gitignore
update gitignore venv/* to *venv/*
2023-04-12 10:12:15 +01:00
Richard Beales 3f693b9234
Merge pull request #752 from josephbisaillon/patch-3
Add OpenAPI Key Link to README
2023-04-12 10:11:16 +01:00
Manal Arora 94441ee63b
correcting the clone command in contributing.md (#927)
* correcting the clone command in contributing.md

* removing extra newlines added in previous commit

removing extra newlines added in previous commit
2023-04-12 10:07:50 +01:00
Richard Beales 3ea57ca326
Merge pull request #888 from chozzz/bugfix
Bugfix for #803 - Debug mode
2023-04-12 10:06:04 +01:00
Wlad c6605b06c5 Merge remote-tracking branch 'upstream/master' into fix-user-feedback-json-error 2023-04-12 10:58:09 +02:00
Wlad 4063483b87 add my fixes 2023-04-12 10:56:54 +02:00
Richard Beales 9558f7a6c0
Merge pull request #746 from blankster/patch-3
Update .gitignore to ignore potential .idea folder
2023-04-12 09:56:44 +01:00
Richard Beales 4dbf72159d
Merge pull request #542 from ccheney/attr-error-lower
command_name null check before calling .lower()
2023-04-12 09:54:05 +01:00
Richard Beales a0cebb02db
Merge pull request #733 from keenborder786/gpt_4_only_option
GPT-4 Only Option
2023-04-12 09:36:45 +01:00
Richard Beales 56ed3eed9b
Merge pull request #871 from Legionof7/typofix
Changed spelling from "GTP" to "GPT". Also removed the 3 as this can run on GPT4.
2023-04-12 09:25:43 +01:00
Drikus Roor 5265d81754 docs: Prepare unit test workflow status badge for Torantulino's repository 2023-04-12 10:16:42 +02:00
Drikus Roor 0e5271b62a ci: Set continue on error to false 2023-04-12 10:16:42 +02:00
Drikus Roor d8f9d1df98 fix: Fix json_parsers tests 2023-04-12 10:16:42 +02:00
Drikus Roor ed120c3a39 fix: Fix browse scrape test 2023-04-12 10:16:42 +02:00
Drikus Roor b3c23ee0d3 chore: Rename workflow to "Unit Tests" 2023-04-12 10:16:42 +02:00
Drikus Roor 0adc4239b7 ci: Calculate coverage only over scripts folder 2023-04-12 10:16:42 +02:00
Drikus Roor 331597eb0e docs: Add badge of unit tests status 2023-04-12 10:16:42 +02:00
Drikus Roor bcdf948e55 docs: Update README.md about running tests and coverage 2023-04-12 10:16:42 +02:00