anything-llm/.devcontainer
Timothy Carambat ed92637f66
Render v1.10.0 (#4892)
* Migrate to `bcryptjs` (#4767)

* Replace bcrypt with bcryptjs across multiple files

* dev build

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Refactor frontend legacy JSON.parse with safeJsonParse (#4759)

* replace all frontend legacy JSON.parse with safeJsonParse

* default collapsed sidebar menu on failed parse

* remove extra check on conditional render

* undo singular json parse

* add guard clause and return null for `userFromStorage`

* patch domainList

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Fix pagination bug in paperless-ngx data connector (#4757)

* iterate over all pages in paperless-ngx data connector

* add error handling and data validation

* refactor to handle edge cases and null values

* catch edge case to prevent infinite loop

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Fix Stale User Session with Proper `fetch` Error Handling (#4770)

* add refresh user functionality

* prettier

* add eslint disable comment for exhaustive-deps warning in AuthContext to stop nagging about navigate func

* remove unused imports and fix typo

* handle unsafe parse of undefined for in-session user deleted

* Refactor refreshUser function to handle errors and return structured response. Update AuthProvider to manage user data based on success status.

* Remove console error logging from promise catch in System model for cleaner error handling.

* change status from 404 to 400 and valid to success

* Refactor error handling in AuthProvider's refreshUser logic to remove redundant catch block and streamline user session management on failure.

* prettier

* reorder clauses - return errors

* refactor
account for all user modes
dev build

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Add Auth Token to Ollama Embedding Client (#4766)

* Enhance OllamaEmbedder to support authentication by adding an authorization token in headers for client initialization.

* Add optional Auth Token input for Ollama embedding options

* move info elements

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Upgrade to Multer 2.0.0 (#4768)

* upgrade to multer 2.0.0

* bump dev

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Implement Global Error Boundary (#4765)

* Implement global error boundary

* add 404 page for generic path catching

* devbuild

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Feat/cohere agent implementation (#4703)

* implement cohere agent support

* run yarn lint

* moderize Cohere
add supported langchain method
redo streaming since it was not working
looping of agent calls was not functioning

* change default model to real model tag
add case statement for model tag

* remove debug

* update default

* only whitelist known labels

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Upgrade MCP SDK to Latest (1.24.3) (#4773)

* upgrade mcp sdk to  latest (1.24.3)

* Upgrade MCP version floor in package.json to 1.24.3

* fix(devcontainer): forward ports 3000/3001 (#4779)

* 4601 log model on response (#4781)

* add model tag to chatCompletion

* add modelTag `model` to async streaming
keeps default arguments for prompt token calculation where applied via explict arg

* fix HF default arg

* render all performance metrics as available for backward compatibility
add `timestamp` to both sync/async chat methods

* extract metrics string to function

* Update Google Search Option Description To Reference Documentation For Rate Limits (#4789)

* Update Google Search description to reference documentation for rate limits

* remove

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Refactor `LLMPerformanceMonitor.measureStream()` to Use Options Object Pattern (#4786)

* Refactor LLMPerformanceMonitor to use options object for measureStream parameters

* Refactor invocations of `measureStream` to use options arguments

* Change invocation of `measureStream` in anthropic provider to use options argument

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* hanging lint

* fix unnecessary scrollbar in workspace general appearance settings tab (#4791)

* fixed SuggestedChatMessages width styling

* ran yarn lint

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Add Eslint Config in `/frontend` (#4785)

* Add local ESLint configuration and disable rules to allow for errorless state

* Remove unnecessary ESLint disable comments in AuthContext and usePromptInputStorage for cleaner code.

* Update eslint-plugin-react-hooks

* Configure prettier to work with eslint

* Removed trailing commas from eslint config

* Prettier to source code

* add a v2 lint script

* put back eslint-disable comments

* fix eslinter and prettier application
always apply --fix since we --write prettier, otherwise it fails

* precaution dev build

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Refactor localWhisper to use custom FFMPEGWrapper class (#4775)

* refactor localWhisper to use new custom FFMPEGWrapper class

* stub tests in github actions

* add back wavefile conversion to 16khz 32f to fix docker builds

* use afterEach for cleanup in ffmpeg tests

* remove unused FFMPEG_PATH env check

* use spawnSync for ffmpeg to capture and log output

* lint

* revert removal of try/catch around validateAudioFile for more helpful error msgs

* use readFileSync instead of createReadStream for less overhead

* change import to require for fix-path and stub import in tests

* refactor to singleton to preserve ffmpeg path
dev build

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Refactor Managed Services in "Data Handling & Privacy" Onboarding Step to Use Their Privacy Policy URL (#4790)

* Refactor non-local LLM Provider, Vector Database, and Embedding Engine privacy information to use their policy URLs instead of descriptions

* Update LLM Provider, Embedding Engine, and Vector Database sections to include privacy policy links

* fix broken links, lint

* Update AstraDB privacy policy URL in onboarding flow

* Refactor AnythingLLM Privacy & Data page to show managed provider privacy policy URLs

* Update Mistral privacy policy URLs in onboarding flow for consistency

* Abstract privacy policies of providers into a reusable component | Refactor Privacy & Data Handling Step of onboarding flow to focus on solely rendering that step | Move provider privacy policy maps into constants.js

* Remove commented-out code for third-party provider privacy policies in Privacy and Data Handling component

* Update privacy policy descriptions for consistency by adding periods at the end of sentences in ProviderPrivacy component and constants.js

* rescope constants for providers

* extract default to external function, add loading state

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* patch ESM import issue (#4819)

* Upgrade YT Scraper (#4820)

* Merge commit from fork

* Update Sponsors README

* fix: validate chat message input (#4811)

* fix: validate chat message input

* fix: align message validation for thread stream-chat endpoint

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* patch AWS credential issue in docker context (#4842)

path AWS credential issue in docker context

* support AWS bedrock agents with streaming (#4850)

* support AWS bedrock agents with streaming

* Add back error handlers from previous fix

* VectorDB class migration (#4787)

* Migrate Astra to class (#4722)

migrate astra to class

* Migrate LanceDB to class (#4721)

migrate lancedb to class

* Migrate Pinecone to class (#4726)

migrate pinecone to class

* Migrate Zilliz to class (#4729)

migrate zilliz to class

* Migrate Weaviate to class (#4728)

migrate weaviate to class

* Migrate Qdrant to class (#4727)

migrate qdrant to class

* Migrate Milvus to class (#4725)

migrate milvus to class

* Migrate Chroma to class (#4723)

migrate chroma to class

* Migrate Chroma Cloud to class (#4724)

* migrate chroma to class

* migrate chroma cloud to class

* move limits to class field

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Migrate PGVector to class (#4730)

* migrate pgvector to class

* patch pgvector test

* convert connectionString, tableName, and validateConnection to static methods

* move instance properties to class fields

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Refactor Zilliz Cloud vector DB provider (#4749)

simplify zilliz implementation by using milvus as base class

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* VectorDatabase base class (#4738)

create generic VectorDatabase base class

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Extend VectorDatabase base class to all providers (#4755)

extend VectorDatabase base class to all providers

* patch lancedb import

* breakout name and add generic logger

* dev tag build

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Make XLSX spreadsheets visible in chat by combining sheets (#4847)

* fix bug with xlsx files not being added as context

* lint

* fix console logs/warn/error

* abstract sheet processing to function + normalize error handling

* fix jsdoc

* patch xlsx filename to prevent orphaned doc

* reduce tokens

* correct pluralization

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Remove Workspace Creation Onboarding Page (#4823)

* remove create workspace step for onboarding

* remove unused image

* workspace creation into dedicated useEffect + use translated workspace name

* dev tag

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Improved DMR support (#4863)

* Improve DMR support
- Autodetect models installed
- Grab all models from hub.docker to show available
- UI to handle render,search, install, and management of models
- Support functionality for chat, stream, and agentic calls

* forgot files

* fix loader circle being too large
fix tooltip width command
adjust location of docker installer open for web platform

* adjust imports

* AnythingLLM Mobile live (#4864)

* remove new labels on landing

* minor DMR UI changes + dynamic tooltip for context management

* Adjust fix path to use ESM import (#4867)

* Adjust fix path to use ESM import

* normalize fix-path imports and usage across the app

* extract path fix logic to utils for server and collector

* add helpers

* repin strip-ansi in collector

* fix log for localWhisper
lint

* Add postsettled callers to updateENV

* minor refactor for context window finder

* Extract Model Table to component (#4871)

* Extract Model Table to component
Add provider icons to header rows and installed models
Light mode supported
Mapping for model name id hints to provider
Update DMR to filter chat models by ability since not available via hub API

* linting + dev

* fix incorrect import

* remove race condition regression for FoundryLocal provider

* remove duplicated steam method on cohere handler

* feat(i18n): add Czech (cs) language translation to AnythingLLM (#4874)

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* Docker model runner download from UI (#4884)

* Enable downloads of DMR models from UI

* add utils + dev build

* linting

* add fallback key to mono model provider

* update announcements for 1.10.0

* bump versions to 1.10.0

---------

Co-authored-by: Marcello Fitton <106866560+angelplusultra@users.noreply.github.com>
Co-authored-by: Sean Hatfield <seanhatfield5@gmail.com>
Co-authored-by: Colin Perry <55003831+17ColinMiPerry@users.noreply.github.com>
Co-authored-by: Irene Wang <lohas1107@gmail.com>
Co-authored-by: timothycarambat <16845892+timothycarambat@users.noreply.github.com>
Co-authored-by: Ocheretovich <ocheretovich@gmail.com>
Co-authored-by: Vladimir Vlach <vladaman@gmail.com>
2026-01-22 07:59:28 -08:00
..
README.md chore: rename Github to GitHub (#3199) 2025-02-13 10:45:43 -08:00
devcontainer.json Render v1.10.0 (#4892) 2026-01-22 07:59:28 -08:00

README.md

AnythingLLM Development Container Setup

Welcome to the AnythingLLM development container configuration, designed to create a seamless and feature-rich development environment for this project.

PLEASE READ THIS

Prerequisites

Features

  • Base Image: Built on mcr.microsoft.com/devcontainers/javascript-node:1-18-bookworm, thus Node.JS LTS v18.
  • Additional Tools: Includes hadolint, and essential apt-packages such as curl, gnupg, and more.
  • Ports: Configured to auto-forward ports 3000 (Frontend) and 3001 (Backend).
  • Environment Variables: Sets NODE_ENV to development and ESLINT_USE_FLAT_CONFIG to true.
  • VS Code Extensions: A suite of extensions such as Prettier, Docker, ESLint, and more are automatically installed. Please revise if you do not agree with any of these extensions. AI-powered extensions and time trackers are (for now) not included to avoid any privacy concerns, but you can install them later in your own environment.

Getting Started

  1. Using GitHub Codespaces. Just select to create a new workspace, and the devcontainer will be created for you.

  2. Using your Local VSCode (Release or Insiders). We suggest you first make a fork of the repo and then clone it to your local machine using VSCode tools. Then open the project folder in VSCode, which will prompt you to open the project in a devcontainer. Select yes, and the devcontainer will be created for you. If this does not happen, you can open the command palette and select "Remote-Containers: Reopen in Container".

On Creation:

When the container is built for the first time, it will automatically run yarn setup to ensure everything is in place for the Collector, Server and Frontend. This command is expected to be automatically re-run if there is a content change on next reboot.

Work in the Container:

Once the container is up, be patient. Some extensions may complain because dependencies are still being installed, and in the Extensions tab, some may ask you to "Reload" the project. Don't do that yet. First, wait until all settle down for the first time. We suggest you create a new VSCode profile for this devcontainer, so any configuration and extensions you change, won't affect your default profile.

Checklist:

  • The usual message asking you to start the Server and Frontend in different windows are now "hidden" in the building process of the devcontainer. Don't forget to do as suggested.
  • Open a JavaScript file, for example "server/index.js" and check if eslint is working. It will complain that 'err' is defined but never used.. This means it is working.
  • Open a React File, for example, "frontend/src/main.jsx," and check if eslint complains about Fast refresh only works when a file has exports. Move your component(s) to a separate file.. Again, it means eslint is working. Now check at the status bar if the Prettier has a double checkmark ✔️ (double). It means Prettier is working. You will see a nice extension Formatting:✔️ that can be used to disable the Format on Save feature temporarily.
  • Check if, on the left pane, you have the NPM Scripts (this may be disabled; look at the "Explorer" tree-dots up-right). There will be scripts inside the package.json files. You will basically need to run the dev:collector, dev:server and the dev:frontend in this order. When the frontend finishes starting, a window browser will open inside the VSCode. Still, you can open it outside.

⚠️ Important for all developers ⚠️

  • When you are using the NODE_ENV=development the server will not store the configurations you set for security reasons. Please set the proper config on file .env.development. The side-effect if you don't, everytime you restart the server, you will be sent to the "Onboarding" page again.

Note when using GitHub Codespaces

  • When running the "Server" for the first time, it will automatically configure its port to be publicly accessible by default, as this is required for the front end to reach the server backend. To know more, read the content of the .env file on the frontend folder about this, and if any issues occur, make sure to manually set the port "Visibility" of the "Server" is set to "Public" if needed. Again, this is only needed for developing on GitHub Codespaces.

For the Collector:

  • In the past, the Collector dwelled within the Python domain, but now it has journeyed to the splendid realm of Node.JS. Consequently, the configuration complexities of bygone versions are no longer a concern.

Now it is ready to start

In the status bar you will see three shortcuts names Collector, Server and Frontend. Just click-and-wait on that order (don't forget to set the Server port 3001 to Public if you are using GH Codespaces before starting the Frontend).

Now you can enjoy your time developing instead of reconfiguring everything.

Debugging with the devcontainers

For debugging the collector, server and frontend

First, make sure the built-in extension (ms-vscode.js-debug) is active (I don't know why it would not be, but just in case). If you want, you can install the nightly version (ms-vscode.js-debug-nightly)

Then, in the "Run and Debug" tab (Ctrl+shift+D), you can select on the menu:

  • Collector debug. This will start the collector in debug mode and attach the debugger. Works very well.
  • Server debug. This will start the server in debug mode and attach the debugger. Works very well.
  • Frontend debug. This will start the frontend in debug mode and attach the debugger. I am still struggling with this one. I don't know if VSCode can handle the .jsx files seamlessly as the pure .js on the server. Maybe there is a need for a particular configuration for Vite or React. Anyway, it starts. Another two configurations launch Chrome and Edge, and I think we could add breakpoints on .jsx files somehow. The best scenario would be always to use the embedded browser. WIP.

Please leave comments on the Issues tab or the