Commit Graph

24 Commits (gw/data-https-insecure-certificate)

Author SHA1 Message Date
Jason Stirnaman 1203602607
docs(influxdb3): document log-filter values and targeted filtering (#6695)
* chore(link-checker): update configs for v1.3.0 severity classification

Remove exclusions for sites that return 403/429 (bot protection) and
5xx (server errors) - these are now handled by severity classification:
- 403/401/429 → info (shown but don't fail CI)
- 5xx/timeout → warning (shown but don't fail CI)
- 404/410/DNS → error (fail CI)

Removed exclusions:
- GitHub, Slack, Reddit, StackOverflow
- Docker Hub, Grafana, Microsoft Learn
- Claude.ai, Dremio, Scarf, InfluxData support

Kept exclusions:
- Localhost/local network URLs
- Example/placeholder URLs
- CI-specific workarounds (canonical URLs, file fragments)

Added [severity] configuration section with default thresholds.

* docs(influxdb3): document log-filter values and targeted filtering

Add comprehensive documentation for the --log-filter configuration option:
- Log levels table (error, warn, info, debug, trace)
- Targeted filtering syntax for specific components
- Common component names for Core and Enterprise
- Debug logging section in write troubleshoot page

closes influxdata/DAR#575

* Update content/shared/influxdb3-cli/config-options.md
2026-01-06 14:01:49 -06:00
peterbarnett03 3ffab3afa1
Rename telemetry-disable-upload to disable-telemetry-upload (#6594)
Fixes a CLI incorrect command

Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>
2025-12-10 10:16:40 -06:00
Jason Stirnaman 0fcf2bdd31
Note excluded internal-use options (#6571)
* chore: Standard exclude comment format to denote flags, options, etc. that shouldn't be promoted in docs

* chore: exclude internal flags

* chore: Add docs:exclude comments for internal CLI flags, fix linting

- Note internal options that should be ignored by `docs audit` and authors.
- Remove character escaping from GitHub callouts and placeholders

Lint config changes:
- Add explicit exclude for content/**/*.md in lint-markdown-instructions
- Exclude all markdown files from Prettier formatting

Fixes issue where remark-lint was auto-formatting content files and
escaping special characters like [!Note] callouts and underscores.

* fix: cleanup escaping
2025-11-25 16:58:29 -06:00
Jason Stirnaman 7f2178afa5
fix(influxdb3): document exec-mem-pool-bytes usage for data persistence (#6394)
* fix(influxdb3): document exec-mem-pool-bytes usage for data persistence

Updates documentation to reflect that exec-mem-pool-bytes is used for both
query processing and parquet persistence operations, not just queries.

Based on source code analysis showing the memory pool is used by:
- Query executor for processing queries
- Persister for converting WAL data to Parquet format

Changes:
- Updated config description to include "data operations"
- Added memory usage info to durability docs for Parquet storage
- Added troubleshooting section for memory-related write performance
- Fixed capitalization of "object store" throughout

Addresses DAR #499

Source analysis: influxdb3/src/commands/serve.rs:772-798
Shows separate executors for queries and write path operations,
both using memory pools for data processing.

* fix(influxdb3): broken links to no-sync
2025-11-05 11:05:13 -06:00
Jason Stirnaman 089190dc60
fix(influxdb3): influxdb3 install package command syntax and details (#6512)
* fix(influxdb3): override PLUGIN_DIR env var in compose services to match --plugin-dir

- Set INFLUXDB3_PLUGIN_DIR=/var/lib/influxdb3/plugins in both influxdb3-core and influxdb3-enterprise services
- Overrides Docker image default (/plugins) to match --plugin-dir command argument
- Ensures package installation works correctly with bind-mounted plugin directory
- Update influxdb3 install package CLI documentation with complete options reference

* docs(influxdb3): add Docker disk space troubleshooting for package installation

Add troubleshooting section for 'No space left on device' errors when installing packages in Docker environments. Includes commands to check Docker disk usage and clean up unused images and build cache.

Also fix Vale linting errors by changing 'URL' to 'url'.

* Apply suggestion from @jstirnaman

* fix(ci): Vale rules for URL/-url-/WAL/-wal-/Parquet/-parquet-:

  1. Simplified the Parquet vocabulary entry from the regex to just Parquet
  2. Added separate regex patterns for hyphenated identifiers

* feat(influxdb3): describe use cases and effects of --package-manager disabled
2025-11-04 23:04:44 -06:00
Jason Stirnaman 1b57292191
feat: functional changes (#6500)
* feat: functional changes

* fix: remove serve inaccuracies

* fix: remove opining

---------

Co-authored-by: Peter Barnett <peter.barnett03@gmail.com>
2025-10-30 09:52:25 -05:00
Jason Stirnaman a30345170c
Core and Ent3 performance tuning guide and configuration options (#6421)
* feat(influxdb3): Core and Ent performance tuning guide:Add an admin/performance-tuning/ page with specific workload and capacity configurations.Part of #6403.

* fix(influxdb3): product-specific link fragments for flags

* fix(influxdb3): enterprise-specific link fragments

* Apply suggestion from @jstirnaman

* fix(influxdb3): duplicate licensing and resource limits sections- Rem… (#6470)

* fix(influxdb3): duplicate licensing and resource limits sections- Remove duplicate licensing section- Resolve resource limits duplicates, merging details into the Resource limits section.

* fix(influxdb3): fix broken links and enterprise-only flags in config options

- Comment out TOC links to undocumented datafusion-runtime-* dev flags
- Wrap enterprise-only section references (#licensing, #resource-limits) in conditionals
- Fix num-datafusion-threads incorrectly marked as enterprise-only
- Move Resource Limits section heading outside enterprise wrapper

Resolves broken fragment links for both Core and Enterprise builds.

* feat(enterprise): add cluster management documentation (#6431)

Add comprehensive guide for managing InfluxDB 3 Enterprise clusters including:
- Node configuration and deployment
- Cluster initialization and scaling
- Node removal and replacement procedures
- Best practices for production deployments

* Fixes multiple influxdb3 config option issues:

-  Fixed option placement (global vs serve options) in performance-tuning.md
-  Fixed --datafusion-num-threads option name (was --num-datafusion-threads)
-  Fixed --parquet-mem-cache-size option name and defaults for Core
-  Commented out unreleased --compaction-row-limit option
-  Added v3.0.0 breaking changes to release notes
-  Updated config-options.md with correct defaults and value formats

All changes verified against InfluxDB v3.5.0 release binaries and git history.

* fix(influxdb3): config options in clustering.md

- Correctly place server options
- Comment out unreleased options
2025-10-21 13:14:31 -05:00
Jason Stirnaman ca24b3be54
Influxdb3 config options (#6419)
* docs(cli): fix global vs serve-specific flag documentation

- Remove --verbose from global flags (it's serve-specific)
- Document --num-io-threads as global-only flag
- Add clear examples showing correct flag positioning
- Update serve.md files with global flag usage notes
- Fix config-options.md to separate Core/Enterprise examples

Resolves incorrect CLI usage patterns that would cause errors.
Global flags must go before 'serve', serve-specific flags go after.

* docs(cli): remove Tokio runtime options from CLI index pages

- Remove detailed Tokio runtime options tables from CLI index pages
- Replace with simplified global options and link to config-options
- Add examples showing correct global flag positioning
- Fix --verbose usage to be serve-specific (after serve command)
- Add --num-io-threads example as global flag (before serve command)

These detailed options are now documented in config-options.md with
proper global vs serve-specific categorization.
2025-10-20 10:17:56 -05:00
peterbarnett03 042978dd12
Update environment variable for package manager option 2025-10-07 20:32:12 -04:00
peterbarnett03 14276e516f
chore: add 3.5 release notes and config options (#6428)
* chore: add 3.5 release notes and config options

* docs(plugins): enhance --plugin-repo documentation with usage examples

- Add comprehensive plugin-repo configuration documentation
- Document custom repository setup with practical examples
- Add Option 3 for custom plugin repositories in usage guide
- Include use cases for private repos, air-gapped environments, and development
- Cross-reference between config options and usage guide
- Add note about custom repositories in setup section

* Update content/shared/influxdb3-cli/config-options.md

Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>

---------

Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>
2025-09-30 09:20:07 -05:00
Jason Stirnaman 1f62fde793 chore(influxdb3): Update config-options from ent3 help output 2025-09-11 16:23:28 -05:00
Jason Stirnaman 62880c9834
Update content/shared/influxdb3-cli/config-options.md 2025-09-11 16:01:18 -05:00
jaal2001 903c16e50a
Update config-options.md
Removed ")" in --exec-mem-pool-bytes as typo.

Added format information for --wal-flush-interval and 100ms suggestion from @peterbarnett03 in discord chat.
2025-09-11 16:46:36 +02:00
Jason Stirnaman 3bc56cc36e
Merge branch 'master' into patch-2 2025-09-05 14:44:08 -05:00
Peter Barnett 3f9b54541b fix: remove link 2025-09-05 10:07:07 -04:00
peterbarnett03 99c515a1b8
Clean up config-options.md 2025-09-05 09:58:30 -04:00
jaal2001 a44a06051d
Update config-options.md
Provide both available options for "log-destination" to make it more obvious that no filesystem logs are supported.
2025-08-28 17:00:28 +02:00
Scott Anderson 3222c7a9fb
InfluxDB 3.4 offline tokens (#6346)
* update: add 3.4 notes

* update: 3.4 notes

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* feat(influxdb-3.4): added cli updates for influxdb 3.4

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: add whitespace to influxdb3 write doc

* feat(offline-tokens): add offline tokens to config options page

* feat(offline-tokens): add task-based offline token docs

* fix(links): fixed broken links and added TOC to offline tokens guide

* Apply suggestions from code review

Co-authored-by: マルコメ <akio.muto@bnt.benextgroup.jp>

* chore(offline-tokens): add token string security standards

* chore(offline-tokens): add note about token string prefix

---------

Co-authored-by: Peter Barnett <peter.barnett03@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: マルコメ <akio.muto@bnt.benextgroup.jp>
2025-08-28 07:03:03 -06:00
Scott Anderson e5c6d1b015
InfluxDB Core and Enterprise 3.4 (#6344)
* update: add 3.4 notes

* update: 3.4 notes

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/shared/v3-core-enterprise-release-notes/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* feat(influxdb-3.4): added cli updates for influxdb 3.4

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: add whitespace to influxdb3 write doc

* fix(data): update patch versions for core and enterprise

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Peter Barnett <peter.barnett03@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-08-27 11:42:41 -06:00
peterbarnett03 3df82f362e
fix: remove buffer-mem-limit-mb (#6341) 2025-08-27 08:32:06 -06:00
Scott Anderson 4d5d509234 fix(monolith): add configurable db, table, and column limits to enterprise 2025-08-14 10:44:58 -05:00
Jason Stirnaman cf8cd90871 Update content/shared/influxdb3-cli/config-options.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2025-08-06 12:54:56 -05:00
Jason Stirnaman df1069ba65 chore(3ent): Add --num-core config option (still missing from the CLI --help) 2025-08-06 12:54:56 -05:00
Jason Stirnaman 407a5e6de6 1. Updated Core serve.md Options Section
- Updated /content/influxdb3/core/reference/cli/influxdb3/serve.md with 84 Core-compatible options
  - Excluded 21 Enterprise-only options (like cluster-id, license-email, license-file, mode, compaction options, clustering options, etc.)
  - All options now link to the Core configuration documentation
  - Fixed the environment variables link to point to Core instead of Enterprise

2. Updated Enterprise serve.md Options Section

  - Updated /content/influxdb3/enterprise/reference/cli/influxdb3/serve.md with all 105 configuration options
  - Includes both Core and Enterprise-only options
  - Maintains proper required option markers for node-id and cluster-id
  - All options link to the Enterprise configuration documentation

3. Verified Content Consistency

  - Core serve.md: Contains examples without cluster-id parameter (appropriate for Core)
  - Enterprise serve.md: Contains examples with both node-id and cluster-id parameters, plus Enterprise-specific mode examples
  - Both maintain consistent structure and troubleshooting sections appropriate to their respective products
  - Environment variables sections correctly reference their respective configuration documentation

4. Allow Vale to accept "parquet" in lowercase when it appears in:
  - Command-line options (e.g., --parquet-mem-cache-size)
  - Hyphenated configuration names (e.g., parquet-mem-cache-prune-interval)
  - Code blocks or inline code (e.g., `parquet`)

  Key Changes Made:

  - Core: Now includes 84 options (was 69), excluding Enterprise-only features
  - Enterprise: Now includes all 105 options (was 78), comprehensive coverage
  - Alphabetical ordering: Both option tables are now properly alphabetized
  - New options added: Many previously missing options like buffer-mem-limit-mb, tcp-listener-file-path, telemetry-*, wal-replay-*, etc.
  - Proper segregation: Core users no longer see Enterprise-only configuration options
  - Vale allows Parquet or parquet in the appropriate context
2025-08-06 12:54:56 -05:00