- Mount a volume to store test project files generated in tests.
- Allow URL and `url` in the linter
- Set timestamp precision for Telegraf example
- Fix Telegraf test, use Python to edit the TOML config file
- Remove date format linting in table cells. Copies Google's DateFormat style config to InfluxDataDocs style with modified scope.
- Update styles (vale sync)
- Skip database create in tests.
- Add example test for table create.
- Fix linting errors.
- Add TEST_RUN placeholder replacement in prepare-content.sh.
* docs: add warning for manual horizontal scaling
* docs: use suggested format
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* docs: move warning
* docs: concise wording
* docs: remove unnecessary backticks
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* WIP sql join statement
* WIP SQL joins
* added join type descriptions and examples
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>
* add info about fully-qualified references in joins
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>
* port sql join reference to serverless and clustered
---------
Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>
- Add python replacement for get-started database/bucket name
- Fixes race condition when deleting previous content:
- Assign each product it's own test content volume instead of sharing a volume.
- Delete existing content in the volume before copying test files.
- Pros and cons, but I suspect a similar approach will be better when ported to Circle CI.
- Run Vale in a Docker container by running ./.ci/vale/vale.sh <args>
- Define vale lint scripts in package.json. Lint added and changed files for products.
- Define error-level vale linting in the lint-staged configuration for staged files.
- Improve product-specific nomenclature checks (e.g. database vs bucket)
- Simplify vocab terms and allowed words lists.
- Fixes content errors revealed by vale.
- Format and structure serverless write-data
- Structure cloud-serverless write-data/line-protocol the same as clustered and dedicated to allow for adding more tool-specific pages.
- Make influxctl examples pass tests
- Reconfigures prettier linting.
- Adds .editorconfig to help with consistent editor settings
- Refactors test runs:
- Removes test configuration from compose.yaml (not suited for this use case).
- Splits test runner into test content setup and pytest that can be run separately or together (and with other test runners in the future).
- Configuration is in Dockerfiles and command line (`.lintstagedrc.mjs`)
- Updates CONTRIBUTING.md
- Updates client library write examples in cloud-dedicated and clustered.
- Revert vale JSON output to line output so that husky appropriately fails the commit.
- Update custom vocab terms
- Add Vale to BasedOnStyles to enable the custom vocabs--they need access to Vale's **Avoid** action.
- Configures lint-staged to run vale on staged files and use a custom config with custom vocab for specific directories.
- .md files in other directories use the project-level .vale.ini
- Adds the write-good package for style checking
* Downsampling InfluxDB2 data with Quix
* Minor updates
* Adjust weight
* WIP - Added downsample with Quix
* Update menu
* Update menu for v2 downsampling with Flux and Quix
* v2 downsampling page ordering
* Add Quix downsample example to clustered
* Add Quix downsample example to cloud
* Update content/influxdb/cloud-dedicated/process-data/downsample/downsample-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Updates based on review comments
* Update Cloud downsampling with Quix page title
* Task/influx quix updates (#3)
Adding alternative downsampling examples - Using Quix.
This PR includes changes to:
Dedicated
Cloud(TSM)
OSS
Clustered
Quix is collaborating with Influxdata to act as a pure Python alternative to Kapacitor+Flux.
The audience is folks who:
Know Python already and/or don't want to learn a DSL, and possibly those who want to process data more "Pythonically" rather than mixing SQL syntax and Python.
FYI: Quix is both a runtime platform (Quix Cloud) and data processor (Quix Streams Python library). The aim of the articles is to show how downsampling can be done in a continuous real-time process using pure Python.
[x] Signed the InfluxData CLA
(if necessary)
[x] Rebased/mergeableAdding alternative downsampling examples - Using Quix.
* Update content/influxdb/cloud-serverless/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/process-data/downsample/downsample.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Review updates (#4)
Updates from review. thanks.
* Update content/influxdb/cloud-dedicated/process-data/downsample/downsample-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/client-libraries.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Updates from review (#5)
Updates from review
---------
Co-authored-by: steverosam <steve@quix.ai>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
- "not sure why DEFAULT is formatted as code. The default RP on a database is the first RP created in a database unless otherwise specified. And typically, the first RP created in a db is autogen"
Co-authored-by: Scott Anderson <scott@influxdata.com>
* add note about using timeformat for partition templates
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feat(dedicated): Task-based docs for using the Management API to manage database tokens.
* chore(dedicated): Specify where to run the command
* Update content/influxdb/cloud-dedicated/admin/tokens/database/create.md
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
* Update create management token, must have double quotes.md
Must have quotes on description otherwise it doesn't work
* Apply suggestions from code review
* ported changes to clustered
* added quotes to examples
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
* Update create.md
should be `expires-at` not `expire-at`
* updated other isntances of incorrect influxctl flag
---------
Co-authored-by: Scott Anderson <scott@influxdata.com>
* add infomrmation about sql timezone support
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* fixed typos
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* docs: add catalog modifcation warning
* docs: use suggested wording
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* docs: object versioning, lifecycle rule best practices
* docs: trim whitespace
* docs: include appinstance configuration
* docs: update gc env var wording
Co-authored-by: Fraser Savage <fraser@savage.engineer>
* chore: use suggested wording
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: dedicated mention of versioning recommendation
The versioning really depends on an organisation's backups/DR strategy.
I've pulled this more inline with how the lifecylce of the ingested data
can be managed through the garbage-collector.
* docs: wording
* docs: use scenario wording suggestion
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: use suggested extension for gc service
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: no versioning suggestion
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: hint requirements for retention
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: mention object store sizing with lower cutoff
* docs: add warning for 3h cutoff
* suggested edits to the clustered ingest lifecycle guide (#5427)
* docs: use suggestion for configurable cutoff floor
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Fraser Savage <fraser@savage.engineer>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Adding alternative version of downsampling procedure that uses the Quix Python library
* adding Jupyter Notebook link
* Apply suggestions from code review
* Rename downsample_quix.md to downsample-quix.md
---------
Co-authored-by: Merlin <merlin@quix.io>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Fix shortcut
* chore(serverless): partition and file limits for free and PAYG (closes#5375)
* chore(serverless): partition and file limits for free and PAYG (closes#5375)
* added influxql query support for influxctl
* removed sql tag from task-based influxctl query guide
* Influxctl v2.8.0 (#5418)
* Release influxctl v2.8.0
* Update change logs
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Add influxctl write timeout and new insecure TLS config (#5419)
* add timeout flag to write, update config with insecure tls
* fixed link
* Add 'enable-system-tables' flag to `influxctl query` (#5415)
* add enable system tables flag to influxctl
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Query system tables with influxctl (#5414)
* outline for querying system tables
* finalized system table query examples
* updated system table validity date
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Apply suggestions from code review
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Joshua Powers <powersj@fastmail.com>
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feat(clustered): add local perf testing guidelines
* feat(clustered): clarify analysis query examples
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(clustered): move query performance troubleshooting doc
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore: Add placeholder format to Docker example.
* chore: Add placeholder formatting to Docker example.
* feat(v2): Add /metrics replications to metrics page and guide.
Closes#3468
* Update content/influxdb/v2/write-data/replication/replicate-data.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix: correct definition of `commit-timeout`
Correct definition of `commit-timeout` to match its use in Raft. See https://github.com/hashicorp/raft/issues/28 for more information.
* Update content/enterprise_influxdb/v1/administration/configure/config-meta-nodes.md
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feat(dedicated): Parameterized queries for SQL and InfluxQL using the native Flight RPC API
* feat(v3): Parameterized queries for SQL and InfluxQL
* feat(v3): Parameterized queries for SQL and InfluxQL
* feat(v3): Dedicated: Parameterized queries for SQL and InfluxQL
* feat(v3): Serverless: Parameterized queries for SQL and InfluxQL
* feat(v3): Clustered: Parameterized queries for SQL and InfluxQL
* feat(v3): Cleanup parameterized queries
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/reference/influxql/time-and-timezone.md
* Update content/influxdb/cloud-dedicated/reference/influxql/time-and-timezone.md
* Update content/influxdb/cloud-dedicated/reference/influxql/time-and-timezone.md
* Influxctl v2.7.1 (#5395)
* Release influxctl v2.7.1
* Update change logs
* feat(v3): Parameterized queries: Add references to time and data types pages
* feat(v3): InfluxQL parameterized queries data types
* feat(v3): InfluxQL parameterized queries data types
* feat(v3): Note that you can't parameterize identifiers in queries
* feat(v3): Parameterized queries restrictions
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Joshua Powers <powersj@fastmail.com>
* update v2 and cloud (tsm) grafana docs
* fixed bug where clicking tab would not update url
* updated v1 and enterprise grafana docs, added grafana video to v3
* Adds operator token requirement to orgs and user docs in oss v2 and updates
examples to use code placeholders.
closes influxdata/influxdb#24817
closes#4829closes#4517
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Strategies to improve query performance: operations, number and size of parquet files
Fixes#5108
- Add query performance strategies to optimize-queries
* Apply suggestions from code review
* Apply suggestions from code review
* Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* chore(v3): WIP query perf
Fixes#5108
* chore(v3): WIP: Query performance
* chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems.
* WIP: optimize queries - how to read a query plan, operators
* WIP: Read a query plan example 2
* WIP: moved how to read a query plan to its own page.
* WIP(v3): operators
* chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN
* chore(v3): WIP read a query plan - explain tree format and reorganize
* WIP: query plan
- Adds Query Plan reference
- Completes Analyze a Query Plan, pending cleanup, continue at :471
- Added image from Nga's blog
- Updates EXPLAIN doc
- TODO: Create public docs for
https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md
* chore(spelling): Vale config changes
- Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually.
- Move InfluxData spelling ignore list into the style.
- Reorganize custom (product) spelling lists to comply with Vale 3.x
- Add InfluxDB v3 terms
* chore(spelling): Vale config changes
- Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually.
- Move InfluxData spelling ignore list into the style.
- Reorganize custom (product) spelling lists to comply with Vale 3.x
- Add InfluxDB v3 terms
* chore(v3): Reorg of query troubleshooting and optimizing docs
- Adds query-data/troubleshoot-and-optimize
- Splits optimize docs into troubleshoot and optimize docs
- Moves Flight response doc to flight-responses.md
* chore: Fixes broken links, typos, missing content, etc.
- Fixes various errors and style violations reported by Vale.
- Fixes broken links and missing content in glossaries.
- Fixes missing and extraneous whitespace.
* Apply suggestions from code review
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md
* chore(clustered): Query plan: Apply review suggestions
Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com>
* feature(v3): Analyze a query plan:
- Apply code formatting to plan implementor names
- Simplify some points
- Add links
* add query plan html diagram (#5365)
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(v3): finish the EXPLAIN descriptions and examples
* chore(tests): Setup a python venv in test containers
* fix(ci): Vale vocab
* fix(v3): Punctuation typo
* chore(ci): Update README
* fix(v3): Apply review suggestions and capitalization
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(v3): Add note to optimize page and revise troubleshoot
* fix(v3): optimize-queries link
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>