- Revert vale JSON output to line output so that husky appropriately fails the commit.
- Update custom vocab terms
- Add Vale to BasedOnStyles to enable the custom vocabs--they need access to Vale's **Avoid** action.
- Configures lint-staged to run vale on staged files and use a custom config with custom vocab for specific directories.
- .md files in other directories use the project-level .vale.ini
- Adds the write-good package for style checking
* Downsampling InfluxDB2 data with Quix
* Minor updates
* Adjust weight
* WIP - Added downsample with Quix
* Update menu
* Update menu for v2 downsampling with Flux and Quix
* v2 downsampling page ordering
* Add Quix downsample example to clustered
* Add Quix downsample example to cloud
* Update content/influxdb/cloud-dedicated/process-data/downsample/downsample-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Updates based on review comments
* Update Cloud downsampling with Quix page title
* Task/influx quix updates (#3)
Adding alternative downsampling examples - Using Quix.
This PR includes changes to:
Dedicated
Cloud(TSM)
OSS
Clustered
Quix is collaborating with Influxdata to act as a pure Python alternative to Kapacitor+Flux.
The audience is folks who:
Know Python already and/or don't want to learn a DSL, and possibly those who want to process data more "Pythonically" rather than mixing SQL syntax and Python.
FYI: Quix is both a runtime platform (Quix Cloud) and data processor (Quix Streams Python library). The aim of the articles is to show how downsampling can be done in a continuous real-time process using pure Python.
[x] Signed the InfluxData CLA
(if necessary)
[x] Rebased/mergeableAdding alternative downsampling examples - Using Quix.
* Update content/influxdb/cloud-serverless/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/process-data/downsample/downsample.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Review updates (#4)
Updates from review. thanks.
* Update content/influxdb/cloud-dedicated/process-data/downsample/downsample-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/tools/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/process-data/downsample/client-libraries.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/process-data/downsample/quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud/process-data/common-tasks/downsample-data-quix.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Updates from review (#5)
Updates from review
---------
Co-authored-by: steverosam <steve@quix.ai>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
- "not sure why DEFAULT is formatted as code. The default RP on a database is the first RP created in a database unless otherwise specified. And typically, the first RP created in a db is autogen"
Co-authored-by: Scott Anderson <scott@influxdata.com>
* add note about using timeformat for partition templates
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feat(dedicated): Task-based docs for using the Management API to manage database tokens.
* chore(dedicated): Specify where to run the command
* Update content/influxdb/cloud-dedicated/admin/tokens/database/create.md
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
* Update create management token, must have double quotes.md
Must have quotes on description otherwise it doesn't work
* Apply suggestions from code review
* ported changes to clustered
* added quotes to examples
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
* Update create.md
should be `expires-at` not `expire-at`
* updated other isntances of incorrect influxctl flag
---------
Co-authored-by: Scott Anderson <scott@influxdata.com>
* add infomrmation about sql timezone support
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* fixed typos
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* docs: add catalog modifcation warning
* docs: use suggested wording
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* docs: object versioning, lifecycle rule best practices
* docs: trim whitespace
* docs: include appinstance configuration
* docs: update gc env var wording
Co-authored-by: Fraser Savage <fraser@savage.engineer>
* chore: use suggested wording
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: dedicated mention of versioning recommendation
The versioning really depends on an organisation's backups/DR strategy.
I've pulled this more inline with how the lifecylce of the ingested data
can be managed through the garbage-collector.
* docs: wording
* docs: use scenario wording suggestion
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: use suggested extension for gc service
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: no versioning suggestion
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: hint requirements for retention
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: mention object store sizing with lower cutoff
* docs: add warning for 3h cutoff
* suggested edits to the clustered ingest lifecycle guide (#5427)
* docs: use suggestion for configurable cutoff floor
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Fraser Savage <fraser@savage.engineer>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Adding alternative version of downsampling procedure that uses the Quix Python library
* adding Jupyter Notebook link
* Apply suggestions from code review
* Rename downsample_quix.md to downsample-quix.md
---------
Co-authored-by: Merlin <merlin@quix.io>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Fix shortcut
* chore(serverless): partition and file limits for free and PAYG (closes#5375)
* chore(serverless): partition and file limits for free and PAYG (closes#5375)
* added influxql query support for influxctl
* removed sql tag from task-based influxctl query guide
* Influxctl v2.8.0 (#5418)
* Release influxctl v2.8.0
* Update change logs
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Add influxctl write timeout and new insecure TLS config (#5419)
* add timeout flag to write, update config with insecure tls
* fixed link
* Add 'enable-system-tables' flag to `influxctl query` (#5415)
* add enable system tables flag to influxctl
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Query system tables with influxctl (#5414)
* outline for querying system tables
* finalized system table query examples
* updated system table validity date
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Apply suggestions from code review
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Joshua Powers <powersj@fastmail.com>
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feat(clustered): add local perf testing guidelines
* feat(clustered): clarify analysis query examples
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/guides/report-query-performance-issues.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(clustered): move query performance troubleshooting doc
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore: Add placeholder format to Docker example.
* chore: Add placeholder formatting to Docker example.
* feat(v2): Add /metrics replications to metrics page and guide.
Closes#3468
* Update content/influxdb/v2/write-data/replication/replicate-data.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix: correct definition of `commit-timeout`
Correct definition of `commit-timeout` to match its use in Raft. See https://github.com/hashicorp/raft/issues/28 for more information.
* Update content/enterprise_influxdb/v1/administration/configure/config-meta-nodes.md
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feat(dedicated): Parameterized queries for SQL and InfluxQL using the native Flight RPC API
* feat(v3): Parameterized queries for SQL and InfluxQL
* feat(v3): Parameterized queries for SQL and InfluxQL
* feat(v3): Dedicated: Parameterized queries for SQL and InfluxQL
* feat(v3): Serverless: Parameterized queries for SQL and InfluxQL
* feat(v3): Clustered: Parameterized queries for SQL and InfluxQL
* feat(v3): Cleanup parameterized queries
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/reference/influxql/time-and-timezone.md
* Update content/influxdb/cloud-dedicated/reference/influxql/time-and-timezone.md
* Update content/influxdb/cloud-dedicated/reference/influxql/time-and-timezone.md
* Influxctl v2.7.1 (#5395)
* Release influxctl v2.7.1
* Update change logs
* feat(v3): Parameterized queries: Add references to time and data types pages
* feat(v3): InfluxQL parameterized queries data types
* feat(v3): InfluxQL parameterized queries data types
* feat(v3): Note that you can't parameterize identifiers in queries
* feat(v3): Parameterized queries restrictions
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Joshua Powers <powersj@fastmail.com>
* update v2 and cloud (tsm) grafana docs
* fixed bug where clicking tab would not update url
* updated v1 and enterprise grafana docs, added grafana video to v3
* Adds operator token requirement to orgs and user docs in oss v2 and updates
examples to use code placeholders.
closes influxdata/influxdb#24817
closes#4829closes#4517
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Strategies to improve query performance: operations, number and size of parquet files
Fixes#5108
- Add query performance strategies to optimize-queries
* Apply suggestions from code review
* Apply suggestions from code review
* Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* chore(v3): WIP query perf
Fixes#5108
* chore(v3): WIP: Query performance
* chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems.
* WIP: optimize queries - how to read a query plan, operators
* WIP: Read a query plan example 2
* WIP: moved how to read a query plan to its own page.
* WIP(v3): operators
* chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN
* chore(v3): WIP read a query plan - explain tree format and reorganize
* WIP: query plan
- Adds Query Plan reference
- Completes Analyze a Query Plan, pending cleanup, continue at :471
- Added image from Nga's blog
- Updates EXPLAIN doc
- TODO: Create public docs for
https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md
* chore(spelling): Vale config changes
- Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually.
- Move InfluxData spelling ignore list into the style.
- Reorganize custom (product) spelling lists to comply with Vale 3.x
- Add InfluxDB v3 terms
* chore(spelling): Vale config changes
- Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually.
- Move InfluxData spelling ignore list into the style.
- Reorganize custom (product) spelling lists to comply with Vale 3.x
- Add InfluxDB v3 terms
* chore(v3): Reorg of query troubleshooting and optimizing docs
- Adds query-data/troubleshoot-and-optimize
- Splits optimize docs into troubleshoot and optimize docs
- Moves Flight response doc to flight-responses.md
* chore: Fixes broken links, typos, missing content, etc.
- Fixes various errors and style violations reported by Vale.
- Fixes broken links and missing content in glossaries.
- Fixes missing and extraneous whitespace.
* Apply suggestions from code review
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md
* chore(clustered): Query plan: Apply review suggestions
Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com>
* feature(v3): Analyze a query plan:
- Apply code formatting to plan implementor names
- Simplify some points
- Add links
* add query plan html diagram (#5365)
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(v3): finish the EXPLAIN descriptions and examples
* chore(tests): Setup a python venv in test containers
* fix(ci): Vale vocab
* fix(v3): Punctuation typo
* chore(ci): Update README
* fix(v3): Apply review suggestions and capitalization
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(v3): Add note to optimize page and revise troubleshoot
* fix(v3): optimize-queries link
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* docs: recommendation of object versioning
* Update content/influxdb/clustered/install/prerequisites.md
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* docs: add DOCKER_CONFIG mention
* chore: use review suggestion
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(v2 cloud): Capitalization
* chore(v2 cloud): Capitalization
* chore(v2 cloud): Punctuation
* chore(v2): Move set up process to get-started/setup page:
- Moves setup process section from the install page to the get-started/setup page.
- Clean up and style updates.
- Add API set up example.
* chore(v2): Cleanup
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/get-started/setup.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/install/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix: update influxdb/host shortcode
* chore(oss-v2): Consistent use of All Access as token name
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
* updates sql functions added upstream
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* port changes to serverless and clustered
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* updated sql time and date functions
* update sql casting docs with new TIMESTAMP behavior, closes#5331
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* added format_n argument to to_timestamp* functions
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* [Docker] Unable to generate the default configuration file on the host file system
Fixes#5318
* [Docker] Unable to generate the default configuration file on the host file system
Fixes#5318, #4841, #4643, #3475
* Removed suggestion to share configs between containers. I tried it and it seems like a bad idea.
* Specify that setup options are environment variables.
* Edit setup mode variable description.
* Fixes command and descriptions.
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/v2/install/_index.md
* Update content/influxdb/v2/install/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Release influxctl v2.4.4
* Update release notes
* add --trace global flag to influxctl docs
* port influxctl --trace flag to clustered
---------
Co-authored-by: Scott Anderson <scott@influxdata.com>
* add note to show tag values docs about including a FROM clause, closes#5321
* Update content/influxdb/cloud-dedicated/reference/influxql/show.md
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* port changes to serverless and clustered
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Updated grafana.md to include the new InfluxDB data source SQL setup
* updates to new grafana docs
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* ported grafana docs to other v3 products
* minor updates to grafana files
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore(telegraf): Improve CSV parser doc and run Telegraf tests:
- Revise CSV parser documentation and add examples.
- Configure test runner for Telegraf tests.
* Update content/telegraf/v1/data_formats/input/csv.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/telegraf/v1/data_formats/input/csv.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/telegraf/v1/data_formats/input/csv.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Fixes#5271
- Updates Go samples that use the client library to use the same Arrow package version (v13) used in the client library
- Updates Go FlightSQL examples to use the latest Arrow package (v14).
* chore(v3): preprocess writes (Telegraf, etc)
* feat: optimize writes using Telegraf
* WIP: dedup plugin
* WIP: Dedup
* chore(v3): Writes: Preprocess data using Telegraf: Dedup example
(#5155)
- Add example using processors.dedup in Telegraf.
- The plugin or configuration doesn't currently work as expected. Investigating...
* chore(v3): Write data: pre-process data using Telegraf
- Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data.
- For Serverless. Will port to Dedicated and Clustered after approval.
- Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup)
* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(test): Test harness setup, use golang base image
- Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go.
- Add flag to bypass python warning about using system python and pip.
- Remove redundant env.products from pytest.ini; we already load it into environment variables.
* chore(v3): Optimize writes: Use Telegraf
Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155
- Adds use cases to Dedicated and Clustered docs
- Adds example for Execd processor plugin to all
- Clean up and pass tests
- Remove shared code sample
* fix(v3): Optimize writes: Placeholders and indent fixes
* Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* feature(v3): Write: partial writes write good lines and reject bad lines #5160
- Documents the proposed partial writes feature for Serverless and Dedicated.
- Updates Troubleshoot writes and API docs.
* chore(v3): update write status codes (#5160)
* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md
* chore(v3): cleanup partial write descriptions in API ref and troubleshooting guide
* added influxctl examples to clustered and dedicated get started
* added task-based influxctl query docs
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* feature(v3): Serverless write API: writes good lines, rejects bad lines #5160
- Documents the proposed partial writes feature for Serverless and Dedicated.
- If some points are written, returns 201 status code.
- Updates Troubleshoot writes and API docs.
* feature(v3): Serverless write API: writes good lines, rejects bad lines #5160
- Documents the proposed partial writes feature for Serverless and Dedicated.
- If some points are written, returns 201 status code.
- Updates Troubleshoot writes and API docs.
* fix: Serverless cleanup
* fix: Serverless write API: restore 204 and explain 201 and 400 status codes.
* Apply suggestions from code review
* fix: Serverless write API: 201 superseded by 204 to maintain v2 compat.
- Documents https://github.com/influxdata/idpe/pull/18398.
* fix: Serverless write API: 201 superseded by 204 to maintain v2 compat.
- Documents https://github.com/influxdata/idpe/pull/18398.
* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md
* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md
* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md
* fix(v2): series keys in OSS
closes#5226
- Fix v2 series keys definitions
- Remove field key from OSS description
- Update glossary and schema-design.
* fix(v3): rejected points reason
closes Fix series definitions and reasons for rejected points #5226
- Replaces series with partition in reasons for rejected points.
* fix(telegraf): describe gpg key compatibility (closes#5231)
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(v3): DBRP: Update Serverless API ref (#5234)
* chore(ci): Tests: substitute placeholders in JSON body parameters
* chore(v3): DBRP: copy page from influxql to admin/dbrps.
* chore(ci): Trying to prevent "a Influx..."
* chore(ci): Allow autogen
* chore(serverless): DBRP glossary entry
* chore(v2): add default DBRP note
* chore(v3): use product-name shortcode
* chore(v3): use product-name shortcode, clarify retention period and mapping
* chore(serverless): Create Bucket:
- add missing example for Data Explorer
- move Retention Period syntax and define retentionRules syntax
- setup for tests
* chore(serverless): Create Bucket:
- add missing example for Data Explorer
- move Retention Period syntax and define retentionRules syntax
- setup for tests
* chore(serverless): Update bucket: alias to match other products
* chore(v3): Serverless for prototyping: update with DBRP behavior
* Serverless auto-generated buckets have 3-day default retention period
Fixes#5234
- v1-compat guide:
- passes tests
- explains DBRPs (default, automatic, and management)
- migrate DBRP content from query-data/influxql/dbrp
- v2-compat guide:
- fix TOC
- add list code example
- rename influxdb-v1-api to api/v1-http, migrate params from v1-compat guide, and explain DBRP in context
- add write-data/api/v1-http and migrate content from v1-compat guide
- move optimize and troubleshooting up to /query-data
- add Related items support for paths containing http
- substitute placeholders in tests
* chore(test): update configuration in README
* fix(serverless): Optimize queries parent
* fix(serverless): create-bucket cleanup
* fix: cleanup
* fix: close tag
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(v3): permission to create dbrp-mapped bucket
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* update mentions of IOx to v3
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
update command to get current mmap details. Multiple fatal typos in existing example, and unnecessarily long.
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* provided more information about changing table and column limits
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* updated column limit in schema design doc
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore(ci): Install Telegraf to test container
* chore(v3): test telegraf config and startup:
- creates the config file for the test run. TODO: remove the duplication and use the content for test setup.
- fix placeholder name
* fix(v3): make test pass for curl API example
* chore(ci): make tests pass for write. Add dependencies to Dockerfile.
* chore(tests): update test build
- Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container.
- Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better.
- test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`.
- pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables.
* fix(write): update JS instructions and pass tests.
* chore(ci): Install influx v2 CLI into the Docker test container.
* chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file:
- Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now.
- Add example for passing custom commands in the compose file.
* fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests.
feat(v3): add v1 write, test, update text:
- adds Serverless v1 /write example with note about autogen behavior
- adds link from v1 examples to Migrate guide
- adds description of autogen behavior to v1-compat guide
- updates "powered by..." text
- adapts examples to make them more testable, asserts `/write` status code
- replace "shared" examples (only used once) with inline to make them testable
fix(v3): promote migrate link
* Update content/influxdb/cloud-dedicated/get-started/write.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(v3): Write: fix wording for curl success (#5156)
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix: update influxql docs to reflect implicit time limit
* chore: include default time range
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore: include default time range
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore: include default time range
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore: better wording/explanation
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore: better wording/explanation
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore: better wording/explanation
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* WIP SQL operators
* add more descriptions for sql operators
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* port sql operator docs to serverless and clustered
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
This removes a section from the Dedicated and Clustered docs that says
that token permissions cannot be updated since influxctl now supports
token updates.
* WIP flux function list
* fix isset error with icon shortcode
* Update content/flux/v0/spec/variables.md
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
Jason Stirnaman
Bethelhem Legesse
Scott Anderson
Steve
Jack
Scott Anderson
dezdez
Benjamin Corbett
alespour
Abdullah Sabaa Allil
Merlin
Andreas Deininger
wayne
Geoffrey Wossum
Jackie Tien
Joshua Powers
Dennis German
Gunnar Aasen
Minsung Oh
Jakub Bednář
cpinflux
Jay Clifford
Andrew Lamb
Bill O'Connell
Gary Fowler
Jeffrey Smith II
Dustin Eaton