* docs: clarify clustered gc env tunables
* docs: use suggested wording
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
- Format and structure serverless write-data
- Structure cloud-serverless write-data/line-protocol the same as clustered and dedicated to allow for adding more tool-specific pages.
- Make influxctl examples pass tests
- Reconfigures prettier linting.
- Adds .editorconfig to help with consistent editor settings
- Refactors test runs:
- Removes test configuration from compose.yaml (not suited for this use case).
- Splits test runner into test content setup and pytest that can be run separately or together (and with other test runners in the future).
- Configuration is in Dockerfiles and command line (`.lintstagedrc.mjs`)
- Updates CONTRIBUTING.md
- Updates client library write examples in cloud-dedicated and clustered.
* docs: object versioning, lifecycle rule best practices
* docs: trim whitespace
* docs: include appinstance configuration
* docs: update gc env var wording
Co-authored-by: Fraser Savage <fraser@savage.engineer>
* chore: use suggested wording
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: dedicated mention of versioning recommendation
The versioning really depends on an organisation's backups/DR strategy.
I've pulled this more inline with how the lifecylce of the ingested data
can be managed through the garbage-collector.
* docs: wording
* docs: use scenario wording suggestion
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: use suggested extension for gc service
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: no versioning suggestion
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: hint requirements for retention
Co-authored-by: Dom <dom@itsallbroken.com>
* docs: mention object store sizing with lower cutoff
* docs: add warning for 3h cutoff
* suggested edits to the clustered ingest lifecycle guide (#5427)
* docs: use suggestion for configurable cutoff floor
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Fraser Savage <fraser@savage.engineer>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(v3): preprocess writes (Telegraf, etc)
* feat: optimize writes using Telegraf
* WIP: dedup plugin
* WIP: Dedup
* chore(v3): Writes: Preprocess data using Telegraf: Dedup example
(#5155)
- Add example using processors.dedup in Telegraf.
- The plugin or configuration doesn't currently work as expected. Investigating...
* chore(v3): Write data: pre-process data using Telegraf
- Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data.
- For Serverless. Will port to Dedicated and Clustered after approval.
- Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup)
* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(test): Test harness setup, use golang base image
- Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go.
- Add flag to bypass python warning about using system python and pip.
- Remove redundant env.products from pytest.ini; we already load it into environment variables.
* chore(v3): Optimize writes: Use Telegraf
Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155
- Adds use cases to Dedicated and Clustered docs
- Adds example for Execd processor plugin to all
- Clean up and pass tests
- Remove shared code sample
* fix(v3): Optimize writes: Placeholders and indent fixes
* Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(v2): series keys in OSS
closes#5226
- Fix v2 series keys definitions
- Remove field key from OSS description
- Update glossary and schema-design.
* fix(v3): rejected points reason
closes Fix series definitions and reasons for rejected points #5226
- Replaces series with partition in reasons for rejected points.
* update mentions of IOx to v3
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* provided more information about changing table and column limits
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* updated column limit in schema design doc
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* fix(v3): remove v2-prefer note, replace with specific recommendations
- removes the shared v2-prefer shortcode note.
- adds "Flight client" tag to all Flight RPC and Flight SQL client pages.
- replaces the note with specific write/query notes in each platform.
- misc fixes
* fix(v3): v2 client library typo
* fix(v3): Cleanup usage note for all v2 client libraries
- Change note to warning
- Condense
- Move warning to prepend block
- Make consistent on all pages
- Remove autolinking to GitHub repos
* chore(v3): Add "Clustered"
* fix(v3): typo
* fix: fix v3 write descriptions, Add v3 Troubleshoot writing data #5135
* Update content/influxdb/cloud-dedicated/write-data/troubleshoot.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/write-data/troubleshoot.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* hotfix(v3): missing shared example files
- replace paths to missing shared-text files with examples.
- update timestamps for custom-timestamps in older examples.
- the shared-text solution isn't really working for us, as it can't render the host shortcode and the placeholder names differ between platforms. I'll probably start doing away with it and tinker on a better way to achieve what I was trying to do.
* Update content/influxdb/clustered/guides/api-compatibility/v1/_index.md
* Update content/influxdb/clustered/guides/api-compatibility/v1/_index.md
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* WIP base changes for clustered docs
* WIP clustered docs
* Add new influxdb/host shortcode and implement it in 3.0 docs (#5077)
* add new influxdb/host shortcode and implement it in 3.0 docs
* remove oss- cloud-only shortcodes from serverless
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* updated urls js to PR suggestion
* Updated JavaScript, templates, and styles for Clustered URLs (#5079)
* updated js, templates, and styles for clustered urls
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* restructure product dropdown template to be more extensible
* fixed more page template bugs
* fixed references to cloud in clustered
* updated docsearch templates
* added early access flagging and cta-link shortcode
* minor content updates in clustered
* updated staging config
* fixed typo in clustered description
* ported influxctl 2.0.1 to clustered
* ported get started changes to clustered
* ported 3.0 admin docs to clustered
* port null tag content to clustered
* ported influxctl note to clustered
* ported query reorg changes to clustered
* updated early access to limited availability, updated clustered landing content
* ported new content to clustered
* ported new content to clustered
* updated cta on clustered landing page
* Updated notifications and added InfluxDB Clustered announcement notification (#5125)
* updated notifications, added clustered announcement notification
* updated cta in clustered notification
* updated influxctl profile configs
* update clustered search attributes
* updated learn more link in clustered notification
* Apply suggestions from code review
* fixed typos
* fixed typos
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>