Commit Graph

27 Commits (v3/inspect-partitions)

Author SHA1 Message Date
Jason Stirnaman 4a00926c86 fix(v3): Apply suggestions from @sanderson 2024-08-21 15:29:25 -05:00
Jason Stirnaman 4dc2033b99 fix(v3): apply correction, remove duplicate content, add links
- restore column limit defaults to 250
- remove duplicate content from schema-design

Co-authored-by: domodwyer <domodwyer@users.noreply.github.com>
2024-08-21 12:04:22 -05:00
Jason Stirnaman 57ed336ea2
Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-08-20 16:44:44 -05:00
Jason Stirnaman 7f8bde4abf fix(v3): Update Cloud Dedicated and Clustered column limit to 1000 and clarify the potential impact of wide schemas. 2024-08-20 14:27:36 -05:00
Jack ab52a00624
docs(clustered): clarify tuning garbage collector env vars (#5517)
* docs: clarify clustered gc env tunables

* docs: use suggested wording

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-07-11 17:25:59 -06:00
Jason Stirnaman 9d542dd8d6 fix: write-data section: consistent page titles, database and table nomenclature in dedicated and clustered 2024-06-25 11:51:26 -05:00
Jason Stirnaman bb166b0bdb fix: add serverless alt-links for influxctl 2024-06-24 16:14:07 -05:00
Jason Stirnaman 3bde9061e7 chore: Remove prettier from Markdown linting--to many whitespace conflicts with code blocks 2024-06-24 15:57:26 -05:00
Jason Stirnaman e0097c9b95 fix: whitespace 2024-06-24 15:51:08 -05:00
Jason Stirnaman 17c4315569 chore: Write data improvements
-  Format and structure serverless write-data
- Structure cloud-serverless write-data/line-protocol the same as clustered and dedicated to allow for adding more tool-specific pages.
- Make influxctl examples pass tests
2024-06-24 15:42:10 -05:00
Jason Stirnaman 5c74f013a1 chore(ci): Improve CI lint and test runners
- Reconfigures prettier linting.
- Adds .editorconfig to help with consistent editor settings
- Refactors test runs:
  - Removes test configuration from compose.yaml (not suited for this use case).
  - Splits test runner into test content setup and pytest that can be run separately or together (and with other test runners in the future).
  - Configuration is in Dockerfiles and command line (`.lintstagedrc.mjs`)
- Updates CONTRIBUTING.md
- Updates client library write examples in cloud-dedicated and clustered.
2024-06-21 18:41:07 -05:00
Jack caca0a71b6
docs(clustered): data ingest lifecycle (#5369)
* docs: object versioning, lifecycle rule best practices

* docs: trim whitespace

* docs: include appinstance configuration

* docs: update gc env var wording

Co-authored-by: Fraser Savage <fraser@savage.engineer>

* chore: use suggested wording

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: dedicated mention of versioning recommendation

The versioning really depends on an organisation's backups/DR strategy.
I've pulled this more inline with how the lifecylce of the ingested data
can be managed through the garbage-collector.

* docs: wording

* docs: use scenario wording suggestion

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: use suggested extension for gc service

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: no versioning suggestion

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: hint requirements for retention

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: mention object store sizing with lower cutoff

* docs: add warning for 3h cutoff

* suggested edits to the clustered ingest lifecycle guide (#5427)

* docs: use suggestion for configurable cutoff floor

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Fraser Savage <fraser@savage.engineer>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-04-16 16:00:46 +01:00
Jason Stirnaman f47631ae0c
fix(v3): Fix column limit totals. (#5398) 2024-03-28 10:34:20 -05:00
Jackie Tien fa8e5dcc93
Update schema-design.md (#5396) 2024-03-28 07:31:26 -06:00
Scott Anderson da1b1105ea
Update v3 token management docs and add management tokens (#5373)
* new token management structure, updated links

* task-based management token docs

* added related links to influxctl management docs

* remove draft status from management token admin docs

* standardize references to identity provider

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-03-21 13:42:41 -06:00
Jason Stirnaman 9e276df194
Optimize writes: Use Telegraf to pre-process data before writing (#5282)
* chore(v3): preprocess writes (Telegraf, etc)

* feat: optimize writes using Telegraf

* WIP: dedup plugin

* WIP: Dedup

* chore(v3): Writes: Preprocess data using Telegraf: Dedup example

(#5155)
- Add example using processors.dedup in Telegraf.
- The plugin or configuration doesn't currently work as expected. Investigating...

* chore(v3): Write data: pre-process data using Telegraf

- Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data.
- For Serverless. Will port to Dedicated and Clustered after approval.
- Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup)

* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* chore(test): Test harness setup, use golang base image

- Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go.
- Add flag to bypass python warning about using system python and pip.
- Remove redundant env.products from pytest.ini; we already load it into environment variables.

* chore(v3): Optimize writes: Use Telegraf

Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155

- Adds use cases to Dedicated and Clustered docs
- Adds example for Execd processor plugin to all
- Clean up and pass tests
- Remove shared code sample

* fix(v3): Optimize writes: Placeholders and indent fixes

* Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 11:23:49 -06:00
Scott Anderson 15395a9da6
Add influxctl documentation to the "Write data" section (#5283)
* reorg write line protocol docs

* port line protocol write changes to clustered
2023-12-19 13:07:43 -07:00
Jason Stirnaman 5649770e06
Fix-5226 v2 and v3 series inaccuracy (#5264)
* fix(v2): series keys in OSS

closes #5226

- Fix v2 series keys definitions
- Remove field key from OSS description
- Update glossary and schema-design.

* fix(v3): rejected points reason

closes Fix series definitions and reasons for rejected points #5226
- Replaces series with partition in reasons for rejected points.
2023-12-06 16:25:37 -06:00
Scott Anderson cbd2a0b72a
Update mentions of IOx to v3 (#5256)
* update mentions of IOx to v3

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-30 11:52:40 -07:00
Scott Anderson 8aca16c211
Update information regarding table and column limits (#5238)
* provided more information about changing table and column limits

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* updated column limit in schema design doc

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-20 15:36:00 -07:00
Jason Stirnaman abf60c9b69
chore(v3): There is no index of Tag Values, Tag Values are "just data" in IOx. #5097 (#5202)
- Fix example

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-10-30 09:03:49 -05:00
Jason Stirnaman c4ccc191b6
fix(v3): remove v2-prefer note, replace with specific recommendations (#5195)
* fix(v3): remove v2-prefer note, replace with specific recommendations

- removes the shared v2-prefer shortcode note.
- adds "Flight client" tag to all Flight RPC and Flight SQL client pages.
- replaces the note with specific write/query notes in each platform.
- misc fixes

* fix(v3): v2 client library typo

* fix(v3): Cleanup usage note for all v2 client libraries

- Change note to warning
- Condense
- Move warning to prepend block
- Make consistent on all pages
- Remove autolinking to GitHub repos

* chore(v3): Add "Clustered"

* fix(v3): typo
2023-10-26 14:45:38 -05:00
Jason Stirnaman 067d53c692
fix: v3 compressed examples, gzip capitalization (#5142) 2023-09-18 13:13:00 -05:00
Jason Stirnaman e0bafcd9a1
fix: fix v3 write descriptions, Add v3 Troubleshoot writing data #5135 (#5140)
* fix: fix v3 write descriptions, Add v3 Troubleshoot writing data #5135

* Update content/influxdb/cloud-dedicated/write-data/troubleshoot.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/clustered/write-data/troubleshoot.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-09-18 13:03:47 -05:00
Scott Anderson 35ad46c4c2
Version restructure (#5133)
* mass changes for version restructure

* fixed latest-patch and flux version generator

* updated hugo configs

* fixed flux frontmatter injector

* fixed flux frontmatter injector

* WIP api generator updates for version restructure (#5128)

* fixed telegraf plugin list

* removed latest shortcode

* fixed current-version

* fixed product dropdown crosslinking

* fixed alt links

* WIP fixing links

* fixed broken links

* updated api doc generation

* fixed additional resources

* added version redirects to edge.js

* fixed search placeholder

* fixed paged titles
2023-09-12 23:33:31 -06:00
Jason Stirnaman 5e5630389e
hotfix(v3): missing shared example files (#5127)
* hotfix(v3): missing shared example files

- replace paths to missing shared-text files with examples.
- update timestamps for custom-timestamps in older examples.
- the shared-text solution isn't really working for us, as it can't render the host shortcode and the placeholder names differ between platforms. I'll probably start doing away with it and tinker on a better way to achieve what I was trying to do.

* Update content/influxdb/clustered/guides/api-compatibility/v1/_index.md

* Update content/influxdb/clustered/guides/api-compatibility/v1/_index.md

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-09-06 10:41:13 -05:00
Scott Anderson 471ee4561d
InfluxDB Clustered documentation (#5126)
* WIP base changes for clustered docs

* WIP clustered docs

* Add new influxdb/host shortcode and implement it in 3.0 docs (#5077)

* add new influxdb/host shortcode and implement it in 3.0 docs

* remove oss- cloud-only shortcodes from serverless

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* updated urls js to PR suggestion

* Updated JavaScript, templates, and styles for Clustered URLs (#5079)

* updated js, templates, and styles for clustered urls

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* restructure product dropdown template to be more extensible

* fixed more page template bugs

* fixed references to cloud in clustered

* updated docsearch templates

* added early access flagging and cta-link shortcode

* minor content updates in clustered

* updated staging config

* fixed typo in clustered description

* ported influxctl 2.0.1 to clustered

* ported get started changes to clustered

* ported 3.0 admin docs to clustered

* port null tag content to clustered

* ported influxctl note to clustered

* ported query reorg changes to clustered

* updated early access to limited availability, updated clustered landing content

* ported new content to clustered

* ported new content to clustered

* updated cta on clustered landing page

* Updated notifications and added InfluxDB Clustered announcement notification (#5125)

* updated notifications, added clustered announcement notification

* updated cta in clustered notification

* updated influxctl profile configs

* update clustered search attributes

* updated learn more link in clustered notification

* Apply suggestions from code review

* fixed typos

* fixed typos

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-09-06 06:21:47 -06:00