Commit Graph

18 Commits (v3/inspect-partitions)

Author SHA1 Message Date
Jason Stirnaman 4a00926c86 fix(v3): Apply suggestions from @sanderson 2024-08-21 15:29:25 -05:00
Jason Stirnaman 4dc2033b99 fix(v3): apply correction, remove duplicate content, add links
- restore column limit defaults to 250
- remove duplicate content from schema-design

Co-authored-by: domodwyer <domodwyer@users.noreply.github.com>
2024-08-21 12:04:22 -05:00
Jason Stirnaman 57ed336ea2
Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-08-20 16:44:44 -05:00
Jason Stirnaman 7f8bde4abf fix(v3): Update Cloud Dedicated and Clustered column limit to 1000 and clarify the potential impact of wide schemas. 2024-08-20 14:27:36 -05:00
Jack ab52a00624
docs(clustered): clarify tuning garbage collector env vars (#5517)
* docs: clarify clustered gc env tunables

* docs: use suggested wording

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-07-11 17:25:59 -06:00
Jason Stirnaman 9d542dd8d6 fix: write-data section: consistent page titles, database and table nomenclature in dedicated and clustered 2024-06-25 11:51:26 -05:00
Jack caca0a71b6
docs(clustered): data ingest lifecycle (#5369)
* docs: object versioning, lifecycle rule best practices

* docs: trim whitespace

* docs: include appinstance configuration

* docs: update gc env var wording

Co-authored-by: Fraser Savage <fraser@savage.engineer>

* chore: use suggested wording

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: dedicated mention of versioning recommendation

The versioning really depends on an organisation's backups/DR strategy.
I've pulled this more inline with how the lifecylce of the ingested data
can be managed through the garbage-collector.

* docs: wording

* docs: use scenario wording suggestion

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: use suggested extension for gc service

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: no versioning suggestion

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: hint requirements for retention

Co-authored-by: Dom <dom@itsallbroken.com>

* docs: mention object store sizing with lower cutoff

* docs: add warning for 3h cutoff

* suggested edits to the clustered ingest lifecycle guide (#5427)

* docs: use suggestion for configurable cutoff floor

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Fraser Savage <fraser@savage.engineer>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-04-16 16:00:46 +01:00
Jason Stirnaman f47631ae0c
fix(v3): Fix column limit totals. (#5398) 2024-03-28 10:34:20 -05:00
Jackie Tien fa8e5dcc93
Update schema-design.md (#5396) 2024-03-28 07:31:26 -06:00
Scott Anderson da1b1105ea
Update v3 token management docs and add management tokens (#5373)
* new token management structure, updated links

* task-based management token docs

* added related links to influxctl management docs

* remove draft status from management token admin docs

* standardize references to identity provider

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-03-21 13:42:41 -06:00
Jason Stirnaman 9e276df194
Optimize writes: Use Telegraf to pre-process data before writing (#5282)
* chore(v3): preprocess writes (Telegraf, etc)

* feat: optimize writes using Telegraf

* WIP: dedup plugin

* WIP: Dedup

* chore(v3): Writes: Preprocess data using Telegraf: Dedup example

(#5155)
- Add example using processors.dedup in Telegraf.
- The plugin or configuration doesn't currently work as expected. Investigating...

* chore(v3): Write data: pre-process data using Telegraf

- Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data.
- For Serverless. Will port to Dedicated and Clustered after approval.
- Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup)

* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* chore(test): Test harness setup, use golang base image

- Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go.
- Add flag to bypass python warning about using system python and pip.
- Remove redundant env.products from pytest.ini; we already load it into environment variables.

* chore(v3): Optimize writes: Use Telegraf

Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155

- Adds use cases to Dedicated and Clustered docs
- Adds example for Execd processor plugin to all
- Clean up and pass tests
- Remove shared code sample

* fix(v3): Optimize writes: Placeholders and indent fixes

* Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 11:23:49 -06:00
Scott Anderson cbd2a0b72a
Update mentions of IOx to v3 (#5256)
* update mentions of IOx to v3

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-30 11:52:40 -07:00
Scott Anderson 8aca16c211
Update information regarding table and column limits (#5238)
* provided more information about changing table and column limits

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* updated column limit in schema design doc

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-20 15:36:00 -07:00
Jason Stirnaman abf60c9b69
chore(v3): There is no index of Tag Values, Tag Values are "just data" in IOx. #5097 (#5202)
- Fix example

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-10-30 09:03:49 -05:00
Jason Stirnaman 067d53c692
fix: v3 compressed examples, gzip capitalization (#5142) 2023-09-18 13:13:00 -05:00
Scott Anderson 35ad46c4c2
Version restructure (#5133)
* mass changes for version restructure

* fixed latest-patch and flux version generator

* updated hugo configs

* fixed flux frontmatter injector

* fixed flux frontmatter injector

* WIP api generator updates for version restructure (#5128)

* fixed telegraf plugin list

* removed latest shortcode

* fixed current-version

* fixed product dropdown crosslinking

* fixed alt links

* WIP fixing links

* fixed broken links

* updated api doc generation

* fixed additional resources

* added version redirects to edge.js

* fixed search placeholder

* fixed paged titles
2023-09-12 23:33:31 -06:00
Jason Stirnaman 5e5630389e
hotfix(v3): missing shared example files (#5127)
* hotfix(v3): missing shared example files

- replace paths to missing shared-text files with examples.
- update timestamps for custom-timestamps in older examples.
- the shared-text solution isn't really working for us, as it can't render the host shortcode and the placeholder names differ between platforms. I'll probably start doing away with it and tinker on a better way to achieve what I was trying to do.

* Update content/influxdb/clustered/guides/api-compatibility/v1/_index.md

* Update content/influxdb/clustered/guides/api-compatibility/v1/_index.md

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-09-06 10:41:13 -05:00
Scott Anderson 471ee4561d
InfluxDB Clustered documentation (#5126)
* WIP base changes for clustered docs

* WIP clustered docs

* Add new influxdb/host shortcode and implement it in 3.0 docs (#5077)

* add new influxdb/host shortcode and implement it in 3.0 docs

* remove oss- cloud-only shortcodes from serverless

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* updated urls js to PR suggestion

* Updated JavaScript, templates, and styles for Clustered URLs (#5079)

* updated js, templates, and styles for clustered urls

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* restructure product dropdown template to be more extensible

* fixed more page template bugs

* fixed references to cloud in clustered

* updated docsearch templates

* added early access flagging and cta-link shortcode

* minor content updates in clustered

* updated staging config

* fixed typo in clustered description

* ported influxctl 2.0.1 to clustered

* ported get started changes to clustered

* ported 3.0 admin docs to clustered

* port null tag content to clustered

* ported influxctl note to clustered

* ported query reorg changes to clustered

* updated early access to limited availability, updated clustered landing content

* ported new content to clustered

* ported new content to clustered

* updated cta on clustered landing page

* Updated notifications and added InfluxDB Clustered announcement notification (#5125)

* updated notifications, added clustered announcement notification

* updated cta in clustered notification

* updated influxctl profile configs

* update clustered search attributes

* updated learn more link in clustered notification

* Apply suggestions from code review

* fixed typos

* fixed typos

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-09-06 06:21:47 -06:00