* chore(v3): preprocess writes (Telegraf, etc)
* feat: optimize writes using Telegraf
* WIP: dedup plugin
* WIP: Dedup
* chore(v3): Writes: Preprocess data using Telegraf: Dedup example
(#5155)
- Add example using processors.dedup in Telegraf.
- The plugin or configuration doesn't currently work as expected. Investigating...
* chore(v3): Write data: pre-process data using Telegraf
- Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data.
- For Serverless. Will port to Dedicated and Clustered after approval.
- Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup)
* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* chore(test): Test harness setup, use golang base image
- Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go.
- Add flag to bypass python warning about using system python and pip.
- Remove redundant env.products from pytest.ini; we already load it into environment variables.
* chore(v3): Optimize writes: Use Telegraf
Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155
- Adds use cases to Dedicated and Clustered docs
- Adds example for Execd processor plugin to all
- Clean up and pass tests
- Remove shared code sample
* fix(v3): Optimize writes: Placeholders and indent fixes
* Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* update mentions of IOx to v3
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
- Adds a Docker image, scripts, and configuration that install and run pytest-codeblocks on Python and shell code samples in Markdown.
- Copied from https://github.com/jstirnaman/docs-codeblocks/
- TODO: The script copies files into a tmp directory configured as a bind mount for the Docker container. We might want to replace this with the experimental `watch` feature.
- TODO: Use a secret to configure the token. As is, values subbed from the dotenv file are exposed in your Docker container history.
* WIP base changes for clustered docs
* WIP clustered docs
* Add new influxdb/host shortcode and implement it in 3.0 docs (#5077)
* add new influxdb/host shortcode and implement it in 3.0 docs
* remove oss- cloud-only shortcodes from serverless
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* updated urls js to PR suggestion
* Updated JavaScript, templates, and styles for Clustered URLs (#5079)
* updated js, templates, and styles for clustered urls
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* restructure product dropdown template to be more extensible
* fixed more page template bugs
* fixed references to cloud in clustered
* updated docsearch templates
* added early access flagging and cta-link shortcode
* minor content updates in clustered
* updated staging config
* fixed typo in clustered description
* ported influxctl 2.0.1 to clustered
* ported get started changes to clustered
* ported 3.0 admin docs to clustered
* port null tag content to clustered
* ported influxctl note to clustered
* ported query reorg changes to clustered
* updated early access to limited availability, updated clustered landing content
* ported new content to clustered
* ported new content to clustered
* updated cta on clustered landing page
* Updated notifications and added InfluxDB Clustered announcement notification (#5125)
* updated notifications, added clustered announcement notification
* updated cta in clustered notification
* updated influxctl profile configs
* update clustered search attributes
* updated learn more link in clustered notification
* Apply suggestions from code review
* fixed typos
* fixed typos
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* chore(cloud): Remove support from billing (https://github.com/influxdata/DAR/issues/390)
* chore(cloud): Remove support from limits (https://github.com/influxdata/DAR/issues/390)
* fix(serverless): Add related and fix aliases.
* chore(cloud): Remove and update Support contact (https://github.com/influxdata/DAR/issues/390)
* chore(serverless): Remove and update Support contact (https://github.com/influxdata/DAR/issues/390)
* fix(serverless): Alternatives to deleting data, update measurement/table entries in glossary.
* chore: Update Support footer.
* hotfix: cloud-only tags in glossary
* chore(docs): Update storage-limits to remove directions to contact support (#4996)
* chore(docs): Update storage-limits to remove directions to contact support
Support are not able to increase these limits on the serverless product. If customers need higher limits they should speak to sales about a dedicated solution in the first instance.
* chore: fix hyperlink to sales
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Update content/influxdb/cloud-serverless/admin/billing/_index.md
Co-authored-by: Ben Tasker <88340935+btasker@users.noreply.github.com>
* Update content/influxdb/cloud/account-management/billing.md
Co-authored-by: Ben Tasker <88340935+btasker@users.noreply.github.com>
* fix(serverless): measurement suggestions
Co-authored-by: Ben Tasker <88340935+btasker@users.noreply.github.com>
* Update content/influxdb/cloud-serverless/reference/internals/storage-limits.md
---------
Co-authored-by: Will Cooke <will@whizzy.org>
Co-authored-by: Ben Tasker <88340935+btasker@users.noreply.github.com>
* wip: fix serverless api related links.
* fix(serverless): remove, replace, alias broken links, and/or mark for pending content
- See the annotated link checker report.
(closes 404s for links in Cloud Serverless API reference #4955)
* base changes for influxdb cloud dedicated
* removed unnecessary whitespace from dedicated homepage
* influxctl reference documentation (#4855)
* influxctl reference docs
* fixed typo, added auth0 token life span
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* more updates to influxctl docs
* update influxctl docs to address PR feedback
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Add admin and manage databases sections to Cloud Dedicated (#4857)
* add admin and manage databases sections
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* added missing page descriptions to admin docs
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Add token management documentation to Cloud Dedicated documentation (#4861)
* add manage tokens documentation to dedicated
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* update admin token docs to address PR feedback
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Dedicated get started (#4878)
* WIP dedicated get started content
* fix(cst): infinite cardinality (#4851)
* WIP cloud dedicated get started
* feat(cloud-dedicated): WIP - write data to Cloud Dedicated
* fix(cloud-dedicated): grammar.
* feat(cloud-dedicated): WIP outline write methods, v1 API use
* fix(cloud-dedicated): dupe name.
* updated staging config, fixed dedicated page titles
* updated dedicated setup doc
* Cloud Dedicated primers v1 API: auth and write (#4865)
* feat(cloud-dedicated): v1 API with Cloud Dedicated
- Add /primers >> /api >> /v1 and /v2
- Move draft started in /write-data to /primers/api/v1
- Created code samples that still need testing
- v1 authentication schemes.
* fix(cloud-dedicated): list children pages
* wip(cloud-dedicated): v1 primer intro
* wip(cloud-dedicated): auth fixes.
* feat(cloud-dedicated): v1 API primer
- part of #4863, #4864
Still untested against CST:
- v1 auth methods
- v1 /write
- Telegraf config
- Precision
- API sample code
* Update content/influxdb/cloud-dedicated/primers/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/_index.md
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v2/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v2/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update layouts/shortcodes/api/cloud/v2-prefer.html
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update shared/text/api/cloud-dedicated/basic-auth.js
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Dedicated v1 write (#4873)
* wip(v1): Revise v1 and add client library info.
* feat(cloud-dedicated): primer v1 API auth and writes
- Fixes for v1 auth and writes
- Configuring node and python v1 client libraries for Cloud Dedicated.
* fix(cloud-dedicated): v1 intros:
- Fix redundant intro
- Query intros
* Apply suggestions from code review
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Dedicated v2 write (#4875)
* fix(cloud-dedicated): v1 API primer:
- fix typo
- fix description
* wip(cloud-dedicated): v2 auth, write, Telegraf
* feat(cloud-dedicated): v2 API primer (#4874)
- v2 authentication
- Write using /api/v2/write
- Cleanup in v1
* Update content/influxdb/cloud-dedicated/primers/api/v2/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/primers/api/v1/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update shared/text/api/cloud-dedicated/token-auth-v2-write.sh
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* fix(cloud-dedicated): parameters for v1 and v2 writes
- testing proves that org can't be empty
Ongoing:
- writes with v2 client library appear to work, but I can't find the measurement when I query.
- v1 writes with curl respond with 404.
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Add Python and Go write instructions to Cloud Dedicated get started (#4876)
* added python and go write instructions to dedicated get started
* Add get started query guide to dedicated (#4877)
* Add get started query guide to dedicated
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Apply suggestions from code review
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Port reference content into dedicated (#4879)
* ported line protocol and sql reference
* port glossary to dedicated
* fix(cloud-dedicated): cleanup (#4880)
* fix(cloud-dedicated): v1 parameter values
- Fixes parameter values in requests.
- Based on inspection of the request (default port, content-type headers).
- Still not working in CST.
* fix(cloud-dedicated): cleanup auth description and list query tools.
* fix(cloud-dedicated): cleanup auth examples:
- remove boilerplate JS examples. Eventually replace with client lib examples.
- fix incorrect URL
- replace localhost with cloud2 host
* fix(cloud-dedicated): replace placeholders
* Add support for custom dedicated URLs (#4882)
* add support for custom dedicated urls
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* removed unnecessary conditional in influxdb-urls.js
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* add information about flight sql support (#4894)
* Update influxctl install and setup instructions (#4893)
* updated influxctl install and setup instructions
* added details to influxctl init page
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Dedicated query data (#4895)
* WIP port query data section to dedicated
* updated database-name to iox-namespace-name
* updated grafana instructions
* update grafana install instructions
* updated images and links
* fixed broken links in query data section
* fix(cloud-dedicated): get-started write (#4890)
* fix(cloud-dedicated): package name typo
* fix(cloud-dedicated): URL missing query
* fix(cloud-dedicated): iox-namespace-name
* fix(cloud-dedicated): use get-started database name
* fix(cloud-dedicated): add auth-specific examples.
* fix(cloud-dedicated): use Bearer for v2 example
* fix(cloud-dedicated): add a note about token schemes and link to primer.
* fix(cloud-dedicated): org no longer required by API, remove from curl example
* fix(cloud-dedicated): use Bearer
* fix(cloud-dedicated): wordsmithing
* fix(cloud-dedicated): file name
* fix(cloud-dedicated): Go client works without org
* fix(cloud-dedicated): separate the commands for copy-pasting
* fix(cloud-dedicated): v1 API token authentication
* fix(cloud-dedicated): org parameter ignored, but needed in python clients
* fix(cloud-dedicated): v1 API examples and params for /query (#4897)
* fix(cloud-dedicated): minor word change (#4898)
* New homepage and structural changes (#4899)
* WIP first sweep of cloud-iox to cloud-serverless
* WIP iox to serverless content updates
* WIP iox to serverless updates in page templates and data files
* WIP new homepage
* chore(dedicated): copy best-practices from serverless
* fix(serverless): missing shortcut
* new homepage
* fix(dedicated): token links in v1 API primer
* chore(dedicated): write csv with Telegraf
* fix(serverless): write CSV with Telegraf
* updated homepage styles
* updated deps, fix unclosed shortcodes, fix light css
* fix product selector order
* updated database naming restrictions, add resource delete confirmation
* add cloud-ios to cloud-serverless redirect to edge.js
* remove sh from allowed extentions
* fix bug in redirect logic
* add sections to product dropdown (#4900)
* minor homepage css adjustment
* fixed page titles
* fixed more iox references in templates
* Apply suggestions from code review
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* Migrate 1.x data to dedicated (#4901)
* fix(serverless): cleanup
* chore(dedicated): Migrate 1.x data to dedicated
- Minimal adaptation of IOx to Dedicated for now.
- Use APIs for writing data (CLIs? pyinflux3 only writes CSV? Can't promote influxdb_iox for now)
- Add 2.x CLI warning
* fix(dedicated): URL typos
* Update content/influxdb/cloud-dedicated/write-data/migrate-data/_index.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/write-data/migrate-data/migrate-1x-to-cloud-dedicated.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/write-data/migrate-data/migrate-1x-to-cloud-dedicated.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/write-data/migrate-data/migrate-1x-to-cloud-dedicated.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/write-data/migrate-data/migrate-1x-to-cloud-dedicated.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
* Update content/influxdb/cloud-dedicated/write-data/migrate-data/migrate-1x-to-cloud-dedicated.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
* add step for requesting a cluster in dedicated setup
* minor content fixes in best practices
---------
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
Jason Stirnaman
Jason Stirnaman
Scott Anderson
Jacob Marble
Scott Anderson