Commit Graph

141 Commits (jstirnaman/issue5108)

Author SHA1 Message Date
Jason Stirnaman 158d38a8d7 hotfix(serverless): InfluxDB Cloud internals menu 2024-03-15 18:49:48 -05:00
Jason Stirnaman 695d291e4b fix(v3): optimize-queries link 2024-03-15 18:33:19 -05:00
Jason Stirnaman 99bb53a97c fix(v3): Add note to optimize page and revise troubleshoot 2024-03-15 18:31:01 -05:00
Jason Stirnaman 726d21e061 fix(v3): Apply review suggestions and capitalization
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 17:58:57 -05:00
Jason Stirnaman f5fd62bac5 fix(v3): finish the EXPLAIN descriptions and examples 2024-03-15 17:47:32 -05:00
Jason Stirnaman 93bb3591fd
Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md
Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 09:42:48 -05:00
Scott Anderson a96773c3c7
add query plan html diagram (#5365) 2024-03-15 09:27:53 -05:00
Jason Stirnaman 0d0bca9223 feature(v3): Analyze a query plan:
- Apply code formatting to plan implementor names
- Simplify some points
- Add links
2024-03-14 16:48:26 -05:00
Jason Stirnaman 8774277311 chore: Fixes broken links, typos, missing content, etc.
- Fixes various errors and style violations reported by Vale.
- Fixes broken links and missing content in glossaries.
- Fixes missing and extraneous whitespace.
2024-03-14 11:15:14 -05:00
Jason Stirnaman 24f88c0d34 chore(v3): Reorg of query troubleshooting and optimizing docs
- Adds query-data/troubleshoot-and-optimize
- Splits optimize docs into troubleshoot and optimize docs
- Moves Flight response doc to flight-responses.md
2024-03-14 11:15:14 -05:00
Jason Stirnaman f1e82bb09a chore(spelling): Vale config changes
- Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually.
- Move InfluxData spelling ignore list into the style.
- Reorganize custom (product) spelling lists to comply with Vale 3.x
- Add InfluxDB v3 terms
2024-03-14 11:15:13 -05:00
Jason Stirnaman 2b222707bf WIP: optimize queries - how to read a query plan, operators 2024-03-14 11:11:36 -05:00
Jason Stirnaman 42415c8dd7 Apply suggestions from code review 2024-03-14 11:11:36 -05:00
Jason Stirnaman 92a8d9ff8e Strategies to improve query performance: operations, number and size of parquet files
Fixes #5108

- Add query performance strategies to optimize-queries
2024-03-14 11:11:36 -05:00
Scott Anderson 259e8e67b4
add JSON page lists for use in the v3 UI (#5363) 2024-03-14 09:32:04 -06:00
Scott Anderson 0ecc796e60
Update SQL functions added upstream (#5345)
* updates sql functions added upstream

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* port changes to serverless and clustered

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-03-06 14:00:18 -07:00
Scott Anderson 3b9bf0d019
Update SQL timestamp functions and casting operations (#5332)
* updated sql time and date functions

* update sql casting docs with new TIMESTAMP behavior, closes #5331

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* added format_n argument to to_timestamp* functions

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-02-26 15:21:25 -07:00
Andreas Deininger e53083e7fc
docs: fix broken links (#5322)
* docs: fix broken links

* Update content/influxdb/cloud-dedicated/process-data/visualize/grafana.md

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-02-16 15:40:14 -06:00
Jason Stirnaman 8cda7285ca
fix: be explicit about srvls write 201 (#5328) 2024-02-16 12:47:41 -06:00
Scott Anderson 926eceea41
Update 'SHOW TAG VALUES' documentation to include a FROM clause (#5324)
* add note to show tag values docs about including a FROM clause, closes #5321

* Update content/influxdb/cloud-dedicated/reference/influxql/show.md

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* port changes to serverless and clustered

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-02-15 11:31:48 -07:00
Andreas Deininger 476a73e95e
Fixing typos (#5315)
* Fix typos

* Bump hugo to latest version v0.122.0

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-02-05 09:51:51 -07:00
Jay Clifford e66563946c
Updated grafana.md to include the new InfluxDB data source SQL setup (#5307)
* Updated grafana.md to include the new InfluxDB data source SQL setup

* updates to new grafana docs

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* ported grafana docs to other v3 products

* minor updates to grafana files

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
Co-authored-by: Scott Anderson <scott@influxdata.com>
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2024-02-05 09:34:34 -07:00
Andrew Lamb 81c6e3edfd
Update time-and-date.md to correct supported `interval` types (#5314)
* Update time-and-date.md

Fixes https://github.com/influxdata/docs-v2/issues/5313

Update docs to correct supported interval type

* Update content/influxdb/cloud-serverless/reference/sql/functions/time-and-date.md
2024-01-30 08:43:17 -07:00
Jason Stirnaman 7479ceabf2
Revert "Revert "feature(v3): Write: partial writes write good lines and reject bad li… (#5169)" (#5280)" (#5304)
This reverts commit 624eb0205b.
2024-01-17 13:20:25 -06:00
Gary Fowler 61e8999dba
Update limits.md (#5297)
Namespace terminology caused some confusion; changing the word namespace to database to try to ease this confusion.
2024-01-10 16:01:44 -07:00
Jason Stirnaman 4b371c91d8
Update Go Arrow package version (#5288)
Fixes #5271

- Updates Go samples that use the client library to use the same Arrow package version (v13) used in the client library
- Updates Go FlightSQL examples to use the latest Arrow package (v14).
2023-12-28 14:02:58 -06:00
Jason Stirnaman 9e276df194
Optimize writes: Use Telegraf to pre-process data before writing (#5282)
* chore(v3): preprocess writes (Telegraf, etc)

* feat: optimize writes using Telegraf

* WIP: dedup plugin

* WIP: Dedup

* chore(v3): Writes: Preprocess data using Telegraf: Dedup example

(#5155)
- Add example using processors.dedup in Telegraf.
- The plugin or configuration doesn't currently work as expected. Investigating...

* chore(v3): Write data: pre-process data using Telegraf

- Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data.
- For Serverless. Will port to Dedicated and Clustered after approval.
- Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup)

* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* chore(test): Test harness setup, use golang base image

- Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go.
- Add flag to bypass python warning about using system python and pip.
- Remove redundant env.products from pytest.ini; we already load it into environment variables.

* chore(v3): Optimize writes: Use Telegraf

Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155

- Adds use cases to Dedicated and Clustered docs
- Adds example for Execd processor plugin to all
- Clean up and pass tests
- Remove shared code sample

* fix(v3): Optimize writes: Placeholders and indent fixes

* Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 11:23:49 -06:00
Jason Stirnaman d61107a3d3
feature(v3): Cloud Dedicated write API: partial writes write good lines and reject bad li… (#5273)
* feature(v3): Write: partial writes write good lines and reject bad lines #5160

- Documents the proposed partial writes feature for Serverless and Dedicated.
- Updates Troubleshoot writes and API docs.

* chore(v3): update write status codes (#5160)

* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md

* chore(v3): cleanup partial write descriptions in API ref and troubleshooting guide
2023-12-18 12:43:44 -06:00
Jason Stirnaman 624eb0205b
Revert "feature(v3): Write: partial writes write good lines and reject bad li… (#5169)" (#5280)
This reverts commit 90948e67dc.
2023-12-15 09:27:57 -06:00
Jason Stirnaman 90948e67dc
feature(v3): Write: partial writes write good lines and reject bad li… (#5169)
* feature(v3): Serverless write API: writes good lines, rejects bad lines #5160

- Documents the proposed partial writes feature for Serverless and Dedicated.
- If some points are written, returns 201 status code.
- Updates Troubleshoot writes and API docs.

* feature(v3): Serverless write API: writes good lines, rejects bad lines #5160

- Documents the proposed partial writes feature for Serverless and Dedicated.
- If some points are written, returns 201 status code.
- Updates Troubleshoot writes and API docs.

* fix: Serverless cleanup

* fix: Serverless write API: restore 204 and explain 201 and 400 status codes.

* Apply suggestions from code review

* fix: Serverless write API: 201 superseded by 204 to maintain v2 compat.

- Documents https://github.com/influxdata/idpe/pull/18398.

* fix: Serverless write API: 201 superseded by 204 to maintain v2 compat.

- Documents https://github.com/influxdata/idpe/pull/18398.

* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md

* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md

* Update content/influxdb/cloud-serverless/write-data/troubleshoot.md
2023-12-13 16:20:51 -06:00
Scott Anderson ada8186a36
Add schema warnings to migration guides (#5268)
* WIP add migration schema warnings

* added tsm to dedicated and clustered migration guides, closes #5258

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-12-12 16:46:33 -07:00
Scott Anderson 2aa5713267
remove serverless system tables info, related to influxdata/EAR#4741 (#5265)
Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-12-06 16:34:31 -07:00
Jason Stirnaman 5649770e06
Fix-5226 v2 and v3 series inaccuracy (#5264)
* fix(v2): series keys in OSS

closes #5226

- Fix v2 series keys definitions
- Remove field key from OSS description
- Update glossary and schema-design.

* fix(v3): rejected points reason

closes Fix series definitions and reasons for rejected points #5226
- Replaces series with partition in reasons for rejected points.
2023-12-06 16:25:37 -06:00
Scott Anderson ae3341cc70
v3 InfluxQL troubleshooting (#5261)
* WIP v3 influxql troubleshooting

* WIP influxql troubleshooting

* WIP InfluxQL troubleshooting

* add influxql troubleshooting to serverless

* Update content/influxdb/cloud-dedicated/query-data/influxql/troubleshoot.md

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* ported influxql troubleshooting to serverless and clustered

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-12-06 14:04:10 -07:00
Jason Stirnaman de0f526bdf
Reorganize Serverless DBRP for v1 queries and writes, explain DBRP and auto bucket defaults (#5257)
* chore(v3): DBRP: Update Serverless API ref (#5234)

* chore(ci): Tests: substitute placeholders in JSON body parameters

* chore(v3): DBRP: copy page from influxql to admin/dbrps.

* chore(ci): Trying to prevent "a Influx..."

* chore(ci): Allow autogen

* chore(serverless): DBRP glossary entry

* chore(v2): add default DBRP note

* chore(v3): use product-name shortcode

* chore(v3): use product-name shortcode, clarify retention period and mapping

* chore(serverless): Create Bucket:

- add missing example for Data Explorer
- move Retention Period syntax and define retentionRules syntax
- setup for tests

* chore(serverless): Create Bucket:

- add missing example for Data Explorer
- move Retention Period syntax and define retentionRules syntax
- setup for tests

* chore(serverless): Update bucket: alias to match other products

* chore(v3): Serverless for prototyping: update with DBRP behavior

* Serverless auto-generated buckets have 3-day default retention period
Fixes #5234

- v1-compat guide:
  - passes tests
  - explains DBRPs (default, automatic, and management)
  - migrate DBRP content from query-data/influxql/dbrp
- v2-compat guide:
  - fix TOC
  - add list code example
- rename influxdb-v1-api to api/v1-http, migrate params from v1-compat guide, and explain DBRP in context
- add write-data/api/v1-http and migrate content from v1-compat guide
- move optimize and troubleshooting up to /query-data
- add Related items support for paths containing http
- substitute placeholders in tests

* chore(test): update configuration in README

* fix(serverless): Optimize queries parent

* fix(serverless): create-bucket cleanup

* fix: cleanup

* fix: close tag

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* fix(v3): permission to create dbrp-mapped bucket

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-05 16:48:25 -06:00
Scott Anderson cbd2a0b72a
Update mentions of IOx to v3 (#5256)
* update mentions of IOx to v3

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-30 11:52:40 -07:00
Scott Anderson 92db741681
Flux migration troubleshooting and IOx naming cleanup (#5249)
* adds error to migration troubleshoot, some IOx cleanup, closes influxdata/DAR#387

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* Apply suggestions from code review

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-22 12:30:24 -07:00
Jason Stirnaman 5c74bf4ff6
5156 Writes: add v1 to Serverless get-started (#5233)
* chore(ci): Install Telegraf to test container

* chore(v3): test telegraf config and startup:

- creates the config file for the test run. TODO: remove the duplication and use the content for test setup.
- fix placeholder name

* fix(v3): make test pass for curl API example

* chore(ci): make tests pass for write. Add dependencies to Dockerfile.

* chore(tests): update test build

- Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container.
- Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better.
- test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`.
- pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables.

* fix(write): update JS instructions and pass tests.

* chore(ci): Install influx v2 CLI into the Docker test container.

* chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file:

- Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now.
- Add example for passing custom commands in the compose file.

* fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests.

feat(v3): add v1 write, test, update text:

- adds Serverless v1 /write example with note about autogen behavior
- adds link from v1 examples to Migrate guide
- adds description of autogen behavior to v1-compat guide
- updates "powered by..." text
- adapts examples to make them more testable, asserts `/write` status code
- replace "shared" examples (only used once) with inline to make them testable

fix(v3): promote migrate link

* Update content/influxdb/cloud-dedicated/get-started/write.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* chore(v3): Write: fix wording for curl success  (#5156)

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 14:41:29 -06:00
Jeffrey Smith II 491dfc50d7
fix: update influxql docs to reflect implicit time limit (#5237)
* fix: update influxql docs to reflect implicit time limit

* chore: include default time range

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* chore: include default time range

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* chore: include default time range

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* chore: better wording/explanation

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* chore: better wording/explanation

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* chore: better wording/explanation

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-15 14:21:55 -06:00
Scott Anderson 2c1375d9cb
SAL operators (#5225)
* WIP SQL operators

* add more descriptions for sql operators

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* port sql operator docs to serverless and clustered

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-13 09:12:50 -07:00
Scott Anderson 636f5ada45
V2 nav reorg (#5213)
* nest reference docs menu in v2 and cloud

* move migrate data into write data

* nest notebooks under tools

* nest templates under tools

* nest telegraf configs under tools

* cleanup weights and titles of tools sections

* reorg org and bucket management under admin

* add backup/restore to admin, clean up related links

* restructure security sections under admin

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* updated serverless cli docs to address pr feedback

* Update content/influxdb/cloud/admin/organizations/delete-org.md

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* port v2 install changes to new structure

* address pr feedback and ported missing content to serverless

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-11-06 15:53:12 -07:00
Jason Stirnaman c4b97f9acf
5025 fix and test python examples (#5207)
* chore(v3): add test replacements

* fix(v3): get-started/query samples, make testable
2023-10-30 16:48:09 -05:00
Jason Stirnaman abf60c9b69
chore(v3): There is no index of Tag Values, Tag Values are "just data" in IOx. #5097 (#5202)
- Fix example

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-10-30 09:03:49 -05:00
Jason Stirnaman c4ccc191b6
fix(v3): remove v2-prefer note, replace with specific recommendations (#5195)
* fix(v3): remove v2-prefer note, replace with specific recommendations

- removes the shared v2-prefer shortcode note.
- adds "Flight client" tag to all Flight RPC and Flight SQL client pages.
- replaces the note with specific write/query notes in each platform.
- misc fixes

* fix(v3): v2 client library typo

* fix(v3): Cleanup usage note for all v2 client libraries

- Change note to warning
- Condense
- Move warning to prepend block
- Make consistent on all pages
- Remove autolinking to GitHub repos

* chore(v3): Add "Clustered"

* fix(v3): typo
2023-10-26 14:45:38 -05:00
Scott Anderson 42a493aafa hotfix: fix typo in get-started query examples, closes #5152 2023-10-25 10:23:27 -06:00
Jason Stirnaman 4f838adb38
V3 summarize tools (#5191)
* feat(v3): add table summarizing tools for each platform

* Update content/influxdb/cloud-dedicated/get-started/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

* Update content/influxdb/clustered/get-started/_index.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>

---------

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-10-25 08:35:52 -05:00
Scott Anderson 5d3328b7c6
Add InfluxQL schema exploration docs (#5189)
* add influxql explore schema task-based doc

* port influxql explore schema guide to clustered and serverless
2023-10-24 10:27:18 -06:00
Scott Anderson 8223d6e3f0
Add task-based InfluxQL aggregation guide (#5187)
* added task-based influxql aggregate guide

* Apply suggestions from code review

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>

* ported influxql aggregate guides to other v3 products, added related links

---------

Co-authored-by: Jason Stirnaman <stirnamanj@gmail.com>
2023-10-24 08:00:32 -06:00
Scott Anderson fc0892fe71
add influxql show stmt docs (#5186) 2023-10-23 08:43:33 -06:00
Jason Stirnaman 5bc6fb2865
5178 v3 fix broken link (#5180)
* fix(v3): Closes v3: fix broken link #5178

* fix(v3): fix broken links, document query FlightCallOptions
2023-10-16 15:25:00 -05:00