docs-v2/test.Dockerfile

94 lines
3.8 KiB
Plaintext
Raw Normal View History

5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
# If you need more help, visit the Dockerfile reference guide at
# https://docs.docker.com/engine/reference/builder/
Optimize writes: Use Telegraf to pre-process data before writing (#5282) * chore(v3): preprocess writes (Telegraf, etc) * feat: optimize writes using Telegraf * WIP: dedup plugin * WIP: Dedup * chore(v3): Writes: Preprocess data using Telegraf: Dedup example (#5155) - Add example using processors.dedup in Telegraf. - The plugin or configuration doesn't currently work as expected. Investigating... * chore(v3): Write data: pre-process data using Telegraf - Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data. - For Serverless. Will port to Dedicated and Clustered after approval. - Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup) * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(test): Test harness setup, use golang base image - Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go. - Add flag to bypass python warning about using system python and pip. - Remove redundant env.products from pytest.ini; we already load it into environment variables. * chore(v3): Optimize writes: Use Telegraf Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155 - Adds use cases to Dedicated and Clustered docs - Adds example for Execd processor plugin to all - Clean up and pass tests - Remove shared code sample * fix(v3): Optimize writes: Placeholders and indent fixes * Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 17:23:49 +00:00
# Starting from a Go base image is easier than setting up the Go environment later.
FROM golang:latest
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
Optimize writes: Use Telegraf to pre-process data before writing (#5282) * chore(v3): preprocess writes (Telegraf, etc) * feat: optimize writes using Telegraf * WIP: dedup plugin * WIP: Dedup * chore(v3): Writes: Preprocess data using Telegraf: Dedup example (#5155) - Add example using processors.dedup in Telegraf. - The plugin or configuration doesn't currently work as expected. Investigating... * chore(v3): Write data: pre-process data using Telegraf - Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data. - For Serverless. Will port to Dedicated and Clustered after approval. - Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup) * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(test): Test harness setup, use golang base image - Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go. - Add flag to bypass python warning about using system python and pip. - Remove redundant env.products from pytest.ini; we already load it into environment variables. * chore(v3): Optimize writes: Use Telegraf Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155 - Adds use cases to Dedicated and Clustered docs - Adds example for Execd processor plugin to all - Clean up and pass tests - Remove shared code sample * fix(v3): Optimize writes: Placeholders and indent fixes * Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 17:23:49 +00:00
RUN apt-get update && apt-get upgrade -y && apt-get install -y \
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
curl \
git \
gpg \
jq \
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
maven \
nodejs \
npm \
Optimize writes: Use Telegraf to pre-process data before writing (#5282) * chore(v3): preprocess writes (Telegraf, etc) * feat: optimize writes using Telegraf * WIP: dedup plugin * WIP: Dedup * chore(v3): Writes: Preprocess data using Telegraf: Dedup example (#5155) - Add example using processors.dedup in Telegraf. - The plugin or configuration doesn't currently work as expected. Investigating... * chore(v3): Write data: pre-process data using Telegraf - Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data. - For Serverless. Will port to Dedicated and Clustered after approval. - Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup) * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(test): Test harness setup, use golang base image - Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go. - Add flag to bypass python warning about using system python and pip. - Remove redundant env.products from pytest.ini; we already load it into environment variables. * chore(v3): Optimize writes: Use Telegraf Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155 - Adds use cases to Dedicated and Clustered docs - Adds example for Execd processor plugin to all - Clean up and pass tests - Remove shared code sample * fix(v3): Optimize writes: Placeholders and indent fixes * Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 17:23:49 +00:00
wget
# Install test runner dependencies
RUN apt-get install -y \
python3 \
python3-pip \
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
python3-venv
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
Optimize writes: Use Telegraf to pre-process data before writing (#5282) * chore(v3): preprocess writes (Telegraf, etc) * feat: optimize writes using Telegraf * WIP: dedup plugin * WIP: Dedup * chore(v3): Writes: Preprocess data using Telegraf: Dedup example (#5155) - Add example using processors.dedup in Telegraf. - The plugin or configuration doesn't currently work as expected. Investigating... * chore(v3): Write data: pre-process data using Telegraf - Add Telegraf examples that pre-process data to avoid schema conflicts and reduce payload (bandwith, memory, etc.) when writing data. - For Serverless. Will port to Dedicated and Clustered after approval. - Doesn't include Dedup yet - I'm waiting on help to make it work (see branch https://github.com/influxdata/docs-v2/compare/issue5155-preprocess-with-dedup) * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(test): Test harness setup, use golang base image - Use golang base image for ease of Go environment setup. Installing Python separately is easier than Go. - Add flag to bypass python warning about using system python and pip. - Remove redundant env.products from pytest.ini; we already load it into environment variables. * chore(v3): Optimize writes: Use Telegraf Closes Telegraf guide: how to use the Converter processor to coerce data before writing #5155 - Adds use cases to Dedicated and Clustered docs - Adds example for Execd processor plugin to all - Clean up and pass tests - Remove shared code sample * fix(v3): Optimize writes: Placeholders and indent fixes * Update content/influxdb/cloud-dedicated/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/clustered/write-data/best-practices/optimize-writes.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-12-22 17:23:49 +00:00
RUN ln -s /usr/bin/python3 /usr/bin/python
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
# Create a virtual environment for Python to avoid conflicts with the system Python and having to use the --break-system-packages flag when installing packages with pip.
RUN python -m venv /opt/venv
# Enable venv
ENV PATH="/opt/venv/bin:$PATH"
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
# Prevents Python from writing pyc files.
ENV PYTHONDONTWRITEBYTECODE=1
# the application crashes without emitting any logs due to buffering.
ENV PYTHONUNBUFFERED=1
# RUN --mount=type=cache,target=/root/.cache/node_modules \
# --mount=type=bind,source=package.json,target=package.json \
# npm install
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
# Copy docs test directory to the image.
WORKDIR /usr/src/app
RUN chmod -R 755 .
ARG SOURCE_DIR
COPY data ./data
# Install parse_yaml.sh and parse YAML config files into dotenv files to be used by tests.
RUN /bin/bash -c 'curl -sO https://raw.githubusercontent.com/mrbaseman/parse_yaml/master/src/parse_yaml.sh'
RUN /bin/bash -c 'source ./parse_yaml.sh && parse_yaml ./data/products.yml > .env.products'
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
COPY test ./test
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
WORKDIR /usr/src/app/test
COPY shared/fixtures ./tmp/data
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
# Some Python test dependencies (pytest-dotenv and pytest-codeblocks) aren't
# available as packages in apt-cache, so use pip to download dependencies in a # separate step and use Docker's caching.
# Leverage a cache mount to /root/.cache/pip to speed up subsequent builds.
# Leverage a bind mount to requirements.txt to avoid having to copy them into
# this layer.
RUN --mount=type=cache,target=/root/.cache/pip \
--mount=type=bind,source=test/requirements.txt,target=requirements.txt \
pip install -Ur requirements.txt
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
COPY test/setup/run-tests.sh /usr/local/bin/run-tests.sh
RUN chmod +x /usr/local/bin/run-tests.sh
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
# Install Telegraf for use in tests.
# Follow the install instructions (https://docs.influxdata.com/telegraf/v1/install/?t=curl), except for sudo (which isn't available in Docker).
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
# influxdata-archive_compat.key GPG fingerprint:
# 9D53 9D90 D332 8DC7 D6C8 D3B9 D8FF 8E1F 7DF8 B07E
RUN wget -q https://repos.influxdata.com/influxdata-archive_compat.key
RUN echo '393e8779c89ac8d958f81f942f9ad7fb82a25e133faddaf92e15b16e6ac9ce4c influxdata-archive_compat.key' | sha256sum -c && cat influxdata-archive_compat.key | gpg --dearmor | tee /etc/apt/trusted.gpg.d/influxdata-archive_compat.gpg > /dev/null
RUN echo 'deb [signed-by=/etc/apt/trusted.gpg.d/influxdata-archive_compat.gpg] https://repos.influxdata.com/debian stable main' | tee /etc/apt/sources.list.d/influxdata.list
RUN apt-get update && apt-get install telegraf
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
# Install influx v2 Cloud CLI for use in tests.
# Follow the install instructions(https://portal.influxdata.com/downloads/), except for sudo (which isn't available in Docker).
# influxdata-archive_compat.key GPG fingerprint:
# 9D53 9D90 D332 8DC7 D6C8 D3B9 D8FF 8E1F 7DF8 B07E
Strategies to improve query performance: operations, number and size … (#5215) * Strategies to improve query performance: operations, number and size of parquet files Fixes #5108 - Add query performance strategies to optimize-queries * Apply suggestions from code review * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/execute-queries/optimize-queries.md Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * chore(v3): WIP query perf Fixes #5108 * chore(v3): WIP: Query performance * chore(v3): WIP: Explain the EXPLAIN report and indicators of query expense, performance problems. * WIP: optimize queries - how to read a query plan, operators * WIP: Read a query plan example 2 * WIP: moved how to read a query plan to its own page. * WIP(v3): operators * chore(v3): WIP add query plan info from DataFusion slides and @NGA-TRAN * chore(v3): WIP read a query plan - explain tree format and reorganize * WIP: query plan - Adds Query Plan reference - Completes Analyze a Query Plan, pending cleanup, continue at :471 - Added image from Nga's blog - Updates EXPLAIN doc - TODO: Create public docs for https://github.com/influxdata/docs.influxdata.io/blob/main/content/operations/specifications/iox_runbooks/slow-queries.md * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(spelling): Vale config changes - Add vale to package.json and use Yarn to manage the binary. You can use `npx vale` to run manually. - Move InfluxData spelling ignore list into the style. - Reorganize custom (product) spelling lists to comply with Vale 3.x - Add InfluxDB v3 terms * chore(v3): Reorg of query troubleshooting and optimizing docs - Adds query-data/troubleshoot-and-optimize - Splits optimize docs into troubleshoot and optimize docs - Moves Flight response doc to flight-responses.md * chore: Fixes broken links, typos, missing content, etc. - Fixes various errors and style violations reported by Vale. - Fixes broken links and missing content in glossaries. - Fixes missing and extraneous whitespace. * Apply suggestions from code review * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md * chore(clustered): Query plan: Apply review suggestions Co-Authored-By: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> * feature(v3): Analyze a query plan: - Apply code formatting to plan implementor names - Simplify some points - Add links * add query plan html diagram (#5365) * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/optimize-queries.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-dedicated/query-data/troubleshoot-and-optimize/trace.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Update content/influxdb/cloud-serverless/query-data/troubleshoot-and-optimize/analyze-query-plan.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): finish the EXPLAIN descriptions and examples * chore(tests): Setup a python venv in test containers * fix(ci): Vale vocab * fix(v3): Punctuation typo * chore(ci): Update README * fix(v3): Apply review suggestions and capitalization Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * fix(v3): Add note to optimize page and revise troubleshoot * fix(v3): optimize-queries link --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> Co-authored-by: Nga Tran <20850014+NGA-TRAN@users.noreply.github.com> Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2024-03-15 23:40:38 +00:00
RUN wget -q https://repos.influxdata.com/influxdata-archive_compat.key
RUN echo '393e8779c89ac8d958f81f942f9ad7fb82a25e133faddaf92e15b16e6ac9ce4c influxdata-archive_compat.key' | sha256sum -c && cat influxdata-archive_compat.key | gpg --dearmor | tee /etc/apt/trusted.gpg.d/influxdata-archive_compat.gpg > /dev/null
RUN echo 'deb [signed-by=/etc/apt/trusted.gpg.d/influxdata-archive_compat.gpg] https://repos.influxdata.com/debian stable main' | tee /etc/apt/sources.list.d/influxdata.list
RUN apt-get update && apt-get install influxdb2-cli
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
ENV TEMP_DIR=./tmp
5156 Writes: add v1 to Serverless get-started (#5233) * chore(ci): Install Telegraf to test container * chore(v3): test telegraf config and startup: - creates the config file for the test run. TODO: remove the duplication and use the content for test setup. - fix placeholder name * fix(v3): make test pass for curl API example * chore(ci): make tests pass for write. Add dependencies to Dockerfile. * chore(tests): update test build - Compose metadata: Add profile to test service. We can decouple services later and apply the profile to each. Rename. Pass the image name to the container. - Fetch the parse_yaml.sh script during docker build, so we only fetch when necessary. Track the script in git. This is still a little janky, but better. - test.sh: Use `HEAD` for diff (duh). Go back to using docker compose up so we're rebuilding only as needed and reusing the container - much faster, but the output isn't as pretty as `run`. - pytest.ini, requirements.txt: Use pytest-dotenv to load env.products variables. * fix(write): update JS instructions and pass tests. * chore(ci): Install influx v2 CLI into the Docker test container. * chore(ci): move .env file loading to pytest and run product tests separately with the proper .env file: - Moves .env configs to be loaded by the test runner instead of by Docker. I'd prefer to ignore any product divergence and have them run interchangeably, but the pros outweigh the cons for now. - Add example for passing custom commands in the compose file. * fix(v3): replace curl example with v1 and v2, simplify JS example, pass tests. feat(v3): add v1 write, test, update text: - adds Serverless v1 /write example with note about autogen behavior - adds link from v1 examples to Migrate guide - adds description of autogen behavior to v1-compat guide - updates "powered by..." text - adapts examples to make them more testable, asserts `/write` status code - replace "shared" examples (only used once) with inline to make them testable fix(v3): promote migrate link * Update content/influxdb/cloud-dedicated/get-started/write.md Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com> * chore(v3): Write: fix wording for curl success (#5156) --------- Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>
2023-11-15 20:41:29 +00:00
ENTRYPOINT [ "run-tests.sh" ]
CMD [""]