Commit Graph

5920 Commits (b5a7bf03daae67081d43f58ecb57a1432d1aa685)

Author SHA1 Message Date
kodiakhq[bot] a1dbca9620
Merge pull request #3055 from influxdata/dependabot/cargo/paste-1.0.6
chore(deps): bump paste from 1.0.5 to 1.0.6
2021-11-08 10:29:29 +00:00
kodiakhq[bot] 6e8517cb1f
Merge branch 'main' into dependabot/cargo/paste-1.0.6 2021-11-08 10:20:56 +00:00
kodiakhq[bot] 1d326bd404
Merge pull request #3040 from influxdata/crepererum/router_conn
feat: add connection management for router
2021-11-08 10:20:32 +00:00
Marco Neumann f751bb5426 ci: use new, public `quay.io/influxdb/iox` image 2021-11-08 11:18:53 +01:00
dependabot[bot] 8724f82c5c
chore(deps): bump paste from 1.0.5 to 1.0.6
Bumps [paste](https://github.com/dtolnay/paste) from 1.0.5 to 1.0.6.
- [Release notes](https://github.com/dtolnay/paste/releases)
- [Commits](https://github.com/dtolnay/paste/compare/1.0.5...1.0.6)

---
updated-dependencies:
- dependency-name: paste
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-08 10:16:07 +00:00
Marco Neumann 5b01f9b3a5 docs: explain btree map decision 2021-11-08 11:11:52 +01:00
Marco Neumann 9984e4d386 fix: debug msg
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-11-08 11:11:52 +01:00
Marco Neumann 7f6280305d fix: `ConnectionPool::new` requires tokio 2021-11-08 11:11:52 +01:00
Marco Neumann 11f4a1dee8 feat: add connection management for router 2021-11-08 11:11:52 +01:00
Marco Neumann 33497ca227
Merge pull request #3060 from influxdata/crepererum/RUSTSEC-2021-0122
chore: ignore `RUSTSEC-2021-0122`
2021-11-08 10:42:53 +01:00
Marco Neumann 601653664d chore: ignore `RUSTSEC-2021-0122` 2021-11-08 09:58:57 +01:00
Nga Tran 97206b13cb fix: statistics for max/min(time) should have data type timstamp 2021-11-05 18:11:54 -04:00
Raphael Taylor-Davies 60f0deaf1e
feat: remove flatbuffer entry (#3045) 2021-11-05 20:19:24 +00:00
Jake Goulding de672b7599 fix: Store the restore database UUID as bytes instead of as a string 2021-11-05 15:20:18 -04:00
Raphael Taylor-Davies 9d0f78788d
feat: unify workflows and add ability to manually trigger CI image (#3047)
* feat: unify workflows and add ability to manually trigger CI image

* chore: s/master/main/g

* chore: docs

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-11-05 18:06:30 +00:00
Raphael Taylor-Davies 7d070f8582
feat: remove influxdata.iox.write.v1.WriteService (#3044)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-05 17:51:01 +00:00
Andrew Lamb a252b81baa
test: add negative test for CREATE EXTERNAL TABLE (#3051)
* test: add negative test for CREATE EXTERNAL TABLE

* fix: clippy

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-05 17:43:08 +00:00
Raphael Taylor-Davies 88868e7496
feat: remove legacy write service from influxdb_iox_client (#3043)
* feat: remove legacy write service from influxdb_iox_client

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-05 17:26:18 +00:00
kodiakhq[bot] 4d456dc92b
Merge pull request #3034 from influxdata/ntran/min_max_string
chore: use latest DataFusion to fix the min/max(dictionary string) bug
2021-11-05 15:30:08 +00:00
kodiakhq[bot] 94016324da
Merge branch 'main' into ntran/min_max_string 2021-11-05 15:21:10 +00:00
Nga Tran 8dcd2ae9d4 chore: latest datafusion to get the boolean(null) and/or expr folding bug fix 2021-11-05 11:20:16 -04:00
Raphael Taylor-Davies 03f9de3841
feat: add redpanda to CI image (#3046)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-05 15:20:11 +00:00
kodiakhq[bot] 12b0f548dd
Merge pull request #3036 from influxdata/cn/move-db-paths
fix: Change database paths to be under /dbs/ instead of under /[server id]/
2021-11-05 14:22:57 +00:00
Carol (Nichols || Goulding) c8d80e5c28
fix: Change database paths to be under /dbs/ instead of under /[server id]/ 2021-11-05 10:14:06 -04:00
Raphael Taylor-Davies 898567e221
feat: migrate server to DbWrite (#2724) (#3035)
* feat: migrate server to DbWrite (#2724)

* chore: print perf log output

* fix: don't suppress CI status code

* chore: review feedback

* fix: don't error on empty line protocol write payloads

* fix: test

* fix: test
2021-11-05 11:09:33 +00:00
kodiakhq[bot] 2e35aaff49
Merge pull request #3039 from influxdata/crepererum/router_sharder
feat: implement sharder for new router
2021-11-05 09:38:36 +00:00
Marco Neumann 92e6acaacd feat: implement sharder for new router 2021-11-05 09:49:33 +01:00
Raphael Taylor-Davies 06dfdc4af8
feat: simplify sharding (#3031)
* feat: simplify sharding

* chore: fix lint
2021-11-04 16:57:19 +00:00
Nga Tran dd4fffaf68
Merge branch 'main' into ntran/min_max_string 2021-11-04 11:12:07 -04:00
Nga Tran 89699cf0de chore: use latest DataFusion to fix the min/max(dictionary string) bug 2021-11-04 11:04:03 -04:00
kodiakhq[bot] 4de2855925
Merge pull request #3033 from influxdata/crepererum/router_remote_crud
feat: implement `RemoteService` for new router mode
2021-11-04 14:56:47 +00:00
Marco Neumann 78101eb52d feat: implement `RemoteService` for new router mode 2021-11-04 15:35:05 +01:00
kodiakhq[bot] 102ca32bec
Merge pull request #3028 from influxdata/crepererum/router_mode_get_set_cfg
feat: add basic CRUD operations for router configs
2021-11-04 14:15:20 +00:00
kodiakhq[bot] 53422dbd48
Merge branch 'main' into crepererum/router_mode_get_set_cfg 2021-11-04 14:06:44 +00:00
kodiakhq[bot] 433b64ca3b
Merge pull request #2989 from influxdata/pd/data-generator-optimiziation
feat: new data generator
2021-11-04 14:06:06 +00:00
kodiakhq[bot] f19788ce94
Merge branch 'main' into pd/data-generator-optimiziation 2021-11-04 13:57:50 +00:00
Paul Dix f50f4cb719 fix: typos in data generator full example 2021-11-04 09:56:58 -04:00
Paul Dix bd1679a903 fix: revert to previous Cargo.lock and remove rand seeder 2021-11-04 09:56:58 -04:00
Paul Dix 7d90314f2b fix: data generator example 2021-11-04 09:56:58 -04:00
Paul Dix 041957be48 fix: datagenerator PR feedback, implement field count 2021-11-04 09:56:58 -04:00
Paul Dix 3b64debec7 fix: fix perf datagen toml for new data generator 2021-11-04 09:56:58 -04:00
Paul Dix 7044b89453 feat: Refactor Data Generator
This is a huge commit that refactors the data generator. It removes many of the previous features that didn't quite make sense. The goal of this refactor was to make the data generator capable of representing complex tagsets that have values dependent on each other. It also significantly optimizes things to use far less memory and generate data much faster. Follow on work will update the generation of line protocol to support spaces in tags and their keys, double quotes in strings, and add more examples and documentation.
2021-11-04 09:56:58 -04:00
Paul Dix 348b91edc4 feat: Add noop option to data generator
I needed this feature to be able to see how much memory and resources a given data spec toml would take to run.
2021-11-04 09:56:58 -04:00
Paul Dix 32bf4be64c chore: add benchmark for data generator tag set 2021-11-04 09:56:58 -04:00
Paul Dix db2f8a58fc feat: Add tag_set and tag_pairs to measurements in Data Generator
This adds the ability to specify a tag_set and a collection of tag_pairs to measurements in the data generator. Tag pairs are evaluated once when the generator is created. This avoids re-running handlebars evaluations while generating data for tags that don't change value.

This commit also fixes an issue when printing the generation output to stdout while generating from more than one agent. Previously it would be garbled together.

Follow on PRs will update the tag generation code in measurement specs to be more consistent and optimzised for performance. I'll be removing the restriction of using different options while using tag_set and tag_pairs. I wanted to get this in first to show the structure of what is output.
2021-11-04 09:56:58 -04:00
Raphael Taylor-Davies d28749bd93
refactor: remove Entry from Db interfaces (#2724) (#3027) 2021-11-04 13:28:47 +00:00
Marco Neumann 4840dc11cb feat: add basic CRUD operations for router configs 2021-11-04 12:03:14 +01:00
Raphael Taylor-Davies 07ba629e2b
feat: migrate write buffer producer to MutableBatch and pbdata (#2743) (#3021)
* feat: migrate write buffer producer to MutableBatch and pbdata (#2743)

* fix: Kafka message content type header

* chore: fix doc
2021-11-04 10:20:40 +00:00
kodiakhq[bot] ca5740e1c9
Merge pull request #3025 from influxdata/alamb/updates
chore: update dependencies
2021-11-04 08:32:54 +00:00
Andrew Lamb 46213a5a28 chore: update dependencies 2021-11-03 17:00:20 -04:00