Commit Graph

5920 Commits (b5a7bf03daae67081d43f58ecb57a1432d1aa685)

Author SHA1 Message Date
kodiakhq[bot] d2c9244d1b
Merge pull request #2990 from influxdata/cn/restore-doesnt-need-name
fix: Handle errors and rule updates correctly with UUIDs
2021-11-03 19:14:47 +00:00
Carol (Nichols || Goulding) 0f62bb1686
fix: Distinguish between restoring twice and name collisions on restore
And return them in the correct situations.
2021-11-03 15:02:22 -04:00
Carol (Nichols || Goulding) 6615001dc7
fix: Extract loading the database name out of the rules file into a function 2021-11-03 15:02:21 -04:00
Carol (Nichols || Goulding) 52d9df5caf
fix: Thread a Not Found error on restore database through all APIs 2021-11-03 15:02:21 -04:00
Carol (Nichols || Goulding) ac75be6b78
fix: Don't require name for database restore CLI; it's now unused 2021-11-03 15:02:21 -04:00
Carol (Nichols || Goulding) 3e44f17698
fix: Return a useful error on attempt to restore an active database 2021-11-03 15:02:18 -04:00
Carol (Nichols || Goulding) f6327b1940
fix: Send back the correct error when attempting to restore the same database twice 2021-11-03 15:01:56 -04:00
Carol (Nichols || Goulding) a0b4b6b8f9
test: Add assertions that ensure UUID doesn't change when DatabaseRules are updated 2021-11-03 15:01:27 -04:00
Carol (Nichols || Goulding) 207d701bdb
fix: Have DatabaseState keep track of the UUID after reading it from object storage 2021-11-03 15:01:27 -04:00
Carol (Nichols || Goulding) b1504f17ed
fix: Detangle UUID from ProvidedDatabaseRules 2021-11-03 15:01:27 -04:00
Carol (Nichols || Goulding) f2cb79bfa0
test: Add more tests around database restore 2021-11-03 15:01:26 -04:00
Carol (Nichols || Goulding) 62e7376394
fix: Restore database should only need UUID, not database name too 2021-11-03 15:01:26 -04:00
Raphael Taylor-Davies 405ed6db1b
feat: add mutable_batch_tests (#2724) (#3011)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-03 18:15:35 +00:00
Marco Neumann 705fa3cb98
fix: dockerfiles should select database server mode by default (#3010)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-03 18:06:01 +00:00
Raphael Taylor-Davies e83b8691db
refactor: remove chunk module from mutable_buffer (#3015)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-03 17:56:52 +00:00
kodiakhq[bot] 3db4abc17f
Merge pull request #3019 from influxdata/crepererum/warn_on_failed_wb_reads
refactor: warn when we receive broken data from write buffer
2021-11-03 17:45:05 +00:00
kodiakhq[bot] bbdfc47b02
Merge branch 'main' into crepererum/warn_on_failed_wb_reads 2021-11-03 17:34:14 +00:00
kodiakhq[bot] 4bebb92591
Merge pull request #3016 from influxdata/crepererum/router_mode_boilerplate
feat: implement basic router server type
2021-11-03 15:45:28 +00:00
Marco Neumann e3e99c45cf fix: remove stale comment 2021-11-03 16:35:54 +01:00
Marco Neumann 1cf697f235 refactor: make server fixture creation less confusing 2021-11-03 16:34:51 +01:00
Marco Neumann a91e572b43 feat: implement basic router server type
This only implements the deployment service and nothing else yet.
2021-11-03 16:34:51 +01:00
Raphael Taylor-Davies 08fcd87337
feat: use protobuf encoding in write buffer (#2724) (#3018) 2021-11-03 15:19:05 +00:00
Marco Neumann 10de63f9b6 refactor: warn when we receive broken data from write buffer
We need to understand why this is the case and where broken data gets
stuck, because at the moment it seems that some Kafka hiccups can
poison the write buffer but it seems restarting IOx recovers the
situation.
2021-11-03 16:03:42 +01:00
Raphael Taylor-Davies 51c6348e54
refactor: extract codec module for write buffer (#2724) (#3017) 2021-11-03 14:07:33 +00:00
Raphael Taylor-Davies e444fa4cb2
feat: pbdata encode (#2724) (#3009) 2021-11-02 18:31:53 +00:00
Raphael Taylor-Davies 39a7f3069f
feat: add alternative string encodings to pbdata (#2724) (#3006)
* feat: add alternative string encodings to pbdata (#2724)

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-02 18:14:34 +00:00
Andrew Lamb 1902c4f8a9
chore: Update DataFusion (#3012)
* chore: Update DataFusion

* fix: restore Cargo.log

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-02 18:06:21 +00:00
Raphael Taylor-Davies 873ce27b0c
feat: reduce lock metric cardinality (#3013) 2021-11-02 17:57:02 +00:00
kodiakhq[bot] c42a60beee
Merge pull request #3008 from influxdata/crepererum/issue2980f
refactor: decouple new router server configs from old management system
2021-11-02 10:19:54 +00:00
Marco Neumann 511621d3ca refactor: use stripped-down shard config for router
This only implements table-based sharding. We can add value-based
sharding later.
2021-11-02 11:12:20 +01:00
Marco Neumann 0d0c0cb42b refactor: move write buffer configs to new home
Write buffer configs will partially be shared by database and router
nodes, so lets move them into a shared home.
2021-11-02 10:17:01 +01:00
Marco Neumann 6644048eec refactor: remove partitioning from router config
Routers are not live yet so this ain't a breaking change. Also w/ write
buffer format rework that is going to be finished soon we don't need
this.
2021-11-02 10:14:00 +01:00
Andrew Lamb 5e86989990
fix: Only use timestamps in first/last when there is a corresponding … (#2988)
* fix: Only use timestamps in first/last when there is a corresponding value

* docs: Fix broken English in comment

* docs: clarify expectations in test
2021-11-01 18:54:43 +00:00
kodiakhq[bot] 6473498cd5
Merge pull request #3002 from influxdata/crepererum/issue2980d
refactor: move `catalog` protobuf to `preserved_catalog`
2021-11-01 17:14:57 +00:00
Marco Neumann 4c9570b519 refactor: move `catalog` protobuf to `preserved_catalog`
This makes it clearer what's going since the contained messages are
only for the preserved part, not the in-mem catalog and its management.
2021-11-01 18:07:25 +01:00
kodiakhq[bot] 2459c6664e
Merge pull request #3004 from influxdata/crepererum/issue2980e
feat: add `DeploymentService`
2021-11-01 17:03:22 +00:00
Marco Neumann 011af2d6ba feat: add `DeploymentService`
Ref #2980.
2021-11-01 17:55:40 +01:00
kodiakhq[bot] 9935f6d855
Merge pull request #2983 from influxdata/crepererum/issue2980b
feat: add `DeleteService`
2021-11-01 16:46:45 +00:00
kodiakhq[bot] 8c3446ac87
Merge branch 'main' into crepererum/issue2980b 2021-11-01 16:39:32 +00:00
Raphael Taylor-Davies f1a6468e7b
feat: migrate write buffer consumer to use DbWrite (#2724) (#3003)
* feat: migrate write buffer consumer to use DbWrite (#2724)

* fix: doc

* chore: fmt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-01 16:38:48 +00:00
kodiakhq[bot] 0bd87f048f
Merge pull request #2999 from influxdata/dependabot/cargo/pprof-0.5.1
chore(deps): bump pprof from 0.5.0 to 0.5.1
2021-11-01 11:57:11 +00:00
dependabot[bot] bf4212e98d
chore(deps): bump pprof from 0.5.0 to 0.5.1
Bumps [pprof](https://github.com/tikv/pprof-rs) from 0.5.0 to 0.5.1.
- [Release notes](https://github.com/tikv/pprof-rs/releases)
- [Commits](https://github.com/tikv/pprof-rs/commits)

---
updated-dependencies:
- dependency-name: pprof
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-01 11:48:31 +00:00
kodiakhq[bot] bba809c2d8
Merge pull request #2994 from influxdata/dependabot/cargo/tokio-stream-0.1.8
chore(deps): bump tokio-stream from 0.1.7 to 0.1.8
2021-11-01 11:46:38 +00:00
dependabot[bot] 1b377f0377
chore(deps): bump tokio-stream from 0.1.7 to 0.1.8
Bumps [tokio-stream](https://github.com/tokio-rs/tokio) from 0.1.7 to 0.1.8.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-stream-0.1.7...tokio-stream-0.1.8)

---
updated-dependencies:
- dependency-name: tokio-stream
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-01 11:38:59 +00:00
kodiakhq[bot] 5959c5d88b
Merge pull request #3000 from influxdata/dependabot/cargo/tokio-1.13.0
chore(deps): bump tokio from 1.12.0 to 1.13.0
2021-11-01 11:37:04 +00:00
kodiakhq[bot] c724bb2ee8
Merge branch 'main' into dependabot/cargo/tokio-1.13.0 2021-11-01 11:30:33 +00:00
dependabot[bot] c540b40f05
chore(deps): bump tokio from 1.12.0 to 1.13.0
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.12.0 to 1.13.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.12.0...tokio-1.13.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-11-01 11:21:59 +00:00
kodiakhq[bot] 2b0540ed53
Merge pull request #2995 from influxdata/dependabot/cargo/libc-0.2.106
chore(deps): bump libc from 0.2.105 to 0.2.106
2021-11-01 11:18:42 +00:00
kodiakhq[bot] b84f70da8e
Merge branch 'main' into dependabot/cargo/libc-0.2.106 2021-11-01 11:09:38 +00:00
kodiakhq[bot] 505cd1e40d
Merge pull request #2982 from influxdata/crepererum/issue2980a
feat: add `RemoteService`
2021-11-01 10:51:21 +00:00