Commit Graph

4903 Commits (6520985b5dfb0de5af3e2268305da55c52f83e67)

Author SHA1 Message Date
Marco Neumann fe0df2ab0c fix: job metric race condition 2021-09-06 14:33:59 +02:00
Marco Neumann 998bafcd85 fix: typo
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-09-06 13:39:22 +02:00
Marco Neumann 77287ad228 feat: rework job metrics to be push-based, add wall/cpu time histograms 2021-09-06 13:39:22 +02:00
Marco Neumann e6f12f965c feat: expose job metrics
Closes #2416.
2021-09-06 13:39:22 +02:00
Marco Neumann 04a301cc64 refactor: make job descriptions a static string 2021-09-06 13:39:22 +02:00
kodiakhq[bot] 28e655f38b
Merge pull request #2470 from influxdata/dependabot/cargo/tokio-1.11.0
chore(deps): bump tokio from 1.10.1 to 1.11.0
2021-09-06 09:27:14 +00:00
kodiakhq[bot] f6e040df3d
Merge branch 'main' into dependabot/cargo/tokio-1.11.0 2021-09-06 09:18:55 +00:00
Raphael Taylor-Davies a4b0cbc0e7
feat: migrate jemalloc metrics to `metric` crate (#2435)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-06 09:18:27 +00:00
dependabot[bot] b67610d9b9
chore(deps): bump tokio from 1.10.1 to 1.11.0
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.10.1 to 1.11.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.10.1...tokio-1.11.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 09:11:38 +00:00
kodiakhq[bot] 0a0afa9485
Merge pull request #2469 from influxdata/dependabot/cargo/parquet-5.3.0
chore(deps): bump parquet from 5.2.0 to 5.3.0
2021-09-06 09:09:00 +00:00
kodiakhq[bot] 06311970fa
Merge branch 'main' into dependabot/cargo/parquet-5.3.0 2021-09-06 09:00:27 +00:00
kodiakhq[bot] a72c2a6192
Merge pull request #2472 from influxdata/dependabot/cargo/structopt-0.3.23
chore(deps): bump structopt from 0.3.22 to 0.3.23
2021-09-06 08:59:47 +00:00
dependabot[bot] ccfd6ad3da
chore(deps): bump parquet from 5.2.0 to 5.3.0
Bumps [parquet](https://github.com/apache/arrow-rs) from 5.2.0 to 5.3.0.
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/5.3.0/CHANGELOG.md)
- [Commits](https://github.com/apache/arrow-rs/compare/5.2.0...5.3.0)

---
updated-dependencies:
- dependency-name: parquet
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 08:52:30 +00:00
kodiakhq[bot] 0fd92c8b45
Merge branch 'main' into dependabot/cargo/structopt-0.3.23 2021-09-06 08:51:32 +00:00
kodiakhq[bot] 78bc638aeb
Merge pull request #2473 from influxdata/dependabot/cargo/parking_lot-0.11.2
chore(deps): bump parking_lot from 0.11.1 to 0.11.2
2021-09-06 08:50:33 +00:00
Nga Tran 9de3b79a90 refactor: more cleanup 2021-09-06 01:45:47 -04:00
Nga Tran de0bd80c3d refactor: cleanup 2021-09-06 01:07:07 -04:00
Nga Tran 4801b2c238 feat: Have the ParseDelete message and its corresponding ProvidedParseDelete struct ready for building delete parser 2021-09-06 00:13:59 -04:00
dependabot[bot] b1bb390893
chore(deps): bump parking_lot from 0.11.1 to 0.11.2
Bumps [parking_lot](https://github.com/Amanieu/parking_lot) from 0.11.1 to 0.11.2.
- [Release notes](https://github.com/Amanieu/parking_lot/releases)
- [Changelog](https://github.com/Amanieu/parking_lot/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Amanieu/parking_lot/compare/0.11.1...0.11.2)

---
updated-dependencies:
- dependency-name: parking_lot
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 01:18:24 +00:00
dependabot[bot] 2cf9505029
chore(deps): bump structopt from 0.3.22 to 0.3.23
Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.22 to 0.3.23.
- [Release notes](https://github.com/TeXitoi/structopt/releases)
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md)
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.22...v0.3.23)

---
updated-dependencies:
- dependency-name: structopt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 01:17:41 +00:00
Nga Tran d8b3208896 refactor: sstart building parser in the client side 2021-09-03 17:56:45 -04:00
kodiakhq[bot] 35b0ff53aa
Merge pull request #2457 from influxdata/cn/list-soft-deleted
feat: Add list_deleted_databases API
2021-09-03 15:25:16 +00:00
kodiakhq[bot] 2d41fd519f
Merge branch 'main' into cn/list-soft-deleted 2021-09-03 15:16:32 +00:00
Jacob Marble fdfec8fa4f
feat: create initial performance test (#2358)
* feat: introduce perf/perf.py: performance tests

* fix: use Python requirements.txt for dependency requirements

* chore: call ManagementService.GetServerStatus directly

* chore: s/decode()/text

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-03 13:20:45 +00:00
kodiakhq[bot] 704a892003
Merge pull request #2456 from influxdata/crepererum/issue1565
feat: correctly account MUB sizes
2021-09-03 07:24:14 +00:00
Marco Neumann 3c968ac092 feat: correctly account MUB sizes
Fixes #1565.
2021-09-03 09:15:49 +02:00
kodiakhq[bot] bba040a1cc
Merge pull request #2460 from influxdata/crepererum/issue2455b
feat: forward connection config to Kafka write buffer
2021-09-03 07:02:39 +00:00
Nga Tran a85d95d2e9 refactor: cleanup 2021-09-02 17:25:41 -04:00
Nga Tran bbc0fcf4c0 refactor: cleanup 2021-09-02 17:21:55 -04:00
Nga Tran e2274a9f41 feat: parser for delete predicate 2021-09-02 17:02:05 -04:00
Carol (Nichols || Goulding) ce6030a3cb feat: Wire list deleted databases through gRPC and CLI APIs 2021-09-02 15:48:07 -04:00
Carol (Nichols || Goulding) 581e49e38f feat: Add a list_deleted_databases API
Fixes #2198.
2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) fbf18813ac fix: Correct a mistaken assumption in in-memory object storage
The implementation of list_with_delimiter for the in-memory object
storage assumed that paths returned from the BTreeMap keys that sorted
greater than the prefix given to list_with_delimiter and for whom
prefix_matches returned true would also have parts after the prefix.

This didn't account for paths that started with the prefix but didn't
immediately have the delimiter after the prefix: that is,

prefix = 1/database_name

would match the in-memory paths:

1/database_name/0/rules.pb
1/database_name_and_another_thing/0/rules.pb

The first path here *would* return some parts_after_prefix, but the
second path would not and the previously existing code would panic for
the added path in the list_with_delimiter test case.
2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 6da9cf246f feat: Introduce a public DeletedDatabase type 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 8703aaff63 feat: Introduce a public GenerationId wrapper type 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) f47d7e6d92 feat: Return the time the database was deleted 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 51b6631d8f feat: Implement a list_all_databases API that returns generation info too 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 1d50eb9880 test: Add a unit-ish test for list_possible_databases 2021-09-02 14:57:27 -04:00
Marco Neumann a63eb53ac5 feat: forward connection config to Kafka write buffer 2021-09-02 16:53:31 +02:00
kodiakhq[bot] bdb772a7f7
Merge pull request #2458 from influxdata/crepererum/issue2455a
refactor: more flexible writer buffer config
2021-09-02 14:51:19 +00:00
Marco Neumann 81e672db14 feat: add `auto_create_sequencers` write buffer flag 2021-09-02 16:41:35 +02:00
Marco Neumann ecf1f99ddb refactor: more flexible writer buffer config
This allows:

- different types (instead of guessing through the connection URL)
- sequencer counts (not used yet but will be by #2455)
- extensible configs (e.g. to configure Kafka in a more granular way,
  not wired up yet)
- future extensions (since we use a message now instead of a single
  string)

**BREAKING: This requires changes for deployed systems / existing DBs!**
2021-09-02 16:41:35 +02:00
kodiakhq[bot] 025ea2b841
Merge pull request #2459 from influxdata/crepererum/massif
docs: add massif guide
2021-09-02 14:13:15 +00:00
Marco Neumann bb94751d98 docs: add massif guide 2021-09-02 15:58:43 +02:00
Marco Neumann 09a5d27434 chore: ignore massif profiler outputs 2021-09-02 15:58:43 +02:00
kodiakhq[bot] 9a246d59e5
Merge pull request #2453 from influxdata/crepererum/dump_catalog
feat: "dump catalog" debug CLI
2021-09-02 06:17:10 +00:00
Marco Neumann 4a863993ec feat: "dump catalog" debug CLI 2021-09-02 08:08:20 +02:00
Marco Neumann 581ee64049 feat: add functions to dump catalog data to text 2021-09-02 08:07:07 +02:00
Nga Tran efcdc8e50f feat: implement delete parser 2021-09-01 17:31:49 -04:00
kodiakhq[bot] 6055152589
Merge pull request #2447 from influxdata/cn/server-startup-delete
test: Database startup error when there are multiple active generations
2021-09-01 13:41:00 +00:00