Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
7,914 Commits
218 Branches
453 Tags
340 MiB
Commit Graph

7914 Commits (ca19567710d13e2edbb0c9a76ca2a75333aa731b)

Author SHA1 Message Date
CircleCI[bot] ca19567710 chore: Run cargo hakari tasks 2022-05-16 01:38:59 +00:00
dependabot[bot] 6ba1a5f253
chore(deps): Bump kube-runtime from 0.71.0 to 0.72.0 
Bumps [kube-runtime](https://github.com/kube-rs/kube-rs) from 0.71.0 to 0.72.0.
- [Release notes](https://github.com/kube-rs/kube-rs/releases)
- [Changelog](https://github.com/kube-rs/kube-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/kube-rs/kube-rs/compare/0.71.0...0.72.0)

---
updated-dependencies:
- dependency-name: kube-runtime
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-05-16 01:37:57 +00:00
Nga Tran 9530e73925
chore: move noisy debug to trace and fix some comments (#4598) 
* chore: move noisy debug to trace and fix some comments

* chore: Apply suggestions from code review

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* chore: fix format

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-13 19:18:15 +00:00
Andrew Lamb 22c1853f3e
chore: Update datafusion dependency (#4599) 
* chore: Update datafusion dependency

* chore: Update for new API
 2022-05-13 19:10:22 +00:00
Raphael Taylor-Davies f2bb0fdf77
feat: update to crates.io object_store version (#4595) 
* feat: update to crates.io object_store version

* chore: Run cargo hakari tasks

* fix: tests

* chore: remove object store integration test plumbing

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
 2022-05-13 16:26:07 +00:00
Andrew Lamb 35d80fc512
refactor: rename `iox_catalog_service` to `service_grpc_catalog` for consistency (#4581) 
* refactor: rename `iox_catalog_service` to `service_grpc_catalog`

* fix: fmt

* fix: alphabetize crate

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-13 14:07:58 +00:00
kodiakhq[bot] 04160d29e6
Merge pull request #4586 from influxdata/cn/remove-chunk-addr 
fix: Remove ChunkAddr and old_gen_partition_key
 2022-05-13 14:01:21 +00:00
kodiakhq[bot] 0f8f294319
Merge branch 'main' into cn/remove-chunk-addr 2022-05-13 13:54:44 +00:00
kodiakhq[bot] 720220c618
Merge pull request #4584 from influxdata/cn/rename-no-ng 
fix: Remove mentions of "NG", "OG"
 2022-05-13 13:54:23 +00:00
kodiakhq[bot] 542ec97b66
Merge branch 'main' into cn/rename-no-ng 2022-05-13 13:47:48 +00:00
Marco Neumann cb0a4176fd
refactor: move `querier::cache_system` into its own crate (#4592) 2022-05-13 13:12:07 +00:00
Andrew Lamb ff8241ea57
fix: Use one (shared) http2 connection per querier and ingester pair (#4583) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-13 11:15:10 +00:00
Marco Neumann 31f3d988ae
feat: LRU cache infrastructure (#4189) 
* feat: `AddressableHeap::is_empty`

* feat: add type-safe size trait

* feat: LRU cache infrastructure

* fix: typos

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* fix: update after rebase

* docs: explain test code

* test: ensure that values are dropped from LRU cache

* test: ensure that backends are dropped from LRU cache

* docs: explain where LRU state is stored

* docs: explain high-level LRU usage

* refactor: "memory (size)" => "resource (consumption)"

This should make the reasoning more generic and easier to understand.

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-13 07:34:59 +00:00
dependabot[bot] d15abc5e2d
chore(deps): Bump zstd-safe from 5.0.1+zstd.1.5.2 to 5.0.2+zstd.1.5.2 (#4591) 
Bumps [zstd-safe](https://github.com/gyscos/zstd-rs) from 5.0.1+zstd.1.5.2 to 5.0.2+zstd.1.5.2.
- [Release notes](https://github.com/gyscos/zstd-rs/releases)
- [Commits](https://github.com/gyscos/zstd-rs/commits)

---
updated-dependencies:
- dependency-name: zstd-safe
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-05-13 07:27:24 +00:00
Marko Mikulicic 335374fed5
chore: Enable pprof feature back (#4587) (#4590) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-12 23:33:28 +00:00
Nga Tran 4434ec6836
chore: convert some debug to trace to reduce noises (#4589) 2022-05-12 22:40:29 +00:00
Marko Mikulicic 24020403ba
fix: Remove pprof feature; it fails to build (#4588) 2022-05-12 21:45:13 +00:00
Marko Mikulicic d807941804
chore: Enable pprof feature back (#4587) 2022-05-12 21:25:22 +00:00
Carol (Nichols || Goulding) 55313d290a
fix: Update or remove comments that mention NG or OG 
Connects to #4450.
 2022-05-12 16:09:08 -04:00
Carol (Nichols || Goulding) 07c7c75067
fix: Remove ng_chunk method 
Connects to #4450.
 2022-05-12 16:09:08 -04:00
Carol (Nichols || Goulding) a38a25437b
fix: Remove split_overlapped_chunks_og and group_potential_duplicates_og 
Connects to #4450.
 2022-05-12 16:09:07 -04:00
Carol (Nichols || Goulding) 025a775cc6
fix: Rename make_ng_chunk to make_chunk. 
Connects to #4450.
 2022-05-12 16:09:07 -04:00
Carol (Nichols || Goulding) b581a42fde
fix: Rename new_id_for_ng to new_id 
Connects to #4450.
 2022-05-12 16:09:07 -04:00
Carol (Nichols || Goulding) 30e53fd09c
fix: Rename end-to-end NG tests to not contain NG 
Connects to #4450.
 2022-05-12 16:09:07 -04:00
Carol (Nichols || Goulding) 48e6e5713d
fix: Rename test_helpers_end_to_end_ng to test_helpers_end_to_end 
Connects to #4450.
 2022-05-12 16:09:07 -04:00
Carol (Nichols || Goulding) 78bbe629b2
feat: Add more logging to understand the flaky multi ingester test better (#4580) 
* feat: Increase logging to investigate multi ingester flaky test

* feat: Temporarily disable a test while logging is increased in CI

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-12 20:05:05 +00:00
Carol (Nichols || Goulding) 71d1f2c9bd
fix: Remove old_gen_partition_key 2022-05-12 16:05:03 -04:00
Carol (Nichols || Goulding) faba90d992
fix: Remove ChunkAddr 2022-05-12 15:50:41 -04:00
Carol (Nichols || Goulding) 975dd288d4
refactor: Rearrange delegation to remove one usage of generated types (#4579) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-12 16:10:38 +00:00
Andrew Lamb 7eff52d04e
refactor: rename `iox_object_store_service` to `service_grpc_object_store` for consisntency (#4572) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-12 14:22:18 +00:00
Nga Tran 66fe4c54ec
fix: make test output deterministic (#4578) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-12 14:15:51 +00:00
kodiakhq[bot] 1bf519c2f6
Merge pull request #4573 from influxdata/cn/write-info-grpc-more 
feat: Querier can get write status from ingesters
 2022-05-12 13:59:41 +00:00
kodiakhq[bot] 2eb2db5286
Merge branch 'main' into cn/write-info-grpc-more 2022-05-12 13:53:19 +00:00
dependabot[bot] 51a1067425
chore(deps): Bump zstd from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2 (#4576) 
Bumps [zstd](https://github.com/gyscos/zstd-rs) from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2.
- [Release notes](https://github.com/gyscos/zstd-rs/releases)
- [Commits](https://github.com/gyscos/zstd-rs/commits/v0.11.2)

---
updated-dependencies:
- dependency-name: zstd
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-12 13:53:10 +00:00
Carol (Nichols || Goulding) 10413a6e9a
docs: Explain that the querier gets the write info from the ingesters 
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
 2022-05-12 09:48:46 -04:00
Nga Tran f9e3495e47
feat: add more metrics for compactor (#4575) 
* feat: add more metrics for compactor

* chore: clearer comment
 2022-05-12 13:20:43 +00:00
Carol (Nichols || Goulding) 2079cf98f6
fix: Add back a test case that needs to check ingester for write info 
Specifically because the querier doesn't know about the ingester.
 2022-05-11 15:30:59 -04:00
Nga Tran 0d5e3c97f0
chore: dump out the diff for SQL tests (#4571) 
* chore: dump out the diff for SQL tests

* refactor: more prety assertion to a specific test to avoid affecting other available tests

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-11 18:43:36 +00:00
dependabot[bot] 3912328497
chore(deps): Bump pprof from 0.8.0 to 0.9.0 (#4562) 
Bumps [pprof](https://github.com/tikv/pprof-rs) from 0.8.0 to 0.9.0.
- [Release notes](https://github.com/tikv/pprof-rs/releases)
- [Changelog](https://github.com/tikv/pprof-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tikv/pprof-rs/commits)

---
updated-dependencies:
- dependency-name: pprof
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-11 18:30:49 +00:00
Carol (Nichols || Goulding) 48b84b3bdf
feat: Querier can get write status from ingesters 
Connects to influxdata/influxdb-iox-client-go#27.
 2022-05-11 14:12:10 -04:00
Carol (Nichols || Goulding) 77205d9a8e
fix: Remove some unused error variants 2022-05-11 14:07:48 -04:00
Carol (Nichols || Goulding) 2ee4a6669a
refactor: Move the code merging write infos to generated_types to share 2022-05-11 14:07:42 -04:00
Carol (Nichols || Goulding) 26170b7a07
refactor: Move gRPC conversion code to generated_types to share 2022-05-11 14:07:12 -04:00
Carol (Nichols || Goulding) 8545bb60c6
refactor: Move KafkaPartitionWriteStatus to data_types to share more 2022-05-11 14:07:06 -04:00
Raphael Taylor-Davies b026073b02
feat: support HEAD requests against object storage (#4553) 
* feat: add head request to ObjectStore

* fix: tests

* fix: gcp build

* chore: update GCS tests

* chore: review feedback

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-11 16:57:48 +00:00
kodiakhq[bot] 2a6b383dd6
Merge pull request #4569 from influxdata/dom/query-metrics 
feat(ingester): emit query latency metrics
 2022-05-11 15:58:29 +00:00
kodiakhq[bot] 5b866989ca
Merge branch 'main' into dom/query-metrics 2022-05-11 15:51:55 +00:00
Andrew Lamb b8bda5f84d
docs: Add docs for CLI (#4559) 
* docs: Add docs for CLI

* fix: add todo

* fix: Update docs/cli.md

Co-authored-by: Nga Tran <nga-tran@live.com>

Co-authored-by: Nga Tran <nga-tran@live.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-05-11 15:51:34 +00:00
kodiakhq[bot] ce5fdaaa4b
Merge pull request #4570 from influxdata/dom/ingest-op-debug 
refactor(ingester): emit per-op debugging info
 2022-05-11 15:42:08 +00:00
Dom Dwyer 7f3473e19f refactor(ingester): emit per-op debugging info 
Emit a TRACE level log containing the op offset & other helpful fields.

This will allow us to identify which messages were last successfully
decoded, and which caused errors so we can pull them from analysis.
 2022-05-11 16:35:35 +01:00