Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
7,096 Commits
189 Branches
453 Tags
380 MiB
Commit Graph

7096 Commits (aaec1c7828139e47296665c84aeea4c974026118)

Author SHA1 Message Date
Dom Dwyer aaec1c7828 build: propagate feature flags to influxdb_ioxd 
When you did a "cargo build --no-default-features" before this commit,
the influxdb_iox crate was compiled without the default features
(namely jemalloc stuff) but the influxdb_ioxd crate was compiled with
jemalloc (it was not possible to compile without jemalloc support).

This commit fixes propagation of the jemalloc flag
("jemalloc_replacing_malloc") into the influxdb_ioxd crate.
 2022-03-07 15:44:13 +00:00
kodiakhq[bot] 3f547c58c9
Merge pull request #3961 from influxdata/dom/no-openssl 
build: remove openssl dependency
 2022-03-07 14:00:09 +00:00
kodiakhq[bot] de3ae7d6f8
Merge branch 'main' into dom/no-openssl 2022-03-07 13:50:19 +00:00
Raphael Taylor-Davies 80fb75d90b
feat: add a flag to enable per-partition tracing (#3928) 
* feat: add a flag to enable per-partition tracing

* chore: rename constant

* feat: use BooleanFlag and cache result
 2022-03-07 13:49:23 +00:00
Dom Dwyer baae6910f2 build: remove openssl dependency 
Switches a stray reqwest dependency to use rustls.
 2022-03-07 13:47:39 +00:00
Raphael Taylor-Davies 7b28fb4366
feat: improve trace naming (#3931) 
* feat: improve trace naming

* test: test span description

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-07 11:49:19 +00:00
Raphael Taylor-Davies 7b3767628f
chore: reduce router log verbosity (#3805) (#3960) 
* chore: reduce router log verbosity (#3805)

* fix: lint

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-07 11:38:51 +00:00
kodiakhq[bot] b69dfec25d
Merge pull request #3936 from influxdata/dom/router-grpc-write 
feat: router grpc write handler
 2022-03-07 11:27:31 +00:00
kodiakhq[bot] e47bfc40be
Merge branch 'main' into dom/router-grpc-write 2022-03-07 11:13:19 +00:00
dependabot[bot] d3321135eb
chore(deps): Bump clap from 3.1.2 to 3.1.5 (#3957) 
Bumps [clap](https://github.com/clap-rs/clap) from 3.1.2 to 3.1.5.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v3.1.2...v3.1.5)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-03-07 09:58:46 +00:00
dependabot[bot] 3c58a08431
chore(deps): Bump siphasher from 0.3.9 to 0.3.10 (#3956) 
Bumps [siphasher](https://github.com/jedisct1/rust-siphash) from 0.3.9 to 0.3.10.
- [Release notes](https://github.com/jedisct1/rust-siphash/releases)
- [Commits](https://github.com/jedisct1/rust-siphash/compare/0.3.9...0.3.10)

---
updated-dependencies:
- dependency-name: siphasher
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-03-07 09:10:09 +00:00
dependabot[bot] 48908054d1
chore(deps): Bump once_cell from 1.9.0 to 1.10.0 (#3955) 
* chore(deps): Bump once_cell from 1.9.0 to 1.10.0

Bumps [once_cell](https://github.com/matklad/once_cell) from 1.9.0 to 1.10.0.
- [Release notes](https://github.com/matklad/once_cell/releases)
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md)
- [Commits](https://github.com/matklad/once_cell/compare/v1.9.0...v1.10.0)

---
updated-dependencies:
- dependency-name: once_cell
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
 2022-03-07 08:54:20 +00:00
Andrew Lamb 7b436d37cd
fix: correctly set nulls in string columns (#3939) 
* fix: correctly set nulls in string columns

* fix: test

* test: fix

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-04 20:15:44 +00:00
Andrew Lamb 9d8bceccbf
test: Add test to verify deduplicating is working (#3937) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-04 20:05:17 +00:00
Andrew Lamb e09f39d6a0
chore: Update datafusion (#3943) 
* chore: Update datafusion

* refactor: update for new datafusion

* chore: Run cargo hakari tasks

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
 2022-03-04 19:37:46 +00:00
Andrew Lamb b870b9340b
chore: remove uneeded dependencies (#3929) 
* chore: remove unused deps in compactor

* chore: remove unused deps in influxdb_ioxd

* chore: remove unused deps in object_store

* chore: remove unused deps in server

* fix: object_store needs observability deps when compiled with aws

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-04 17:39:46 +00:00
kodiakhq[bot] c0ea6d1cfc
Merge pull request #3924 from influxdata/cn/auto-hakari 
feat: Auto commit cargo hakari generate changes
 2022-03-04 15:52:22 +00:00
kodiakhq[bot] ad637218ea
Merge branch 'main' into cn/auto-hakari 2022-03-04 15:40:34 +00:00
Carol (Nichols || Goulding) b28aa22039
fix: Check hakari even if a hakari commit is already present; fail the build if so 2022-03-04 10:24:42 -05:00
Carol (Nichols || Goulding) 9961efd702
feat: Send parquet and tombstone seq nums with ingester query response (#3925) 
Fixes #3867.
 2022-03-04 15:22:29 +00:00
Carol (Nichols || Goulding) b57632fb6c
fix: Fail the build if hakari changes need to be committed before merge 2022-03-04 10:17:17 -05:00
Dom Dwyer 7c5ba34d44 refactor: enable gRPC handler 
Plumbs the gRPC write handler into the existing router2 server.
 2022-03-04 14:51:43 +00:00
Dom Dwyer 26c43f0a2c feat: grpc write handler 
Implements the gRPC write handler endpoint.
 2022-03-04 14:51:42 +00:00
Raphael Taylor-Davies 636381c805
fix: fix read-window-aggregate CLI defaults (#3930) 2022-03-04 12:09:07 +00:00
kodiakhq[bot] 81b942cd13
Merge pull request #3927 from influxdata/dom/more-router-metrics 
feat: more router metrics
 2022-03-04 10:30:36 +00:00
kodiakhq[bot] 5dd0fed435
Merge branch 'main' into dom/more-router-metrics 2022-03-04 10:10:45 +00:00
Marco Neumann 8d00aaba90
feat: sync chunks in querier (#3911) 
* feat: `ParquetFileRepo::list_by_namespace_not_to_delete`

* feat: `ChunkAddr: Clone`

* test: ensure that querier keeps same partition objects

* test: improve `create_parquet_file` flexibility

* feat: sync chunks in querier

* test: improve `test_parquet_file`
 2022-03-04 08:53:39 +00:00
Paul Dix 6ba5e51897
feat: update max_persisted_sequence_number in the buffered table on persist (#3868) 
This includes a bit of a refactor in the locking structure of the buffer data. Locking at the partition collection and within the partition data was making things more complex than they needed to be. The partitions in the buffer are there only temporarily until they get persisted. Locking on the table simplifies things a bit and makes it more clear when the table state is being modified since it no longer has any interior mutability. Having access to separate partitions without the same lock isn't something we need because queries will hit all partitions and data is brought in sequentially, regardless of which partition it is hitting in a sequencer.

Fixes #3850
 2022-03-03 23:52:31 +00:00
Dom Dwyer 14d90d1011 feat: schema validation benchmarks 
Useful for confirming the scalability of the schema check algorithm.
 2022-03-03 23:40:13 +00:00
Dom Dwyer 6b5283bf36 refactor: NamespaceCache latency histograms 
Switches the get/put counters to latency histograms to record the
duration of each call - this might be interesting!
 2022-03-03 23:40:13 +00:00
Dom Dwyer bb9b140f4b refactor: sequencer metrics 
Records per-sequencer (kafka partition) enqueue latency / counts broken
down by operation success/error.
 2022-03-03 23:40:13 +00:00
Dom Dwyer e00986c563 refactor: write table count metric 
Record the number of tables in each write - this will let us observe the
total number of tables a router instance has observed, which when
combined with the existing metrics helps us understand the shape
(distribution of tables/lines/fields) of the workload hitting the
routers.
 2022-03-03 23:40:13 +00:00
Carol (Nichols || Goulding) c3acf79307
fix: Only make potentially one cargo hakari commit per branch 
So that we don't have to skip running tests when cargo hakari makes a
change, but we won't have infinite cargo hakari commits if there's some
sort of problem.
 2022-03-03 15:32:31 -05:00
Carol (Nichols || Goulding) 33bbbd9950
fix: Cargo hakari commits have to use semantic commits too 2022-03-03 14:50:36 -05:00
Carol (Nichols || Goulding) 7f8dcf1ed0
chore: Add ssh key to CircleCI hakari job so it can push commits 2022-03-03 14:43:37 -05:00
Carol (Nichols || Goulding) 5018d1bf66
fix: Have auto hakari commits come from a CircleCI bot, not dependabot 2022-03-03 14:43:37 -05:00
Carol (Nichols || Goulding) 26b9ad812e
feat: Auto commit cargo hakari generate changes 2022-03-03 14:43:37 -05:00
Andrew Lamb 677a272095
refactor: Clean up some future clippy warnings from nightly (#3892) 
* refactor: clean up new clippy lints

* refactor: complete other cleanups

* fix: ignore overzealous clippy

* fix: re-remove old code
 2022-03-03 19:14:27 +00:00
Raphael Taylor-Davies e304613546
feat: include trace ID in query log (#3912) (#3923) 
* feat: include trace ID in query log (#3912)

* chore: fmt

* chore: lint
 2022-03-03 17:50:49 +00:00
Marco Neumann cf0c238ae4
feat: allow unencrypted HTTP connections to AWS via flag (#3916) 
This is required for the test bench.
 2022-03-03 17:01:03 +00:00
Andrew Lamb d6afda0227
refactor: split `influxdb_ioxd`, `clap_blocks` and `serving_readiness` from influxdb_iox crate (#3908) 
* refactor: split influxdb_ioxd, clap_blocks, and serving_readiness out of influxdb_iox

split out serving readiness, get compiling

* fix: hakari

* fix: hakari again

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-03 16:48:30 +00:00
Raphael Taylor-Davies 82aa314659
feat: make wait-server-initialized wait for database init (#3915) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-03-03 15:37:22 +00:00
Andrew Lamb 07fdbe7c6b
fix: apply `_field` restrictions that do not match any fields (#3903) 
* fix: apply field restriction correctly

* refactor: Use Vec::retain
 2022-03-03 15:04:05 +00:00
kodiakhq[bot] b9ffc5bcbe
Merge pull request #3913 from influxdata/er/feat/rpc_tracing 
feat: add tracing to all remaining influx RPC calls
 2022-03-03 14:41:34 +00:00
Edd Robinson de7c46c9bb feat: add read_window_aggregate tracing 2022-03-03 14:30:27 +00:00
Edd Robinson ea32bc366a feat: add read_group tracing 2022-03-03 14:27:01 +00:00
Edd Robinson 32baaa1ee7 feat: add tracing to field_columns 2022-03-03 14:27:01 +00:00
Edd Robinson 787a848bf5 feat: add tracing for tag_values 2022-03-03 14:27:01 +00:00
Edd Robinson 6a6fbf73ae feat: add tracing support tag_keys 2022-03-03 14:27:01 +00:00
Edd Robinson 998e205c2c feat: trace table_names 2022-03-03 14:27:01 +00:00