Commit Graph

446 Commits (0bd7941a187588299f4141d7f6e47fff67da4643)

Author SHA1 Message Date
Edd Robinson 04a85515d3
Merge branch 'main' into er/refactor/read_buffer_clippy 2022-02-01 15:11:00 +00:00
Edd Robinson 04a59f825f refactor: fix clippy lints 2022-02-01 14:56:49 +00:00
Edd Robinson fa546047fb
refactor: update dep with API change (#3596) 2022-02-01 14:53:10 +00:00
Edd Robinson 2f3cc046f6 chore: enable to_string restrictive lints 2022-02-01 14:47:30 +00:00
Marco Neumann 22778a3a80
chore: upgrade rskafka and parking_lot (#3592) 2022-02-01 11:50:42 +00:00
Edd Robinson 87af662d3b
refactor: include comments in test cases (#3550) 2022-01-27 20:35:14 +00:00
Andrew Lamb 2062267d0f
chore: Update hashbrown (#3551)
* chore: Update hashbrown

* fix: hakari

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-27 15:34:10 +00:00
Edd Robinson 5befa7922b
refactor: move chunk metrics to module (#3548)
* refactor: move chunk metrics into module

* refactor: use Metrics as internal name

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-27 15:24:31 +00:00
Andrew Lamb 5488c257d1
chore: Update datafusion, upgrade to arrow/parqet/arrow-flight 8.0.0 (#3517)
* chore: Update datafusion

* chore: update to arrow 8

* fix: update to use new DataFusion APIs

* fix: update case for sortedness

* fix: cargo hakari
2022-01-27 13:33:27 +00:00
Edd Robinson 0a0b8b2150
feat: decouple read buffer row group size from Datafusion batch size (#3538)
* feat: add chunk builder

* test: test coverage for chunk builder

* refactor: apply suggestions from code review

* refactor: address PR feedback
2022-01-26 12:39:29 +00:00
Edd Robinson d1816b662f
chore: update rust to 1.58 (#3461)
* chore: update rust to 1.58

* fix: clippy

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-01-13 21:12:46 +00:00
Andrew Lamb dd23056efd
chore: update datafusion, arrow, prost, tonic, pbjson, etc (#3455)
* chore: update datafusion, arrow, prost, tonic, etc

* fix: update pprof as well

* chore: update hakari

* fix: update pbjson

* chore: update heappy

* fix: hakari

* fix: workaround https://github.com/influxdata/influxdb_iox/issues/3458

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 17:07:15 +00:00
Marco Neumann f3f6f335a9
chore: upgrade to snafu 0.7 (#3440) 2022-01-11 19:22:36 +00:00
Andrew Lamb 80c048528c
refactor: Clean up code by using `lit` and `lit_timestamp_nano` rather than `Expr::Literal(ScalarValue(Some(...)))` (#3427) 2022-01-07 17:23:14 +00:00
Andrew Lamb 527885f7f8
chore: Update datafusion (#3413)
* chore: Update datafusion and update code to handle timezone aware timestamps

* fix: cargo hakari

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 14:52:12 +00:00
Edd Robinson a08246e3c7
Merge branch 'main' into er/refactor/debug_rub_query 2021-12-02 19:42:46 +00:00
Edd Robinson 083ba1daf4 refactor: apply PR feedback 2021-12-02 19:34:47 +00:00
Carol (Nichols || Goulding) 0683f851e9
fix: Derive Default instead of doing an equivalent manual impl
Identified by clippy. The impl did have `#[cfg(test)]` on it, but the
entire struct does too, so this is fine.

https://rust-lang.github.io/rust-clippy/master/index.html#derivable_impls
2021-12-02 11:52:02 -05:00
Carol (Nichols || Goulding) 1a899b939e
fix: Remove redundant closures identified by clippy
https://rust-lang.github.io/rust-clippy/master/index.html#redundant_closure
2021-12-02 11:52:02 -05:00
Edd Robinson de25c8e1a4 refactor: add some trace timings 2021-12-02 12:23:44 +00:00
Raphael Taylor-Davies 197634ed50
feat: reload chunk back into read buffer (#3209) (#3216)
* feat: reload chunk back into read buffer (#3209)

* chore: fix logical conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 11:34:55 +00:00
Carol (Nichols || Goulding) 9fd4a560f5
feat: Results of running cargo hakari manage-deps 2021-11-19 09:21:57 -05:00
Edd Robinson b1096d2a36
Merge branch 'main' into er/feat/read_buffer/meta_delete 2021-11-01 10:26:10 +00:00
Marco Neumann bc7244c48e chore: use Rust edition 2021 2021-10-25 10:58:20 +02:00
Edd Robinson 8d267e5840
Merge branch 'main' into er/test/read_buffer/null_column 2021-10-22 15:28:39 +01:00
Edd Robinson 7a5263d709 refactor: tidy up column summary to stats 2021-10-22 13:04:42 +01:00
Edd Robinson 09a2d805b9 refactor: restore concept of NULL value 2021-10-22 13:03:16 +01:00
Edd Robinson 8b406b4f91 test: update table_summaries test 2021-10-22 12:06:56 +01:00
Edd Robinson a3e750c9fc test: add null column to test 2021-10-22 11:27:06 +01:00
Carol (Nichols || Goulding) 654d33684a fix: Move code shared between if/else blocks out 2021-10-21 20:47:35 -04:00
Andrew Lamb a82dc6f5f0
chore: Update datafusion + arrow (#2903)
* chore: Update datafusion to latest, arrow to 6.0.0

* fix: Update tests

* fix: bubble internal error

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-19 17:14:08 +00:00
Edd Robinson 7c3b0a00e5 feat: add delete support to column_names 2021-10-14 13:08:57 +01:00
Edd Robinson 7c97cd68bf test: add test for column_names with deletes 2021-10-14 13:08:57 +01:00
Edd Robinson 96e05726ee refactor: expose negated_predicate API for columns_names 2021-10-14 13:08:56 +01:00
Raphael Taylor-Davies 8a82f92c5d
refactor: add TimeProvider abstraction (#2722) (#2815)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-12 21:19:03 +00:00
Raphael Taylor-Davies afe34751e7
refactor: split out schema crate (#2781)
* refactor: split out schema crate

* chore: fix doc
2021-10-11 09:45:08 +00:00
Edd Robinson 04a7ddd34a fix: ensure correct PredicateMatch for columns 2021-10-08 12:46:24 +01:00
dependabot[bot] d1f5209869
chore(deps): bump arrow from 5.4.0 to 5.5.0
Bumps [arrow](https://github.com/apache/arrow-rs) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md)
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0)

---
updated-dependencies:
- dependency-name: arrow
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:55:38 +00:00
Edd Robinson 8b458e2c2b feat: add API for validating a predicate against a chunk: 2021-09-29 14:42:42 +01:00
Edd Robinson 0a3ca90809 refactor: only validate same types 2021-09-29 14:39:43 +01:00
Edd Robinson a70a55cb3d test: update benchmarks 2021-09-24 15:00:17 +01:00
Edd Robinson 5c7459f488 feat: validate predicates on satisfies_predicate 2021-09-24 14:52:19 +01:00
Edd Robinson a69e46efc6 feat: validate predicates on column_values 2021-09-24 14:52:19 +01:00
Edd Robinson f618aa1b76 feat: validate predicates on column_names 2021-09-24 14:52:19 +01:00
Edd Robinson c107434d20 feat: validate predicates on read_aggregate 2021-09-24 14:52:19 +01:00
Edd Robinson 621b26166c feat: validate predicates on read_filter 2021-09-24 14:52:16 +01:00
Edd Robinson 053186ab29 feat: add ability validate predicate compatible with schema 2021-09-24 13:05:46 +01:00
dependabot[bot] 876bb10cf8
chore(deps): bump rand_distr from 0.4.1 to 0.4.2
Bumps [rand_distr](https://github.com/rust-random/rand) from 0.4.1 to 0.4.2.
- [Release notes](https://github.com/rust-random/rand/releases)
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-random/rand/compare/rand_distr-0.4.1...rand_distr-0.4.2)

---
updated-dependencies:
- dependency-name: rand_distr
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-20 08:39:39 +00:00
Edd Robinson e51dd0365a refactor: PR feedback
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2021-09-16 10:01:44 +01:00
Edd Robinson f7228ddd60 test: add test for byte trimmed floats 2021-09-16 10:01:44 +01:00