Edd Robinson
895827aa98
chore: disable SIMD in Arrow
2021-04-20 17:30:50 +00:00
Carol (Nichols || Goulding)
3e87ce5232
fix: Make this trait and methods more idiomatically named
...
"into" usually takes ownership and does a conversion; "as" takes
references and provides a different view.
2021-04-19 08:45:34 -04:00
Marco Neumann
fd0da7e74a
chore: upgrade arrow and Rust
...
See https://github.com/apache/arrow/pull/10082 for upstream PR.
2021-04-19 14:00:04 +02:00
Andrew Lamb
e226b5a820
feat: Use TimestampNanosecondArray for timestamps in IOx ( #1230 )
...
* refactor: Create Arrow arrays using iterators
* feat: use Timestamp64(TimeUnit::Nanosecond) for timestamps
* feat: add support for timestamp array
* fix: update more tests
* fix: remove unecessary code
Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-16 15:55:33 +00:00
Andrew Lamb
59ca090aef
feat: Use single db-wide executor for running queries ( #1198 )
...
* refactor: plumb executor into all Db instances
* refactor: Route all query executions through worker pool
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-14 16:46:02 +00:00
Andrew Lamb
518df742df
chore: update arrow deps ( #1195 )
2021-04-13 18:05:03 +00:00
Andrew Lamb
a1ee443f2a
chore: update arrow deps ( #1148 )
2021-04-07 22:08:58 +00:00
Andrew Lamb
7cc9f06e74
chore: Update arrow / datafusion deps again ( #1126 )
...
* chore: Update arrow dependencies
* test: add test for SHOW COLUMNS
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 12:41:41 +00:00
Andrew Lamb
a59a6edbb8
feat: add SHOW TABLES and `select * from information_schema.columns` ( #1102 )
...
* chore: update dependencies
* test: add tests for new information schema
2021-04-01 12:50:37 +00:00
Andrew Lamb
865910ae5b
chore: update dependencies
2021-03-30 09:01:35 -04:00
Wakahisa
b33d97c946
refactor: write nanosecond timestamps to parquet ( #1030 )
...
* feat: write nanosecond timestamps to parquet
* chore: update arrow deps
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-27 19:00:57 +00:00
Andrew Lamb
895e808754
chore: Upgrade arrow deps ( #1046 )
...
* chore: Upgrade dependencies
* chore: upgrade query for new interfaces
* chore: update read_buffer
2021-03-25 13:35:08 +00:00
Andrew Lamb
72eff5eed5
chore: update deps (including arrow)
2021-03-16 18:15:44 -04:00
Andrew Lamb
746373a687
refactor: Remove mutable_buffer crate dependency on query crate ( #927 )
2021-03-05 11:34:27 +00:00
Andrew Lamb
3abfb5f089
chore: Update arrow deps, turn off optional datafusion features ( #930 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-04 22:41:54 +00:00
Nga Tran
957e05ef25
chore: use newly added Arrow's Expr::is_not_null function
2021-03-03 11:46:49 -05:00
Andrew Lamb
7d8d00781c
feat: Make read_filter work for mutable buffer and read buffer ( #882 )
...
* feat: port read_filter to InfluxRPCPlanner
* fix: remove commented out vestigal test
* fix: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* fix: fmt
* fix: Update arrow_deps/src/util.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-01 16:50:29 +00:00
Andrew Lamb
86c82be7f1
chore: Update arrow deps, remove custom JsonArrayWriter ( #888 )
...
* chore: update dependencies
* refactor: Use Arrow json::ArrayWriter
2021-02-27 10:18:43 +00:00
Andrew Lamb
d29d7efa8c
chore: Update arrow/datafusion deps again
2021-02-25 07:39:01 -05:00
NGA TRAN
213094f8f7
chore: update Arrow dependencies
2021-02-18 10:02:57 -05:00
Andrew Lamb
071b13b939
chore: Update dependencies ( #821 )
...
* chore: Update dependencies
* fix: update udf implementation for DataFusion update
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-02-16 23:27:36 +00:00
Edd Robinson
dfe6e50e26
refactor: add arc clone lint
2021-02-15 12:52:12 +00:00
Andrew Lamb
150baec84c
chore: Update arrow dependencies
2021-02-14 05:47:23 -05:00
Carol (Nichols || Goulding)
fbf776c6b3
chore: Clean up Cargo.tomls ( #754 )
...
* fix: test_helpers crate should only be a dev-dep
* fix: object_store no longer has a build script, so no longer needs a build dep
* chore: Alphabetize all Cargo.tomls
2021-02-04 18:56:02 -05:00
Andrew Lamb
d5ebf9c3da
chore: Update deps again ( #738 )
2021-02-04 06:02:05 -05:00
Carol (Nichols || Goulding)
8975b1cbf5
fix: into_iter in the assert_table_eq macro
...
This makes it so the macro can take `&[String]` or `&[&str]`.
2021-02-03 09:56:56 -05:00
Jake Goulding
a5e09366b0
feat: Export arrow-flight from arrow-deps
2021-02-03 09:56:56 -05:00
Andrew Lamb
abc26a33c1
chore: Update dependencies (again) ( #718 )
...
* chore: Update dependencies (again)
* refactor: update for changes in DataFusion API
* fix: fmt
* fix: clippy
2021-02-02 18:33:01 -05:00
Andrew Lamb
f3bd8bd0e3
chore: update deps (tokio 1.0 and ecosystem) ( #707 )
...
* chore: Update arrow + tokio deps
* chore: Use bleeding edge azure
* chore: Update aws + other deps
* fix: fmt
* fix: Switch to in-house version of routerify
* fix: Upgrade to hyper 0.14
The hyper::error module is now private; hyper::Error is the public
re-export
* fix: Upgrade cloud storage to get tokio upgrade
* fix: Upgrade open_telemetry
* fix: Do not call `panic::set_hook` during another panic
Doing so leads to a double panic which aborts the process.
* fix: new h2 error who dis
Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@integer32.com>
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2021-01-29 16:11:55 -05:00
Andrew Lamb
8308fad188
chore: update arrow deps again ( #699 )
2021-01-26 07:55:30 -05:00
Andrew Lamb
c3b0371c84
feat: Initial RPC Query Frontend ( #692 )
...
* feat: Initial RPC Query Frontend
* docs: s/immutable buffer/mutable buffer
* docs: Correct type in docstring
2021-01-25 08:33:39 -05:00
Andrew Lamb
9b6fbae7f5
chore: Bump arrow deps
2021-01-23 08:09:46 -05:00
Andrew Lamb
747b96d801
chore: Upgrade arrow dependencies, reduce duplication with upstream ( #676 )
2021-01-21 08:58:11 -05:00
Andrew Lamb
08d52ea043
feat: implement partition chunk rollover + ids and timestamps ( #601 )
...
* feat: implement partition chunk rollover + ids and timestamps
* feat: add last_write_timestamp
* refactor: Use DateTime<Utc> rather than Instant
* refactor: avoid use of structure to generate ids
2020-12-29 11:00:18 -05:00
Andrew Lamb
0d0ec0ce69
chore: Upgrade arrow dependencies ( #603 )
...
* chore: Update arrow dependencies to latest
* refactor: Update code to conform to new arrow api
2020-12-28 16:08:09 -05:00
Andrew Lamb
bb96142564
chore: Update arrow dependencies, remove custom min/max implementation ( #585 )
...
* chore: Update arrow dependency
* fix: Update code for changes in datafusion
* fix: use arrow version of min_boolean
2020-12-21 12:31:39 -05:00
Andrew Lamb
a6d2c13888
chore: Update arrow + other depenencies ( #540 )
...
* chore: Update arrow + other depenencies
* chore: Update write_buffer and query crate
2020-12-15 08:46:27 -05:00
Andrew Lamb
3a9ee88f00
chore: update to latest version of arrow + update code ( #486 )
...
* chore: update to latest version of arrow + update code
* chore: Update rust toolchain to match arrow
* fix: clippy
2020-11-25 14:46:35 -05:00
Andrew Lamb
cdb26e60e4
refactor: rename `storage` crate to `query` to better reflect what it is ( #475 )
...
* refactor: rename storage --> query
* refactor: update a few more referenes
2020-11-24 14:19:29 -05:00
Andrew Lamb
831a0875d6
chore: update to latest arrow + Rust nightly-2020-11-14 ( #454 )
...
* chore: update to latest arrow + Rust nightly-2020-11-14
* chore: update ci
* fix: update for clippy lints
* fix: Allow redundant_field_names in generated types crate
* fix: clippy about try_for_each
* fix: clippy uneeded-collect
* fix: clippy about default values
* fix: clippy mathces --> matches!
* fix: clippy sort --> sort_by_key
* fix: clippy about default values again
2020-11-16 11:48:42 -05:00
Andrew Lamb
2fa0e03162
fix: Use datafusion optimizer in IOx query plans ( #439 )
...
* chore: update arrow dep to 8e4d9ebef3
* fix: checkin Cargo.lock
* fix: Enable datafusion optimizer, use display_indent_schema
2020-11-11 18:06:21 -05:00
Andrew Lamb
b745a180a4
refactor: rename delorean --> InfluDB IOx ( #417 )
2020-11-05 13:51:04 -05:00
Andrew Lamb
a52e0001c5
refactor: rename all crates that start with`delorean_` in preparation for rename ( #415 )
...
* refactor: rename delorean_cluster --> cluster
* refactor: rebane delorean_generated_types --> generated_types
* refactor: rename delorean_write_buffer --> write_buffer
* refactor: rename delorean_ingest --> ingest
* refactor: rename delorean_storage --> storage
* refactor: rename delorean_tsm --> tsm
* refactor: rename delorean_test_helpers --> test_helpers
* refactor: rename delorean_arrow --> arrow_deps
* refactor: rename delorean_line_parser --> influxdb_line_protocol
2020-11-05 13:44:36 -05:00