Commit Graph

584 Commits (bae67cf43aacce1489f7a95dcd34b98b510860f0)

Author SHA1 Message Date
Jake Goulding bae67cf43a refactor: Use InternalResult on the implementations of `get` streams 2020-06-29 08:48:48 -04:00
Jake Goulding f2003fbf78 refactor: Use std::io to shorten lines 2020-06-29 08:48:48 -04:00
Jake Goulding 00805a0225 refactor: Use enum variants to shorten matches 2020-06-29 08:48:48 -04:00
Jake Goulding 99549953d6
Merge pull request #193 from influxdata/idiomatic-snafu 2020-06-26 16:35:23 -04:00
Jake Goulding 672afa1195 refactor: Merge unknown and missing extension errors 2020-06-26 16:07:35 -04:00
Jake Goulding aca63b68b2 refactor: Use more unique errors for the commands 2020-06-26 16:01:59 -04:00
Carol (Nichols || Goulding) 7f838efd80
Merge pull request #187 from influxdata/cn-bool-enc 2020-06-26 15:45:42 -04:00
Jake Goulding f5d73ee580
Merge pull request #173 from influxdata/idiomatic-snafu 2020-06-26 14:22:42 -04:00
Jake Goulding 020d56e021 refactor: use SNAFU more idiomatically in delorean_parquet 2020-06-26 13:26:51 -04:00
Jake Goulding bca4d00716 refactor: use SNAFU more idiomatically in command modules 2020-06-26 13:26:51 -04:00
Jake Goulding eeb5b4a33a chore: Add public constructors for delorean_table::Error 2020-06-26 13:26:51 -04:00
Jake Goulding b72767b695 refactor: use SNAFU more idiomatically in delorean_ingest 2020-06-26 13:26:51 -04:00
Jake Goulding a169a80f33 refactor: No need to return &String 2020-06-26 13:12:19 -04:00
Jake Goulding fdf44d2745 refactor: Support converting EscapedStr into a String 2020-06-26 13:12:19 -04:00
Carol (Nichols || Goulding) 8888f11826
Merge pull request #192 from influxdata/cn-docker-cleanup
refactor: Don't install rust and clippy twice
2020-06-26 13:05:41 -04:00
Carol (Nichols || Goulding) 1d86876bb3 refactor: Don't install rust and clippy twice 2020-06-26 11:45:41 -04:00
Carol (Nichols || Goulding) a2888dbbb2 refactor: Use cmp::min instead of an if 2020-06-26 10:36:27 -04:00
Carol (Nichols || Goulding) 201f7bef41 fix: Add an assertion for the boolean encoder format bit 2020-06-26 10:36:27 -04:00
Carol (Nichols || Goulding) a56957944c refactor: Use a constant value instead of calculating 1 2020-06-26 10:36:27 -04:00
Carol (Nichols || Goulding) 9ef07cac14 feat: Implement boolean encoding
Fixes #149.
2020-06-26 10:36:27 -04:00
Andrew Lamb 463297e8f1
Merge pull request #191 from influxdata/alamb/refactor-rename-timestamp
fix: rename timestamp column "timestamp" -> "time" to be consistent
2020-06-26 09:33:55 -04:00
alamb d4a2cf1bd8 fix: rename timestamp column "timestamp" -> "time" to be consistent 2020-06-26 08:26:16 -04:00
Edd Robinson 18128a72c7
Merge pull request #188 from influxdata/er/tsm-parquet-fix
fix: ensure all rows are returned for all columns
2020-06-26 12:16:48 +01:00
Edd Robinson d15256e0e7 refactor: address PR feedback 2020-06-26 12:08:42 +01:00
Edd Robinson 99268f5260 test: add coverage for converting tsm file 2020-06-26 11:50:37 +01:00
Edd Robinson 9d889828c3 fix: ensure all rows are emitted for each column 2020-06-26 11:50:37 +01:00
Andrew Lamb 305b919bac feat: benchmark for lp->parquet performance (#176) 2020-06-26 11:50:37 +01:00
Carol (Nichols || Goulding) efbff0e5ef
Merge pull request #189 from influxdata/moar-clippy 2020-06-25 10:50:15 -04:00
Carol (Nichols || Goulding) 4df99f1a7c style: Enable the clippy warning to use `Self` when recommended
Fixes #158.
2020-06-25 07:38:58 -04:00
Carol (Nichols || Goulding) afcd1efd1e style: Unify lints everywhere
Then fix the failures, mostly by adding derives and then removing some
unneeded (cheap) clones.

Document places where we purposefully don't use the same lints.

Not unifying missing_docs.

👀 https://github.com/rust-lang/cargo/issues/5034
2020-06-25 07:28:42 -04:00
Carol (Nichols || Goulding) 423ee71f5e refactor: Remove duplicated lint rules
These get inherited from crate root files, so the lint rules in
src/main.rs apply in this file already.
2020-06-24 16:56:16 -04:00
Andrew Lamb 3bb3f2ddbd
Merge pull request #185 from influxdata/alamb/fix-parquet-nulls
fix: Correctly encode nulls in parquet files
2020-06-24 11:51:31 -04:00
alamb 0fdc6aa745 test: add test for packing null values 2020-06-24 11:34:40 -04:00
alamb 431787fb31 Merge remote-tracking branch 'origin/master' into alamb/fix-parquet-nulls 2020-06-24 11:29:07 -04:00
Andrew Lamb de600b7712
fix: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-06-24 09:44:08 -04:00
Andrew Lamb ab22384009
Merge pull request #186 from influxdata/alamb/refactor-parquet-deps
refactor: clean up parquet library deps and remove use of InputReaderAdapter (related to parquet dependencies)
2020-06-24 09:42:44 -04:00
Carol (Nichols || Goulding) 6fb107af68
Merge pull request #178 from influxdata/cn-u64-enc 2020-06-24 08:48:57 -04:00
alamb 2c4a9dba53 fix: cleanup comment + code order 2020-06-23 17:21:20 -04:00
alamb b22423621b refactor: remove InputReaderAdapter 2020-06-23 17:15:02 -04:00
alamb 68ce351a3a refactor: remove direct parquet dependency from delorean_ingest 2020-06-23 16:58:31 -04:00
Andrew Lamb 16bf5887df
fix: Setup parquet column encoding correctly (#182)
FYI @e-dard
2020-06-23 16:42:44 -04:00
alamb c9b24f3762 fix: Correctly encode nulls in parquet files 2020-06-23 12:23:47 -04:00
alamb eee1e9fe77 fix: Setup parquet column encoding correctly 2020-06-23 09:54:16 -04:00
Edd Robinson ec448f361a refactor: enable unisgned block reading 2020-06-23 10:50:32 +01:00
Andrew Lamb 943a6cd299
feat: benchmark for lp->parquet performance (#176) 2020-06-23 05:44:52 -04:00
Andrew Lamb 322a491b9d
perf: Improve line protocol --> parquet conversion performance by ~20% (#177)
* feat: benchmark for lp->parquet performance

* feat: improve parser performance by storing contiguous EscapedStr

* fix: remove all string copies during LP-Parquet conversion

* refactor: Implement from_str as From<&str> only

* refactor: implement Deref instead of as_str

* refactor: Remove ends_with because Deref now makes it work

* refactor: Eq can be derived

* refactor: Remove unused From implementation

* refactor: Replace single-character strings with chars as requested by clippy

Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@integer32.com>
2020-06-23 05:42:19 -04:00
Andrew Lamb 86a425e5ef
feat: Add support for parsing bool values in line protocol parser (#156)
* feat: Implement boolean support for the line protcol parser

* fix: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: fmt+clippy

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-06-22 16:58:38 -04:00
Carol (Nichols || Goulding) 294163bed0 feat: Implement unsigned encoding 2020-06-22 16:52:24 -04:00
Andrew Lamb 2a42df278a
docs: Initial style guide with idomatic error handling (#174)
* docs: Initial style guide with idomatic error handling

* fix: Apply suggestions from code review

Co-authored-by: Paul Dix <paul@influxdata.com>

* fix: Apply suggestions from code review

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: clean up example 

To not to use different field name

Co-authored-by: Paul Dix <paul@influxdata.com>
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-06-22 16:41:36 -04:00
Carol (Nichols || Goulding) 1f6effba91
Merge pull request #163 from influxdata/cn-string-enc 2020-06-22 16:10:58 -04:00