Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
706 Commits
187 Branches
453 Tags
379 MiB
Commit Graph

706 Commits (5e256f3722703778c8e4bdf80837cdbcfe9baf42)

Author SHA1 Message Date
Andrew Lamb 5e256f3722 fix: Apply suggestions from code review 
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
 2020-07-13 10:35:28 -04:00
alamb 2ecfcbaae0 docs: Add worked example and caveats about priority scheduling 2020-07-13 10:35:28 -04:00
Andrew Lamb 646a244c08 fix: Apply suggestions from code review 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-13 10:35:28 -04:00
alamb 6a5854bbc3 docs: writeup multi core tasks architecture 2020-07-13 10:35:28 -04:00
Andrew Lamb 17c61da5f1
Merge pull request #238 from influxdata/alamb/fix-partition-errors 
fix: update error handling in memdb.rs and partitioned_store.rs, remove StorageError
 2020-07-10 09:23:02 -04:00
alamb 6d78647602 Merge remote-tracking branch 'origin/master' into alamb/fix-partition-errors 2020-07-10 08:49:09 -04:00
Andrew Lamb 6ee72e5733
Merge pull request #239 from influxdata/alamb/less-chatty 
fix: Make default output of delorean less chatty
 2020-07-10 06:59:54 -04:00
Edd Robinson 27733457bb
Merge pull request #229 from influxdata/er/multi-tsm 
feat: support combining multiple TSM files -> Parquet files
 2020-07-09 21:56:29 +01:00
Edd Robinson 4e66a48ba9
refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-09 15:46:08 +01:00
Edd Robinson fd3f482652
refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-09 15:45:50 +01:00
Edd Robinson 3d0d24d6fb
refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-09 15:45:41 +01:00
alamb d1e334f3fe fix: Make default output of delorean less chatty 2020-07-08 18:02:48 -04:00
Edd Robinson cc7e8e8da0 fix: ensure tables merged correctly 2020-07-08 22:57:15 +01:00
Edd Robinson bd5d39f60c refactor: address PR feedback 2020-07-08 22:57:15 +01:00
Edd Robinson d19094d023 refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-08 22:57:15 +01:00
Edd Robinson 4e455ff595 refactor: PR feedback 
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
 2020-07-08 22:57:15 +01:00
Edd Robinson 5755949c01 refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-08 22:57:15 +01:00
Edd Robinson da305596f9 refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-08 22:57:15 +01:00
Edd Robinson a3a8b8273b refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-08 22:57:15 +01:00
Edd Robinson a8f77c49e2 refactor: PR feedback 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-08 22:57:15 +01:00
Edd Robinson f3970990ac test: fix mapper benc 2020-07-08 22:57:15 +01:00
Edd Robinson 54a61b33fc refactor: remove redundant block type 2020-07-08 22:57:15 +01:00
Edd Robinson c5d6509ad5 feat: extend multi file conversion to CLI 2020-07-08 22:57:15 +01:00
Edd Robinson 50ef521e6c feat: add support for converting multiple TSM files 
This commit extends the ingest crate to support converting multiple TSM
files to a single Parquet file by merging identical measurements across
the TSM files.

This does not yet support merging blocks that overlap.
 2020-07-08 22:57:15 +01:00
Edd Robinson eed1e030df feat: add support for multi-block readers 
This commit embeds an index within each block materialised from a TSM
index, which can be used later on to identify which TSM block reader
should be used to decode the block.

This essentially lets one coalesce blocks for the same measurement from
different files lazily - that is, you don't need to materialise them
until you're ready, and when you do want to materialise them you know
which file to read from.
 2020-07-08 22:57:15 +01:00
Edd Robinson 70cdeb2d08 feat: add ability to merge measurement tables 2020-07-08 22:57:15 +01:00
Edd Robinson fff5577efb refactor: encapsulate mapping logic 
This commit moves some of the TSM mapper logic that had leaked into the
TSM->Parquer converter back into the mapper. The refactor allows us to
make some previously public APIs private, whilst still providing a
reasonably flexible API.
 2020-07-08 22:57:15 +01:00
alamb bb2518b7e9 fix: Remove StorageError 2020-07-08 17:32:16 -04:00
alamb febfbe4d45 fix: update error handling in memdb.rs and partitioned_store.rs to use standard errors 2020-07-08 17:32:16 -04:00
Andrew Lamb 13309e10f2
Merge pull request #236 from influxdata/alamb/fix-block-errors 
fix: update error handling in block.rs
 2020-07-08 17:30:29 -04:00
alamb 49555aad05 Merge remote-tracking branch 'origin/master' into alamb/fix-block-errors 2020-07-08 17:26:03 -04:00
Andrew Lamb 4a9fc5b785
fix: Apply suggestions from code review 
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
 2020-07-08 17:25:44 -04:00
Andrew Lamb 3d372157dd
Merge pull request #232 from influxdata/alamb/better-errors 
feat: Better error messages for TSM key parse errors
 2020-07-08 17:15:44 -04:00
Andrew Lamb 63c2c62292
Merge pull request #235 from influxdata/alamb/fix-database-errors 
fix: update error handling in database.rs
 2020-07-08 17:14:12 -04:00
alamb 0865196f20 fix: implement PR suggestions 2020-07-08 17:04:08 -04:00
alamb e24e520176 fix: update error handling in block.rs 2020-07-08 11:37:06 -04:00
alamb 003a08331b fix: remove special case error message 2020-07-08 11:16:19 -04:00
alamb c840317428 fix: update error handling in database.rs 2020-07-08 11:11:02 -04:00
Carol (Nichols || Goulding) f2278a31e0
Merge pull request #231 from influxdata/cn/update-croaring/perf 2020-07-08 10:40:25 -04:00
Carol (Nichols || Goulding) fc80b463d5 fix: Set ROARING_ARCH to build a portable binary using CRoaring 
See https://github.com/saulius/croaring-rs/pull/62
 2020-07-08 10:03:02 -04:00
alamb d072cafc23 feat: Better error messages for TSM key parse errors 2020-07-08 09:37:16 -04:00
Carol (Nichols || Goulding) b3a16c080f feat: Update croaring 
Jake dug into why the end-to-end tests fail with delorean running in the
Docker image I built, and it appears to be a crash with an illegal
instruction from CRoaring.

We think it's this issue: https://github.com/saulius/croaring-rs/pull/62
which was merged and released, so let's try updating CRoaring.
 2020-07-08 08:49:28 -04:00
Andrew Lamb 78a17d7827
Merge pull request #222 from influxdata/alamb/async 
refactor: make delorean main async
 2020-07-07 17:51:12 -04:00
alamb 0ad6cb61b1 refactor: make delorean main async 2020-07-06 16:32:37 -04:00
Andrew Lamb 5d8ebe5d63
Merge pull request #215 from influxdata/alamb/214-decode-escaped-keys 
feat: implement escaped tsm key parsing
 2020-07-06 16:23:28 -04:00
Andrew Lamb d81e2e2b53
Merge pull request #220 from influxdata/alamb/error-improve 
fix: use fail in error handling
 2020-07-06 11:52:44 -04:00
Carol (Nichols || Goulding) 09759a3961
Merge pull request #219 from influxdata/cn/perf-test/perf 
feat: When a branch ends with /perf, build in release mode and upload to quay
 2020-07-06 11:00:22 -04:00
Andrew Lamb 10079de9b7 fix: Apply more suggestions from code review 
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
 2020-07-04 09:00:56 -04:00
alamb 2123797edb fix: better string api usage 2020-07-04 08:46:45 -04:00
alamb 18a5f5312c fix: improve comments 2020-07-04 08:46:45 -04:00