b94d4ddd94
feat: add support for decoding blocks
2020-06-04 14:36:43 +01:00
413738a264
feat: support org and bucket ID in entries
2020-06-04 14:36:43 +01:00
97e77a681b
feat: add basic TSM reader
...
This commit adds a basic TSM file reader, which will provide an iterator
over the TSM index.
2020-06-04 14:36:43 +01:00
2914535c72
refactor: move Encoder trait up
2020-06-04 14:36:43 +01:00
234b2f5752
feat: Line Protocol Schema extractor ( #108 )
...
* feat: schema inference from iterator of parsed lines
* fix: Clean up error handing even more
* fix: fmt
* fix: make a sacrifice to the clippy gods
2020-06-03 18:29:57 -04:00
f00f408f34
Merge pull request #110 from influxdata/cn-cleanup
2020-06-03 08:55:57 -04:00
2e4008eb2e
docs: Small documentation readability fixes
...
Make a URL into a link, make some punctuation consistent, add some code
formatting.
2020-06-03 08:50:29 -04:00
eff7fda966
docs: Change doc comment to apply to the containing item
2020-06-03 08:41:28 -04:00
5d2c5de39d
feat: Structs to represent line protocol schema ( #103 )
...
* feat: Structs to represent line protocol schema
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2020-06-03 08:39:35 -04:00
54125e35c8
chore: touch up docs + test for multi-part EscapedStr ( #109 )
...
* chore: Doc + Test for multi-part EscapedStr
* fix: Add additional test case, for completeness
2020-06-03 08:09:12 -04:00
18b05ce9ef
fix: move test of dstool to its delorean_storage_tool package ( #107 )
2020-06-02 16:10:30 -04:00
f13c9658e2
Merge pull request #97 from influxdata/chore/build-image
...
chore(build): setup nightly ci image build
2020-06-02 10:21:49 -04:00
86949a6fc1
fix(circleci): remove nightly install tools
2020-06-02 10:14:10 -04:00
da523ff290
fix(docker): include missing dependencies
...
This includes libssl-dev and pkg-config since I disabled install recommends
2020-06-02 10:00:22 -04:00
888c876429
chore(docker): updated based on review
...
Updated the nightly image based on review comments.
Switched base image and removed a few tools that caused the final image to be bloated
2020-06-02 10:00:22 -04:00
6ad580127c
chore(Docker): change base image
2020-06-02 10:00:21 -04:00
5aafbf1977
chore(build): setup nightly ci image build
...
We can reduce the number of install steps by using a custom container. This container will build nightly and publish to Quay
2020-06-02 10:00:17 -04:00
fbc74348c6
fix: consistent capitalization and data location ( #105 )
2020-06-02 08:00:13 -04:00
fded360a4e
Merge pull request #104 from influxdata/er/spr
...
chore: ensure commit messages are semantic
2020-06-02 12:41:28 +01:00
2df6328384
chore: ensure commit messages are semantic
2020-06-02 12:34:30 +01:00
1a2efdfd71
feat: Add dstool command line tool ( #102 )
...
* feat: Add dstool command line tool
* clippy
* Update delorean_storage_tool/src/main.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* Update delorean_storage_tool/src/main.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* Add in tests + PR comments
* fmt
* build first then run tests
* actually build before test
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-06-02 07:33:43 -04:00
11017e297f
Merge pull request #101 from influxdata/er/float-influxdb
...
refactor: add influxdb support to decoder
2020-06-02 12:28:48 +01:00
42bd4bf492
refactor: add influxdb support to decoder
...
InfluxDB's float encoder uses a different NaN value to terminate a
block. In order to support decoding float blocks that are inside of TSM
files created by InfluxDB this commit adds the option to explictly
decode those via another decode method.
In the future this API may get simplified if we decide we only need the
float encoder/decoder for encoding and decoding blocks solely
originating from InfluxDB.
2020-06-02 12:19:48 +01:00
84b3e4c463
Merge pull request #100 from influxdata/er-fix-rle
...
fix(encoders): RLE compatibility with influxdb
2020-06-01 16:08:22 +01:00
979e8ee2c2
fix(encoders): RLE compatibility with influxdb
...
The RLE encoder was implemented in a correct way, but not in a way that
was byte for byte compatible with the InfluxDB RLE encoder/decoder. This
commit changes the implementation to make this encoder compatible with
the InfluxDB implementation.
2020-05-31 10:02:06 +01:00
e468b3c044
Merge pull request #99 from influxdata/updates
...
build: update semver-compatible versions
2020-05-29 17:36:17 -04:00
924f20fd50
build: update semver-compatible versions
2020-05-29 13:40:44 -04:00
3e0c7e25ff
test: Add comments and some more tests to parsers ( #96 )
...
* test: Add comments and some more tests to parsers
* Update delorean_line_parser/src/lib.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* Update src/line_parser.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* Update src/line_parser.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* Update delorean_line_parser/src/lib.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* Remove end to end test as it is now covered by docs
* Update src/line_parser.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* one final tweak
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-05-28 05:32:40 -04:00
54dfe826d7
Merge pull request #89 from influxdata/cn-wal-delete
2020-05-27 09:55:26 -04:00
936e7c2a6f
docs: Change some answered questions to statements
2020-05-27 09:49:05 -04:00
d84fdb13ec
feat: Delete entries from the WAL up to some entry number
2020-05-27 09:46:02 -04:00
4ac063088d
Merge pull request #91 from influxdata/cn-wal-metadata
2020-05-27 09:22:27 -04:00
ac9958db30
Merge pull request #94 from influxdata/jpg/extract-parser
2020-05-27 08:36:55 -04:00
0a02afe016
test: Wait for test server to stop before restarting ( #92 )
2020-05-26 17:34:54 -04:00
d4af54c3de
refactor: extract the line protocol parser to a separate crate
...
This will facilitate reusing the parser for other tasks.
2020-05-26 13:22:34 -04:00
d394e2177f
test: Rewrite line_parser tests at a lower level
...
This will ease extracting them to a separate crate
2020-05-25 20:57:48 -04:00
e573ca0061
test: Combine duplicate tests
2020-05-25 20:57:39 -04:00
4a0b2cd671
doc: Initial file encoding thoughts ( #88 )
2020-05-22 17:28:24 -04:00
0d023b60a4
feat: Metadata file
2020-05-22 11:36:26 -04:00
5940b4fcdf
Merge pull request #86 from influxdata/cn-wal-total-size
2020-05-21 14:41:17 -04:00
a312bcc9bb
test: Move file size tests out of the file rollover tests
2020-05-20 11:12:07 -04:00
23fd94664e
feat: Keep track of the total size of all the files in the WAL
2020-05-20 11:12:07 -04:00
d6df717e42
Merge pull request #82 from influxdata/wal-early-sync
2020-05-20 09:50:05 -04:00
59493c9903
feat: Allow an HTTP task to sync the WAL to disk immediately
2020-05-20 09:26:13 -04:00
30776f3d74
Merge pull request #84 from influxdata/cn-wal-file-rollover
2020-05-20 09:23:06 -04:00
f5d7e70db9
fix: improve build error message when flatc is not installed ( #85 )
...
* fix: improve build error message when flatc is not installed
* Apply suggestions from code review
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
* Make it more canonical rust
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2020-05-19 11:05:18 -04:00
f2823ccecd
feat: WAL file rollover based on size of file
2020-05-18 14:08:24 -04:00
e5d8271eeb
fix: Remove redundant clone
2020-05-13 09:52:20 -04:00
f1f41d84b5
test: Verify batches of multiple entries increase sequence number appropriately
2020-05-13 09:38:07 -04:00
cbf4dd96e1
feat: Track a sequence number in the WAL
2020-05-13 09:17:33 -04:00
Edd Robinson
Andrew Lamb
Carol (Nichols || Goulding)
Carol (Nichols || Goulding)
AJ
AJ Bond
Jake Goulding
Andrew Lamb