Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,888 Commits
188 Branches
453 Tags
378 MiB
Commit Graph

2888 Commits (2b98bca9caaa683a101cde305bc960645504c09c)

Author SHA1 Message Date
Edd Robinson 2b98bca9ca test: allow from slice to be testable 2021-05-17 14:32:55 +01:00
Edd Robinson b7ea53f5db refactor: remove unnecessary from imps 2021-05-17 14:32:55 +01:00
Raphael Taylor-Davies 91a45fd380
feat: simplify shutdown (#1502) 
* feat: simplify shutdown

* chore: fix lint

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-05-17 11:50:14 +00:00
Andrew Lamb 07db4932ee
refactor: rename data_types/src/chunk.rs -> data_types/src/chunk_metadata.rs (#1500) 2021-05-15 10:18:01 +00:00
Andrew Lamb 133ce12827
chore: update deps (#1499) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-05-14 20:22:16 +00:00
Raphael Taylor-Davies f9178dbb5f
feat: push metrics into catalog (#1488) 
* feat: push metrics into catalog

* chore: minor cleanup

* fix: include db labels in chunk metric domains

* chore: fmt

* fix: don't allow dropping moving chunks

* chore: further tweaks

* chore: review feedback

* feat: use new_unregistered() for metric instruments instead of default

* chore: use &[KeyValue] instead of &Vec<KeyValue>

* refactor: make GauageValue non default constructible
 2021-05-14 17:37:39 +00:00
Raphael Taylor-Davies cfa8160644
fix: don't test snapshotting when disabled (#1496) (#1498) 2021-05-14 16:15:55 +00:00
kodiakhq[bot] 73c43f1710
Merge pull request #1497 from influxdata/dom/rle-size-target 
refactor: RLE selector target
 2021-05-14 15:34:33 +00:00
Dom db6c7728c7 refactor: use 10% target reduction for RLE 
Comments say 10% but const was 30% - a 10% computed size reduction
sounds sensible!
 2021-05-14 15:08:54 +01:00
Dom 874d7a1118 test: run rle_rows test 
The rle_rows test was missing a #[test] annotation preventing it from
running.
 2021-05-14 14:41:17 +01:00
kodiakhq[bot] d98d66e718
Merge pull request #1444 from influxdata/cn/wb-clock 
feat: Add a process clock to Db and use it for Sequenced Entries
 2021-05-14 13:04:26 +00:00
kodiakhq[bot] fdc8461c7f
Merge branch 'main' into cn/wb-clock 2021-05-14 13:00:06 +00:00
kodiakhq[bot] 02ae69dffc
Merge pull request #1493 from influxdata/er/feat/read_buffer/num_rle 
feat: implement Read Buffer run-length encoding for scalars
 2021-05-14 12:42:51 +00:00
Edd Robinson 0d21d9e2e0 refactor: implement from_iter, reduce code! 2021-05-14 13:32:02 +01:00
Edd Robinson ac4fa1e527 refactor: update read_buffer/src/column/encoding/scalar/rle.rs 
Co-authored-by: Dom <dom@itsallbroken.com>

Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
 2021-05-14 13:24:55 +01:00
Edd Robinson 1fa08d0de5 test: add test for float encoding rules 2021-05-14 13:24:53 +01:00
Edd Robinson 1ac949e7ea feat: implement predicate pushdown on RLE 2021-05-14 13:23:42 +01:00
Edd Robinson 0cf445991e refactor: all read buffer tests passing 2021-05-14 13:14:12 +01:00
Edd Robinson 7525f6e9e3 feat: teach read buffer to create RLE float columns 2021-05-14 13:14:10 +01:00
Edd Robinson 9a666fac00 feat: implement RLE methods for materialising 2021-05-14 13:05:02 +01:00
Edd Robinson c55dce3af5 feat: implement stat methods 2021-05-14 13:05:02 +01:00
Edd Robinson 958219d63e feat: skeleton scalar RLE 2021-05-14 13:05:02 +01:00
Edd Robinson 41abeba7a0
Merge pull request #1494 from influxdata/er/feat/rb_raw_size 
feat: add uncompressed read buffer size metric
 2021-05-14 12:47:57 +01:00
Edd Robinson 91fda41f8e refactor: pdate read_buffer/src/column/boolean.rs 
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
 2021-05-14 12:11:54 +01:00
Edd Robinson d80e71ad86 feat: add new metric to track raw size 2021-05-14 10:34:54 +01:00
Edd Robinson 51c9c15026 refactor: include raw size in log message 2021-05-14 09:42:24 +01:00
Edd Robinson 966093deec feat: expose size_raw via ReadBuffer API 2021-05-14 09:42:24 +01:00
Edd Robinson 984f505267 feat: implement raw column size on bool columns 2021-05-14 09:42:24 +01:00
Edd Robinson 1a20f3fb4a feat: implement raw column size on float columns 2021-05-14 09:42:24 +01:00
Edd Robinson 301df03e72 feat: implement raw column size on integer columns 2021-05-14 09:42:24 +01:00
Edd Robinson 850db3f6c2 feat: implement raw size on string columns 2021-05-14 09:42:22 +01:00
kodiakhq[bot] 68b3577b0d
Merge pull request #1492 from influxdata/pointsmetric 
fix: Add ingest_fields_total
 2021-05-13 16:08:49 +00:00
Marko Mikulicic 35c2ca17fc
fix: Add ingest_fields_total 
ingest_lines_total count lines (which apparently are the same as points, quite confusingly)

No yaks harmed in the making of this PR.

(NOTE: the code around metric, especially dealing with happy and error paths is very painful;
to be done in another PR)
 2021-05-13 17:55:07 +02:00
Raphael Taylor-Davies 8ab71be5eb
feat: use PackedStringArray in mutable buffer (#1476) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-05-13 15:25:19 +00:00
kodiakhq[bot] 553bc83eef
Merge pull request #1486 from influxdata/ntran/parquet_os 
feat: we now can read parquet files from all kind of object stores
 2021-05-13 10:27:40 +00:00
Nga Tran 9583636748 feat: we now can read parquet files form all kind of object stores 2021-05-12 18:05:34 -04:00
Carol (Nichols || Goulding) 8be95856ab test: Add a test with multiple threads using a process clock 2021-05-12 13:31:26 -04:00
Carol (Nichols || Goulding) cecb4afc58 docs: Add some documentation on the assumptions around this design 2021-05-12 13:31:26 -04:00
Carol (Nichols || Goulding) b3fb61a0b3 refactor: Rename now_nanos to system_clock_now for clarity 2021-05-12 13:31:26 -04:00
Carol (Nichols || Goulding) 425aacc391 refactor: Extract ProcessClock into its own type 2021-05-12 13:31:26 -04:00
Carol (Nichols || Goulding) b749353d21 refactor: Use a compare_exchange loop instead of Arc Mutex 2021-05-12 10:58:08 -04:00
Carol (Nichols || Goulding) 5dfd152549 test: Use the now_nanos helper function more in tests 2021-05-12 10:58:08 -04:00
Carol (Nichols || Goulding) f28c9ae04c docs: Add unit and semantic information about the process clock 2021-05-12 10:58:08 -04:00
Carol (Nichols || Goulding) 513d4731be feat: Add a process clock to Db and use it for Sequenced Entries 
Connects to #1157.
 2021-05-12 10:58:06 -04:00
Carol (Nichols || Goulding) f98807936d test: Some tests don't call await, so they don't need to be async 2021-05-12 10:57:05 -04:00
Andrew Lamb ebea554e5a
feat: Report num_cpus seen by IOx on startup (#1484) 2021-05-12 13:42:16 +00:00
Marco Neumann 0b1ef52481
chore: upgrade arrow and datafusion (#1483) 2021-05-12 13:08:37 +00:00
kodiakhq[bot] 658c34009a
Merge pull request #1480 from influxdata/er/feat/read_buffer/num_rle 
refactor: shuffle encodings around in Read Buffer
 2021-05-12 10:30:13 +00:00
Edd Robinson 1416097a35
Merge branch 'main' into er/feat/read_buffer/num_rle 2021-05-11 23:30:55 +01:00
Edd Robinson aa83669740 refactor: move encodings to scalar module 2021-05-11 22:49:20 +01:00