8be95856ab
test: Add a test with multiple threads using a process clock
2021-05-12 13:31:26 -04:00
cecb4afc58
docs: Add some documentation on the assumptions around this design
2021-05-12 13:31:26 -04:00
b3fb61a0b3
refactor: Rename now_nanos to system_clock_now for clarity
2021-05-12 13:31:26 -04:00
425aacc391
refactor: Extract ProcessClock into its own type
2021-05-12 13:31:26 -04:00
b749353d21
refactor: Use a compare_exchange loop instead of Arc Mutex
2021-05-12 10:58:08 -04:00
5dfd152549
test: Use the now_nanos helper function more in tests
2021-05-12 10:58:08 -04:00
f28c9ae04c
docs: Add unit and semantic information about the process clock
2021-05-12 10:58:08 -04:00
513d4731be
feat: Add a process clock to Db and use it for Sequenced Entries
...
Connects to #1157 .
2021-05-12 10:58:06 -04:00
f98807936d
test: Some tests don't call await, so they don't need to be async
2021-05-12 10:57:05 -04:00
ebea554e5a
feat: Report num_cpus seen by IOx on startup ( #1484 )
2021-05-12 13:42:16 +00:00
0b1ef52481
chore: upgrade arrow and datafusion ( #1483 )
2021-05-12 13:08:37 +00:00
658c34009a
Merge pull request #1480 from influxdata/er/feat/read_buffer/num_rle
...
refactor: shuffle encodings around in Read Buffer
2021-05-12 10:30:13 +00:00
1416097a35
Merge branch 'main' into er/feat/read_buffer/num_rle
2021-05-11 23:30:55 +01:00
aa83669740
refactor: move encodings to scalar module
2021-05-11 22:49:20 +01:00
482e4dab86
refactor: shuffle string encodings
2021-05-11 22:47:42 +01:00
f86e0641fd
refactor: clarify benchmark
2021-05-11 22:47:42 +01:00
f5fe270e43
refactor: move benchmark
2021-05-11 22:47:36 +01:00
b02105e47b
feat: construct StringDictionary from PackedStringArray ( #1475 )
...
* feat: construct StringDictionary from PackedStringArray
* chore: fix formatting
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-11 20:16:25 +00:00
67984fbff5
Merge pull request #1474 from influxdata/er/feat/rb_metrics
...
fix: ensure metrics not overwriting
2021-05-11 20:06:16 +00:00
696e4e0cfd
fix: ensure metrics not overwriting
2021-05-11 20:57:31 +01:00
4409d2c8af
feat: instrument catalog locks ( #1464 )
...
* feat: instrument catalog locks (#1355 )
* chore: add metrics test
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-11 18:59:11 +00:00
9d0c3a2b1a
refactor: Remove multi-table per chunk code in MUB ( #1471 )
...
* refactor: Remove multi-table per chunk code in MUB
* fix: clippy
* fix: bench build
* fix: merge conflicts
2021-05-11 17:49:07 +00:00
c85d1574eb
feat: move dictionary and bitset into arrow_utils ( #1459 )
...
* feat: move dictionary and bitset into arrow_utils
* chore: review feedback
* chore: remove redundant dictionary methods
* chore: consistent type parameter name in PackedStringArray
* chore: review comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-11 16:43:38 +00:00
d1da954fe4
feat: don't store encoded strings twice in RLE dictionaries ( #1469 )
2021-05-11 15:22:25 +00:00
e00b4aaa24
feat: associate labels with a domain ( #1463 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-11 13:03:45 +00:00
be74eab3fd
Merge pull request #1468 from influxdata/er/feat/rb_metrics
...
feat: add in-depth column encoding metrics
2021-05-11 12:45:08 +00:00
32abe2e777
feat: wire up stats to metrics
2021-05-11 13:38:32 +01:00
c4987028fb
feat: expose all column stats
2021-05-11 13:00:52 +01:00
88ed58aa8a
feat: column statistics for int/float
2021-05-11 13:00:52 +01:00
ef2eda04ef
feat: add string encoder statistics
2021-05-11 13:00:52 +01:00
3622a92c8b
feat: wire in rb column metrics
2021-05-11 13:00:52 +01:00
767d6b66f6
Merge pull request #1448 from influxdata/crepererum/optional_stats_minmax
...
refactor: make `StatValues::{min,max}` optional + handle NaNs
2021-05-11 07:39:02 +00:00
6f106c49aa
Merge branch 'main' into crepererum/optional_stats_minmax
2021-05-11 07:35:13 +00:00
b6290f1ff3
chore: update deps ( #1466 )
2021-05-10 22:14:08 +00:00
795f5bfcb7
refactor: make `StatValues::{min,max}` optional + handle NaNs
...
This will allow us to:
- handle all-NULL columns correctly
- be in-line with Parquet (where min/max are optional)
- handle NaNs at least somewhat sane (they do not "poison" stats
anymore)
2021-05-10 17:12:25 +02:00
f037c1281a
feat: Calculate all system tables "on demand" ( #1452 )
...
* feat: compute system.columns table on demand
* feat: compute system.chunk_columns on demand
* feat: compute system.operations on demand
* fix: fixup schemas
* fix: Log errors
* fix: clippy
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-10 14:43:55 +00:00
8dcb4a54a2
Merge pull request #1456 from influxdata/fixrulesexistence
...
fix: Load only databases for which a config exists
2021-05-10 11:18:42 +00:00
9f5350a6c5
fix: Load only databases for which a config exists
...
Closes #1450
2021-05-10 13:14:22 +02:00
ebdab25a3c
Merge pull request #1453 from influxdata/ntran/e2e_with_unload
...
feat: Query Parquet files
2021-05-07 22:44:54 +00:00
c6b933eb63
chore: merge main to branch
2021-05-07 18:40:17 -04:00
6fc05769b1
Merge pull request #1458 from influxdata/cn/path-manipulation
...
fix: Use PathBuf rather than debug formatting and back to String
2021-05-07 21:41:04 +00:00
f2c19ec080
refactor: further address Carol's comment
2021-05-07 17:40:40 -04:00
1c61f9b485
Merge branch 'main' into cn/path-manipulation
2021-05-07 21:36:22 +00:00
971500681f
refactor: address Andrew's and Carol's comment
2021-05-07 17:33:19 -04:00
bc6ade4776
feat: Include system.chunk_columns` in the tables that are scraped ( #1455 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-07 20:31:04 +00:00
e2cc4634bf
fix: Use PathBuf rather than debug formatting and back to String
...
This is the same fix I made in 54c5f98
2021-05-07 15:58:11 -04:00
e2e3c9f77c
feat: workaround bug/limitation in OT handling of observers ( #1457 )
...
* feat: workardound bug/limitation in OT handling of observers
* chore: fix lints
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-07 18:53:28 +00:00
60f4b927e8
Merge pull request #1454 from influxdata/er/fix/null_rb_row_groups
...
fix: don't blow up on all null columns
2021-05-07 17:24:31 +00:00
4a414fc8fb
fix: don't blow up on all null columns
2021-05-07 17:31:18 +01:00
31d49db0ed
chore: a litlle more cleanup
2021-05-07 09:38:41 -04:00
Carol (Nichols || Goulding)
Andrew Lamb
Marco Neumann
kodiakhq[bot]
Edd Robinson
Raphael Taylor-Davies
Marko Mikulicic
Nga Tran