7f77a01e61
chore: merged main to branch and resolved conflicts
2021-04-12 12:09:04 -04:00
e86a02efa7
refactor: Address comments and add more tests
2021-04-12 11:46:31 -04:00
453aeaf1a0
feat: Add tests for writing RB chunks to Object Store
2021-04-09 17:39:23 -04:00
078c0f3fda
refactor: lift chunk and table summaries out of DBChunk ( #1162 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-09 12:00:47 +00:00
e76980928b
feat: Implement Update API
2021-04-08 22:25:36 +00:00
738134004e
feat: implement memory tracking on read buffer
2021-04-08 18:20:37 +00:00
bd3816a6c9
chore: merge main to branch
2021-04-08 10:59:33 -04:00
d429cf9aeb
refactor: tighten up Read Buffer API
2021-04-08 10:24:19 +00:00
dae9f12593
refactor: remove deprecated API
2021-04-08 10:24:19 +00:00
232d6ec439
refactor: appease clippy gods
2021-04-08 10:19:11 +00:00
bd21cf5d24
refactor: remove read buffer db from db
2021-04-08 10:19:11 +00:00
17853266ce
refactor: add helper method for all names
2021-04-08 10:19:11 +00:00
c32fe3decd
chore: clean up
2021-04-07 21:43:45 -04:00
f501a74aea
refactor: Address review comments
2021-04-07 21:28:03 -04:00
be6e1e48e4
feat: add writer_id and object_store in Db
2021-04-07 18:36:07 -04:00
319e66706e
Merge branch 'main' into cn/no-more-test-results
2021-04-07 16:45:32 +00:00
82588d5c72
fix: Don't return Result from test functions
2021-04-07 12:40:00 -04:00
c2355aca6d
feat: add basic memory tracking ( #1125 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-07 15:38:24 +00:00
3769ad3d21
test: update test
2021-04-07 10:46:08 +00:00
d4c090cb84
refactor: extract OnceNonZeroU32 ( #1134 )
2021-04-06 21:38:04 +00:00
864f9bcd35
fix: avoid spamming the logs with errors that are not errors ( #1129 )
...
* fix: avoid spamming the logs with errors that are not errors
* fix: make it compile
* fix: change to warning, add database name
* fix: include buffer_size and soft_limit as well
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 20:21:56 +00:00
ef2dc952e1
feat: write once writer id ( #1131 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 17:51:57 +00:00
5cd1d6691d
refactor: use DatabaseName in DatabaseRules ( #1127 )
2021-04-06 13:26:30 +00:00
7cc9f06e74
chore: Update arrow / datafusion deps again ( #1126 )
...
* chore: Update arrow dependencies
* test: add test for SHOW COLUMNS
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 12:41:41 +00:00
9a2e636d8c
refactor: move tracking utilities into separate crate ( #1124 )
2021-04-06 11:43:11 +00:00
6e01fbc382
feat: ause TableSummary as metadata for parquet chunk's tables and read buffer's read_filter ot get data
2021-04-05 15:37:34 -04:00
59bd66a33a
refactor: Merge remote-tracking branch 'origin' into ntran/write_parquet_3
2021-04-05 09:40:08 -04:00
80d55d0829
chore: rename tracing_deps to observability_deps
...
OpenTelemetry makes this necessary.
2021-04-02 13:14:30 -07:00
4bdf8963e6
feat: continue buidling foundation for writing RB chunks to parquet files
2021-04-02 16:06:25 -04:00
5a04c85da5
Merge branch 'main' into ntran/parquet_write_2
2021-04-02 14:43:46 +00:00
0b880d3534
chore: Group all tracing-related crates under one crate for easier upgrade management
2021-04-02 09:54:39 -04:00
eba799e4e7
Merge branch 'main' into ntran/parquet_write_2
2021-04-01 21:54:19 +00:00
839fe514a2
fix: do not make rows for empty partitions or empty tables
2021-04-01 21:22:04 +00:00
18ca5c5292
refactor: Implement `as_str()` directly rather than using a crate
2021-04-01 21:22:04 +00:00
e52c6a8292
test: Add / update query tests
2021-04-01 21:22:04 +00:00
d0e901f503
chore: fix row_estimate to match comment
2021-04-01 21:22:04 +00:00
c0abeba792
feat: system tables
2021-04-01 21:22:04 +00:00
f66c67692c
feat: add 2 more chunk states for writing chunks to object store
2021-04-01 17:04:08 -04:00
49267114d3
chore: merge main into branch and resolve conflicts
2021-04-01 13:22:49 -04:00
1463c6645f
feat: Add ChunkState::ObjectStore and rename ParquetChunk to Chunk
2021-04-01 11:53:03 -04:00
3a150594ab
refactor: push chunk and partition summary into catalog ( #1103 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-01 13:34:21 +00:00
a59a6edbb8
feat: add SHOW TABLES and `select * from information_schema.columns` ( #1102 )
...
* chore: update dependencies
* test: add tests for new information schema
2021-04-01 12:50:37 +00:00
0d599eeaf4
refactor: remove Db::writeable ( #1101 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-01 11:45:40 +00:00
b0e21e5f9e
feat: automated chunk lifecycle ( #1091 )
...
* feat: automated chunk lifecycle
* chore: use >= for lifecycle timestamp comparisons
* chore: review fixes
2021-04-01 11:05:58 +00:00
8f69a12ec6
refactor: Add rwlock around db rules
2021-04-01 10:43:46 +00:00
de25dc1b53
refactor: remove stuff moved to different crate
2021-03-31 20:02:34 -04:00
19a453a483
feat: finally have some framework with clear todos for writing a chunk into parquet files
2021-03-31 16:21:53 -04:00
b61875e0b2
feat: Add TableSummary calculation to ReadBuffer ( #1092 )
2021-03-31 16:26:37 +00:00
569f90d937
feat: Add ability to get PartitionSummary statistics from a Db ( #1090 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-31 14:18:53 +00:00
13612047c0
feat: chunk sorting ( #1077 )
2021-03-31 12:30:59 +00:00
Nga Tran
Raphael Taylor-Davies
Marko Mikulicic
Edd Robinson
kodiakhq[bot]
Carol (Nichols || Goulding)
Andrew Lamb
Jacob Marble
Andrew Lamb
Raphael Taylor-Davies