Commit Graph

2252 Commits (bc3560af8ce090042fd39bd82959b1aa2b440347)

Author SHA1 Message Date
Edd Robinson bc3560af8c test: add coverage for has_table 2021-04-07 10:46:08 +00:00
Edd Robinson 0c32cb48c7 feat: add read_filter schema method 2021-04-07 10:46:08 +00:00
Edd Robinson d39fe8abf8 refactor: add ability to upsert table 2021-04-07 10:46:08 +00:00
Edd Robinson 2129c2a725 refactor: make some methods crate-visible 2021-04-07 10:46:08 +00:00
Edd Robinson 5eea06c9b3 refactor: allow empty chunks 2021-04-07 10:46:08 +00:00
Marko Mikulicic 82ed5d1708 fix: Deep clone small results over flight
Workaround for #1133
2021-04-07 10:41:29 +00:00
kodiakhq[bot] ba2ac64f80
Merge pull request #1122 from influxdata/pd-lp-to-entry
feat: implement line protocol to flatbuffers
2021-04-06 22:57:17 +00:00
Paul Dix 531ffe7ab0 chore: fix fmt and add comment to entry.fbs 2021-04-06 18:53:22 -04:00
Paul Dix a7659addbe chore: cleanup entry.rs based on PR feedback and add better errors 2021-04-06 17:56:58 -04:00
Paul Dix 2a134a3ac1 feat: implment line protocol to flatbuffers
This implements a builder for converting line protocol to the Entry flatbuffers. It also contains wrapper structs to make working with the flatbuffers a little easier.

The flatbuffer needed an addition to keep track of how many bits in the null mask should be used.
2021-04-06 17:56:56 -04:00
Raphael Taylor-Davies d4c090cb84
refactor: extract OnceNonZeroU32 (#1134) 2021-04-06 21:38:04 +00:00
Andrew Lamb 864f9bcd35
fix: avoid spamming the logs with errors that are not errors (#1129)
* fix: avoid spamming the logs with errors that are not errors

* fix: make it compile

* fix: change to warning, add database name

* fix: include buffer_size and soft_limit as well

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 20:21:56 +00:00
Raphael Taylor-Davies ef2dc952e1
feat: write once writer id (#1131)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 17:51:57 +00:00
Raphael Taylor-Davies bef1bd2076
fix: disable minimum age by default (#1128) 2021-04-06 16:55:08 +00:00
Raphael Taylor-Davies 5cd1d6691d
refactor: use DatabaseName in DatabaseRules (#1127) 2021-04-06 13:26:30 +00:00
Andrew Lamb 7cc9f06e74
chore: Update arrow / datafusion deps again (#1126)
* chore: Update arrow dependencies

* test: add test for SHOW COLUMNS

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-06 12:41:41 +00:00
Raphael Taylor-Davies 9a2e636d8c
refactor: move tracking utilities into separate crate (#1124) 2021-04-06 11:43:11 +00:00
kodiakhq[bot] 081c208ad3
Merge pull request #1112 from influxdata/ntran/write_parquet_3
feat: continue building foundation for writing RB chunks to parquet files
2021-04-05 20:46:18 +00:00
kodiakhq[bot] 872be9097c
Merge branch 'main' into ntran/write_parquet_3 2021-04-05 20:42:08 +00:00
Nga Tran 6e01fbc382 feat: ause TableSummary as metadata for parquet chunk's tables and read buffer's read_filter ot get data 2021-04-05 15:37:34 -04:00
Carol (Nichols || Goulding) 4e25147062
docs: Codify our preference for no return type in test functions (#1116)
* docs: Copy edit existing style guide

I can't help myself.

* docs: Codify our preference for no return type in test functions
2021-04-05 18:12:51 +00:00
kodiakhq[bot] 978d9066e3
Merge pull request #1115 from influxdata/cn/remove-gha
chore: Remove GitHub Actions config
2021-04-05 15:03:54 +00:00
Carol (Nichols || Goulding) 5f789ca4b9 chore: Remove GitHub Actions config; all CircleCI now 2021-04-05 10:56:52 -04:00
kodiakhq[bot] dbb932291c
Merge pull request #1114 from influxdata/alamb/better_descriptions
docs: Improve influxdb_iox_client module descriptions
2021-04-05 14:42:56 +00:00
Nga Tran 59bd66a33a refactor: Merge remote-tracking branch 'origin' into ntran/write_parquet_3 2021-04-05 09:40:08 -04:00
Andrew Lamb 3034b7e76d docs: Improve influxdb_iox_client module descriptions 2021-04-05 09:33:52 -04:00
kodiakhq[bot] af025879aa
Merge pull request #1113 from influxdata/jgm-observability
chore: rename tracing_deps to observability_deps
2021-04-02 20:30:14 +00:00
Jacob Marble 80d55d0829 chore: rename tracing_deps to observability_deps
OpenTelemetry makes this necessary.
2021-04-02 13:14:30 -07:00
Nga Tran 4bdf8963e6 feat: continue buidling foundation for writing RB chunks to parquet files 2021-04-02 16:06:25 -04:00
kodiakhq[bot] cf93c91973
Merge pull request #1111 from influxdata/jgm-metrics
feat: add Prometheus metrics endpoint
2021-04-02 16:59:22 +00:00
Jacob Marble 89205bb3c6 chore: improve comments and simplify a bit 2021-04-02 09:43:56 -07:00
Jacob Marble e885cf072e feat: add Prometheus metrics endpoint
This change adds HTTP endpoint /metrics. Now, I need to add a metric.
2021-04-02 09:35:16 -07:00
kodiakhq[bot] 90e13a7f89
Merge pull request #1108 from influxdata/ntran/parquet_write_2
feat: add 2 more chunk states for writing chunks to object store
2021-04-02 14:57:56 +00:00
kodiakhq[bot] 5a04c85da5
Merge branch 'main' into ntran/parquet_write_2 2021-04-02 14:43:46 +00:00
kodiakhq[bot] 6cc84c8a50
Merge pull request #1110 from influxdata/cn/trace-together
chore: Group all tracing-related crates under one crate for easier upgrade management
2021-04-02 14:41:28 +00:00
Carol (Nichols || Goulding) 0b880d3534 chore: Group all tracing-related crates under one crate for easier upgrade management 2021-04-02 09:54:39 -04:00
kodiakhq[bot] eba799e4e7
Merge branch 'main' into ntran/parquet_write_2 2021-04-01 21:54:19 +00:00
Andrew Lamb 839fe514a2 fix: do not make rows for empty partitions or empty tables 2021-04-01 21:22:04 +00:00
Andrew Lamb 18ca5c5292 refactor: Implement `as_str()` directly rather than using a crate 2021-04-01 21:22:04 +00:00
Andrew Lamb e52c6a8292 test: Add / update query tests 2021-04-01 21:22:04 +00:00
Raphael Taylor-Davies d0e901f503 chore: fix row_estimate to match comment 2021-04-01 21:22:04 +00:00
Raphael Taylor-Davies c0abeba792 feat: system tables 2021-04-01 21:22:04 +00:00
Nga Tran f66c67692c feat: add 2 more chunk states for writing chunks to object store 2021-04-01 17:04:08 -04:00
kodiakhq[bot] 30701bff3e
Merge pull request #1097 from influxdata/ntran/parquet_write
feat: Write Chunks to Parquet Files in Object Store
2021-04-01 17:37:51 +00:00
Nga Tran 49267114d3 chore: merge main into branch and resolve conflicts 2021-04-01 13:22:49 -04:00
Nga Tran 1463c6645f feat: Add ChunkState::ObjectStore and rename ParquetChunk to Chunk 2021-04-01 11:53:03 -04:00
Raphael Taylor-Davies 3a150594ab
refactor: push chunk and partition summary into catalog (#1103)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-01 13:34:21 +00:00
Andrew Lamb a59a6edbb8
feat: add SHOW TABLES and `select * from information_schema.columns` (#1102)
* chore: update dependencies

* test: add tests for new information schema
2021-04-01 12:50:37 +00:00
Raphael Taylor-Davies 0d599eeaf4
refactor: remove Db::writeable (#1101)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-01 11:45:40 +00:00
Raphael Taylor-Davies b0e21e5f9e
feat: automated chunk lifecycle (#1091)
* feat: automated chunk lifecycle

* chore: use >= for lifecycle timestamp comparisons

* chore: review fixes
2021-04-01 11:05:58 +00:00