Raphael Taylor-Davies
479276b8cd
docs: document ingest flow ( #3418 )
...
* docs: document ingest flow
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:37:30 +00:00
Andrew Lamb
80c048528c
refactor: Clean up code by using `lit` and `lit_timestamp_nano` rather than `Expr::Literal(ScalarValue(Some(...)))` ( #3427 )
2022-01-07 17:23:14 +00:00
Andrew Lamb
6d20ce1f9e
feat: Allow wipe catalog in `ReplayError` and `WriteBufferCreationError` states ( #3425 )
...
* feat: feat: Allow wipe catalog in ReplayError
* fix: comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:07:44 +00:00
Andrew Lamb
336ffd1966
refactor: Remove `Result` in QueryDatabase trait (none of the functions can fail) ( #3422 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-06 22:03:08 +00:00
Andrew Lamb
8d732ad78c
refactor: Split database.rs into smaller modules ( #3424 )
...
* refactor: Split database.rs into smaller modules
* fix: clippy
2022-01-06 21:42:36 +00:00
Andrew Lamb
a93ae739a9
feat: Add table_name to Partition API ( #3421 )
2022-01-06 16:38:39 +00:00
Raphael Taylor-Davies
5b71306423
chore: lint markdown docs and use relative code references in docs ( #3420 )
...
* chore: lint markdown docs
docs: relative source file references in markdown docs
* chore: review feedback
2022-01-04 09:50:13 +00:00
Carol (Nichols || Goulding)
f9174c483b
refactor: Extract server::db into its own crate ( #3417 )
...
* refactor: Extract JobRegistry from the server crate
Both the server crate and a db crate that I'm about to extract depend on
JobRegistry, so to avoid making circular dependencies, extract the
JobRegistry to its own crate.
* refactor: Move db out of server into its own crate
Fixes #2821 .
2021-12-23 22:01:17 +00:00
Andrew Lamb
527885f7f8
chore: Update datafusion ( #3413 )
...
* chore: Update datafusion and update code to handle timezone aware timestamps
* fix: cargo hakari
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 14:52:12 +00:00
Carol (Nichols || Goulding)
2c3ca0c77c
docs: Add doc comments to all CLI subcommands ( #3414 )
...
* docs: Add doc comments to all CLI subcommands
* docs: Update influxdb_iox/src/commands/database/recover.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 12:17:39 +00:00
Andrew Lamb
b3f74a555f
fix: Remove outdated arrow advisories ( #3416 )
2021-12-23 11:19:27 +00:00
Carol (Nichols || Goulding)
5aaee1bcf4
fix: Remove some straggling references to writer ID that should be server ID ( #3415 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-22 21:05:38 +00:00
kodiakhq[bot]
c71acd2108
Merge pull request #3408 from influxdata/er/feat/tag_values_tag_key_pred
...
feat: add support for predicates on SHOW TAG VALUES WITH KEY = pred
2021-12-22 10:45:13 +00:00
Edd Robinson
c631dd4267
refactor: address PR feedback
2021-12-21 10:23:12 +00:00
Edd Robinson
200c32cb32
feat: support all tag key predicates
2021-12-21 10:23:12 +00:00
kodiakhq[bot]
c949281aa6
Merge pull request #3378 from influxdata/ntran/doc_catalogs
...
docs: IOx Catalogs
2021-12-20 19:10:51 +00:00
kodiakhq[bot]
2b8d1a1ed4
Merge branch 'main' into ntran/doc_catalogs
2021-12-20 19:01:34 +00:00
Nga Tran
b943f176a0
fix: update diagram per review feedback
2021-12-20 14:00:53 -05:00
Nga Tran
0a2521c6cb
chore: Apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:56:02 -05:00
Nga Tran
f2e22bdb1c
chore: Apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:55:07 -05:00
Nga Tran
d2ea7a8eba
chore: Apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:49:26 -05:00
Nga Tran
e574c5e10f
docs: add a reference
2021-12-20 09:50:54 -05:00
kodiakhq[bot]
28a7ce0f48
Merge pull request #3406 from influxdata/er/feat/grpc_tag_values_gb_meas_simple
...
feat: increase support for TagValuesGroupedByMeasurementAndTagKey
2021-12-20 12:35:55 +00:00
Nga Tran
bd914c6727
fix: typos
2021-12-17 17:36:56 -05:00
Nga Tran
548653d934
docs: re structure the doc to reflect review comments
2021-12-17 17:18:06 -05:00
Nga Tran
218032c73b
chore: Merge branch 'main' into ntran/doc_catalogs
2021-12-17 13:56:06 -05:00
Edd Robinson
5b277c8754
test: exercise show tag values
2021-12-17 17:59:30 +00:00
Edd Robinson
119e579fa3
feat: add support for tag values grouped by measurement and tag key
2021-12-17 17:59:30 +00:00
Edd Robinson
a68d71ef06
feat: add ability to materialise measurements
2021-12-17 17:59:30 +00:00
Edd Robinson
ebbf86dc1d
refactor: impl stub
2021-12-17 17:59:30 +00:00
Edd Robinson
3fde298a99
refactor: handle rpc
2021-12-17 17:59:30 +00:00
kodiakhq[bot]
d8c5e8ef31
Merge pull request #3367 from influxdata/ntran/doc_data_org_lifecycle
...
docs: IOx Data Organization and Lifecycle
2021-12-17 17:35:50 +00:00
Nga Tran
59bba2646f
Merge branch 'main' into ntran/doc_data_org_lifecycle
2021-12-17 12:25:19 -05:00
Nga Tran
2091007c08
fix: title of next topic
2021-12-17 12:22:06 -05:00
Nga Tran
1c962b05a4
fix: address review comments
2021-12-17 12:18:28 -05:00
kodiakhq[bot]
c14674a212
Merge pull request #3393 from influxdata/crepererum/issue3226
...
refactor: make object store prefixes segment based
2021-12-17 16:46:52 +00:00
kodiakhq[bot]
099d9dc6e1
Merge branch 'main' into crepererum/issue3226
2021-12-17 16:37:16 +00:00
Carol (Nichols || Goulding)
24fd2e549b
docs: Fix some typos and outdated comments
2021-12-17 11:33:36 -05:00
Nga Tran
8be572812d
chore: Apply suggestions from code review
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-17 11:23:20 -05:00
kodiakhq[bot]
d0f588d3b8
Merge pull request #3391 from influxdata/crepererum/object_store_azure_test
...
test: `objest_store` azure support via Azurite
2021-12-17 08:39:03 +00:00
Marco Neumann
9f2694bf1b
test: `objest_store` azure support via Azurite
2021-12-17 09:30:21 +01:00
Andrew Lamb
64f915d860
fix: flaky end to end system_tables test ( #3397 )
2021-12-17 08:13:09 +00:00
kodiakhq[bot]
c6ddfb4799
Merge pull request #3384 from influxdata/pd/add-big-db-dg-schema
...
chore: add data generator config for large database
2021-12-16 15:22:42 +00:00
kodiakhq[bot]
32b7f6e658
Merge branch 'main' into pd/add-big-db-dg-schema
2021-12-16 15:11:54 +00:00
Marco Neumann
61ee70d222
refactor: make object store prefixes segment based
...
Don't use string prefixes, e.g. `foo/bar/` is a prefix of `foo/bar/x`
but NOT of `foo/bar_baz/y`.
This also removes some heuristics during the cloud storage parsing that
assumed that file names always contain a dot but directories don't.
Technically we should now always be able to know whether a path points
to a file or a directory:
- Rust (manually constructed): we use `DirsAndFileName` which knows the
difference (i.e. if `file_name` is set)
- in-mem store: we also use `DirsAndFileName`
- file system: this was fixed by #1523
(ccd094dfcf
and 464667d8b8
)
- cloud: cloud doesn't know about directories. So all paths that these
APIs return and that end with a `/` are directories (can only occur in
`list_with_delimiter`); everyting else is a file
Path string representations are now acting occurdingly (i.e. always end
with an `/` if they point to a directory).
Fixes #3226 .
2021-12-16 14:40:45 +01:00
Andrew Lamb
ccba68fe3e
chore: Update datafusion and sqlparser, and arrow ( #3385 )
...
* chore: Update datafusion and sqlparser, and arrow
* fix: cargo hakari
* test: fix metadata size
* fix: update some metadata sizes
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-16 12:13:40 +00:00
Raphael Taylor-Davies
2f3e25922a
refactor: use redpanda docker image ( #3390 )
...
* refactor: use redpanda docker image
* chore: remove unused gpg key
2021-12-16 11:59:10 +00:00
kodiakhq[bot]
edcc2b5b99
Merge pull request #3388 from influxdata/crepererum/object_store_aws_test
...
test: `object_store` aws test using localstack
2021-12-16 11:41:43 +00:00
kodiakhq[bot]
32d8c9bf5f
Merge branch 'main' into crepererum/object_store_aws_test
2021-12-16 11:32:26 +00:00
Marco Neumann
36ba011653
docs: explain CI docker images
2021-12-16 12:31:55 +01:00