Commit Graph

6778 Commits (e6ec8ef5f345a9e3b91a414da154e256b6d35fe3)

Author SHA1 Message Date
Raphael Taylor-Davies 479276b8cd
docs: document ingest flow (#3418)
* docs: document ingest flow

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:37:30 +00:00
Andrew Lamb 80c048528c
refactor: Clean up code by using `lit` and `lit_timestamp_nano` rather than `Expr::Literal(ScalarValue(Some(...)))` (#3427) 2022-01-07 17:23:14 +00:00
Andrew Lamb 6d20ce1f9e
feat: Allow wipe catalog in `ReplayError` and `WriteBufferCreationError` states (#3425)
* feat: feat: Allow wipe catalog in ReplayError

* fix: comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:07:44 +00:00
Andrew Lamb 336ffd1966
refactor: Remove `Result` in QueryDatabase trait (none of the functions can fail) (#3422)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-06 22:03:08 +00:00
Andrew Lamb 8d732ad78c
refactor: Split database.rs into smaller modules (#3424)
* refactor: Split database.rs into smaller modules

* fix: clippy
2022-01-06 21:42:36 +00:00
Andrew Lamb a93ae739a9
feat: Add table_name to Partition API (#3421) 2022-01-06 16:38:39 +00:00
Raphael Taylor-Davies 5b71306423
chore: lint markdown docs and use relative code references in docs (#3420)
* chore: lint markdown docs

docs: relative source file references in markdown docs

* chore: review feedback
2022-01-04 09:50:13 +00:00
Carol (Nichols || Goulding) f9174c483b
refactor: Extract server::db into its own crate (#3417)
* refactor: Extract JobRegistry from the server crate

Both the server crate and a db crate that I'm about to extract depend on
JobRegistry, so to avoid making circular dependencies, extract the
JobRegistry to its own crate.

* refactor: Move db out of server into its own crate

Fixes #2821.
2021-12-23 22:01:17 +00:00
Andrew Lamb 527885f7f8
chore: Update datafusion (#3413)
* chore: Update datafusion and update code to handle timezone aware timestamps

* fix: cargo hakari

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 14:52:12 +00:00
Carol (Nichols || Goulding) 2c3ca0c77c
docs: Add doc comments to all CLI subcommands (#3414)
* docs: Add doc comments to all CLI subcommands

* docs: Update influxdb_iox/src/commands/database/recover.rs

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 12:17:39 +00:00
Andrew Lamb b3f74a555f
fix: Remove outdated arrow advisories (#3416) 2021-12-23 11:19:27 +00:00
Carol (Nichols || Goulding) 5aaee1bcf4
fix: Remove some straggling references to writer ID that should be server ID (#3415)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-22 21:05:38 +00:00
kodiakhq[bot] c71acd2108
Merge pull request #3408 from influxdata/er/feat/tag_values_tag_key_pred
feat: add support for predicates on SHOW TAG VALUES WITH KEY = pred
2021-12-22 10:45:13 +00:00
Edd Robinson c631dd4267 refactor: address PR feedback 2021-12-21 10:23:12 +00:00
Edd Robinson 200c32cb32 feat: support all tag key predicates 2021-12-21 10:23:12 +00:00
kodiakhq[bot] c949281aa6
Merge pull request #3378 from influxdata/ntran/doc_catalogs
docs: IOx Catalogs
2021-12-20 19:10:51 +00:00
kodiakhq[bot] 2b8d1a1ed4
Merge branch 'main' into ntran/doc_catalogs 2021-12-20 19:01:34 +00:00
Nga Tran b943f176a0 fix: update diagram per review feedback 2021-12-20 14:00:53 -05:00
Nga Tran 0a2521c6cb
chore: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:56:02 -05:00
Nga Tran f2e22bdb1c
chore: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:55:07 -05:00
Nga Tran d2ea7a8eba
chore: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:49:26 -05:00
Nga Tran e574c5e10f docs: add a reference 2021-12-20 09:50:54 -05:00
kodiakhq[bot] 28a7ce0f48
Merge pull request #3406 from influxdata/er/feat/grpc_tag_values_gb_meas_simple
feat: increase support for TagValuesGroupedByMeasurementAndTagKey
2021-12-20 12:35:55 +00:00
Nga Tran bd914c6727 fix: typos 2021-12-17 17:36:56 -05:00
Nga Tran 548653d934 docs: re structure the doc to reflect review comments 2021-12-17 17:18:06 -05:00
Nga Tran 218032c73b chore: Merge branch 'main' into ntran/doc_catalogs 2021-12-17 13:56:06 -05:00
Edd Robinson 5b277c8754 test: exercise show tag values 2021-12-17 17:59:30 +00:00
Edd Robinson 119e579fa3 feat: add support for tag values grouped by measurement and tag key 2021-12-17 17:59:30 +00:00
Edd Robinson a68d71ef06 feat: add ability to materialise measurements 2021-12-17 17:59:30 +00:00
Edd Robinson ebbf86dc1d refactor: impl stub 2021-12-17 17:59:30 +00:00
Edd Robinson 3fde298a99 refactor: handle rpc 2021-12-17 17:59:30 +00:00
kodiakhq[bot] d8c5e8ef31
Merge pull request #3367 from influxdata/ntran/doc_data_org_lifecycle
docs: IOx Data Organization and Lifecycle
2021-12-17 17:35:50 +00:00
Nga Tran 59bba2646f
Merge branch 'main' into ntran/doc_data_org_lifecycle 2021-12-17 12:25:19 -05:00
Nga Tran 2091007c08 fix: title of next topic 2021-12-17 12:22:06 -05:00
Nga Tran 1c962b05a4 fix: address review comments 2021-12-17 12:18:28 -05:00
kodiakhq[bot] c14674a212
Merge pull request #3393 from influxdata/crepererum/issue3226
refactor: make object store prefixes segment based
2021-12-17 16:46:52 +00:00
kodiakhq[bot] 099d9dc6e1
Merge branch 'main' into crepererum/issue3226 2021-12-17 16:37:16 +00:00
Carol (Nichols || Goulding) 24fd2e549b
docs: Fix some typos and outdated comments 2021-12-17 11:33:36 -05:00
Nga Tran 8be572812d
chore: Apply suggestions from code review
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-17 11:23:20 -05:00
kodiakhq[bot] d0f588d3b8
Merge pull request #3391 from influxdata/crepererum/object_store_azure_test
test: `objest_store` azure support via Azurite
2021-12-17 08:39:03 +00:00
Marco Neumann 9f2694bf1b test: `objest_store` azure support via Azurite 2021-12-17 09:30:21 +01:00
Andrew Lamb 64f915d860
fix: flaky end to end system_tables test (#3397) 2021-12-17 08:13:09 +00:00
kodiakhq[bot] c6ddfb4799
Merge pull request #3384 from influxdata/pd/add-big-db-dg-schema
chore: add data generator config for large database
2021-12-16 15:22:42 +00:00
kodiakhq[bot] 32b7f6e658
Merge branch 'main' into pd/add-big-db-dg-schema 2021-12-16 15:11:54 +00:00
Marco Neumann 61ee70d222 refactor: make object store prefixes segment based
Don't use string prefixes, e.g. `foo/bar/` is a prefix of `foo/bar/x`
but NOT of `foo/bar_baz/y`.

This also removes some heuristics during the cloud storage parsing that
assumed that file names always contain a dot but directories don't.

Technically we should now always be able to know whether a path points
to a file or a directory:

- Rust (manually constructed): we use `DirsAndFileName` which knows the
  difference (i.e. if `file_name` is set)
- in-mem store: we also use `DirsAndFileName`
- file system: this was fixed by #1523
  (ccd094dfcf and 464667d8b8)
- cloud: cloud doesn't know about directories. So all paths that these
  APIs return and that end with a `/` are directories (can only occur in
  `list_with_delimiter`); everyting else is a file

Path string representations are now acting occurdingly (i.e. always end
with an `/` if they point to a directory).

Fixes #3226.
2021-12-16 14:40:45 +01:00
Andrew Lamb ccba68fe3e
chore: Update datafusion and sqlparser, and arrow (#3385)
* chore: Update datafusion and sqlparser, and arrow

* fix: cargo hakari

* test: fix metadata size

* fix: update some metadata sizes

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-16 12:13:40 +00:00
Raphael Taylor-Davies 2f3e25922a
refactor: use redpanda docker image (#3390)
* refactor: use redpanda docker image

* chore: remove unused gpg key
2021-12-16 11:59:10 +00:00
kodiakhq[bot] edcc2b5b99
Merge pull request #3388 from influxdata/crepererum/object_store_aws_test
test: `object_store` aws test using localstack
2021-12-16 11:41:43 +00:00
kodiakhq[bot] 32d8c9bf5f
Merge branch 'main' into crepererum/object_store_aws_test 2021-12-16 11:32:26 +00:00
Marco Neumann 36ba011653 docs: explain CI docker images 2021-12-16 12:31:55 +01:00