dfdc964f64
chore(deps): Bump insta from 1.24.1 to 1.26.0 ( #6534 )
...
* chore(deps): Bump insta from 1.24.1 to 1.26.0
Bumps [insta](https://github.com/mitsuhiko/insta ) from 1.24.1 to 1.26.0.
- [Release notes](https://github.com/mitsuhiko/insta/releases )
- [Changelog](https://github.com/mitsuhiko/insta/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mitsuhiko/insta/compare/1.24.1...1.26.0 )
---
updated-dependencies:
- dependency-name: insta
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* chore: Run cargo hakari tasks
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-09 08:02:08 +00:00
e31c84a794
chore(deps): Bump async-trait from 0.1.60 to 0.1.61 ( #6533 )
...
Bumps [async-trait](https://github.com/dtolnay/async-trait ) from 0.1.60 to 0.1.61.
- [Release notes](https://github.com/dtolnay/async-trait/releases )
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.60...0.1.61 )
---
updated-dependencies:
- dependency-name: async-trait
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-09 07:44:35 +00:00
29df5d7fcb
fix: create statistics for nulled columns in RecordBatchExec ( #6527 )
2023-01-09 07:37:10 +00:00
b20226797a
fix: make trigger midification in different file ( #6526 )
2023-01-06 20:34:48 +00:00
4031ea1c10
feat: integrate new way to get partition candidates for hot compaction ( #6525 )
...
* feat: integrate new way to get partition candidates for hot compaction
* chore: rename
2023-01-06 18:51:52 +00:00
b856edf826
feat: function to get parttion candidates from partition table ( #6519 )
...
* feat: function to get parttion candidates from partition table
* chore: cleanup
* fix: make new_file_at the same value as created_at
* chore: cleanup
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-06 16:20:45 +00:00
c87e1c8fe2
Merge pull request #6523 from influxdata/alamb-patch-1
...
docs: Update docstring on Schema
2023-01-06 11:23:21 +00:00
9a0db0ec30
Merge branch 'main' into alamb-patch-1
2023-01-06 11:16:52 +00:00
f0141bcb41
fix: fmt
2023-01-06 06:13:40 -05:00
544f5c5bff
fix: Update schema/src/lib.rs
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2023-01-06 06:13:04 -05:00
e1036a0c63
refactor: cleanup schema boxing ( #6511 )
...
* refactor: cleanup Schema boxing
* chore: clippy
2023-01-06 10:57:39 +00:00
ba844ddf03
docs: Update docstring on Schema
2023-01-06 05:49:49 -05:00
2037db7f7b
refactor: decouple influxql from SchemaProvider ( #6507 )
...
* refactor: decouple influxql from SchemaProvider
* refactor: reorder arguments
* refactor: use QueryNamespaceMeta
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-06 07:36:29 +00:00
23807df7a9
feat: trigger that updates partition table when a parquet file is created ( #6514 )
...
* feat: trigger that update partition table when a parquet file is created
* chore: simplify epoch of now
2023-01-05 19:57:23 +00:00
e1d0bcdaad
Merge pull request #6494 from influxdata/dom/replication-proto
...
feat(replication): define replication RPC API
2023-01-05 13:51:16 +00:00
69ce1b8fbf
Merge branch 'main' into dom/replication-proto
2023-01-05 13:45:00 +00:00
9f858d1dd5
Merge pull request #6509 from influxdata/dom/router-startup-offline-ingester
...
fix(router2): drive ingester node (re)-discovery
2023-01-05 13:33:49 +00:00
3f22af9183
Merge branch 'main' into dom/router-startup-offline-ingester
2023-01-05 13:26:54 +00:00
9ab86fa154
fix(router2): drive ingester node (re)-discovery
...
The tonic / tower load-balance implementation discards failed nodes,
even when using a static list - this causes nodes that fail once to
never be retried.
This doesn't happen for the last node for some reason, and leads to all
the load from one router hitting a single ingester instead of load
balancing across all ingesters.
This commit adds a hack to constantly tell the load balancer to probe
all nodes, hopefully causing them to re-discover previously failed
nodes. I don't have the time to do this properly :(
2023-01-05 14:06:29 +01:00
6f4b128285
refactor: improve "Parquet files after filtering" dbg log ( #6502 )
...
- Place IDs last because they may hit the "max line length" limit and be
truncated. The other information should NOT be truncated with it.
- Unpack IDs to integer to remove useless `ParquetFileID(...)` wrappers
in output.
- Print number of files in addition to the actual list to simplify
debugging.
2023-01-05 11:13:33 +00:00
c2f479d370
Merge branch 'main' into dom/replication-proto
2023-01-05 11:00:32 +00:00
0431ef9b71
Merge pull request #6499 from influxdata/dependabot/cargo/arrow-string-30.0.0
...
chore(deps): Bump arrow-string from 29.0.0 to 30.0.0
2023-01-05 11:00:23 +00:00
3eba1153d6
chore(deps): Bump arrow-ord from 29.0.0 to 30.0.0 ( #6501 )
...
* chore(deps): Bump arrow-ord from 29.0.0 to 30.0.0
Bumps [arrow-ord](https://github.com/apache/arrow-rs ) from 29.0.0 to 30.0.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md )
- [Commits](https://github.com/apache/arrow-rs/compare/29.0.0...30.0.0 )
---
updated-dependencies:
- dependency-name: arrow-ord
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
* chore: Run cargo hakari tasks
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: Dom <dom@itsallbroken.com>
2023-01-05 10:46:12 +00:00
d72835564a
Merge branch 'main' into dependabot/cargo/arrow-string-30.0.0
2023-01-05 10:40:13 +00:00
b0b15de272
Merge pull request #6504 from influxdata/dom/router-startup-offline-ingester
...
fix(router2): lazily connect to ingesters
2023-01-05 10:39:18 +00:00
a5a26f5efb
fix(router2): lazily connect to ingesters
...
Allow the routers to start up without requiring full availability of all
downstream ingesters. Previously a single unavailable ingester prevented
the routers from starting up.
This has downsides:
* Lazily initialising a connection will cause the first writes to have
higher latency as the connection is established.
* The routers MAY come up in a state that will never work (i.e. bad
ingester addresses)
* Using the opaque gRPC load balancing mechanism restricts the
visibility into which nodes are up/down (hindering useful log
messages) and prevents us from implementing more advanced circuit
breaking / probing logic / load-balancing strategies.
This change is a quick fix - it leaves the round-robin handler in place,
load-balancing over a single tonic Channel, which internally
load-balances. This will need cleaning up.
2023-01-05 11:25:35 +01:00
84485b57b0
chore(deps): Bump insta from 1.24.0 to 1.24.1 ( #6500 )
...
Bumps [insta](https://github.com/mitsuhiko/insta ) from 1.24.0 to 1.24.1.
- [Release notes](https://github.com/mitsuhiko/insta/releases )
- [Changelog](https://github.com/mitsuhiko/insta/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mitsuhiko/insta/compare/1.24.0...1.24.1 )
---
updated-dependencies:
- dependency-name: insta
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-05 08:49:05 +00:00
48aad6863d
chore: Run cargo hakari tasks
2023-01-05 01:07:59 +00:00
45a1b84080
chore(deps): Bump arrow-string from 29.0.0 to 30.0.0
...
Bumps [arrow-string](https://github.com/apache/arrow-rs ) from 29.0.0 to 30.0.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md )
- [Commits](https://github.com/apache/arrow-rs/compare/29.0.0...30.0.0 )
---
updated-dependencies:
- dependency-name: arrow-string
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-01-05 01:06:49 +00:00
2a43caf132
Merge pull request #6498 from influxdata/ntran/compactor2
...
feat: catalog query to select partitions with recently created files
2023-01-04 16:34:40 -05:00
c733f27eea
chore: cleanup
2023-01-04 16:00:42 -05:00
72977bf250
feat: catalog query to select partitions with recently created files
2023-01-04 15:54:46 -05:00
1088baea3d
chore: index for selecting partitions with parquet files created after a given time ( #6496 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-04 18:07:07 +00:00
25f275f1b0
refactor: improve influxRPC warning logging ( #6493 )
...
The current version is barely readable because the logged schema w/ all
it's metadata is soooo long.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-04 16:52:32 +00:00
91680854ce
feat(replication): define replication RPC API
...
Defines the rough outline of an replication RPC API. More details/docs
to follow.
2023-01-04 17:37:32 +01:00
d4e890d01f
Merge pull request #6480 from influxdata/cn/groundwork
...
test: Lay the groundwork for porting query_tests to the RPC write path
2023-01-04 15:22:05 +00:00
afaaedc758
test: Reproduce the test for querier caching
2023-01-04 10:15:35 -05:00
9f7dede433
refactor: Reorganize tests to make deleting half the tests easier
...
When we switch to RPC write mode, the with_kafka module can be deleted
and the kafkaless_rpc_write module can be unwrapped.
2023-01-04 10:15:35 -05:00
c464487bb2
test: Ability to set up a querier2 that doesn't connect to any ingesters
2023-01-04 10:06:57 -05:00
08ceb4ee48
test: Check catalog for new Parquet files to know when data is persisted
2023-01-04 10:06:57 -05:00
e49bee0c26
test: Make test ingester2 instances either persist very quickly or not at all
2023-01-04 10:06:57 -05:00
afd09d96be
test: Create a Querier2 test server type
2023-01-04 10:06:56 -05:00
96029654ab
test: Add a shared MiniCluster for version 2 services
2023-01-04 10:06:56 -05:00
bc5e37c1bf
fix: Correct RecordBatch splitting logic ( #6484 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-04 14:04:22 +00:00
17239d5feb
Merge pull request #6415 from influxdata/feat/delete-namespace-api
...
feat: delete namespace api
2023-01-04 13:50:58 +00:00
69c82e590c
Merge branch 'main' into feat/delete-namespace-api
2023-01-04 13:44:08 +00:00
6843eee1d2
feat: Extract encoding from `RecordBatch` --> `FlightData` from flight implementations ( #6460 )
...
* feat: Extract encoding from `RecordBatch` --> `FlightData` from flight implementations
Refactor existing flight server impl
* fix: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* fix: fixup code review comments
* fix: update for more details
* fix: Update names / types
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-04 13:36:16 +00:00
fb8ead8515
Merge branch 'main' into feat/delete-namespace-api
2023-01-04 11:55:01 +00:00
b39ee78160
chore(deps): Bump arrow-ord from 29.0.0 to 30.0.0 ( #6488 )
...
* chore(deps): Bump arrow-ord from 29.0.0 to 30.0.0
Bumps [arrow-ord](https://github.com/apache/arrow-rs ) from 29.0.0 to 30.0.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md )
- [Commits](https://github.com/apache/arrow-rs/compare/29.0.0...30.0.0 )
---
updated-dependencies:
- dependency-name: arrow-ord
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
* chore: Run cargo hakari tasks
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-04 11:19:44 +00:00
1b44f4c1c6
chore(deps): Bump arrow-string from 29.0.0 to 30.0.0 ( #6490 )
...
* chore(deps): Bump arrow-string from 29.0.0 to 30.0.0
Bumps [arrow-string](https://github.com/apache/arrow-rs ) from 29.0.0 to 30.0.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md )
- [Commits](https://github.com/apache/arrow-rs/compare/29.0.0...30.0.0 )
---
updated-dependencies:
- dependency-name: arrow-string
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
* chore: Run cargo hakari tasks
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: Dom <dom@itsallbroken.com>
2023-01-04 11:13:04 +00:00
dependabot[bot]
Andrew Lamb
Nga Tran
kodiakhq[bot]
Andrew Lamb
Raphael Taylor-Davies
Dom
Marco Neumann
CircleCI[bot]
Carol (Nichols || Goulding)
Luke Bond