5831cf8cee
feat: Add basic Edge server structure ( #24552 )
...
* WIP: basic influxdb3 command and http server
* WIP: write lp, buffer, query out
* WIP: test write & query on influxdb3_server, fix warnings
* WIP: pull write buffer and catalog into separate crate
* WIP: sketch out types used for write: buffer, wal, persister
* WIP: remove a bunch of old IOx stuff and fmt
2024-01-08 11:50:59 -05:00
acfef87659
chore: Sync and release v1.0.1 of influxdb-line-protocol ( #24527 )
...
* chore: Backport influxdb line protocol changes, release v1.0.1
* chore: Update influxdb_line_protocol to 2.0
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2023-12-22 15:12:41 -05:00
2fabaf98a4
chore: Run cargo fmt --all ( #24528 )
2023-12-20 14:11:04 -07:00
bb6a5c0bf6
chore: ignore Go in .github/dependabot.yml, take 3 ( #24439 )
...
Update to use the documented dependency-name: "*" methodology rather
than an undocumented example.
References:
- https://docs.github.com/en/code-security/dependabot/dependabot-version-updates/configuration-options-for-the-dependabot.yml-file
2023-11-02 08:16:13 -04:00
560c2ef846
chore: Update dependabot.yml ( #24391 )
...
Add the v3 label to dependabot Rust PRs
2023-11-02 08:10:04 -04:00
4baa25e56f
chore: ignore Go in .github/dependabot.yml, take 2 ( #24438 )
2023-11-02 07:29:35 -04:00
361a82a84a
chore: ignore Go in .github/dependabot.yml ( #24430 )
...
Before switching to rust-based IOx, influxdb was a Go project which
dependabot tracked. After the switch, dependabot would issue alerts for
go files that no longer exist. Tell dependabot to ignore "gomod"
2023-10-26 10:53:42 -05:00
d34fc59217
chore(deps): Bump rustix from 0.38.8 to 0.38.19 ( #24421 )
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.38.8 to 0.38.19.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.38.8...v0.38.19 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-19 16:24:15 -05:00
2f0e2dcb9d
chore: Update README.md ( #24379 )
...
Update README to include link to Flux repo
2023-09-26 09:59:23 -04:00
7b7475983b
chore: update README with new v3 details
2023-09-21 09:31:53 -04:00
aa458ed166
Merge branch 'iox-repo'
2023-09-21 09:22:15 -04:00
cafe37bd1f
Merge branch 'pd/influxdb3-oss'
2023-09-21 09:15:41 -04:00
427daa82b0
Merge pull request #8788 from influxdata/dependabot/cargo/tokio-util-0.7.9
...
chore(deps): Bump tokio-util from 0.7.8 to 0.7.9
2023-09-21 14:04:16 +01:00
de835d8c33
feat: remove everything to make way for 3.0, the last database rewrite you'll ever need.
2023-09-21 09:03:38 -04:00
25f3147dc7
Merge branch 'main' into dependabot/cargo/tokio-util-0.7.9
2023-09-21 13:37:57 +01:00
008b60cffb
Merge pull request #8790 from influxdata/dependabot/cargo/insta-1.32.0
...
chore(deps): Bump insta from 1.31.0 to 1.32.0
2023-09-21 13:36:11 +01:00
75d4d8c55b
Merge branch 'main' into dependabot/cargo/insta-1.32.0
2023-09-21 12:52:56 +01:00
e61a35e396
Merge branch 'main' into dependabot/cargo/tokio-util-0.7.9
2023-09-21 12:52:23 +01:00
b5c0ecd140
Merge pull request #8767 from influxdata/savage/respect-ingest-system-state-during-wal-replay
...
feat(ingester): Respect `IngestState` during WAL replay
2023-09-21 10:19:37 +00:00
12b02359aa
Merge branch 'main' into savage/respect-ingest-system-state-during-wal-replay
2023-09-21 10:13:27 +00:00
82382b9b3a
chore(deps): Bump insta from 1.31.0 to 1.32.0
...
Bumps [insta](https://github.com/mitsuhiko/insta ) from 1.31.0 to 1.32.0.
- [Changelog](https://github.com/mitsuhiko/insta/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mitsuhiko/insta/compare/1.31.0...1.32.0 )
---
updated-dependencies:
- dependency-name: insta
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-09-21 10:10:26 +00:00
bd1b668dbb
Merge branch 'main' into dependabot/cargo/tokio-util-0.7.9
2023-09-21 11:04:42 +01:00
29462d0fe5
Merge pull request #8789 from influxdata/dependabot/cargo/smallvec-1.11.1
...
chore(deps): Bump smallvec from 1.11.0 to 1.11.1
2023-09-21 11:04:28 +01:00
37d37f3626
chore(deps): Bump smallvec from 1.11.0 to 1.11.1
...
Bumps [smallvec](https://github.com/servo/rust-smallvec ) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/servo/rust-smallvec/releases )
- [Commits](https://github.com/servo/rust-smallvec/compare/v1.11.0...v1.11.1 )
---
updated-dependencies:
- dependency-name: smallvec
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-09-21 02:02:29 +00:00
661acc77f0
chore(deps): Bump tokio-util from 0.7.8 to 0.7.9
...
Bumps [tokio-util](https://github.com/tokio-rs/tokio ) from 0.7.8 to 0.7.9.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-util-0.7.8...tokio-util-0.7.9 )
---
updated-dependencies:
- dependency-name: tokio-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-09-21 02:01:19 +00:00
b3b982d746
chore: update MacOS executor to M1 ( #24372 )
2023-09-20 14:30:21 -04:00
3e5196bbda
Merge pull request #8782 from influxdata/cn/independent-refactorings
...
refactor: Improvements made during UpsertSchema work that are actually independent
2023-09-20 16:56:41 +00:00
d1f355bb58
fix: Remove an Arc wrapping that's no longer needed
2023-09-20 11:14:20 -04:00
7c31771c64
refactor: Implement NamespaceSchema proto conversion as From
2023-09-20 11:13:53 -04:00
11f916eee1
refactor: Extract test helper functions to improve readability
2023-09-20 10:42:26 -04:00
cb7a26cb65
refactor(ingester): Revert `IngestState` methods to crate public
...
These methods should not be used at all outside the ingester, and only
the type itself needs to be accessible in the WAL replay benchmark.
2023-09-20 15:03:39 +01:00
eda4ccdf1a
test: Clean up existing test for consistency with current test style
...
- Extract some shared values
- Remove an unneeded Arc::clone
- Change expects that don't provide much clarity to unwraps
- Give the test a more distinctive and less redundant name
2023-09-20 10:01:06 -04:00
257a6d2552
fix: Generating proto doesn't need ownership of an Arc
2023-09-20 10:01:06 -04:00
265941f1a8
refactor: Only return NamespaceSchema proto so it can be reused in different responses
2023-09-20 09:57:06 -04:00
28c3637c01
Merge pull request #8780 from influxdata/dom/enable-merkle-tracking
...
feat(router): init anti-entropy merkle search tree
2023-09-20 14:41:30 +01:00
d6f87cc569
Merge branch 'main' into dom/enable-merkle-tracking
2023-09-20 14:25:45 +01:00
5269285250
refactor: isolate V1 ingester->querier client ( #8778 )
...
Isolate the actual client from the query planning parts
(`Ingester{Chunk,Partition}`) so we can hook up the V2 client in #8350 .
The PR looks large, but it just moves code around and decouples the
error handling.
2023-09-20 12:55:30 +00:00
39768fa989
feat(router): init anti-entropy merkle search tree
...
Adds initialisation code to the routers to instantiate an
AntiEntropyActor, pre-populate the Merkle Search Tree during schema
warmup, and maintain it at runtime.
2023-09-20 13:47:16 +02:00
3ca05369dc
Merge pull request #8777 from influxdata/dom/rust-bump
...
build: bump rust to 1.72.1
2023-09-20 12:08:00 +01:00
6d0ef588f4
Merge branch 'main' into dom/rust-bump
2023-09-20 11:10:10 +01:00
485dbe9a82
Merge pull request #8776 from influxdata/dom/merkle-snap
...
feat: merkle search tree snapshot generation
2023-09-20 11:10:03 +01:00
3c9f282837
build: bump rust to 1.72.1
...
https://github.com/rust-lang/rust/releases/tag/1.72.1
2023-09-20 12:00:04 +02:00
ec96545c34
feat: merkle search tree snapshot generation
...
Allow an owned, compact content summary snapshot of the merkle search
tree state to be read from the MST actor.
This snapshot describes the structure of the MST in a compact/efficient
representation suitable for exchanging over the network between peers.
2023-09-20 11:43:47 +02:00
7b4dbb570d
refactor: clean up query log impl ( #8775 )
...
- take span ctx directly instead of the execution context (see point
below)
- use the original trace ID (i.e. the one that we get via HTTP header),
NOT some internal span/trace because the latter is only available for
sampled requests, while the former one is generally more available (we
also do that for the stdout logs btw.)
- minor code clean ups
This is prep work for #8774 .
2023-09-20 09:20:19 +00:00
fd50d7cfcf
Merge pull request #8771 from influxdata/crepererum/issue8705
...
feat: prune partitions before creating parquet chunks
2023-09-20 10:49:48 +02:00
4219d7d318
feat: prune partitions before creating parquet chunks
...
This should lower query latency, because creating many chunks just to
throw them away afterwards isn't exactly cheap.
Closes #8705 .
2023-09-20 10:43:39 +02:00
60e795e15e
Merge pull request #8768 from influxdata/crepererum/issue8350b
...
refactor: allow streaming record batches into query
2023-09-20 10:36:23 +02:00
809e0f4a42
Merge branch 'main' into crepererum/issue8350b
2023-09-20 08:21:04 +00:00
65d0ea2055
chore: Update DataFusion ( #8765 )
...
* chore: Update DataFusion pin again
* chore: update for different type
* fix: statistics
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-09-19 22:26:53 +00:00
c05739ff20
chore(compactor): move CompactRange up to RoundInfo ( #8736 )
...
* chore(compactor): move CompactRange up to RoundInfo
* chore: insta updates from compactor CompactRange refactor
* chore: lint cleanup
* chore: addressing some of the comments
* chore: remove duplicated done check
* chore: variable renaming
2023-09-19 16:53:36 +00:00
Paul Dix
Joshua Powers
Jamie Strandboge
Jeffrey Smith II
dependabot[bot]
Rick Spencer
Dom
kodiakhq[bot]
Brandon Pfeifer
Carol (Nichols || Goulding)
Fraser Savage
Marco Neumann
Andrew Lamb
Joe-Blount