ce7005ec75
chore: merge main to branch and resolve conflict
2022-01-18 22:06:38 -05:00
e8294d21ec
fix: add .lock
2022-01-18 22:02:27 -05:00
fe9a41ee9a
chore: remove non-longer needed dependency
2022-01-18 21:45:20 -05:00
b89c250ccc
refactor: use RepoColection instead of MemCatalog
2022-01-18 21:39:22 -05:00
b57f027e35
refactor: address review comments
2022-01-18 20:57:13 -05:00
367a9fb812
fix: add workspace-hack
2022-01-18 18:10:42 -05:00
1c970a2064
fix: format
2022-01-18 18:01:47 -05:00
667ec5bfc5
fix: the code is now compile without warnings
2022-01-18 18:01:06 -05:00
d0705001e6
Merge pull request #3482 from influxdata/pd/fix-partitionid-desc
...
fix: typo in partitionid description
2022-01-18 22:47:16 +00:00
b20d1757d0
feat: initialize ingester data
2022-01-18 17:43:03 -05:00
8067316c33
fix: typo in partitionid description
2022-01-18 17:33:05 -05:00
d3e517bf13
chore: Merge branch 'main' into ntran/ingester
2022-01-18 16:11:57 -05:00
125285ae9a
feat: commit in order to pull and merge new commit from main
2022-01-18 16:11:25 -05:00
f33aaf700a
Merge pull request #3481 from influxdata/pd/kafka-partition
...
refactor: add new type for Kafka Partition in Catalog
2022-01-18 20:23:54 +00:00
b1510675ae
refactor: add new type for Kafka Partition in Catalog
2022-01-18 15:13:18 -05:00
e34b24fc7f
Merge pull request #3480 from influxdata/pd/partitions-catalog
...
feat: add Partition scaffolding to iox_catalog crate
2022-01-18 20:11:45 +00:00
f6a901f90d
Merge branch 'main' into pd/partitions-catalog
2022-01-18 20:00:42 +00:00
e395ef7066
feat: add Partition scaffolding to iox_catalog
2022-01-18 14:50:49 -05:00
5d3c9de7aa
chore: Merge branch 'main' into ntran/ingester
2022-01-18 14:04:44 -05:00
23290fd2ff
fix: new data structures suggested by reviewers
2022-01-18 14:04:07 -05:00
65c5b8248b
Merge pull request #3478 from influxdata/pd/catalog-ids
...
refactor: change all ids in catalog to their own types
2022-01-18 18:54:23 +00:00
40cac21e21
refactor: change all ids in catalog to their own types
2022-01-18 12:42:10 -05:00
15d87b4087
Merge pull request #3475 from influxdata/pd/mem-catalog
...
feat: implement memory backed iox_catalog
2022-01-18 15:20:05 +00:00
5e464727d1
refactor: make get_schema_by_name bare function
2022-01-18 10:09:16 -05:00
4f87600081
chore: make iox_catalog tests generic for any backend implementation
2022-01-17 17:20:11 -05:00
ef336b4659
feat: add ingester crate and a few basic data structures for its data lifecycle
2022-01-17 15:38:03 -05:00
dfe95e1a56
refactor: make postgres and mem catalog implementations public
2022-01-17 14:46:10 -05:00
b3ee1032b3
feat: add memory based catalog
...
Adds a memory based catalog, useful for testing purposes.
Separates getting the namespace schema from the namespace and moves the schema code out interface out of postgres.
2022-01-17 14:09:10 -05:00
357a1aadb9
Merge pull request #3472 from influxdata/dom/delete-handler
...
feat(router2): implement delete API handler
2022-01-17 15:36:52 +00:00
02d45bbae0
Merge branch 'main' into dom/delete-handler
2022-01-17 15:26:33 +00:00
1843476651
chore: Update datafusion deps ( #3471 )
...
* chore: Update datafusion
* refactor: Update to use new Exec plan APIs
* fix: error message
* fix: fixup last bit
* fix: clippy
* fix: doclink
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-17 15:26:19 +00:00
450b324bc3
Merge pull request #3441 from influxdata/pd/iox_catalog
...
feat: Add initial iox_catalog skeleton
2022-01-17 15:15:37 +00:00
d4d4b4c087
fix: workspace hack after adding iox_catalog crate
2022-01-17 10:04:24 -05:00
b796d5e2d1
fix: query pool type and sequencer create
2022-01-17 10:00:33 -05:00
1f4469b5a0
feat: Create iox_catalog interface with traits
...
This creates traits for the catalog API and moves the data objects over to interface.rs.
Updates the postgres module to implement the trait API.
Moves schema vaildation and creation out to the primary lib using the trait API.
Adds setup function to create shared kafka topic, query pool, and sequencer records.
2022-01-17 10:00:33 -05:00
aa6f118487
feat: iox_catalog sequencers ( #3465 )
...
* refactor: ensure sequencers are unique
Adds a unique constraint to ensure only one sequencer record exists for
each Kafka (topic, partition).
* test: use DSN from env for integration tests
Removes the hard-coded DSN, instead sourcing it from the DATABASE_URL
environment variable.
* docs: integration testing for iox_catalog
Documents the required steps in order to run the Postgres integration
tests for the iox_catalog crate.
* feat(iox_catalog): create & list sequencers
Adds support for interacting with the "sequencer" table.
* chore: update lockfile
Running cargo in iox_catalog generates a lockfile diff.
2022-01-17 10:00:31 -05:00
6f2e10cab6
feat(router2): implement delete API handler
...
Adds support for the HTTP v2 delete API endpoint.
2022-01-17 14:57:36 +00:00
4f908021e4
chore: Update iox_catalog Postgres test to only run on integration
2022-01-17 09:56:20 -05:00
3215928d2f
chore: fix CI sqlx migrate command
2022-01-17 09:56:20 -05:00
5877374d0d
chore: fix ci postgres env
2022-01-17 09:56:20 -05:00
c373e7a397
chore: update circle CI for postgres
2022-01-17 09:56:20 -05:00
4e48aea55c
chore: add Postgres and migrations to CI
2022-01-17 09:56:20 -05:00
8d6d9e679f
refactor: update iox_catalog
...
Changed to use the iox_catalog schema in Postgres rather than public.
Updated talbe names to be singular.
Removed the connection_string from query_pool
2022-01-17 09:56:20 -05:00
4e5bca93fb
chore: update iox_catalog to Snafu 0.7
2022-01-17 09:56:20 -05:00
4764e71c54
feat: Add initial iox_catalog skeleton
2022-01-17 09:56:20 -05:00
c59c17b2f2
Merge pull request #3468 from influxdata/dom/http-handlers
...
feat(router2): http write handler
2022-01-17 12:08:23 +00:00
1b7369e743
docs: fix broken doc link
2022-01-17 11:57:32 +00:00
7badf37250
refactor: db_name -> namespace
...
Renames all "database name" references to "namespace".
2022-01-17 11:57:32 +00:00
885c831aff
refactor: avoid constructing DmlOperation
...
Instead of converting the set of MutableBatches into a DmlOperation to
shard into more DmlOperation instances, the sharder can operate directly
on the MutableBatches.
2022-01-17 11:57:32 +00:00
7f99d18dd1
refactor: clippy
2022-01-17 11:57:31 +00:00
NGA-TRAN
kodiakhq[bot]
Paul Dix
Andrew Lamb
Dom