Commit Graph

315 Commits (3997de6a524ab77a765f62ec07d50b26d1d0795c)

Author SHA1 Message Date
Paul Dix b1510675ae refactor: add new type for Kafka Partition in Catalog 2022-01-18 15:13:18 -05:00
Paul Dix e395ef7066 feat: add Partition scaffolding to iox_catalog 2022-01-18 14:50:49 -05:00
Paul Dix 40cac21e21 refactor: change all ids in catalog to their own types 2022-01-18 12:42:10 -05:00
Paul Dix 5e464727d1 refactor: make get_schema_by_name bare function 2022-01-18 10:09:16 -05:00
Paul Dix 4f87600081 chore: make iox_catalog tests generic for any backend implementation 2022-01-17 17:20:11 -05:00
Paul Dix dfe95e1a56 refactor: make postgres and mem catalog implementations public 2022-01-17 14:46:10 -05:00
Paul Dix b3ee1032b3 feat: add memory based catalog
Adds a memory based catalog, useful for testing purposes.
Separates getting the namespace schema from the namespace and moves the schema code out interface out of postgres.
2022-01-17 14:09:10 -05:00
Paul Dix d4d4b4c087 fix: workspace hack after adding iox_catalog crate 2022-01-17 10:04:24 -05:00
Paul Dix b796d5e2d1 fix: query pool type and sequencer create 2022-01-17 10:00:33 -05:00
Paul Dix 1f4469b5a0 feat: Create iox_catalog interface with traits
This creates traits for the catalog API and moves the data objects over to interface.rs.
Updates the postgres module to implement the trait API.
Moves schema vaildation and creation out to the primary lib using the trait API.
Adds setup function to create shared kafka topic, query pool, and sequencer records.
2022-01-17 10:00:33 -05:00
Dom aa6f118487 feat: iox_catalog sequencers (#3465)
* refactor: ensure sequencers are unique

Adds a unique constraint to ensure only one sequencer record exists for
each Kafka (topic, partition).

* test: use DSN from env for integration tests

Removes the hard-coded DSN, instead sourcing it from the DATABASE_URL
environment variable.

* docs: integration testing for iox_catalog

Documents the required steps in order to run the Postgres integration
tests for the iox_catalog crate.

* feat(iox_catalog): create & list sequencers

Adds support for interacting with the "sequencer" table.

* chore: update lockfile

Running cargo in iox_catalog generates a lockfile diff.
2022-01-17 10:00:31 -05:00
Paul Dix 4f908021e4 chore: Update iox_catalog Postgres test to only run on integration 2022-01-17 09:56:20 -05:00
Paul Dix 8d6d9e679f refactor: update iox_catalog
Changed to use the iox_catalog schema in Postgres rather than public.
Updated talbe names to be singular.
Removed the connection_string from query_pool
2022-01-17 09:56:20 -05:00
Paul Dix 4e5bca93fb chore: update iox_catalog to Snafu 0.7 2022-01-17 09:56:20 -05:00
Paul Dix 4764e71c54 feat: Add initial iox_catalog skeleton 2022-01-17 09:56:20 -05:00