Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
6,545 Commits
218 Branches
453 Tags
340 MiB
Commit Graph

6545 Commits (5d3c9de7aa73483ad89b47c49bc2450e95443784)

Author SHA1 Message Date
NGA-TRAN 5d3c9de7aa chore: Merge branch 'main' into ntran/ingester 2022-01-18 14:04:44 -05:00
NGA-TRAN 23290fd2ff fix: new data structures suggested by reviewers 2022-01-18 14:04:07 -05:00
kodiakhq[bot] 65c5b8248b
Merge pull request #3478 from influxdata/pd/catalog-ids 
refactor: change all ids in catalog to their own types
 2022-01-18 18:54:23 +00:00
Paul Dix 40cac21e21 refactor: change all ids in catalog to their own types 2022-01-18 12:42:10 -05:00
kodiakhq[bot] 15d87b4087
Merge pull request #3475 from influxdata/pd/mem-catalog 
feat: implement memory backed iox_catalog
 2022-01-18 15:20:05 +00:00
Paul Dix 5e464727d1 refactor: make get_schema_by_name bare function 2022-01-18 10:09:16 -05:00
Paul Dix 4f87600081 chore: make iox_catalog tests generic for any backend implementation 2022-01-17 17:20:11 -05:00
NGA-TRAN ef336b4659 feat: add ingester crate and a few basic data structures for its data lifecycle 2022-01-17 15:38:03 -05:00
Paul Dix dfe95e1a56 refactor: make postgres and mem catalog implementations public 2022-01-17 14:46:10 -05:00
Paul Dix b3ee1032b3 feat: add memory based catalog 
Adds a memory based catalog, useful for testing purposes.
Separates getting the namespace schema from the namespace and moves the schema code out interface out of postgres.
 2022-01-17 14:09:10 -05:00
kodiakhq[bot] 357a1aadb9
Merge pull request #3472 from influxdata/dom/delete-handler 
feat(router2): implement delete API handler
 2022-01-17 15:36:52 +00:00
kodiakhq[bot] 02d45bbae0
Merge branch 'main' into dom/delete-handler 2022-01-17 15:26:33 +00:00
Andrew Lamb 1843476651
chore: Update datafusion deps (#3471) 
* chore: Update datafusion

* refactor: Update to use new Exec plan APIs

* fix: error message

* fix: fixup last bit

* fix: clippy

* fix: doclink

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-01-17 15:26:19 +00:00
kodiakhq[bot] 450b324bc3
Merge pull request #3441 from influxdata/pd/iox_catalog 
feat: Add initial iox_catalog skeleton
 2022-01-17 15:15:37 +00:00
Paul Dix d4d4b4c087 fix: workspace hack after adding iox_catalog crate 2022-01-17 10:04:24 -05:00
Paul Dix b796d5e2d1 fix: query pool type and sequencer create 2022-01-17 10:00:33 -05:00
Paul Dix 1f4469b5a0 feat: Create iox_catalog interface with traits 
This creates traits for the catalog API and moves the data objects over to interface.rs.
Updates the postgres module to implement the trait API.
Moves schema vaildation and creation out to the primary lib using the trait API.
Adds setup function to create shared kafka topic, query pool, and sequencer records.
 2022-01-17 10:00:33 -05:00
Dom aa6f118487 feat: iox_catalog sequencers (#3465) 
* refactor: ensure sequencers are unique

Adds a unique constraint to ensure only one sequencer record exists for
each Kafka (topic, partition).

* test: use DSN from env for integration tests

Removes the hard-coded DSN, instead sourcing it from the DATABASE_URL
environment variable.

* docs: integration testing for iox_catalog

Documents the required steps in order to run the Postgres integration
tests for the iox_catalog crate.

* feat(iox_catalog): create & list sequencers

Adds support for interacting with the "sequencer" table.

* chore: update lockfile

Running cargo in iox_catalog generates a lockfile diff.
 2022-01-17 10:00:31 -05:00
Dom 6f2e10cab6 feat(router2): implement delete API handler 
Adds support for the HTTP v2 delete API endpoint.
 2022-01-17 14:57:36 +00:00
Paul Dix 4f908021e4 chore: Update iox_catalog Postgres test to only run on integration 2022-01-17 09:56:20 -05:00
Paul Dix 3215928d2f chore: fix CI sqlx migrate command 2022-01-17 09:56:20 -05:00
Paul Dix 5877374d0d chore: fix ci postgres env 2022-01-17 09:56:20 -05:00
Paul Dix c373e7a397 chore: update circle CI for postgres 2022-01-17 09:56:20 -05:00
Paul Dix 4e48aea55c chore: add Postgres and migrations to CI 2022-01-17 09:56:20 -05:00
Paul Dix 8d6d9e679f refactor: update iox_catalog 
Changed to use the iox_catalog schema in Postgres rather than public.
Updated talbe names to be singular.
Removed the connection_string from query_pool
 2022-01-17 09:56:20 -05:00
Paul Dix 4e5bca93fb chore: update iox_catalog to Snafu 0.7 2022-01-17 09:56:20 -05:00
Paul Dix 4764e71c54 feat: Add initial iox_catalog skeleton 2022-01-17 09:56:20 -05:00
kodiakhq[bot] c59c17b2f2
Merge pull request #3468 from influxdata/dom/http-handlers 
feat(router2): http write handler
 2022-01-17 12:08:23 +00:00
Dom 1b7369e743 docs: fix broken doc link 2022-01-17 11:57:32 +00:00
Dom 7badf37250 refactor: db_name -> namespace 
Renames all "database name" references to "namespace".
 2022-01-17 11:57:32 +00:00
Dom 885c831aff refactor: avoid constructing DmlOperation 
Instead of converting the set of MutableBatches into a DmlOperation to
shard into more DmlOperation instances, the sharder can operate directly
on the MutableBatches.
 2022-01-17 11:57:32 +00:00
Dom 7f99d18dd1 refactor: clippy 2022-01-17 11:57:31 +00:00
Dom 40a290f6f7 feat: router2 HTTP handlers 
Implements the HTTP v2 write API endpoint for router2.
 2022-01-17 11:57:28 +00:00
Dom 80b12d417c feat: abstract DML handler 
Defines the DmlHandler trait responsible for processing a request in
some abstract way, decoupling the HTTP/gRPC request handlers from the
underlying routing logic.
 2022-01-17 11:56:04 +00:00
kodiakhq[bot] da35abfc8a
Merge pull request #3470 from influxdata/crepererum/clap_v3 
chore: upgrade clap to v3
 2022-01-17 11:21:11 +00:00
Marco Neumann c399e676ca chore: upgrade clap to v3 2022-01-17 12:12:46 +01:00
Raphael Taylor-Davies 89db894df4
fix: serde_json `arbitrary_precision` (#3458) (#3469) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-01-17 09:50:54 +00:00
Andrew Lamb b036db293f
fix: Format `ParenExpression` RPC storage Expression `Node`s (#3463) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-01-14 16:02:51 +00:00
kodiakhq[bot] 8e2e9b9082
Merge pull request #3464 from influxdata/dom/empty-org-bucket 
fix: reject empty org & bucket
 2022-01-14 14:17:45 +00:00
Dom 5cce69b481 fix: reject empty org & bucket 
Previously a request that specified an empty org & bucket value would be
mapped to a database named "_".

This commit changes the org/bucket mapping fn to return an error if
either org or bucket is empty.
 2022-01-14 12:17:26 +00:00
kodiakhq[bot] e1d7b71d6a
Merge pull request #3460 from influxdata/er/feat/query_duration 
feat: add query completion duration to queries system table
 2022-01-14 10:49:36 +00:00
Edd Robinson cdb4f43d62 refactor: address feedback 2022-01-14 10:41:27 +00:00
Edd Robinson 9283432a0f refactor: display as ns 2022-01-14 10:26:11 +00:00
Edd Robinson 36ec6019f9 feat: wire up token to query frontends 2022-01-14 10:26:11 +00:00
Edd Robinson 0b343bcf19 feat: add RAII token to time query completion 2022-01-14 10:26:11 +00:00
Edd Robinson 6a842fc105 feat: add completed duration to system table 2022-01-14 10:26:11 +00:00
Edd Robinson 211bee5886 feat: add support for setting complete time 2022-01-14 10:26:11 +00:00
Edd Robinson d1816b662f
chore: update rust to 1.58 (#3461) 
* chore: update rust to 1.58

* fix: clippy

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
 2022-01-13 21:12:46 +00:00
Andrew Lamb 957276faa1
fix: reduce "nothing to do" lifecycle messages from from debug to trace (#3449) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-01-13 19:04:47 +00:00
Andrew Lamb dd23056efd
chore: update datafusion, arrow, prost, tonic, pbjson, etc (#3455) 
* chore: update datafusion, arrow, prost, tonic, etc

* fix: update pprof as well

* chore: update hakari

* fix: update pbjson

* chore: update heappy

* fix: hakari

* fix: workaround https://github.com/influxdata/influxdb_iox/issues/3458

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2022-01-13 17:07:15 +00:00