46b43d3c30
Merge pull request #3342 from influxdata/crepererum/issue3336
...
fix: limit number of S3 connections
2021-12-09 09:53:50 +00:00
38ce54c1be
Merge branch 'main' into crepererum/issue3336
2021-12-09 09:44:55 +00:00
95f907efd8
Merge pull request #3340 from influxdata/crepererum/set_server_id_twice
...
fix: allow setting the same server ID twice
2021-12-09 08:21:08 +00:00
12c3c6b12c
Merge branch 'main' into crepererum/set_server_id_twice
2021-12-09 08:08:01 +00:00
8f81120d54
Merge pull request #3319 from influxdata/cn/quick-release
...
feat: Create a build-time-optimized release build profile
2021-12-08 21:18:56 +00:00
60de5b7c5a
Merge branch 'main' into cn/quick-release
2021-12-08 21:10:10 +00:00
876a9af35a
fix: limit number of S3 connections
...
Otherwise the whole thing blows up when starting a server that has many
DBs registerd, because we potentially create 1 connection per DB (e.g.
to read out the preserved catalog).
Fixes #3336 .
2021-12-08 19:06:02 +01:00
a8bc5b3b6d
fix: allow setting the same server ID twice
...
This is important for idempotence and simplifies clients and helper
scripts a lot.
2021-12-08 19:03:30 +01:00
b0209137e6
Merge pull request #3330 from influxdata/pd/data-generator-many-dbs
...
feat: add ability for data generator to write to many buckets
2021-12-08 17:26:21 +00:00
90a6b255a9
Merge branch 'main' into pd/data-generator-many-dbs
2021-12-08 17:17:58 +00:00
12c40b0f0f
Merge pull request #3329 from influxdata/ntran/compact_os_sql_tests
...
test: sql tests and checkpoint test for compact OS chunks
2021-12-08 17:17:41 +00:00
2c8d17bea8
refactor: change percent to ratio in data generator bucket writers
2021-12-08 12:09:04 -05:00
31aa41e240
feat: add ability for data generator to write to many buckets
...
This adds the ability for the data generator to write to many databases. A new command line argument, `bucket_list`, is added which should be a file name. The file should contain a list of databsaes, one per line, with the structure of <org>_<bucket>. This is a little odd given the data generator expects org and bucket separately, but I expect the file that we'll be using will be database names, which have this format.
The configuration can specify what percentage of the list should get written to by which agents at what sampling interval. This should allow configurations where databases get different levels of ingest and different types (as specified via different agent specs). The structure is a little wonky, but I think it'll get the job done. The next step is to run some perf tests to see how the data generator performs if writing to 10k databases.
2021-12-08 12:09:04 -05:00
713a4aca89
Merge branch 'main' into ntran/compact_os_sql_tests
2021-12-08 17:08:50 +00:00
35edee6b4f
fix: flaky test migrate_table_files_from_one_server_to_another ( #3339 )
2021-12-08 12:08:25 -05:00
6c6d3fe818
chore: Merge branch 'ntran/compact_os_sql_tests' of https://github.com/influxdata/influxdb_iox into ntran/compact_os_sql_tests
2021-12-08 12:07:19 -05:00
43e3e76de2
chore: Merge branch 'main' into ntran/compact_os_sql_tests
2021-12-08 12:07:02 -05:00
a374dfdc8f
Merge branch 'main' into ntran/compact_os_sql_tests
2021-12-08 16:51:41 +00:00
b93b7e9304
refactor: address review comments
2021-12-08 11:50:09 -05:00
428851b467
chore: Apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-08 11:42:25 -05:00
218042784f
feat: add `system.queries `system table ( #3328 )
...
* feat: Add query log and system table
* docs: Add docstrings for test normalization
2021-12-08 16:26:24 +00:00
c6a3765d76
feat: Add force flag to RebuildCatalog ( #3292 )
...
* feat: Add force flag to RebuildCatalog
* fix: small cleanups
* docs: Update comments and add WARNING
2021-12-08 15:36:07 +00:00
183de4519f
feat: Add incremental = true to the quick-release profile
2021-12-08 09:53:19 -05:00
2561af666e
fix: Use profile name variable in build artifact paths
...
Co-authored-by: Marco Neumann <marco@crepererum.net>
2021-12-08 09:53:19 -05:00
255cf79104
docs: Explain tradeoffs and use cases of the different release profiles
2021-12-08 09:53:19 -05:00
361745803e
feat: Use a PROFILE arg/env var in the Dockerfile
2021-12-08 09:53:19 -05:00
758a17e199
feat: Create a build-time-optimized release build profile
...
Fixes #3316 .
2021-12-08 09:53:19 -05:00
61dd7e0ba0
chore: clean up `all_chunks_dropped.sql` ( #3337 )
2021-12-08 14:51:56 +00:00
435aeac91d
Merge pull request #3332 from influxdata/crepererum/issue3331
...
feat: add router CLI, and GetRouter gRPC request
2021-12-08 12:55:26 +00:00
3e97e49c35
refactor: "update router" -> "create or update router"
2021-12-08 13:45:55 +01:00
e42c6974cf
fix: remove unused code
2021-12-08 13:45:55 +01:00
af71e2422e
fix: typos
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-08 13:45:55 +01:00
b7d6865f87
feat: add router CLI
...
Closes #3331 .
2021-12-08 13:45:55 +01:00
c17a6c10c1
feat: add `GetRouter` gRPC method
2021-12-08 13:45:55 +01:00
b86c7c1d13
Merge pull request #3333 from influxdata/er/perf/load_chunk_rub
...
perf: don't sort single chunk when loading from OS to RUB
2021-12-08 12:27:46 +00:00
7443b3685e
refactor: address PR feedback
2021-12-08 12:18:23 +00:00
2a2c5889c3
perf: loading chunks doesn't require sort
2021-12-08 12:03:56 +00:00
b0e01edb86
fix: include pbjson code for storage package ( #3334 )
2021-12-08 11:58:09 +00:00
76befe94ad
Merge pull request #3289 from influxdata/ntran/compact_os_tests
...
fix: Capture the right 'no data' while parquet has no data
2021-12-07 23:00:47 +00:00
04e0c22397
Merge branch 'main' into ntran/compact_os_tests
2021-12-07 22:52:19 +00:00
a13c3120a6
test: sql tests and checkpoint test for compact OS chunks
2021-12-07 17:32:48 -05:00
ec8644a39a
refactor: return clearer error message
2021-12-07 12:24:28 -05:00
cffb4152ab
Merge pull request #3326 from influxdata/crepererum/issue3312
...
fix: test flakyness while waiting for gRPC connection
2021-12-07 17:22:23 +00:00
667e6a6eb6
Merge branch 'main' into crepererum/issue3312
2021-12-07 17:12:56 +00:00
561c5ed8e7
refactor: make checking no data happen during reading inout stream
2021-12-07 12:03:41 -05:00
1156a81567
feat: Add pbjson serialization for storage rpc ( #3324 )
...
* feat: Add pbjson serialization for storage rpc
* chore: update pbjson-build to 0.1.1
Co-authored-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>
2021-12-07 16:39:16 +00:00
c992c82582
chore: Merge branch 'main' into ntran/compact_os_tests
2021-12-07 11:08:12 -05:00
577df009d8
fix: test flakyness while waiting for gRPC connection
...
Fixes #3312 .
2021-12-07 17:05:06 +01:00
5bdadc360c
Merge pull request #3318 from influxdata/crepererum/issue3287
...
fix: retry write buffer creation during database init
2021-12-07 13:04:52 +00:00
52f1285d28
Merge branch 'main' into crepererum/issue3287
2021-12-07 12:54:29 +00:00
kodiakhq[bot]
Marco Neumann
Paul Dix
Andrew Lamb
Nga Tran
Carol (Nichols || Goulding)
Carol (Nichols || Goulding)
Edd Robinson
Raphael Taylor-Davies