Commit Graph

35147 Commits (33a7add74539116f736e894caedc1f409023e130)

Author SHA1 Message Date
William Baker e4e16335f5
fix: replications remote writes do not block server shutdown (#22958)
* fix: replications remote writes do not block server shutdown

* fix: don't leak goroutine
2021-12-02 12:04:52 -06:00
Sam Arnold b970e359dc
feat: remaining storage metrics from OSS engine (#22938)
* fix: simplify disk size tracking

* refactor: EngineTags in tsdb package

* fix: fewer compaction buckets and dead code removal

* feat: shard metrics

* chore: formatting

* feat: tsdb store metrics

* feat: retention check metrics

* chore: fix go vet

* fix: review comments
2021-12-02 09:01:46 -05:00
William Baker 3460f1cc52
feat: replication remote writes do not block local writes (#22956)
* feat: replication remote writes do not block local writes
2021-12-01 15:37:10 -06:00
William Baker f05d0136f1
feat: metrics collection for replications remote writes (#22952)
* feat: metrics collection for replications remote writes

* fix: don't update metrics with 204 error code on successful writes
2021-12-01 12:41:24 -06:00
William Baker 906015023c
test: add e2e test for replication streams (#22949)
* test: add e2e test for replication streams

* chore: fix race
2021-12-01 11:12:44 -06:00
William Baker 9873ccd657
feat: remote write function for replications (#22942)
* feat: remote write function for replications

* chore: implement UpdateResponseInfo store method

* chore: only set gzip heading for non-empty requests

* fix: address review feedback
2021-11-30 15:33:42 -06:00
Jason Stirnaman 5ce164f849
fix: remove influx CLI output from CONTRIBUTING (#22946)
* fix: remove influx CLI output from CONTRIBUTING. Add link to influx CLI repo. Cleanup build instructions. Update Flux in README.

* fix: headers
2021-11-30 14:02:20 -06:00
Sam Arnold 799d349813
fix(tsi): sync index file before close (#22927)
(cherry picked from commit 5fd1b29d74)

Co-authored-by: lifeibo <lifeibo382005@gmail.com>
2021-11-24 15:52:45 -05:00
Sam Arnold 9308b6586a
chore: remove unused member from TagSet (#22930)
Co-authored-by: Tristan Su <suqing.sq@alibaba-inc.com>
2021-11-24 14:43:50 -05:00
Sam Arnold 4ee93a9b22
chore: fix up message when build fails due to OS (#22928) 2021-11-24 14:43:42 -05:00
Sam Arnold 8aa3a8f7e5
fix: add causal error when meta.db is missing (#22905) 2021-11-24 13:05:35 -05:00
William Baker f47d514225
refactor: move replications store functionality to separate package (#22923)
* refactor: move replications store functionality to separate package

* fix: make opening all repls on startup work right
2021-11-24 11:45:19 -06:00
Bryan FRIMIN 5a1e3752c7
build: allow to build on FreeBSD (#22285)
* fix(build): checksum failed on FreeBSD

* fix(build): avoid BSD make evaluate Makefile

This Makefile use GNU make functions which is not compatible with the BSD
make. In order to avoid BSD make to try evaluation the Makefile and because
the Makefile use GNU make functions renaming the from Makefile to GNUmakefile
does not change anything for GNU make users and expose a clear error
when someone try to evaluate with BSD make.

* fix(build): invalid shebang on FreeBSD
2021-11-24 08:42:36 -05:00
Sam Arnold edb21abe91
feat: metrics for wal subsystem (#22918)
https://github.com/influxdata/influxdb/issues/20026
2021-11-23 12:17:52 -05:00
Sam Arnold feb459c785
feat: metrics for cache subsystem (#22915)
* fix: drop complicated cache metrics and document remaining

* feat: metrics for cache
2021-11-23 10:11:22 -05:00
Sam Arnold a74e05177c
feat: disk size metrics per shard (#22912) 2021-11-22 16:53:55 -05:00
Sam Arnold 0a740856c7
feat: point write requests have metrics (#22910)
* fix: remove dead subscriptions code

* feat: storage_writer metrics
2021-11-22 12:58:17 -05:00
William Baker 3a81166812
feat: added metrics collection for replications (#22906)
* feat: added metrics collection for replications

* fix: fixed panic when restarting

* fix: fix panic pt2

* chore: self-review fixes

* chore: simplify test
2021-11-22 11:40:03 -06:00
Sam Arnold dece95d1dd
feat: tsm compaction metrics via prometheus (#22904)
* feat: tsm compaction metrics via prometheus

* chore: fix formatting

* chore: make activeCompactions a pointer
2021-11-19 14:51:22 -05:00
Dane Strandboge 6ee472725f
refactor: use remote write func in NewDurableQueueManager (#22888) 2021-11-19 11:31:10 -06:00
William Baker b9b86a19a3
chore: remove remote validation code (#22901)
* chore: remove remote validation code

* chore: remove unused function

* chore: add todo for updating swagger ref

* chore: update swagger ref
2021-11-18 15:17:11 -07:00
Sam Arnold fea3037c6b
feat: configure perf tests with yaml (#22887) 2021-11-18 15:02:31 -05:00
William Baker 90baa802ed
chore: use tagged version of pkg-config (#22898) 2021-11-18 11:59:37 -07:00
Sam Arnold 9d8173c9f3
chore: delete dead pprof related code (#22892) 2021-11-18 08:28:17 -05:00
Daniel Moran a5f6431321
build: pull SHA-specific image before tagging it as latest (#22891) 2021-11-17 10:26:27 -05:00
William Baker ad52815e19
feat: add field for dropping data resulting in non-retryable errors to individual replications (#22885)
* feat: add field for dropping data resulting in non-retryable errors to individual replications
2021-11-16 13:41:54 -07:00
Daniel Moran e7a77f0e24
build: follow-up fixes after CI refactor (#22884)
* Setup docker before trying to push image
* Fix perf-test script name
2021-11-16 15:41:43 -05:00
Daniel Moran 0572ae05d2
build: replace cross_build job with parallelized build matrix (#22877) 2021-11-16 14:38:30 -05:00
Dane Strandboge 40d9587ece
feat: add replications queue scanner (#22873)
Co-authored-by: “mcfarlm3” <“58636946+mcfarlm3@users.noreply.github.com”>
2021-11-16 10:30:52 -06:00
Sam Arnold 16e3b165ca
chore: refactor performance test to generate queries and data together (#22861) 2021-11-15 12:01:38 -05:00
Jakub Bednář fa9ba8e86f
fix: duplicated X-version and X-Build headers for /ping endpoint (#22862)
* fix: duplicated X-version and X-Build headers for /ping endpoint

Signed-off-by: Jakub Bednar <jakub.bednar@gmail.com>

* chore: change branch to master

* chore: only http/handler.go is responsible for sets headers

Signed-off-by: Jakub Bednar <jakub.bednar@gmail.com>
2021-11-12 13:32:12 -07:00
William Baker 11f60520f9
build: better versioning and verification for releases (#22866) 2021-11-12 08:57:21 -07:00
Daniel Moran 0ecde93012
build: stop building & pushing images to quay.io (#22864) 2021-11-11 12:28:06 -05:00
CasMc 2bace7767d
fix: unhandled errors returned by Sketch.Merge (#22858) 2021-11-10 09:26:24 -05:00
Daniel Moran 6b56af3c3f
feat: mirror writes to registered replications (#22833) 2021-11-10 08:25:47 -05:00
William Baker 5a0051ad5b
build: Remove additional commit file (#22853) 2021-11-09 12:42:44 -07:00
mcfarlm3 cd0243d2b4
feat: added replications queue management to launcher tasks (#22820)
* feat: added replications queue management to launcher tasks

* refactor: separated sql logic into replications service rather than durable queue manager

* refactor: extended replications feature flag to launcher code and minor change to startup function param

* chore: added unit test coverage for replications server startup queue management

* refactor: made error messages reusable and factored out unecessary string from queue management tests

* refactor: changed queue management error names to pass linter check
2021-11-09 11:32:07 -08:00
Sean Brickley f6568a7ff6
build(flux): update flux to v0.140.0 (#22845)
* build(flux): update flux to v0.140.0

* chore: Reformat scripts in generated flux tests
2021-11-09 13:35:51 -05:00
William Baker 36dcc20320
chore: don't look for non-existent changelog file in release job (#22842) 2021-11-08 10:22:59 -07:00
William Baker 4af68d06b7
build: updated changelog automation (#22835)
* build: updated changelog automation

* chore: update frozen changelog date
2021-11-05 20:55:37 -06:00
Daniel Moran 1aac92c5ee
refactor: remove replications.current_queue_size_bytes from sqlite (#22832)
Maintaining the current queue size in a SQL column would require
updating the DB on every queue operation. Avoid that contention by
instead looking up the current size on the in-memory durable queue
struct, which is already tracked & updated as data enters & leaves
the queue.
2021-11-05 14:35:12 -04:00
Dane Strandboge a7f3b67092
chore: clean up protobuf loose ends (#22823)
- Remove `gogo/protobuf` and `golang/protobuf` deps
- Fix mistake in `CONTRIBUTING.md`
- Use Prometheus `MetricType` type over our own copy-paste version
2021-11-05 10:30:30 -05:00
Daniel Moran 21362910f2
build: add a CI job to test `influxd downgrade` (#22821) 2021-11-03 14:28:19 -04:00
Andrew Lamb ca633cdfaf
chore: Remove outdated query readme (#22608) 2021-11-03 09:13:00 -04:00
Dane Strandboge f4e9ae94ca
build: upgrade protobuf library (#22654) 2021-11-02 16:00:54 -05:00
William Baker 88d6487f4a
feat: extended downgrade command to include sql migrations (#22813)
* feat: extended downgrade command to include sql migrations

* feat: remove short forms in downgrade command
2021-11-02 10:42:02 -06:00
William Baker f7573f43a7
feat: sql migrator can do down migrations (#22806)
* feat: sql down migrations

* refactor: different name for up migrations

* chore: update migrations ref in svc tests

* build: add lint step to verify sql migration names match
2021-11-01 14:30:18 -06:00
Paul Hummer a4fd1caf8e
build(flux): update flux to v0.139.0 (#22812) 2021-11-01 14:04:18 -06:00
Daniel Moran 0fbda8397d
feat: recommend `influxd downgrade` after encountering unknown KV migration (#22805) 2021-11-01 11:07:54 -04:00
Jonathan A. Sternberg b93f3a3222
build(flux): update flux to v0.137.0 (#22792) 2021-11-01 09:24:00 -05:00