b8ccf5bbbd
fix: correctly handle PartialWriteError ( #23098 )
...
Check for the correctly returned PartialWriteError
in (*shard).validateSeriesAndFields, allow partial
writes.
closes https://github.com/influxdata/influxdb/issues/23096
2022-02-02 14:43:23 -08:00
2a957c9a56
chore(query/influxql): remove the influxql transpiler ( #23000 )
2022-01-31 11:34:37 -05:00
888f82c9c8
build(flux): update flux to v0.150.0 ( #23064 )
...
* build(flux): update flux to v0.150.0
* chore: update list of skipped flux integration tests
2022-01-19 11:10:02 -06:00
0c30afd308
fix: updating a check does not require an owner id ( #23034 )
2022-01-13 11:38:01 -08:00
b02c89edf6
feat: option to log flux queries cancelled because of server shutdown ( #23032 )
...
Co-authored-by: DStrand1 <dstrandboge@influxdata.com>
2022-01-11 16:06:36 -06:00
a812d8b603
build(flux): update flux to v0.148.0 ( #23047 )
2022-01-11 11:30:01 -08:00
c1d384de19
test: fix flaky enqueue test ( #23035 )
2022-01-10 08:04:59 -08:00
11c00813f1
fix(templates): disable use of jsonnet with `/api/v2/templates/apply` ( #23030 )
2021-12-30 12:55:45 -05:00
4f74049a52
feat: add downgrade target for 2.1 ( #23029 )
2021-12-29 13:27:07 -05:00
c889d0f22b
chore: remove outdated `/docs` folder ( #23028 )
2021-12-28 15:59:21 -05:00
a8ca413d14
chore: add deprecation notice for print-config command ( #23026 )
2021-12-28 13:54:17 -05:00
f78f9eda9c
feat: api/v2/config endpoint displays runtime configuration ( #23003 )
...
* feat: api/v2/config endpoint for runtime config
* feat: use a type switch
* fix: add tests
* chore: add config key to returned json
* chore: update swagger ref
2021-12-23 09:27:39 -05:00
afb167a2ca
feat: `query-memory-bytes` zero-value is unlimited ( #23013 )
2021-12-20 19:25:10 -05:00
b0a0e734e0
chore: remove unused user http code ( #23011 )
...
* chore: remove unused user http code
* fix: resolve circular dep
* fix: copy newUserResponse function
2021-12-20 15:17:18 -05:00
c51a0df1ef
feat: error out when config file contains 1.x config values ( #22996 )
...
* feat: error out when config file contains invalid options
* feat: debug logging when loading a config file
* fix: only detect flags from 1.x
* test: update tests to use toml configs
2021-12-15 20:57:01 -06:00
60234964d0
refactor: replications local write optimization ( #22993 )
...
* refactor: eliminate sqlite query in case of no configured replications
* refactor: updated write-related tests to reflect tracking of orgID and localBucket by the queue manager
* refactor: removed redundant trackedReplications field
* refactor: corrected slice init in GetReplications and added TestGetReplications
* refactor: eliminated tracked package and moved TrackedReplication struct to influxdb package via replication.go
* chore: ran make fmt
* fix: added closeRq function back in to address flaky tests
* refactor: small changes to queue manager test based on code review
2021-12-15 12:32:46 -08:00
4fd4bd019f
fix: use copy when a rename spans volumes ( #22995 )
...
When a file rename fails with EXDEV
(cross device or volume error), copy the
file and delete the original instead.
closes https://github.com/influxdata/influxdb/issues/22890
Co-authored-by: Chris Pahl <sahib@online.de>
2021-12-14 12:58:44 -08:00
f78c189211
build(flux): update flux to v0.146.0 ( #22988 )
...
* build(flux): update flux to v0.146.0
* chore: use new cross-builder image and skip tests
2021-12-13 17:18:30 -05:00
5a919b69d7
feat: enable remotes and replication streams feature ( #22990 )
2021-12-13 16:01:50 -06:00
0e5b14fa5e
chore: increase replications batch size limits ( #22983 )
2021-12-13 11:02:38 -06:00
a7a5233432
feat: advance queue scanner periodically instead of every remote write ( #22981 )
2021-12-13 10:09:36 -06:00
e3ff434f81
test: fix flaky replications tests ( #22973 )
...
* fix: fix test and run 20 times
* fix: unfix and run test 20 times
* test: wait for rq run fn to return in tests
2021-12-08 14:48:25 -06:00
e5cbd279ee
fix: advance replications queue after successful remote writes ( #22967 )
...
* fix: advance replications queue after successful remote writes to prevent data duplication on errors
* fix: loop on sendwrite
* chore: remove flaky test
* chore: add TODO about future optimization
2021-12-08 12:52:46 -06:00
39eeb3e456
fix(restore): fix race condition which could cause restore command to fail ( #22965 )
...
Fixes a race condition in the restore code path that could cause shard data restores to fail. When the race condition occurs, `Error while freeing cold shard resources` appears in the log files.
This is port of PR 22796 from master-1.x to master. Attempts at creating a test case for master failed, so the fix has ported without a corresponding unit test.
fixes #22957
2021-12-06 14:50:40 -06:00
6096ee2ad4
feat: replications metrics include failure to enqueue ( #22962 )
...
* feat: replications metrics include failure to enqueue
2021-12-02 14:42:55 -06:00
28bcd416b2
feat: batch replications remote writes to avoid payload limit errors ( #22914 )
...
* feat: batch replications remote writes appropriately to avoid payload limit errors
* chore: ran make fmt
* chore: fixed staticcheck failure
* refactor: removed batching code from queue manager
* refactor: batch writes before gzip compression
* fix: add in missing bracket after merge
* fix: removed duplicate lines of code from WritePoints function
* feat: add batching functionality for remote writes
* refactor: removed batch index variable
2021-12-02 12:04:10 -08:00
e4e16335f5
fix: replications remote writes do not block server shutdown ( #22958 )
...
* fix: replications remote writes do not block server shutdown
* fix: don't leak goroutine
2021-12-02 12:04:52 -06:00
b970e359dc
feat: remaining storage metrics from OSS engine ( #22938 )
...
* fix: simplify disk size tracking
* refactor: EngineTags in tsdb package
* fix: fewer compaction buckets and dead code removal
* feat: shard metrics
* chore: formatting
* feat: tsdb store metrics
* feat: retention check metrics
* chore: fix go vet
* fix: review comments
2021-12-02 09:01:46 -05:00
3460f1cc52
feat: replication remote writes do not block local writes ( #22956 )
...
* feat: replication remote writes do not block local writes
2021-12-01 15:37:10 -06:00
f05d0136f1
feat: metrics collection for replications remote writes ( #22952 )
...
* feat: metrics collection for replications remote writes
* fix: don't update metrics with 204 error code on successful writes
2021-12-01 12:41:24 -06:00
906015023c
test: add e2e test for replication streams ( #22949 )
...
* test: add e2e test for replication streams
* chore: fix race
2021-12-01 11:12:44 -06:00
9873ccd657
feat: remote write function for replications ( #22942 )
...
* feat: remote write function for replications
* chore: implement UpdateResponseInfo store method
* chore: only set gzip heading for non-empty requests
* fix: address review feedback
2021-11-30 15:33:42 -06:00
5ce164f849
fix: remove influx CLI output from CONTRIBUTING ( #22946 )
...
* fix: remove influx CLI output from CONTRIBUTING. Add link to influx CLI repo. Cleanup build instructions. Update Flux in README.
* fix: headers
2021-11-30 14:02:20 -06:00
799d349813
fix(tsi): sync index file before close ( #22927 )
...
(cherry picked from commit 5fd1b29d74
2021-11-24 15:52:45 -05:00
9308b6586a
chore: remove unused member from TagSet ( #22930 )
...
Co-authored-by: Tristan Su <suqing.sq@alibaba-inc.com>
2021-11-24 14:43:50 -05:00
4ee93a9b22
chore: fix up message when build fails due to OS ( #22928 )
2021-11-24 14:43:42 -05:00
8aa3a8f7e5
fix: add causal error when meta.db is missing ( #22905 )
2021-11-24 13:05:35 -05:00
f47d514225
refactor: move replications store functionality to separate package ( #22923 )
...
* refactor: move replications store functionality to separate package
* fix: make opening all repls on startup work right
2021-11-24 11:45:19 -06:00
5a1e3752c7
build: allow to build on FreeBSD ( #22285 )
...
* fix(build): checksum failed on FreeBSD
* fix(build): avoid BSD make evaluate Makefile
This Makefile use GNU make functions which is not compatible with the BSD
make. In order to avoid BSD make to try evaluation the Makefile and because
the Makefile use GNU make functions renaming the from Makefile to GNUmakefile
does not change anything for GNU make users and expose a clear error
when someone try to evaluate with BSD make.
* fix(build): invalid shebang on FreeBSD
2021-11-24 08:42:36 -05:00
edb21abe91
feat: metrics for wal subsystem ( #22918 )
...
https://github.com/influxdata/influxdb/issues/20026
2021-11-23 12:17:52 -05:00
feb459c785
feat: metrics for cache subsystem ( #22915 )
...
* fix: drop complicated cache metrics and document remaining
* feat: metrics for cache
2021-11-23 10:11:22 -05:00
a74e05177c
feat: disk size metrics per shard ( #22912 )
2021-11-22 16:53:55 -05:00
0a740856c7
feat: point write requests have metrics ( #22910 )
...
* fix: remove dead subscriptions code
* feat: storage_writer metrics
2021-11-22 12:58:17 -05:00
3a81166812
feat: added metrics collection for replications ( #22906 )
...
* feat: added metrics collection for replications
* fix: fixed panic when restarting
* fix: fix panic pt2
* chore: self-review fixes
* chore: simplify test
2021-11-22 11:40:03 -06:00
dece95d1dd
feat: tsm compaction metrics via prometheus ( #22904 )
...
* feat: tsm compaction metrics via prometheus
* chore: fix formatting
* chore: make activeCompactions a pointer
2021-11-19 14:51:22 -05:00
6ee472725f
refactor: use remote write func in NewDurableQueueManager ( #22888 )
2021-11-19 11:31:10 -06:00
b9b86a19a3
chore: remove remote validation code ( #22901 )
...
* chore: remove remote validation code
* chore: remove unused function
* chore: add todo for updating swagger ref
* chore: update swagger ref
2021-11-18 15:17:11 -07:00
fea3037c6b
feat: configure perf tests with yaml ( #22887 )
2021-11-18 15:02:31 -05:00
90baa802ed
chore: use tagged version of pkg-config ( #22898 )
2021-11-18 11:59:37 -07:00
9d8173c9f3
chore: delete dead pprof related code ( #22892 )
2021-11-18 08:28:17 -05:00
davidby-influx
Jonathan A. Sternberg
William Baker
Christopher M. Wolff
mcfarlm3
Sean Brickley
Geoffrey Wossum
Sam Arnold
Jason Stirnaman
Bryan FRIMIN
Dane Strandboge