Commit Graph

14903 Commits (db/shards_persisting_chaos_testing)

Author SHA1 Message Date
Sam Arnold 1b03f7ec35
chore: don't load approximate cache before saving new version (#22827) 2021-11-05 11:51:12 -04:00
Geoffrey Wossum 91609fdd3f
fix(restore): fix race condition which causes restore command to fail (#22796)
* fix(restore): fix race condition which causes restore command to fail

Fixes a race condition in the restore code path that causes shard data restores
to fail. When the bug occurs, `Error while freeing cold shard resources`
appears in the log files.

fixes issue #15323
2021-11-03 14:21:33 -05:00
davidby-influx af9e89a4d4
fix: detect misquoted tag values and return an error (#22754)
SHOW TAG KEYS FROM "foo" where bar="misquoted" is
erroneous, because the tag value must be enclosed
in single, not double, quotes. Although this
correctly returns no tag keys, it is very
inefficient and has cause out-of-memory failures
at a customer. This fix short-circuits the query.

closes https://github.com/influxdata/influxdb/issues/22755
2021-10-27 11:26:20 -07:00
Sam Arnold 312a3a7a69
chore: finalize changelog automation (#22770) 2021-10-27 08:35:32 -04:00
Sam Arnold d9bf99d493
chore: usage newer container for changelogger (#22761) 2021-10-26 11:49:11 -04:00
Sam Arnold 5f07c101ba
chore: fix frozen changelog path (#22760) 2021-10-26 11:01:15 -04:00
Sam Arnold 19f7fccebe
chore: temporarily enable changelog on merge to master-1.x (#22759)
* chore: temporarily enable changelog on merge to master-1.x

* fix: changelog generation improvement
2021-10-26 10:46:10 -04:00
Sam Arnold 0c0c8de001
chore: changelog automation (#22758) 2021-10-26 09:52:11 -04:00
davidby-influx d9b9e86db9
fix: extend snapshot copy to filesystems that cannot link (#22703)
If os.Link fails with syscall.ENOTSUP, then the file
system does not support links, and we must make copies
to snapshot files for backup. We also automatically make
copies instead of link on Windows, because although it
makes links, their semantics are different from Linux.

closes https://github.com/influxdata/influxdb/issues/16739
2021-10-21 12:53:26 -07:00
Dane Strandboge 09026509b6
chore: increase more flaky test timeouts (#22725) 2021-10-21 14:08:09 -05:00
Dane Strandboge 449319a964
chore: upgrade `influx_tools` to new protobuf library (#22717) 2021-10-21 14:00:53 -05:00
Dane Strandboge 06d1df22a2
chore: fix deadlock in `influx_inspect dumptsi` (#22661) 2021-10-20 12:48:59 -05:00
Sam Arnold 3a739948a6
fix: test runner uses gotestsum for better junit test capture (#22698) 2021-10-20 08:59:31 -04:00
Dane Strandboge 8b38d0e2bf
build: upgrade protobuf library (#22606) 2021-10-15 11:42:47 -05:00
Dane Strandboge e6c3d18942
chore: increase `TestMonitor_Reporter` timeout timer (#22662) 2021-10-13 14:02:12 -05:00
Sam Arnold 59fe8e515e
test: fix DiskSizeBytes flakiness (#22641) 2021-10-08 09:47:12 -04:00
davidby-influx fd1d51690d
feat: optionally dump queries to log on SIGTERM (#22638)
Dump all active queries to the log when a SIGTERM
is received and the termination-query-log flag is
true in the coordinator section of the config. The
default is false.
2021-10-07 14:02:38 -07:00
Sam Arnold 611a4370a2
feat: show measurements database and retention policy wildcards (#22388)
* feat: show measurements database and retention policy wildcards

Closes #3318

* chore: run formatter
2021-10-05 09:07:25 -04:00
davidby-influx 022b6e866b
feat: add thread-safe access to CountingWriter byte total (#22620)
Use atomic operations to update and report CountingWriter.Total through a new method.

closes https://github.com/influxdata/influxdb/issues/22618
2021-10-04 16:48:54 -07:00
Sam Arnold 3c811bcd81
fix: create shards without overlaps (#22601) 2021-10-01 13:38:52 -04:00
Cody Shepherd 57c6f2e75d
fix: update flux dependency to v0.131.0 (#22602) 2021-09-30 11:46:32 -07:00
Dane Strandboge b4e781eff6
fix(tsdb): sync series segment to disk after writing (#22566) 2021-09-23 14:10:29 -05:00
davidby-influx 3702fe8e76
fix: for Windows, copy snapshot files being backed up (#22551)
On Windows, make copies of files for snapshots, because
Go does not support the FILE_SHARE_DELETE flag which
allows files (and links) to be deleted while open. This
causes temporary directories to be left behind after
backups.

closes https://github.com/influxdata/influxdb/issues/16289
2021-09-22 10:56:17 -07:00
davidby-influx 1dde65bb75
fix(restore): enforce the -db parameter when -newdb used (#22542)
closes https://github.com/influxdata/influxdb/issues/15901
2021-09-22 08:50:32 -07:00
Sam Arnold 6b80ab1f77
build: update cross build container (#22333) 2021-09-22 07:26:37 -04:00
Cody Shepherd 380dade9b3
build: automate changelog (#22522) 2021-09-21 08:30:50 -07:00
davidby-influx d2199efcd7
fix: For Windows, close temp file before removing (#22492)
closes https://github.com/influxdata/influxdb/issues/21470
2021-09-16 09:52:17 -07:00
Sam Arnold 84b785b78c
fix: better error for no data from snapshots (#22452)
Closes: #16739
2021-09-16 09:34:31 -04:00
Cody Shepherd 24f9f05264
fix: influxdb packages should depend on curl (#22229)
* fix: influxdb packages should depend on curl bc of use in systemd script

* chore: update changelog

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-09-07 08:03:26 -07:00
davidby-influx e53f75e06d
fix: discard excessive errors (#22379)
The tsmBatchKeyIterator discards excessive errors to avoid
out-of-memory crashes when compacting very corrupt files.
Any error beyond DefaultMaxSavedErrors (100) will be
discarded instead of appended to the error slice.

closes https://github.com/influxdata/influxdb/issues/22328
2021-09-03 09:11:05 -07:00
Sam Arnold 50d3bcad99
build: upgrade flux to 0.127.3 (#22375) 2021-09-02 14:21:56 -04:00
Sam Arnold 38de69cc1c
fix: flux error properly read by cloud (#22348) 2021-08-31 17:43:12 -04:00
davidby-influx 926020e331
fix: correct error return shadowing (#22353) 2021-08-31 11:46:21 -07:00
Sam Arnold 1755b8f6d2
fix: TSI logfile race (#22338)
modTime should be protected by the read lock.

Fixes #22337
2021-08-30 17:43:37 -04:00
davidby-influx 0090c5b111
fix: return correct count of ErrNotExecuted (#22273)
executeQuery() iterates over statements until each is
processed or if an error is encountered that causes
the loop to exit pre-maturely. It should return
ErrNotExecuted for each remaining statement in the
query

closes https://github.com/influxdata/influxdb/issues/19136
2021-08-24 11:27:10 -07:00
Sam Arnold 27e5f9709e
build: update circle jobs to use cross build container (#22286)
* build: update circle jobs to use cross build container

* build: fixes for review comments
2021-08-24 12:53:31 -04:00
davidby-influx 71b3d06494
fix: require database authorization to see continuous queries (#22283)
SHOW CONTINUOUS QUERIES now requires the same permissions
as SHOW DATABASES in order to see the continuous queries
in a database.

closes https://github.com/influxdata/influxdb/issues/10292
2021-08-24 08:56:56 -07:00
Tristan Su e5f6894037
fix(tsm): check write-ahead-log size (#18991) 2021-08-24 11:44:01 -04:00
davidby-influx 7d3efe1e9e
fix: avoid compaction queue stats flutter. (#22195)
When the compaction planner runs, if it cannot acquire
a lock on the files it plans to compact, it returns a
nil list of compaction groups. This, in turn, sets the
engine statistics for compactions queues to zero,
which is incorrect. Instead, use the length of pending
files which would have been returned.

closes https://github.com/influxdata/influxdb/issues/22138
2021-08-16 09:21:07 -07:00
Sam Arnold fd81373937
test: expose tcpaddr for enterprise tests (#22172)
* docs: update comment for series updates

* fix: expose TCP address for Enterprise test harness

* refactor: remove dead RemoteServer code
2021-08-11 17:19:26 -04:00
Cody Shepherd f71ab14888
fix: systemd service -- handle https, 40x, and block indefinitely (#22090)
* fix: systemd service --handle 40x and block indefinitely

* chore: update changelog
2021-08-10 14:35:12 -07:00
Sam Arnold 90b4c80af2
test: compile time only needs testing once (#22123)
* test: compile time only needs testing once

* test: fix review comments for Cody
2021-08-09 16:58:07 -04:00
Cody Shepherd 37faac9755
chore: update flux dependency (#22097)
* chore: update flux dependency

* chore: update changelog
2021-08-09 09:32:19 -07:00
Sam Arnold 3ae389b359
test: add extra logging when disk size test fails (#22103) 2021-08-07 06:48:42 -04:00
davidby-influx 0315d2ede1
fix: ensure log formatting (JSON) is respected (#22106)
Replace usage of the Go log package with the zap
logger and respect the formatting specified in
the configuration file.

closes https://github.com/influxdata/influxdb/issues/22104
2021-08-06 16:32:30 -07:00
Sam Arnold 444c22b67d
test: fix order of index teardown (#22038) 2021-08-04 16:34:51 -04:00
davidby-influx a989f8f8b6
fix: copy names from mmapped memory before closing iterator (#22040)
This fix ensures that memory-mapped files are not released
before pointers into them are copied into heap memory.
MeasurementNamesByExpr() and MeasurementNamesByPredicate() can
cause panics by copying memory from mmapped files that have been
released. The functions they call use iterators to files which
are closed (releasing the mmapped files) before the memory is
safely copied to the heap.

closes https://github.com/influxdata/influxdb/issues/22000
2021-08-04 13:16:00 -07:00
Sam Arnold d0fe2ba2ff
fix: error instead of panic when enterprise tries to restore with OSS (#22019) 2021-08-03 15:56:19 -04:00
Sam Arnold 733a6b4245
feat: add subscription buffer size usage metric (#22020) 2021-08-03 14:32:41 -04:00
Cody Shepherd 8f8e9209c6
fix: systemd-start script should be executable by group and others (#21992)
* fix: systemd unit should block on startup until http endpoint is ready

* fix: systemd-start script should be executable by group and others

* chore: update changelog
2021-08-03 08:22:11 -07:00