Commit Graph

14918 Commits (db/6263/compaction-debug-logging)

Author SHA1 Message Date
Brandon Pfeifer e9f44a401a
build: allow circleci to build 1.x packages (#23104)
* build: enable version 1.x builds in circleci (#23087)

* wip: oss build first try

* build: remove unused release-engineering files

* build: update alpine and fpm versions

* build: remove static package builds

* fix: allow for ubuntu and centos package builds

* fix(build): supply INFLUXDB_VERSION to go and package buildsystems

rebaseme

* build: test debian and rpm packages

Co-authored-by: Sam Arnold <sarnold@influxdata.com>

* fix: resolve quoting issues in go build

* fix: rework version detection for circleci builds

Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2022-02-07 12:15:05 -05:00
davidby-influx f27df39c03
fix: add additional testing for MaxSeriesPerDatabase (#23094)
Added test to ensure new code path taken for inmem index
2022-02-02 13:16:09 -08:00
davidby-influx 0c3dca883e
fix: correctly handle MaxSeriesPerDatabaseExceeded (#23091)
Check for the correctly returned PartialWriteError
in (*shard).validateSeriesAndFields, allow partial
writes.

closes https://github.com/influxdata/influxdb/issues/23090
2022-02-01 19:08:51 -08:00
Geoffrey Wossum 1ab50d7557
fix: `influxd-ctl backup` will create a working backup when only `-shard` given (#22998)
`influxd-ctl backup` will now create a working backup when only the `-shard`
option is given. Previously this would create a backup that could not be
restored.

fixes #16751
2022-01-28 14:59:20 -06:00
davidby-influx eb3bc7069f
feat: configurable DELETE concurrency (#23055)
Currently, deletion of series or measurements are
serialized. This new feature will add
max-concurrent-deletes to the [data] section of the
 configuration file. Legal values are any positive
 number, defaulting to 1, the current behavior.

 closes https://github.com/influxdata/influxdb/issues/23054
2022-01-13 11:04:57 -08:00
Sam Arnold d2da5c5088
build: use latest build container (#23057) 2022-01-13 10:05:53 -05:00
Sam Arnold 3ce6cb45aa
fix: allow limiting shards during flux iterator reads (#23052) 2022-01-12 19:29:32 -05:00
J. Emrys Landivar 004438e91f
build: bigger stack for musl builds (#23043) 2022-01-07 12:33:12 -06:00
Sam Arnold e8c9f54532
test: increase timeout in continuous query test (#22955)
Closes: #22954
2021-12-01 13:26:39 -08:00
Dane Strandboge b2984faef7
chore: upgrade Flux, restore `rules_test.go` (#22931)
Upgrade Flux to v0.140.0
2021-11-25 08:13:46 -05:00
Sam Arnold 956915296a
fix: use defer for unlock (#22929) 2021-11-24 14:43:46 -05:00
davidby-influx 08a4a710eb
chore: upgrade Go to 1.17 (#22921)
* chore: upgrade Go to 1.17

* fix: update circleci container to go1.17

* fix: correct unsafe conversion of []byte to string

Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-11-24 12:47:26 -05:00
lifeibo 5be1c044c3
fix(tsi): sync index file before close (#21932) 2021-11-24 08:36:03 -05:00
Sam Arnold d4fd1cb4ca
chore: update changelog container (#22834) 2021-11-10 11:12:58 -05:00
davidby-influx 3f7192ab3c
fix: log at Debug level in influx_tools compact-shard (#22848)
Closes https://github.com/influxdata/influxdb/issues/22846
2021-11-08 16:50:48 -08:00
Sam Arnold 1b03f7ec35
chore: don't load approximate cache before saving new version (#22827) 2021-11-05 11:51:12 -04:00
Geoffrey Wossum 91609fdd3f
fix(restore): fix race condition which causes restore command to fail (#22796)
* fix(restore): fix race condition which causes restore command to fail

Fixes a race condition in the restore code path that causes shard data restores
to fail. When the bug occurs, `Error while freeing cold shard resources`
appears in the log files.

fixes issue #15323
2021-11-03 14:21:33 -05:00
davidby-influx af9e89a4d4
fix: detect misquoted tag values and return an error (#22754)
SHOW TAG KEYS FROM "foo" where bar="misquoted" is
erroneous, because the tag value must be enclosed
in single, not double, quotes. Although this
correctly returns no tag keys, it is very
inefficient and has cause out-of-memory failures
at a customer. This fix short-circuits the query.

closes https://github.com/influxdata/influxdb/issues/22755
2021-10-27 11:26:20 -07:00
Sam Arnold 312a3a7a69
chore: finalize changelog automation (#22770) 2021-10-27 08:35:32 -04:00
Sam Arnold d9bf99d493
chore: usage newer container for changelogger (#22761) 2021-10-26 11:49:11 -04:00
Sam Arnold 5f07c101ba
chore: fix frozen changelog path (#22760) 2021-10-26 11:01:15 -04:00
Sam Arnold 19f7fccebe
chore: temporarily enable changelog on merge to master-1.x (#22759)
* chore: temporarily enable changelog on merge to master-1.x

* fix: changelog generation improvement
2021-10-26 10:46:10 -04:00
Sam Arnold 0c0c8de001
chore: changelog automation (#22758) 2021-10-26 09:52:11 -04:00
davidby-influx d9b9e86db9
fix: extend snapshot copy to filesystems that cannot link (#22703)
If os.Link fails with syscall.ENOTSUP, then the file
system does not support links, and we must make copies
to snapshot files for backup. We also automatically make
copies instead of link on Windows, because although it
makes links, their semantics are different from Linux.

closes https://github.com/influxdata/influxdb/issues/16739
2021-10-21 12:53:26 -07:00
Dane Strandboge 09026509b6
chore: increase more flaky test timeouts (#22725) 2021-10-21 14:08:09 -05:00
Dane Strandboge 449319a964
chore: upgrade `influx_tools` to new protobuf library (#22717) 2021-10-21 14:00:53 -05:00
Dane Strandboge 06d1df22a2
chore: fix deadlock in `influx_inspect dumptsi` (#22661) 2021-10-20 12:48:59 -05:00
Sam Arnold 3a739948a6
fix: test runner uses gotestsum for better junit test capture (#22698) 2021-10-20 08:59:31 -04:00
Dane Strandboge 8b38d0e2bf
build: upgrade protobuf library (#22606) 2021-10-15 11:42:47 -05:00
Dane Strandboge e6c3d18942
chore: increase `TestMonitor_Reporter` timeout timer (#22662) 2021-10-13 14:02:12 -05:00
Sam Arnold 59fe8e515e
test: fix DiskSizeBytes flakiness (#22641) 2021-10-08 09:47:12 -04:00
davidby-influx fd1d51690d
feat: optionally dump queries to log on SIGTERM (#22638)
Dump all active queries to the log when a SIGTERM
is received and the termination-query-log flag is
true in the coordinator section of the config. The
default is false.
2021-10-07 14:02:38 -07:00
Sam Arnold 611a4370a2
feat: show measurements database and retention policy wildcards (#22388)
* feat: show measurements database and retention policy wildcards

Closes #3318

* chore: run formatter
2021-10-05 09:07:25 -04:00
davidby-influx 022b6e866b
feat: add thread-safe access to CountingWriter byte total (#22620)
Use atomic operations to update and report CountingWriter.Total through a new method.

closes https://github.com/influxdata/influxdb/issues/22618
2021-10-04 16:48:54 -07:00
Sam Arnold 3c811bcd81
fix: create shards without overlaps (#22601) 2021-10-01 13:38:52 -04:00
Cody Shepherd 57c6f2e75d
fix: update flux dependency to v0.131.0 (#22602) 2021-09-30 11:46:32 -07:00
Dane Strandboge b4e781eff6
fix(tsdb): sync series segment to disk after writing (#22566) 2021-09-23 14:10:29 -05:00
davidby-influx 3702fe8e76
fix: for Windows, copy snapshot files being backed up (#22551)
On Windows, make copies of files for snapshots, because
Go does not support the FILE_SHARE_DELETE flag which
allows files (and links) to be deleted while open. This
causes temporary directories to be left behind after
backups.

closes https://github.com/influxdata/influxdb/issues/16289
2021-09-22 10:56:17 -07:00
davidby-influx 1dde65bb75
fix(restore): enforce the -db parameter when -newdb used (#22542)
closes https://github.com/influxdata/influxdb/issues/15901
2021-09-22 08:50:32 -07:00
Sam Arnold 6b80ab1f77
build: update cross build container (#22333) 2021-09-22 07:26:37 -04:00
Cody Shepherd 380dade9b3
build: automate changelog (#22522) 2021-09-21 08:30:50 -07:00
davidby-influx d2199efcd7
fix: For Windows, close temp file before removing (#22492)
closes https://github.com/influxdata/influxdb/issues/21470
2021-09-16 09:52:17 -07:00
Sam Arnold 84b785b78c
fix: better error for no data from snapshots (#22452)
Closes: #16739
2021-09-16 09:34:31 -04:00
Cody Shepherd 24f9f05264
fix: influxdb packages should depend on curl (#22229)
* fix: influxdb packages should depend on curl bc of use in systemd script

* chore: update changelog

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-09-07 08:03:26 -07:00
davidby-influx e53f75e06d
fix: discard excessive errors (#22379)
The tsmBatchKeyIterator discards excessive errors to avoid
out-of-memory crashes when compacting very corrupt files.
Any error beyond DefaultMaxSavedErrors (100) will be
discarded instead of appended to the error slice.

closes https://github.com/influxdata/influxdb/issues/22328
2021-09-03 09:11:05 -07:00
Sam Arnold 50d3bcad99
build: upgrade flux to 0.127.3 (#22375) 2021-09-02 14:21:56 -04:00
Sam Arnold 38de69cc1c
fix: flux error properly read by cloud (#22348) 2021-08-31 17:43:12 -04:00
davidby-influx 926020e331
fix: correct error return shadowing (#22353) 2021-08-31 11:46:21 -07:00
Sam Arnold 1755b8f6d2
fix: TSI logfile race (#22338)
modTime should be protected by the read lock.

Fixes #22337
2021-08-30 17:43:37 -04:00
davidby-influx 0090c5b111
fix: return correct count of ErrNotExecuted (#22273)
executeQuery() iterates over statements until each is
processed or if an error is encountered that causes
the loop to exit pre-maturely. It should return
ErrNotExecuted for each remaining statement in the
query

closes https://github.com/influxdata/influxdb/issues/19136
2021-08-24 11:27:10 -07:00