Commit Graph

14739 Commits (df65c01ba2f77beefdc7a17827059acd216a3301)

Author SHA1 Message Date
Dane Strandboge e6c3d18942
chore: increase `TestMonitor_Reporter` timeout timer (#22662) 2021-10-13 14:02:12 -05:00
Sam Arnold 59fe8e515e
test: fix DiskSizeBytes flakiness (#22641) 2021-10-08 09:47:12 -04:00
davidby-influx fd1d51690d
feat: optionally dump queries to log on SIGTERM (#22638)
Dump all active queries to the log when a SIGTERM
is received and the termination-query-log flag is
true in the coordinator section of the config. The
default is false.
2021-10-07 14:02:38 -07:00
Sam Arnold 611a4370a2
feat: show measurements database and retention policy wildcards (#22388)
* feat: show measurements database and retention policy wildcards

Closes #3318

* chore: run formatter
2021-10-05 09:07:25 -04:00
davidby-influx 022b6e866b
feat: add thread-safe access to CountingWriter byte total (#22620)
Use atomic operations to update and report CountingWriter.Total through a new method.

closes https://github.com/influxdata/influxdb/issues/22618
2021-10-04 16:48:54 -07:00
Sam Arnold 3c811bcd81
fix: create shards without overlaps (#22601) 2021-10-01 13:38:52 -04:00
Cody Shepherd 57c6f2e75d
fix: update flux dependency to v0.131.0 (#22602) 2021-09-30 11:46:32 -07:00
Dane Strandboge b4e781eff6
fix(tsdb): sync series segment to disk after writing (#22566) 2021-09-23 14:10:29 -05:00
davidby-influx 3702fe8e76
fix: for Windows, copy snapshot files being backed up (#22551)
On Windows, make copies of files for snapshots, because
Go does not support the FILE_SHARE_DELETE flag which
allows files (and links) to be deleted while open. This
causes temporary directories to be left behind after
backups.

closes https://github.com/influxdata/influxdb/issues/16289
2021-09-22 10:56:17 -07:00
davidby-influx 1dde65bb75
fix(restore): enforce the -db parameter when -newdb used (#22542)
closes https://github.com/influxdata/influxdb/issues/15901
2021-09-22 08:50:32 -07:00
Sam Arnold 6b80ab1f77
build: update cross build container (#22333) 2021-09-22 07:26:37 -04:00
Cody Shepherd 380dade9b3
build: automate changelog (#22522) 2021-09-21 08:30:50 -07:00
davidby-influx d2199efcd7
fix: For Windows, close temp file before removing (#22492)
closes https://github.com/influxdata/influxdb/issues/21470
2021-09-16 09:52:17 -07:00
Sam Arnold 84b785b78c
fix: better error for no data from snapshots (#22452)
Closes: #16739
2021-09-16 09:34:31 -04:00
Cody Shepherd 24f9f05264
fix: influxdb packages should depend on curl (#22229)
* fix: influxdb packages should depend on curl bc of use in systemd script

* chore: update changelog

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-09-07 08:03:26 -07:00
davidby-influx e53f75e06d
fix: discard excessive errors (#22379)
The tsmBatchKeyIterator discards excessive errors to avoid
out-of-memory crashes when compacting very corrupt files.
Any error beyond DefaultMaxSavedErrors (100) will be
discarded instead of appended to the error slice.

closes https://github.com/influxdata/influxdb/issues/22328
2021-09-03 09:11:05 -07:00
Sam Arnold 50d3bcad99
build: upgrade flux to 0.127.3 (#22375) 2021-09-02 14:21:56 -04:00
Sam Arnold 38de69cc1c
fix: flux error properly read by cloud (#22348) 2021-08-31 17:43:12 -04:00
davidby-influx 926020e331
fix: correct error return shadowing (#22353) 2021-08-31 11:46:21 -07:00
Sam Arnold 1755b8f6d2
fix: TSI logfile race (#22338)
modTime should be protected by the read lock.

Fixes #22337
2021-08-30 17:43:37 -04:00
davidby-influx 0090c5b111
fix: return correct count of ErrNotExecuted (#22273)
executeQuery() iterates over statements until each is
processed or if an error is encountered that causes
the loop to exit pre-maturely. It should return
ErrNotExecuted for each remaining statement in the
query

closes https://github.com/influxdata/influxdb/issues/19136
2021-08-24 11:27:10 -07:00
Sam Arnold 27e5f9709e
build: update circle jobs to use cross build container (#22286)
* build: update circle jobs to use cross build container

* build: fixes for review comments
2021-08-24 12:53:31 -04:00
davidby-influx 71b3d06494
fix: require database authorization to see continuous queries (#22283)
SHOW CONTINUOUS QUERIES now requires the same permissions
as SHOW DATABASES in order to see the continuous queries
in a database.

closes https://github.com/influxdata/influxdb/issues/10292
2021-08-24 08:56:56 -07:00
Tristan Su e5f6894037
fix(tsm): check write-ahead-log size (#18991) 2021-08-24 11:44:01 -04:00
davidby-influx 7d3efe1e9e
fix: avoid compaction queue stats flutter. (#22195)
When the compaction planner runs, if it cannot acquire
a lock on the files it plans to compact, it returns a
nil list of compaction groups. This, in turn, sets the
engine statistics for compactions queues to zero,
which is incorrect. Instead, use the length of pending
files which would have been returned.

closes https://github.com/influxdata/influxdb/issues/22138
2021-08-16 09:21:07 -07:00
Sam Arnold fd81373937
test: expose tcpaddr for enterprise tests (#22172)
* docs: update comment for series updates

* fix: expose TCP address for Enterprise test harness

* refactor: remove dead RemoteServer code
2021-08-11 17:19:26 -04:00
Cody Shepherd f71ab14888
fix: systemd service -- handle https, 40x, and block indefinitely (#22090)
* fix: systemd service --handle 40x and block indefinitely

* chore: update changelog
2021-08-10 14:35:12 -07:00
Sam Arnold 90b4c80af2
test: compile time only needs testing once (#22123)
* test: compile time only needs testing once

* test: fix review comments for Cody
2021-08-09 16:58:07 -04:00
Cody Shepherd 37faac9755
chore: update flux dependency (#22097)
* chore: update flux dependency

* chore: update changelog
2021-08-09 09:32:19 -07:00
Sam Arnold 3ae389b359
test: add extra logging when disk size test fails (#22103) 2021-08-07 06:48:42 -04:00
davidby-influx 0315d2ede1
fix: ensure log formatting (JSON) is respected (#22106)
Replace usage of the Go log package with the zap
logger and respect the formatting specified in
the configuration file.

closes https://github.com/influxdata/influxdb/issues/22104
2021-08-06 16:32:30 -07:00
Sam Arnold 444c22b67d
test: fix order of index teardown (#22038) 2021-08-04 16:34:51 -04:00
davidby-influx a989f8f8b6
fix: copy names from mmapped memory before closing iterator (#22040)
This fix ensures that memory-mapped files are not released
before pointers into them are copied into heap memory.
MeasurementNamesByExpr() and MeasurementNamesByPredicate() can
cause panics by copying memory from mmapped files that have been
released. The functions they call use iterators to files which
are closed (releasing the mmapped files) before the memory is
safely copied to the heap.

closes https://github.com/influxdata/influxdb/issues/22000
2021-08-04 13:16:00 -07:00
Sam Arnold d0fe2ba2ff
fix: error instead of panic when enterprise tries to restore with OSS (#22019) 2021-08-03 15:56:19 -04:00
Sam Arnold 733a6b4245
feat: add subscription buffer size usage metric (#22020) 2021-08-03 14:32:41 -04:00
Cody Shepherd 8f8e9209c6
fix: systemd-start script should be executable by group and others (#21992)
* fix: systemd unit should block on startup until http endpoint is ready

* fix: systemd-start script should be executable by group and others

* chore: update changelog
2021-08-03 08:22:11 -07:00
Cody Shepherd af5a5e476d
chore: pin rust version in additional place (#22009)
* chore: pin rust version

* chore: additional place to pin rust version
2021-08-03 07:22:03 -07:00
davidby-influx 519e23b86a
feat: SHOW TAG VALUES should produce results from one specific RP (#21983)
Ensure that the Sources field of the ShowTagValuesStatement is
filled in. Then use the sources to limit the retention policies,
and thus the shards from which tag values are collected.

This fix only works on TSI databases; INMEM shards share
indices, so restricting shard indices used does not restrict the
tag values returned.

This will not permit multiple retention policies to be specified in 
a query; either all RPs or one are permitted.

Closes https://github.com/influxdata/influxdb/issues/21981
2021-08-02 11:11:39 -07:00
Sam Arnold e62efaf751
fix: old tsl files should be compacted without new writes (#22006)
* fix: old tsl files should be compacted wihout new writes

* chore: update changelog.md
2021-08-02 13:36:23 -04:00
Cody Shepherd 12f361062d
chore: pin rust version (#21995) 2021-08-02 08:37:48 -07:00
Sam Arnold 5bbb61b815
fix: restore portable backup error (#21978)
Originally committed by rickif in https://github.com/influxdata/influxdb/pull/20115/files

This is manual copy of the changes to master-1.x
2021-07-30 13:06:54 -04:00
Jonathan A. Sternberg 8fae484a66
feat: update flux components to use flux/array instead of arrow/array (#21979)
This updates the flux integration to use the `flux/array` package rather
than directly using the `arrow/array` package.

Flux recently switched to wrapping the array types from arrow and
creating its own array package to be used for table columns instead of
directly referencing the arrow package. This allows us to keep a
consistent interface, but potentially change internal implementations
without changing downstream consumers. Most recently, the
`*array.String` type has some of its own optimizations for certain array
patterns.

This change updates the flux integration to use the new API.
2021-07-30 08:59:52 -04:00
Sam Arnold eef37b96b9
test: ensure compile takes time (#21973) 2021-07-29 17:22:17 -04:00
Daniel Moran 62484387cf
fix: prevent silently dropped writes with overlapping shards (#21947)
Co-authored-by: Geoffrey Wossum <gwossum@influxdata.com>
2021-07-27 12:29:01 -04:00
Sam Arnold b64c2c3dcf
fix: tsi index should compact old or too-large log files (#21943)
* fix: tsi index should compact old log files that are too large

* chore: run automated formatter

* chore: update changelog

* fix: review comments
2021-07-26 17:40:15 -04:00
Jamie Strandboge dec56f9c31
chore: use community maintained golang-jwt (#21934)
The dgrijalva/jwt-go project is no longer maintained[1] and they have
transferred ownership to golang-jwt/jwt[2][3][4]. We should move to the
supported golang-jwt/jwt.

The following was performed:

1. update services/httpd/handler*.go to import golang-jwt/jwt
2. revert testcase string comparison changes from 225bcecd (back to v3)
2. go mod edit -require github.com/golang-jwt/jwt@v3.2.1+incompatible
3. go mod edit -droprequire github.com/dgrijalva/jwt-go
4. go mod tidy  # see note
5. go clean ./... && go build ./...
6. go test ./...

Note: 'go mod tidy' had unrelated changes (perhaps it wasn't run in
recent commits) so I removed the unrelated delta to keep this PR focused
on the dgrijalva/jwt-go to golang-jwt/jwt changes.

References:
[1] dgrijalva/jwt-go#462
[2] dgrijalva/jwt-go#463
[3] https://github.com/dgrijalva/jwt-go/blob/master/README.md
[4] https://github.com/golang-jwt/jwt
[5] https://github.com/influxdata/influxdb/issues/21926
2021-07-23 11:41:14 -05:00
Cody Shepherd ca97bb2b28
chore: update master-1.x changelog to reflect v1.8.7 release (#21907) 2021-07-21 12:25:24 -07:00
Sam Arnold 22809a33aa
fix: export example and fix adjacent shards (#21863)
* fix: export example and fix adjacent shards

* fix: Cody's review
2021-07-21 09:39:31 -04:00
Cody Shepherd d0772d7d67
fix: systemd unit should block on startup until http endpoint is ready (#21895)
* fix: systemd unit should block on startup until http endpoint is ready

* chore: update changelog
2021-07-20 11:08:03 -07:00
Sam Arnold 23c3d35aab
chore: update protobuf library versions and remove influx_tsm (#21882)
* chore: update protobufs

* fix: run codegen during build

* fix: fully remove influx_tsm
2021-07-20 09:42:52 -04:00