Commit Graph

34761 Commits (b1b076f6007b29473cc81395523771674960de8d)

Author SHA1 Message Date
Daniel Moran b1b076f600
refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo (#21703) 2021-06-17 09:18:55 -04:00
William Baker 235366a603
feat: enable annotations backend (#21702)
* feat: enable annotations backend
2021-06-16 12:41:23 -04:00
Sam Arnold 2a4dc9e356
fix: remove incorrect optimization for group-by (#21691)
* fix: remove incorrect optimization for group-by

Closes #21639

* test: add test for the broken group-by

* chore: formatting
2021-06-16 12:23:05 -04:00
William Baker 22f4f5bba8
chore: remove unnecessary file name from metadata backup api (#21701) 2021-06-16 09:17:03 -04:00
William Baker 5b2511c776
feat(notebooks): additional auth filter for listing (#21699) 2021-06-16 09:02:40 -04:00
William Baker 1935c13c16
feat(annotations): storage service (#21690)
* feat(annotations): storage service

* feat: stickers are in db as array

* chore: fix some unintended diffs

* fix: fixes from review

* fix: specific table name for json_each

* fix: update primary keys and constraints

* fix: fix schema

* feat: stream name updates are reflected in annotations via FK
2021-06-15 18:36:11 -04:00
Nathaniel Cook 56833b772b
build(flux): update flux to v0.118.1 (#21694) 2021-06-15 14:20:17 -06:00
davidby-influx f8ef784cff
fix: don't access a field in a nil struct (#21693) (#21696)
(cherry picked from commit aca69e530f)
2021-06-15 11:51:51 -07:00
Cody Shepherd 45f8c66345
chore: enable ingest performance tests for master (#21627)
* chore: enable ingest performance tests (#21624)

* chore: add run script for performance tests

* chore: update circle config to run performance tests

* chore: adjustments to perf test config

* remove 1.8 branch here, as that branch is already configured for perf
  tests
* remove extraneous comments in config and perftest script
* move perftest setup logic out of circle config and into a script
* use a specific ubuntu machine image for circle driver
* omit gzip/gunzip from perf test dataset manipulations

* chore: use r5.2xlarge instance type and put perf test dataset in ramdisk

* chore: fix query logic in nightly aws teardown (#21678)
2021-06-15 10:00:40 -07:00
Nathaniel Cook 4e7d1b3909
chore(go-bindata): update to recent version of go-bindata (#21684)
It seems that go-bindata version 3.11.0 was changed and causes issues
when building from a clean Go env.

See :
verifying github.com/kevinburke/go-bindata@v3.11.0+incompatible: checksum mismatch
	downloaded: h1:GiPs9jxaG2xY1B5Dt/d/yHUOMlTk14uS35VcmHrdo4I=
	go.sum:     h1:RcC+GJNmrBHbGaOpQ9MBD8z22rdzlIm0esDRDkyxd4s=

This change updates to the latest go-bindata release.
2021-06-15 10:06:01 -06:00
Daniel Moran 8fa7e5fa8c
feat: implement new restore/bucket-metadata API (#21685) 2021-06-15 10:32:47 -04:00
Daniel Moran e0d8a98837
feat: add bucket description to backup manifest (#21683) 2021-06-14 16:32:28 -04:00
Daniel Moran a216501723
feat: add support for gzip request bodies in restore API (#21676) 2021-06-14 11:52:31 -04:00
Daniel Moran 3e3e77ed1d
docs: bump Go version in build-from-source docs (#21677) 2021-06-14 11:07:52 -04:00
Daniel Moran 242e313b10
feat: add gzip support to backup API responses (#21675) 2021-06-14 10:37:49 -04:00
William Baker 8ee59f4bf4
feat(annotations): authorization service (#21665)
* feat(annotations): added authz service for annotations and streams

* fix: tests and adjustments

* chore: misc cleanup

* chore: update number in authz comment

Co-authored-by: Daniel Moran <danxmoran@gmail.com>

* chore: update number in authz comment

Co-authored-by: Daniel Moran <danxmoran@gmail.com>

* chore: update number in authz comment

Co-authored-by: Daniel Moran <danxmoran@gmail.com>

* fix: address review comments

* feat: added post-list filter for fine-grained auth

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-06-11 17:39:51 -04:00
William Baker 40c7d69415
feat: use go embed for sqlite migrations (#21653) 2021-06-10 18:40:57 -04:00
davidby-influx 5251c85412
fix: Do not close connection twice in DigestWithOptions (#21659) (#21662)
tsm1.DigestWithOptions closes its network connection
twice. This may cause broken pipe errors on concurrent
invocations of the same procedure, by closing a reused
i/o descriptor. This fix also captures errors from TSM
file closures, which were previously ignored.

Closes https://github.com/influxdata/influxdb/issues/21656

(cherry picked from commit bce6553459)

Closes https://github.com/influxdata/influxdb/issues/21660
2021-06-10 13:32:36 -07:00
Daniel Moran 23547fe746
build: make sure go1.16 is installed in machine-executor jobs (#21658) 2021-06-10 14:50:17 -04:00
Timmy Luong 354c385ee7
fix: change static legend's hide property to show (#21648) 2021-06-10 09:20:59 -07:00
William Baker fa31037d37
feat(annotations): annotations api handlers (#21645)
* feat(annotations): annotations handler; annotations & streams router

* chore: fix typos & clarify comments
2021-06-09 16:20:22 -04:00
Daniel Moran 9b02820a0f
build: upgrade to go1.16 (#21642)
* build: bump to go 1.16
* build: go mod tidy & update godeps CI step
2021-06-09 12:59:05 -04:00
Dane Strandboge 8b90d23088
feat: Port influxd inspect verify-tsm (#21615)
* feat: port tsm-inspect command to dbv2

* test: add test code for tsm-verify

* chore: delete old tsm-verify code stubs

* docs: update changelog

* chore: test for broken checksums more thoroughly
2021-06-09 10:38:51 -05:00
Daniel Moran d747e7ec4e
feat: add config parameters to toggle WAL concurrency and timeouts (#21621)
* feat: add context parameter to Take() method on fixed limiter
* refactor: plumb context through to uses of Take()
* test: update tests to pass context as needed
* feat: add config toggles for setting WAL write concurrency & timeout
2021-06-09 11:03:53 -04:00
Dane Strandboge c665c749fe
feat: Port influxd inspect verify-seriesfile (#21635)
* feat: Port influxd inspect verify-seriesfile

* chore: clean up logic, use zaptest logger

* chore: better error handling

* chore: generic error return statement

* chore: collapse nil check into if-block

Co-authored-by: Daniel Moran <danxmoran@gmail.com>

* chore: update changelog

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-06-08 15:19:21 -05:00
pierwill e59b8ea078
fix: verify rustup checksum in CI (#21637)
* chore: bump rust in CI to 1.52.1
2021-06-08 13:32:13 -05:00
William Baker b1ef9f668c
feat(annotations): annotations service definition (#21629)
* feat(annotations): annotations service definition

* feat: generate mock for annotations service

* fix: use utf8.RuneCountInString; nowFunc as a parameter
2021-06-08 12:56:33 -04:00
Daniel Moran a187292632
chore: update CHANGELOG to reflect 2.0.7 release (#21632) 2021-06-08 10:47:36 -04:00
Jonathan A. Sternberg 7e126811aa
build(flux): update flux to v0.117.3 (#21623) 2021-06-07 14:16:16 -05:00
Nathaniel Cook 8496ada3cc
feat(fluxtest): add ability to wait between test runs (#21626)
This change adds a flag to the flux-test-harness cmd that makes the test
harness wait between test runs leaving the InfluxDB instance running for
inspection. The credentials for connecting to the test instance are also
added to the local influx cli configs.
2021-06-07 11:44:58 -06:00
davidby-influx d10a727157
fix: avoid rewriting fields.idx unnecessarily (#21592) (#21610)
Under heavy write load creating new fields and measurements
the rewrite of the fields.idx file is a bottleneck. This
enhancement combines multiple writes into a single one and
shares any error return value with all of the combined
invocations. MeasurementFieldSet and the new
MeasurementFieldSetWriter must both now be explicitly
closed.

Closes #21577

(cherry picked from commit f64be286be)

Closes https://github.com/influxdata/influxdb/issues/21598
2021-06-04 13:17:53 -07:00
William Baker 04d7742b26
feat: enable the notebooks backend (#21613)
* feat: remove feature flag from notebooks backend
2021-06-04 15:56:34 -04:00
Nathaniel Cook 67f366d9cb
fix(query): do not hide errors from first pass of flux acceptance tests (#21602) 2021-06-04 13:24:51 -06:00
Daniel Moran 2e2552f75f
test: move InfluxQL compatibility suites so they're covered by linting & `go test` (#21611)
* Move InfluxQL tests so they're included in normal `go test`
* Fix `staticcheck` errors
* No parallel runs for influxql
2021-06-04 14:40:42 -04:00
Yun Zhao c22fe2f0d7
fix(coordinator): avoid unnecessary copy of FieldDimensions result data (#21390) 2021-06-04 13:09:42 -04:00
Daniel Moran fd9a08862e
build: speed up CI runtime (#21608)
* Stop using GOCACHE, it only ever grows in size and the upload/download ends up dominating job runtime
* Use RAMdisks in build/test steps where we expect it'll help runtime
2021-06-04 12:31:58 -04:00
Yun Zhao 2116332950
fix(tsm1): fix calculation of tsmFullCompactionQueue statistic (#20897)
Co-authored-by: zhaoyun.248 <zhaoyun.248@bytedance.com>
2021-06-04 10:26:37 -04:00
William Baker 34a4a8e60e
feat: metadata backup returns bucket manifests (#21601)
* fix: properly omit empty time.Time that are optional

* fix: optimize slice creation in manifest fns
2021-06-04 09:26:17 -04:00
Yun Zhao ce536037dc
fix(tsm1): limit concurrent WAL encodings to reduce memory pressure under heavy write load (#20814)
Co-authored-by: zhaoyun.248 <zhaoyun.248@bytedance.com>
2021-06-03 16:11:36 -04:00
Sunil Kartikey cd546e9eb8
fix: report error when a flux acceptance test doesn't have a package statement (#21594) 2021-06-03 16:36:57 +01:00
William Baker b0ea3b6675
feat: backup and restore sqlite database (#21584)
* feat: new metadata backup endpoint

* feat: added restore/sql API endpoint

* fix: content-type is multipart/mixed, part names are kv and sql

* fix: changed multipart manifest to buckets and made it .json

* feat: added lock for backing up sqlite and bolt dbs

* fix: use read lock instead of write lock on kv during backup

* fix: use filepath.Join for temp dirs
2021-06-02 19:07:53 -04:00
Dane Strandboge c88fc07451
docs: Update build-from-source docs to favor make commands (#21590)
* docs: add link to Homebrew install for OSX

* docs: remove go command info in favor of make

* docs: update OSX make command installation
2021-06-02 16:33:40 -05:00
William Baker b928d3bda4
fix: empty notebooks list returns empty array (#21588) 2021-06-02 14:33:37 -04:00
Sean Brickley 75594094f5
build(flux): update flux to v0.117.1 (#21583) 2021-06-01 14:34:06 -04:00
Stuart Carnie d165d76fc3
feat: influx CLI Packager support for explicit schema buckets (#21465)
This commit adds the minimal requirements to process specs containing
explicit schema buckets, so they may be exported and applied from
Cloud 2.
2021-05-31 10:01:29 +10:00
William Baker ed629bfebe
feat(notebooks): notebooks database implementation (#21573) 2021-05-28 09:29:00 -04:00
William Baker c267b31232
chore: move notebook service interface to root (#21570) 2021-05-26 12:27:56 -04:00
Jill R. Pelavin 46fe0ee9d1
chore: adding rangeAnnotations feature flag (#21556) 2021-05-25 15:25:05 -04:00
Timmy Luong b0d62f0c72
feat: add legendHide for the tooltip (#21547) 2021-05-25 10:31:50 -07:00
William Baker 19b0470ed7
feat: integrated sqlite db for metadata (#21543) 2021-05-25 12:12:07 -04:00