Commit Graph

1128 Commits (1f66b3110efb691935ddde0d060800291c20ef5d)

Author SHA1 Message Date
Dane Strandboge 7c529d929a
feat: port `influxd inspect dump-tsm` (#21761)
This differs from the 1.x implementation as the blocks and index in-depth printout will now only happen if explicitly stated, instead of being printed with filterKey set
2021-07-02 15:51:36 -05:00
Dane Strandboge 8e8953f2c5
refactor: reorganize inspect subcommands for better package hierarchy (#21763) 2021-06-30 11:46:47 -05:00
Dane Strandboge 3c715d6851
feat: Port influxd inspect verify-tombstone subcommand (#21646) 2021-06-28 15:14:30 -05:00
Daniel Moran ab589cc326
chore: delete deprecated PostSetupUser API (#21709) 2021-06-22 09:09:52 -04:00
Daniel Moran b1b076f600
refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo (#21703) 2021-06-17 09:18:55 -04:00
William Baker 235366a603
feat: enable annotations backend (#21702)
* feat: enable annotations backend
2021-06-16 12:41:23 -04:00
William Baker 40c7d69415
feat: use go embed for sqlite migrations (#21653) 2021-06-10 18:40:57 -04:00
Dane Strandboge 8b90d23088
feat: Port influxd inspect verify-tsm (#21615)
* feat: port tsm-inspect command to dbv2

* test: add test code for tsm-verify

* chore: delete old tsm-verify code stubs

* docs: update changelog

* chore: test for broken checksums more thoroughly
2021-06-09 10:38:51 -05:00
Daniel Moran d747e7ec4e
feat: add config parameters to toggle WAL concurrency and timeouts (#21621)
* feat: add context parameter to Take() method on fixed limiter
* refactor: plumb context through to uses of Take()
* test: update tests to pass context as needed
* feat: add config toggles for setting WAL write concurrency & timeout
2021-06-09 11:03:53 -04:00
Dane Strandboge c665c749fe
feat: Port influxd inspect verify-seriesfile (#21635)
* feat: Port influxd inspect verify-seriesfile

* chore: clean up logic, use zaptest logger

* chore: better error handling

* chore: generic error return statement

* chore: collapse nil check into if-block

Co-authored-by: Daniel Moran <danxmoran@gmail.com>

* chore: update changelog

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-06-08 15:19:21 -05:00
William Baker 34a4a8e60e
feat: metadata backup returns bucket manifests (#21601)
* fix: properly omit empty time.Time that are optional

* fix: optimize slice creation in manifest fns
2021-06-04 09:26:17 -04:00
William Baker b0ea3b6675
feat: backup and restore sqlite database (#21584)
* feat: new metadata backup endpoint

* feat: added restore/sql API endpoint

* fix: content-type is multipart/mixed, part names are kv and sql

* fix: changed multipart manifest to buckets and made it .json

* feat: added lock for backing up sqlite and bolt dbs

* fix: use read lock instead of write lock on kv during backup

* fix: use filepath.Join for temp dirs
2021-06-02 19:07:53 -04:00
Stuart Carnie d165d76fc3
feat: influx CLI Packager support for explicit schema buckets (#21465)
This commit adds the minimal requirements to process specs containing
explicit schema buckets, so they may be exported and applied from
Cloud 2.
2021-05-31 10:01:29 +10:00
William Baker ed629bfebe
feat(notebooks): notebooks database implementation (#21573) 2021-05-28 09:29:00 -04:00
William Baker c267b31232
chore: move notebook service interface to root (#21570) 2021-05-26 12:27:56 -04:00
William Baker 19b0470ed7
feat: integrated sqlite db for metadata (#21543) 2021-05-25 12:12:07 -04:00
Daniel Moran 00420fb54c
fix(influxql): make meta queries respect query timeout (#21545)
Co-authored-by: davidby-influx <dbyrne@influxdata.com>
2021-05-24 21:10:53 -04:00
Daniel Moran b1e1125376
fix(cmd/influxd): Add logging work-around for absolute file paths on Windows (#21540) 2021-05-24 16:52:58 -04:00
William Baker 40897b9a98
feat(notebooks): authorization for notebooks (#21490)
* feat(notebooks): auth changes to top-level authz

* feat(notebooks): added authorization

* chore(notebooks): added tests for authz
2021-05-17 19:01:27 -04:00
William Baker cc4ebe231d
feat: notebooks api handlers & fake store (#21480)
* feat(notebooks): demo store functionality

* feat: demo store with context and middleware

* refactor: without context

* fix: update endpoint and status code for delete

* chore: changed name

* chore: added some tests

* fix: address review comments
2021-05-17 12:07:48 -04:00
Daniel Moran 6bdcbaa141
fix(cmd/influx): accept `--input` flag in `restore` command (#21477)
* feat(cmd/influx): accept --input flag in `restore` command.
* fix(restore): make it an error if no backup manifests are found
2021-05-14 15:07:58 -04:00
Daniel Moran 4343d5ce07
fix: add logging to NATS streaming server (#21375) 2021-05-05 14:25:39 -04:00
Daniel Moran e28377f05c
fix: deprecate PostSetupUser and `influx setup user` (#21345) 2021-04-30 15:30:35 -04:00
Daniel Moran 942f7095e7
fix(query): make config validation for query controller less strict (#21324)
* fix(query): accept queue-size > 0 when concurrency = 0
* fix(influxd): revert defaults for query settings to avoid validation err
* test: lower the default query concurrency used by test launchers
2021-04-28 17:27:37 -04:00
Daniel Moran 91d59d9588
fix(upgrade): ensure query config written by `influxd upgrade` is valid (#21321)
* test: refactor upgrade test to cover the config upgrade
* fix: ensure upgraded query config is valid
2021-04-28 15:41:44 -04:00
William Baker 0106de9fa7
feat: notebooks HTTP handlers (#21316)
* feat: notebooks HTTP handlers
2021-04-28 11:06:13 -04:00
Timmy Luong 0c88854486
feat: add StaticLegend (#21218) 2021-04-15 15:06:01 -07:00
William Baker 1d431e8bc3
feat: structured logging for HTTP server ErrorLog (#21235)
* feat: structured logging for HTTP server ErrorLog

* chore: update CHANGELOG
2021-04-15 17:08:12 -04:00
Sam Arnold 7b2e122869
refactor: refactor for tasks backport (#21117)
* chore: remove dead code

* refactor: move FluxLanguageService interface to fluxlang

* chore: run fmt

* refactor: move task.go from top level to task/taskmodel

* chore: run formatter

* chore: fix up import ordering with gci
2021-04-07 14:42:55 -04:00
Daniel Moran ff6b55aca4
feat(flux): allow values of 0 to disable controller limits (#21127)
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-04-05 16:58:27 -04:00
Daniel Moran 00afd95cb7
refactor: automated move of errors and id from root to kit (#21101)
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-03-30 14:10:02 -04:00
Russ Savage 1b7d5f3156
feat: add profiler to query command in cli (#21006) 2021-03-23 15:47:52 -04:00
Daniel Moran 4ef09e1ccb
feat(cmd/inflxud): add support for writing to stdout in `export-lp` (#21046) 2021-03-23 14:59:16 -04:00
Daniel Moran 8ab90d335f
fix(cmd/influx): add limits to task and run filters in retry-failed (#21033) 2021-03-23 07:53:58 -04:00
Daniel Moran 3420ed53d3
refactor: modularize backup/restore behavior so it's possible to test using `go test` (#20991) 2021-03-23 07:28:38 -04:00
Daniel Moran c5edd9092f
feat(http): add config parameters for HTTP timeouts (#20971) 2021-03-16 16:54:46 -04:00
Daniel Moran 9922863185
fix(tls): Update TLS strict cipher suite to actually work (#20921) 2021-03-16 10:45:27 -04:00
Daniel Moran 316eaa24b4
feat(http): add config option to disable metrics endpoint in influxd (#20963) 2021-03-15 15:11:23 -04:00
J. Emrys Landivar 5df737cbc7
fix(cmd/influx): log error details when `influxd upgrade` fails to migrate databases (#20929)
Co-authored-by: Dan Moran <dmoran@influxdata.com>
2021-03-15 14:32:50 -04:00
Daniel Moran ba4099ddb9
feat(cmd/influx): allow setting shard-group durations for buckets via API and CLI (#20911)
Co-authored-by: Alexander Savinykh <asavinykh@nbrx.de>
2021-03-11 14:51:03 -05:00
Daniel Moran b6842d676e
fix(cmd/influx): delete unsupported `influx transpile` command (#20913) 2021-03-11 14:28:58 -05:00
Daniel Moran 49b83b58ee
refactor: remove panics from CLI kit code and influxd CLI setup (#20863) 2021-03-04 17:18:21 -05:00
Daniel Moran 25738db42c
feat(http): allow for disabling pprof (#20827)
And translate pprof-enabled config during upgrade
2021-03-04 09:28:03 -05:00
Daniel Moran d4a0c34c39
fix(onboarding): deprecate misleading `retentionPeriodHrs` key (#20798) 2021-03-01 09:55:39 -05:00
Daniel Moran 1e50418535
refactor: reduce duplication in setup logic (#20794) 2021-02-22 17:01:26 -05:00
Daniel Moran 58ae51d2d0
feat(cmd/influx): support reading GZIP data in `influx write` (#20763)
Co-authored-by: davidby-influx <dbyrne@influxdata.com>
2021-02-19 12:31:09 -05:00
Daniel Moran 6515a79413
fix: update doc links to point at new site (#20754) 2021-02-16 12:37:56 -05:00
Arnav Aggarwal afbe31dddc
feat(cmd/influx): add command to find and retry failed task runs (#20307)
Co-authored-by: Brett Buddin <brett@buddin.org>
Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-02-11 13:25:40 -05:00
Daniel Moran 727a7b58c1
test: replace influxlogger with zaptest logger (#20589) 2021-02-11 10:12:39 -05:00
Daniel Moran a3fa943a0a
refactor(cmd/influx): clean up existing tests for `influx write` (#20666) 2021-02-04 14:24:45 -05:00
Daniel Moran 9566892022
fix(cmd/influx): allow for creating users without initial passwords in `influx user create` (#20657) 2021-02-02 11:53:24 -05:00
Jonathan A. Sternberg 719c8495f2
feat(fluxtest): add support for testing/expect planner rules (#20662) 2021-02-01 15:53:05 -06:00
Sam Arnold 781fa0e846 chore: add goimports 2021-01-29 14:06:52 -05:00
Daniel Moran 552646d81c
fix(cmd/influx): improve logging consistency in `influxd upgrade` (#20640) 2021-01-28 10:42:07 -08:00
Daniel Moran a668a9ed0a
feat(cmd/influxd): add `influxd inspect export-lp` command to export LP (#20467) 2021-01-25 14:28:36 -08:00
Daniel Moran 3be8e498b4
fix(cmd/influx): respect --skip-verify in `influx query` (#20578) 2021-01-25 11:15:51 -08:00
Jonathan A. Sternberg f6669f7512
feat(internal/cmd): add internal command for influxdb flux test harness (#20508)
The internal command can be used to execute flux tests using the same
internals as the `flux test` command, but it will invoke these tests
against a test influxdb instance that is launched in-process.
2021-01-25 10:31:23 -06:00
Daniel Moran e77c4670d6
feat(cmd/influxd): add `nats-max-payload-bytes` config option to influxd (#20564) 2021-01-20 12:44:43 -08:00
Daniel Moran d8a4b4d6cb
feat(cmd/influxd): add `nats-port` config option to influxd server (#20561) 2021-01-20 10:53:56 -08:00
Daniel Moran c62d3f2d8d
fix(cmd/influxd): prevent panic on upgrade with V1 users and no V1 conf (#20548) 2021-01-19 13:26:44 -08:00
Daniel Moran e970aae778
feat(cmd/influxd): add `print-config` subcommand to support automation (#20524) 2021-01-19 12:34:12 -08:00
Daniel Moran fdc0fdb92b
feat(cmd/influxd): add --overwrite-existing-v2 flag to influxd upgrade (#20473) 2021-01-15 08:20:48 -08:00
Daniel Moran 78af2e7317
fix(kit/cli): don't ignore failures to mark CLI options as required (#20490) 2021-01-13 07:25:16 -08:00
Daniel Moran 30306e5b10
fix(cmd/influxd): improve `influxd upgrade` logging, and require manual confirmation of data copy (#20440) 2021-01-07 07:34:48 -08:00
Daniel Moran d05a79d13d
fix: ignore a harmless error to avoid a confusing log message (#20448) 2021-01-06 08:00:51 -08:00
Daniel Moran 9aefa6f868
fix(tsdb): never use an inmem index (#20313)
And fix the logging setup for the TSDB storage engine
2020-12-23 07:46:57 -08:00
Daniel Moran afdcb18655
refactor: simplify how we set the top-level influxd logger (#20374) 2020-12-21 11:15:08 -08:00
Daniel Moran 68f4df204f
fix(cmd/influx): improve CLI error returned on org-not-found (#20387) 2020-12-21 08:44:50 -08:00
Daniel Moran 6ed1922681
fix: don't use a finished context for graceful shutdown (#20355) 2020-12-16 18:56:21 -08:00
Greg 0a28e7be99
fix(cli): don't overwrite stack name/desc on stack update (#20362) 2020-12-16 18:09:22 -07:00
Daniel Moran b5bbc503a0
fix(onboarding): don't ignore failures to set initial password (#20317) 2020-12-16 06:43:43 -08:00
Daniel Moran 1058a8e3f1
fix(upgrade): add DB URL to log message at end up upgrade (#20274) 2020-12-08 11:12:31 -05:00
Ben Johnson 7dafc2cf34 feat(tsdb): Implement delete with predicate. 2020-12-02 14:55:02 -07:00
Adrian Thurston e0543e6e3a
fix: various improvements to setup command (#20155)
When checking for existing configs, check the length of the array after
parsing. There could be an empty config file present.

If --name was specified then use that as the configuration name, regardless of
whether or not there are existing configs.

Allow a 0 (infinite) retention to be specified with --retention when in
interactive mode.


Co-authored-by: Dan Moran <dmoran@influxdata.com>
2020-12-02 10:39:56 -05:00
Daniel Moran 5fa60878d9
feat(cmd/influx): add hints to ID-related errors in DBRP CLI commands (#20204) 2020-12-01 10:52:54 -05:00
Daniel Moran 4235c12d64
refactor(cmd/influxd): parse log-level CLI opts directly to correct type (#20196) 2020-11-30 13:59:06 -05:00
Daniel Moran 81a671894d
refactor(cmd/influxd): separate CLI parsing from core launcher (#20109) 2020-11-30 09:38:27 -05:00
Dan Moran bbb008acd3 refactor: use explicit int64s for remaining query CLI args 2020-11-24 13:36:27 -05:00
Dan Moran 295d89ba22 fix: limit query queue size to an int32 to avoid panic 2020-11-24 13:36:27 -05:00
Dan Moran 4540645276 fix: limit query concurrency quota to an int32 to avoid panic 2020-11-24 13:36:27 -05:00
Daniel Moran 89764adabd
feat(cmd/influxd): use a better default for upgraded V2 config, and allow users to override it (#20110) 2020-11-23 13:05:48 -05:00
Daniel Moran cfca0cc85f
feat(cmd/influx): allow for setting v1 passwords via CLI args (#20123) 2020-11-20 15:09:23 -05:00
Dan Moran 4541ab936f chore: adjust help text based on PR feedback 2020-11-18 10:54:19 -05:00
Stuart Carnie d5becff970 fix: UX improvements and bug fixes to dbrp commands
Closes #20085
2020-11-18 10:54:19 -05:00
Daniel Moran 1e324b6a63
fix(cmd/influxd): remove internal subcommands of `upgrade` from help text (#20076) 2020-11-17 15:37:43 -05:00
J. Emrys Landivar 478d25e774
feat(cmd/influx): Add DBRP cli commands as `influx v1 dbrp` (#20067)
Co-authored-by: Dan Moran <dmoran@influxdata.com>
2020-11-17 15:14:55 -05:00
Daniel Moran 632e8f11ed
fix(cmd/influxd): don't validate unused paths in `upgrade` (#20052) 2020-11-17 00:38:53 -05:00
Daniel Moran b732f3663c
feat(cmd/influxd): export 1.x continuous queries as part of upgrade (#20039) 2020-11-16 16:37:47 -05:00
Stuart Carnie 1cd9d0b04a feat: Port pipeline tests package from Cloud
This package provides essentially the same API as the Cloud tests
package, utilising the `TestLauncher` type.

Additional With functional options were added to the `Launcher`
in order to expose type-safe configuration of InfluxQL configuration.
Additional With options may be added in the future as the need arises.
2020-11-17 08:14:17 +11:00
Daniel Moran 693d153195
feat(cmd/influxd): warn if auth wasn't enabled and users were upgraded (#20036) 2020-11-16 09:05:40 -05:00
George MacRorie 5954db8c4d chore(documents): reinstate minimal read-only document store for dashboard templates 2020-11-16 12:41:26 +00:00
George MacRorie 16d916a952 refactor(kv): delete deprecated kv service code
This includes removal of a lot of kv.Service responsibilities. However,
it does not finish the re-wiring. It removes documents, telegrafs,
notification rules + endpoints, checks, orgs, users, buckets, passwords,
urms, labels and authorizations. There are some oustanding pieces that
are needed to get kv service compiling (dashboard service urm
dependency). Then all the call sites for kv service need updating and
the new implementations of telegraf and notification rules + endpoints
needed installing (along with any necessary migrations).
2020-11-16 12:41:26 +00:00
Daniel Moran 4efb8515b8
fix(cmd/influxd): validate all input paths to `upgrade` up-front (#20012) 2020-11-13 09:25:57 -05:00
Stuart Carnie fab99c9512 chore: Remove fragile nats port assignment loop
This resolves observed race conditions when running test suites that
utilize the launcher. It also reduces test times considerably, by
eliminating a slow loop to find a port.
2020-11-13 09:13:48 +11:00
Stuart Carnie aa8064a43a fix: PR Feedback 2020-11-13 08:47:52 +11:00
Stuart Carnie 42aabb28fc chore: Do not use global viper APIs, which breaks testing 2020-11-13 08:47:52 +11:00
Daniel Moran 518098e4f3
fix(cmd/influxd): suggest running with -h on error instead of printing usage (#19995) 2020-11-11 16:37:36 -05:00
Ben Johnson b5f127597a fix: Use --skip-verify flag for backup/restore CLI command.
This commit passes the `--skip-verify` flag to the underlying HTTP
client in for the `BackupService` & `RestoreService`.
2020-11-11 12:54:22 -07:00
Daniel Moran 15b9531273
fix: correct various typos (#19987)
Co-authored-by: kumakichi <xyesan@gmail.com>
2020-11-11 13:54:21 -05:00
Daniel Moran d8e7de93cc
fix: check write permission in legacy write path (#19980) 2020-11-10 18:41:50 -05:00