Commit Graph

742 Commits (8ca8ce9da3934f93ef40f625038ccf35739a9333)

Author SHA1 Message Date
Alirie Gray 3120b4c47e
refactor(tasks): add Client to http TaskService (#16912) 2020-02-24 11:41:21 -08:00
jlapacik 2c184ead7f chore: update flux dependency and unskip notification tests
Fixes https://github.com/influxdata/influxdb/issues/16809.
2020-02-21 14:58:41 -08:00
jlapacik 766aa231b5 chore: update flux dependency
Fixes https://github.com/influxdata/influxdb/issues/16810.
2020-02-21 14:03:02 -08:00
Johnny Steenbergen 80751314bc chore(influx): refactor influx cmd to use builder
refators test to use full call paths where possible
2020-02-20 11:27:44 -08:00
tmgordeeva 890c943643
fix(backup): handle backup with no credentials file (#16877)
* fix(backup): handle backup with no credentials file

Backups and restores should work whether or not the original installation uses
a credentials file and whether or not the backup contains a credentials file.
2020-02-14 09:19:58 -08:00
Johnny Steenbergen a632025eb6 fix(influx): fix token env var and default assignment 2020-02-13 13:25:50 -08:00
Johnny Steenbergen 505ce2372c fix(influx): fix issue with locla state overriding env vars for token
closes: #16874
2020-02-13 11:55:41 -08:00
Nathaniel Cook 03f65cf045
fix(influxql): add explicit routing to influxql service (#16832)
Prior to this change influxql requests were sent to the same back end as Flux queries.
This MAY not always be the case. Now InfluxQL queries are specifically routed to the InfluxQLService.
In the case of this OSS build the FluxService and InfluxQLService are the same.
2020-02-12 10:07:29 -07:00
Christopher M. Wolff d6766962d1
test(query): skip tests that are not passing in feat/use-algo-w (#16813) 2020-02-11 15:02:26 -08:00
Stephanie Engel 1d0afefc4e
refactor: update restore cli flag descriptions (#16799) 2020-02-10 12:07:55 -06:00
Kelvin Wang 670d2b7113 feat(cmd/influx): add secret cli 2020-02-10 11:40:06 -05:00
Johnny Steenbergen af6fac9fdf chore(pkg): remove ambiguity in wrong cmd calls within influx pkg cmd
there was an issue where you could call, `influx pkg summarize`
and the influx cli would actually prescribe that to `influx pkg` cmd
and pass summarize as an arg. This removes that ambiguity
2020-02-06 18:06:17 -08:00
Johnny Steenbergen bf0cc56d7f feat(influx): add ability to provide multiple urls to influx pkg command
also provides an interface to mix and match everything together. you can
now provide `-f` flags for file or directories, `-u` flags for urls, and
use the | to pipe in a pkg. all of which can be done at the same time.
2020-02-06 17:16:47 -08:00
Johnny Steenbergen 2d2fb4056b feat(influx): add support for providing directories of pkgs to pkg command
closes: #16657
2020-02-06 15:57:03 -08:00
Johnny Steenbergen e472b013d9 feat(influx): add support for mulitple pkg files to be submitted together 2020-02-06 13:02:35 -08:00
Johnny Steenbergen 7cf6167356 feat(influx): extend pkg command with providing env ref entries
this also extend dry run to provide env refs to it. the refactoring was
to enable that bit. Having the ability to dry run with the env ref entries
means we can dry run the pkg with the env ref values to see the impact before
the application takes place.
2020-02-06 08:48:05 -08:00
Johnny Steenbergen bbdd6bf7fc feat(pkger): add env refs for associations 2020-02-05 09:48:50 -08:00
Johnny Steenbergen 036ba49e12 feat(pkger): add env ref fields for remaining resources 2020-02-05 07:47:12 -08:00
Johnny Steenbergen 64c8707594 feat(pkger): add support for env references for buckets 2020-02-04 17:00:11 -08:00
Johnny Steenbergen 9ee07b097c chore(pkger): refactor http server to use new http.API type 2020-02-04 10:42:54 -08:00
Johnny Steenbergen 343c9b166b chore(pkger): consolidate pkger http server into pkger
this is the last step for pkger to follow the service definition pattern
that is in the works. Some bits from http were moved into kit/transport/http
for reusability. End result is to hopefully axe http pkg for resuable types in
kit. Long ways off still...
2020-02-03 12:39:47 -08:00
Johnny Steenbergen 2b0b32abe8 chore(http): pull out eror handler into kit pkg for portability 2020-02-03 12:39:47 -08:00
Johnny Steenbergen f9ed0ccb82 feat(pkger): add metrics svc middleware 2020-02-03 11:07:46 -08:00
Johnny Steenbergen 12052a942c chore(influx): fixup flag setting in influx tests to use args
this is inspired by: https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/cmd_test.go#L73
2020-02-01 09:08:09 -08:00
Johnny Steenbergen 592e9369a7 feat(pkger): add support for inspecting url paths to grab extension for pkger decoding 2020-01-23 14:14:28 -08:00
Jacob Marble b836ab9c17
feat(storage): implement backup and restore (#16504)
* feat(backup): `influx backup` creates data backup

* feat(backup): initial restore work

* feat(restore): initial restore impl

Adds a restore tool which does offline restore of data and metadata.

* fix(restore): pr cleanup

* fix(restore): fix data dir creation

* fix(restore): pr cleanup

* chore: amend CHANGELOG

* fix: restore to empty dir fails differently

* feat(backup): backup and restore credentials

Saves the credentials file to backups and restores it from backups.

Additionally adds some logging for errors when fetching backup files.

* fix(restore): add missed commit

* fix(restore): pr cleanup

* fix(restore): fix default credentials restore path

* fix(backup): actually copy the credentials file for the backup

* fix: dirs get 0777, files get 0666

* fix: small review feedback

Co-authored-by: tmgordeeva <tanya@influxdata.com>
2020-01-21 14:22:45 -08:00
Johnny Steenbergen 9eb72d4cf9 chore(influx): use disable- for color/table borders in pkg cmd
closes: #16582
2020-01-17 09:51:20 -08:00
Jade McGough 3f7a32f739
fix(pkg): normalize cli arg format (#16580) 2020-01-17 09:31:07 -08:00
Johnny Steenbergen 22c0f787db fix(influx): fix description for reuable org/ord id type
closes: #16579
2020-01-17 09:15:10 -08:00
Johnny Steenbergen 19d2e5580a feat(influx): trim space on credentials file 2020-01-16 07:22:56 -08:00
Johnny Steenbergen 93c8a2a104 feat(pkger): add service logging and tracing middlewares 2020-01-15 12:00:59 -08:00
Kelvin Wang cf5daee66b chore(cmd/influx): refactor user.go
feat(cmd/influx): add user tests
fix(cmd/influx): make golint happier
2020-01-15 13:45:26 -05:00
Kelvin Wang f62d3a25f1 feat(cmd/influx): update password in cli 2020-01-15 13:30:23 -05:00
Johnny Steenbergen 41beaf0bd5 fix(pkger): fixes issue where pkger can't discern the mime/content type of a package
also makes the yaml decoder the default. To foten we end up in application/octet-stream
which is the default for many different mime types. This provides a mechanism
around that so that when the automagical detection fails it can allow the user
to provide it via the CLI.
2020-01-14 15:44:48 -08:00
Johnny Steenbergen 234c458fa0 fix(pkger): fix missing API version in export of existing resources 2020-01-14 14:36:37 -08:00
Johnny Steenbergen 63fd1e2e9a feat(pkger): make pkger packages CRD compliant 2020-01-14 13:20:00 -08:00
Johnny Steenbergen fe12fd051e feat(pkger): add jsonnet support for package files 2020-01-13 09:55:08 -08:00
Johnny Steenbergen 3b62340b31 chore(influx): refactor org cmd with buidler pattern 2020-01-13 07:49:16 -08:00
Johnny Steenbergen fdc3e7658c feat(pkger): add ability to supply a pkg from a url
the following is now possible from the CLI(same in REST API):
  influx pkg -u 1717709ffa/bucket_pkg_json
2020-01-12 07:53:58 -08:00
Johnny Steenbergen 3f56658418 fix(influx): drop persistent pre run func taht double prints help cmd 2020-01-10 17:22:05 -08:00
Johnny Steenbergen 9338a0be97 chore(influx): refactor bucket cmd into builder pattern 2020-01-10 15:20:15 -08:00
Johnny Steenbergen 89939dea4e fix(influx): add env vars to cli usage and normalize usage and flag/env var priority
also rids us of the cobra tutorial code and encapsulates things into funcs
2020-01-10 15:20:15 -08:00
Michael Desa 26e8ee879c
feat: add tool to migrate 1.x chronograf dashboards and variables
feat(pkger): export dashboard and variable *ToResource methods

fix(pkger): add empty selected _measurement to builder config

feat(chronograf): add note & note visibility to dashboard cell

The 1.x DashboardCell struct had migrated since we brought the code into
the InfluxDB codebase. This allows us to migrate cells that were created
since then.

feat(cmd/chronograf-migrator): add 1.x chronograf migrator tool

feat(chronograf-migrator): add function to transpile queries

fix: update spelling of todo comment pkger/models.go

Co-Authored-By: Deniz Kusefoglu <deniz@influxdata.com>

fix(chronograf): add type to DashboardQuery

The type has evolved since this code was moved over from chronograf.
Previously, we did not have access to flux as a type of query.

feat(chonograf-migrator): transpile influxql query to flux if possible

fix(chronograf): omit fields when empty on old chronograf structs

fix: make linter not mad at me

feat(chronograf-migrator): lowercase variable names

fix(pkger): add empty selected measurement to builder config

chore(chronograf-migrator): add basic readme

chore(pkger): export Variable and Dashboard ToResource methods

fix(chronograf-migrator): move flags out of init call
2020-01-10 09:05:19 -08:00
Johnny Steenbergen ba7502aaf5 fix(influx): update influx pkg cmd flag secrets delimter to match vaults using an `=` 2020-01-09 14:22:38 -08:00
Johnny Steenbergen c8aabaf515 chore(http): fixup middleware stack and normalize metrics into same buckets for id fields 2020-01-08 15:05:34 -08:00
Yiqun Zhang 74ba877cb9
feat: opentracing in query execution runtime 2020-01-08 11:16:13 -05:00
Jade McGough 79ab5e5e59
fix(pkger): don't swallow errors when failing to get organization (#16397) 2020-01-03 01:22:54 -08:00
Alirie Gray 6c6bd39ffc
refactor(tasks): remove dead scheduler code (#16252) 2020-01-02 11:41:21 -08:00
Jacob Marble 047afcfc10
fix(tests): make sure NATS port is open for unit tests (#16310)
* fix(tests): make sure NATS port is open for unit tests

Fixes #10628 again

* chore: add comment re possible race
2020-01-02 11:05:56 -08:00
Kelvin Wang f8c0ea032c fix(cmd/influx): show see help, instead of usage 2019-12-31 14:52:55 -05:00
Greg b2531c1f97
fix: improve date in `version` command (#16365)
set date in go like a sane person
2019-12-30 17:56:58 -07:00
Greg 56973b8dc5
fix: add 'version' command to match github bug report template (#15629) 2019-12-30 12:53:52 -07:00
Johnny Steenbergen f1b5e19776 feat(influx): add hide headers flag to influx cli task cmd 2019-12-27 14:41:55 -08:00
Johnny Steenbergen cce279a80e feat(pkger): add ability to provide secrets alongside package when applying
this provides the ability to add secret refs at runtime instead of adding
them to the pkg.
2019-12-27 12:41:42 -08:00
Johnny Steenbergen 935389912a chore(pkger): reorder print statements to be alphabetical 2019-12-26 11:34:48 -08:00
Johnny Steenbergen 1c2421cb9c feat(pkger): add export support for tasks 2019-12-23 15:41:14 -08:00
Johnny Steenbergen c9431bceb8 feat(pkger): add apply functionality for task resource 2019-12-23 13:56:42 -08:00
Johnny Steenbergen 8e87498317 feat(pkger): add dry run functionality for task resource 2019-12-23 11:40:28 -08:00
Johnny Steenbergen af5b7fd7d3 feat(pkger): add export support for notification rules 2019-12-21 14:58:02 -08:00
Greg abd8ce0089
feat(http): add functionality to retrieve/store telegraf config as toml (#16132) 2019-12-20 14:20:13 -07:00
Johnny Steenbergen 61dceaa727 feat(pkger): add application functionality for the notification rules resource 2019-12-20 12:48:46 -08:00
Johnny Steenbergen 02aec6ed29 feat(pkger): add dry run functionality for notification rules 2019-12-19 16:31:22 -08:00
Jade McGough cc0943ceeb
chore(cli): improve walk function documentation (#16176) 2019-12-19 03:22:56 -08:00
Johnny Steenbergen a8a4d3d0b2 feat(pkger): add export functionality to checks resource 2019-12-18 17:52:28 -08:00
Johnny Steenbergen 677e836bf4 feat(pkger): add apply functionality for checks
this work is to support pkger, but was able to add back in the
skipped tests. seeing failures upstream, and didn't catch it in
influxdb b/c the tests were being skipped.

closes: #14799
2019-12-18 15:02:03 -08:00
Johnny Steenbergen 1db3256980 feat(pkger): add check dry run functionality 2019-12-18 12:15:08 -08:00
Johnny Steenbergen f527636fe0 chore(http): refactor user http service to use the httpc.Client 2019-12-17 12:49:14 -08:00
Johnny Steenbergen 1c2b900687 chore(http): refactor auth service http client to use httpc.Client
normalizing the auth service http client to follow suit with other services.
2019-12-17 12:18:16 -08:00
Deary Hudson III d5f8a5fc9f
feat(cmd): apply env vars consistently across cmd (#16225) 2019-12-17 13:55:35 -06:00
Johnny Steenbergen d42bbb3c64 feat(pkger): add support for exporting notification endpoints 2019-12-17 11:33:34 -08:00
Johnny Steenbergen b8652ee178 feat(pkger): add support for secret references to notification endpoints parsing 2019-12-17 11:33:34 -08:00
Johnny Steenbergen a6e768dc7c chore: refactor notication endpoints to make a service out of notification endpoints
this is a blocker for anyone who hits the endpoint services internally. They
had to know that they need to also know of hte secret service then do all that
put/delete alongside the operation. This makes that unified inside the store tx.

one other thing this does is make obvious the dependencies that
notification services has. In this case it is the secrets service it
depends on.
2019-12-17 10:49:06 -08:00
Johnny Steenbergen 39e89eafdf chore(pkger): utilize http client for integration tests for pkger 2019-12-13 09:46:01 -08:00
Deary Hudson III 48e854776e
fix(cmd): adds org svc dep to pkg (#16206) 2019-12-12 11:33:15 -06:00
Johnny Steenbergen 3daaa4d307 feat(pkger): add apply functionality for notification endpoints kind 2019-12-11 15:13:42 -08:00
Johnny Steenbergen 69d7eb4455 feat(pkger): add notification endpoint dry run functionality 2019-12-11 15:13:42 -08:00
Alirie Gray b5ccad3c07
feat(metrics): add run latency to executor metrics (#16190) 2019-12-11 14:50:32 -08:00
Deary Hudson III 336961c757
feat(cmd): bucket create to accept org name as flag (#16187)
* enables the user to specify an organization name when creating a bucket.
2019-12-10 17:46:36 -06:00
Johnny Steenbergen 417d25537f chore(http): refactor org service to use httpc client 2019-12-10 10:49:22 -08:00
Johnny Steenbergen 5cc02de988 feat(httpc): add httpc pkg to resuse code for http client type 2019-12-09 12:17:22 -08:00
Johnny Steenbergen 648a14d148 chore(influx): refactor orgnization cmd
death to unneccessary inits
2019-12-09 11:39:28 -08:00
Johnny Steenbergen ad841608ca chore(http): refactor bucket|dashboard|label|umr|var http clients to use reusable HTTP client
this is a step towards providing a shared http client that manages  pooling connections,
timeouts, and reducing GC for by not creating/GCing a client each req. Bring on the red!
2019-12-09 09:44:41 -08:00
Johnny Steenbergen 521ce543eb fix(pkger): fix flaky test in pkger service tests
tests failign from a data race caused in the tests setup. an incrementing
const needs something to serialzie it (atmoic in this case) to remove that
data race. This touches that up.
2019-12-09 08:59:44 -08:00
Johnny Steenbergen 0225160814 fix(http): provides a reusable http client instead of creating/GCing one each time 2019-12-06 18:15:35 -08:00
Johnny Steenbergen 51f1b73738 feat(pkger): speed up application of pkg with a touch of concurrency
governs the concurrency with a simple semaphore. Defaults to 5
concurrent reqs, anything greater, could put a lot of pressure
on the system as a whole (especially OSS/bolt store).
2019-12-06 18:15:35 -08:00
Johnny Steenbergen ed974ba50a fix(pkger): add telegraf to launcher for public api support 2019-12-06 09:05:51 -08:00
Johnny Steenbergen ea67663ab7 fix(pkger): cleanup leftover bits from telegraf and label mapping misses
telegraf was not being mapped correctly for applying the label mapppings
and touched up a bunch of other issues that came up along the way.
2019-12-06 08:51:32 -08:00
Johnny Steenbergen c76babdce6 feat(pkger): add support for exporting telegraf 2019-12-05 09:58:44 -08:00
Jacob Marble 5f19c6cace
chore: Remove several instances of WithLogger (#15996)
* chore: Remove several instances of WithLogger

* chore: unexport Logger fields

* chore: unexport some more Logger fields

* chore: go fmt

chore: fix test

chore: s/logger/log

chore: fix test

chore: revert http.Handler.Handler constructor initialization

* refactor: integrate review feedback, fix all test nop loggers

* refactor: capitalize all log messages

* refactor: rename two logger to log
2019-12-04 15:10:23 -08:00
Johnny Steenbergen 695211aeda feat(pkger): add dry run and apply functionality for telegraf resources 2019-12-04 13:50:42 -08:00
Nathaniel Cook fd63ff17f3
feat(cmd/influx): add command to manually transpile InfluxQL to Flux (#16119) 2019-12-04 13:31:20 -07:00
Johnny Steenbergen 988fd0ae80 chore(pkger): refactor diff into common types for easier access 2019-11-22 16:09:23 -08:00
Johnny Steenbergen 251651cc97 feat(influx): add pkg summary cmd to influx cli 2019-11-21 16:26:24 -08:00
Johnny Steenbergen c533f8495d chore(influx): add tests for pkg validate cmd 2019-11-21 16:26:24 -08:00
Johnny Steenbergen d98ce676fb chore(pkger): refactor pkger cli into a builder for better reuability and testability 2019-11-21 16:26:24 -08:00
Johnny Steenbergen 9149b6af6f feat(influx): add pkg validate command to validate existing packages
also renames a the commands to start with cmd followed by the args. this
is an attempt to order the commands in a slightly more autocomplete friendly
way.
2019-11-21 16:26:24 -08:00
pierwill 9fd97d1b28
Merge pull request #15976 from pierwill/repl-cmd-description
Edit `influx repl` command description
2019-11-21 11:31:13 -08:00
Johnny Steenbergen 77ddcab2b5 feat(influx): add nix pipe support to influx pkg cmd 2019-11-21 10:55:12 -08:00
Johnny Steenbergen 9c525ad413 feat(pkger): add ability to export all and defined list of resources via influx cli to a package
refers: #15921
2019-11-21 10:55:12 -08:00
Johnny Steenbergen a92b632e05 feat(influx): add ability to drop headers from bucket find cli cmd 2019-11-21 10:55:12 -08:00
Chris Goller da2edb88bb fix(cmd/influxd): add mutex for open/close of temp engine 2019-11-20 16:39:47 -06:00
Chris Goller 0f5df301ca refactor(storage/readservice): rename View interface to Viewer 2019-11-20 16:10:37 -06:00
Chris Goller 354b58005f fix(cmd/influxd): prefix temporary engine dir with e2e 2019-11-20 16:04:27 -06:00
Chris Goller f9c5021782 feat(influxd/launcher): add tmp filesystem backed engine for e2e 2019-11-20 15:54:32 -06:00
Johnny Steenbergen 4036e6c426 feat(pkger): add authentication to service dependencies for pkger
closes: #15897
2019-11-20 11:12:14 -08:00
Johnny Steenbergen dc2d931f00 feat: add support for setting password and org for a new user in the cli
one thing to note here is that new endpoint was created. there was no
endpoint for setting an initial password that worked. The existin endpoint
was a bit messy and coupled across multiple routes. Having multiple auth
schemes proved incredibly taxing to write against.
2019-11-20 09:16:31 -08:00
Johnny Steenbergen 4d5ac08fff chore(influx): refactor auth cli cmd 2019-11-19 12:36:52 -08:00
pierwill 8196d280cd Edit `influx repl` command description 2019-11-19 11:27:26 -08:00
Johnny Steenbergen a875a6a7ea chore(pkger): add tests to pkg new cli command 2019-11-18 12:19:15 -08:00
Jade McGough 1606b089b4
fix(cli): add organization back to bucket response (#15947) 2019-11-18 09:45:03 -08:00
Johnny Steenbergen e88fa7d90a fix(influx): bad shorthand var for pkg command 2019-11-15 11:36:33 -08:00
Johnny Steenbergen 626b719769 feat(pkger): add pkg new operation to cli to create packages 2019-11-15 10:08:41 -08:00
Johnny Steenbergen ab50e18695 feat: add support for insecure skip verify on cli http clients 2019-11-14 16:48:13 -08:00
Johnny Steenbergen 1c6d499711 feat(pkger): extend integration tests to include rollback functionality 2019-11-13 10:45:02 -08:00
Johnny Steenbergen e26b21e261 chore(pkger): add integration tests for pkger service
these tests supply coverage for the happy path of the pkger service
behavior.
2019-11-12 14:05:07 -08:00
Johnny Steenbergen 5eb29e9ed9 feat(pkger): add label associations to variables 2019-11-07 12:33:20 -08:00
Johnny Steenbergen 2090afa5fd chore(pkger): move pkger http server to http pkg 2019-11-07 09:44:24 -08:00
Johnny Steenbergen 2902638c8a feat(pkger): add pgker http server to the api handler 2019-11-07 09:44:24 -08:00
Lyon Hill bb6aa1df3b
feat(task): Add a latestScheduled field for tasks (#15785)
Previously we overwrote the tasks existing latestCompleted to be used for latestCompleted as well as latestScheduled.
For obvious reasons this is confusing and missleading. I believe by seperating the two fields we can have a clear seperation
of concerns.
2019-11-06 15:10:52 -07:00
Faith Chikwekwe 0664dbc47d fix(cmd/influx): fix bug that causes long startup when running 'influx help' or related commands 2019-11-06 10:25:14 -08:00
Johnny Steenbergen c47bad5981 feat(pkger): add single stat chart to pkger dashboards 2019-11-01 14:36:18 -07:00
Johnny Steenbergen eea44f6c72 feat(pkger): add dashboard support to pkger
included is the base for dashboards and association of labels with
dashboards.
2019-11-01 12:20:54 -07:00
Johnny Steenbergen 37decdfa24 chore(pkger): fixup loose ends from PR review 2019-11-01 11:59:09 -07:00
Johnny Steenbergen a03c497015 feat(pkger): add dry run functionality
does not apply to mappings, will apply mappings no matter what. we need to
remedy the uniqueness of resources from the API side. Applies to labels,
label mappings,
2019-11-01 11:59:09 -07:00
Johnny Steenbergen c7545f8951 feat(pkger): add label -> bucket mappings to pkger 2019-11-01 11:59:09 -07:00
Johnny Steenbergen c0849acb9f feat(pkger): add pkg label support to the influx cli 2019-11-01 11:59:09 -07:00
Johnny Steenbergen 2c9f0f2d66 feat(pkger): add pkg cmd to influx CLI
extends the influx CLI to include the pkg cmd for buckets. Included is
the user interface for confirmation and printing of summaries before and
after the package is applied.
2019-11-01 11:59:09 -07:00
Johnny Steenbergen 52647af79e feat(pkger): add groundwork for manifest to support bucket resource 2019-11-01 11:59:09 -07:00
Kelvin Wang f8dee71516 fix(cmd/influx): remove dup usage 2019-10-31 12:35:11 -04:00
kelwang 5403e8aaa6
Merge pull request #15607 from influxdata/cli_delete_predicate
feat(cmd/influx): add cli delete predicate
2019-10-29 12:10:20 -04:00
docmerlin (j. Emrys Landivar) 6feae8f3ce feat(tasks): fixes for changeover 2019-10-29 10:36:47 -05:00
docmerlin (j. Emrys Landivar) aa5b094c8d refactor(task): feature flag for nw scheduler 2019-10-29 10:36:47 -05:00
Julius Volz e4558257e3 test(query): add PromQL end-to-end tests in go submodule
Signed-off-by: Lorenzo Affetti <lorenzo.affetti@gmail.com>
Signed-off-by: Julius Volz <julius.volz@gmail.com>

move to internal

update flux to v0.50

Revert "move to internal"

This reverts commit bcd4caffbd44135f1dbeac4163cb2a22a751f45a.

promtests/internal --> internal/promtests
2019-10-28 18:59:50 +01:00
Kelvin Wang 27d15deadb feat(cmd/influx): add cli delete predicate 2019-10-28 11:46:01 -04:00
Johnny Steenbergen 1e69c517b4
Merge pull request #15526 from influxdata/4447/fix_vault_flag_names
fix(vault): rename flags to match env vars and add missing token flag
2019-10-21 16:15:57 -07:00
Brandon Farmer ea82dc3470 fix(tasks): tasks look up system bucket id 2019-10-21 14:48:47 -07:00
Johnny Steenbergen 1bacb62b3a fix(vault): rename flags to match env vars and add missing token flag
the flags have to match the flags with the exception of beign lower case and
all `_` be changed to `-` in the flag. This is a result of using the cobra
flag to env var mapping with the `-` replaced to `_`.
2019-10-21 13:23:54 -07:00
Kelvin Wang 449bbd3fb0 feat(cmd/influxd): add deleteservice to launcher 2019-10-18 12:02:52 -04:00
Alirie Gray 552168d3ae
refactor(tasks): use Go time objects for timestamps on task Runs (#15406) 2019-10-17 17:23:45 -07:00
David McKay 647e179453 feat(tls): add options to run HTTP over TLS 2019-10-17 23:35:04 +01:00
Johnny Steenbergen cf2f785803 feat(vault): add flags to influxd for vault configuration 2019-10-16 09:41:51 -07:00
kelwang 072270d7d8
Merge pull request #15372 from influxdata/cli_list_org_members
fix(cmd/influx): fix list org members
2019-10-10 12:10:25 -04:00
Kelvin Wang c96fe7ed6e fix(cmd/influx): fix list org members 2019-10-10 11:57:03 -04:00
Johnny Steenbergen dbe0103d92 fix(logging): blacklist endpoints with sensitive data from logging body 2019-10-09 13:17:24 -07:00
Johnny Steenbergen 5a546d5827
Merge pull request #15335 from influxdata/2939/add_logging_to_gateway
2939/add logging to gateway
2019-10-07 14:49:36 -07:00
Johnny Steenbergen 9d5392cfd9 fix(logging): add debug logging for all http requests 2019-10-07 14:19:21 -07:00
Lyon Hill 5e1d7f6c69
feat(task): remove preauth (#15286)
* feat(task): remove preauth

* fix(task): remove e2e test that verified preauth
2019-09-26 10:52:24 -06:00
Kelvin Wang 4aa6df1c34 fix(cmd/influx): org add/remove members 2019-09-24 13:26:18 -04:00
Christopher Wolff 26dbd9225c feat(query/stdlib/experimental): add experimental.to() implementation to OSS 2019-09-20 14:31:58 -07:00
Lorenzo Affetti ab835c8e0e
refactor(dependencies): use new dependency injection framework (#15174)
refactor(dependencies): use new dependency injection framework
2019-09-19 17:01:17 +02:00
Edd Robinson 080943a9f5 fix(tests): ensure NATS server port free 2019-09-13 19:33:19 +01:00
Edd Robinson 65cb8b606e
Merge pull request #15132 from influxdata/er-build-tsi
feat(tools): add build-tsi tool
2019-09-13 17:40:24 +01:00
Ben Johnson ee3cf79ae7
fix(tsdb): Fix pull request feedback. 2019-09-13 10:00:54 -06:00
Ben Johnson d08403b658
feat(tsdb): Add SQL export for TSI indexes 2019-09-13 10:00:54 -06:00
Edd Robinson 4a2db1ec5f feat(inspect): add build-tsi tool 2019-09-13 16:38:05 +01:00
Edd Robinson d681955a84 refactor: imports 2019-09-13 16:38:05 +01:00
zhulongcheng dffca8f4fe chore(cmd): replace bolt.Client with kv.Service (#14726) 2019-09-12 10:26:25 -07:00
Jonathan A. Sternberg ae780ff468
tests(cmd/influxd/launcher): add a launcher test for the secret service (#14813)
The secret service is tested by creating a secret and then attempting to
use it in a flux query. There is one test where accessing the secret
should work and one where it should return that the action is forbidden.
2019-08-27 10:44:46 -05:00
Lyon Hill ee9e622c6d
feat(task): Add task middleware's for checks and notifications (#14809)
To have checks and notifications happen transactionally we need to be
able to alert the task system when a new task was created using the checks and notifications systems.
These two new middlewares allow us to inform the task system of a update
to a task that was created through the check or notification systems.
2019-08-26 16:54:52 -06:00
Nathaniel Cook dfc28335ea refactor(query/dependencies): update to new Flux dependencies defaults 2019-08-26 16:46:17 -06:00
Adam 945b68b8fd fix(query): finish refactoring the repl and inject the secret service as a dependency 2019-08-26 16:46:17 -06:00
Max U 36d3a6ea82 refactor(tsi1): address comments to clean up tool 2019-08-23 14:08:00 -07:00
Max U b2b4892918 refactor(inspect): make flags less vague 2019-08-23 14:07:30 -07:00
Max U 9fc99c2724 feat(tsi1): port the dump-tsi tool to 2.x 2019-08-23 14:07:30 -07:00
Adam Perlin 76dbc44e3c
feat(storage): Add influxd inspect dumpwal tool (#14237)
* feat(storage/wal/dump): initial influxd inspect dumptsmwal implementation

* feat(storage/wal/dump): add org bucket formatting to dumpwal tool; improve test cases

* refactor(storage/wal/dump): add long description for dumpstmwal tool

* refactor(storage/wal/dump): rename dumptsmwal flag

* chore(storage/wal/dump): gofmt

* refactor(storage/wal/dump): update error printing in dumptsmwal tool

* refactor(storage/wal/dump): address review comments

* refactor(storage/wal/dump): rename dumpwal command source file

* refactor(storage/wal/dump): clarify print flag comment

* refactor(inspect): remote unnecessary for-loop in influxd inspect command
2019-08-23 13:05:06 -07:00
George 0cc9caa1d4
refactor(tasks): separate coordinator and middleware (#14779) 2019-08-23 19:05:13 +00:00
maxunt 6ffbab89d4
Merge pull request #14316 from influxdata/mu-verify-series-2.x
feat(inspect): add verify-seriesfile tool to 2.x
2019-08-23 11:40:39 -07:00
Max U 6d361201d3 refactor(inspect): add shorthand for command line args 2019-08-22 11:01:02 -07:00
Max U 1ce93f0ca4 refactor(inspect): address config changes 2019-08-22 11:01:02 -07:00
Nathaniel Cook 6f5c81f0dc feat(inspect): add verify-seriesfile to 2.x 2019-08-22 11:01:02 -07:00
Max U ed7b88525b fix(launcher): print inspect as a subcommand when running with --help flag 2019-08-21 16:15:30 -07:00
Kelvin Wang 64e42271be feat(cmd/launcher): add notification endpoint 2019-08-15 21:56:24 -04:00
maxunt 757fb4f80c
Merge pull request #14280 from influxdata/er-rename
feat(fs): API for replacing os calls
2019-08-07 11:33:57 -07:00
Edd Robinson a2fc43ff0c
Merge pull request #14470 from influxdata/mu-reportTSI-2.x
feat(tsi1): add report-tsi tool to 2.x
2019-08-07 19:30:58 +01:00
Max U 64747e9781 refactor(tsi1): address config changes to report-tsi tool 2019-08-05 10:03:32 -07:00
Kelvin Wang 87730440ee feat(cmd/launcher): add check to launcher 2019-07-31 19:00:26 -04:00
Adam Perlin 4fef1683a0 refactor(tsi1): address review comments for report-tsi tool 2019-07-26 16:21:11 -07:00
Adam Perlin 7ce1b8109f chore(tsi1): Clean up flags and naming in report-tsi tool; add comments 2019-07-26 11:16:59 -07:00
Max U 9bd6200f15 fix(tsi1): make mergeable 2019-07-26 11:16:12 -07:00
Max U 17b1dd8562 feat(tsi1): add shorthand for --top flag as -t, plus cleaning 2019-07-26 11:12:15 -07:00
Max U aa2f7a8ff7 feat(tsi1): add a --top flag for limiting output, output now sorted 2019-07-26 11:12:15 -07:00
Adam Perlin 32b283d25a feat(tsi1/report): Add ability to filter by measurement; add additional maps for efficient retrieval of total org/bucket cardinalities 2019-07-26 11:12:15 -07:00
Max U 5e5fa96c5b feat(tsi1): add flags for --org-id and --bucket-id 2019-07-26 11:12:15 -07:00
Max U bfd38d93d8 feat(tsi1): provide API tooling for use in testing 2019-07-26 11:12:15 -07:00
Max U 8f99d20deb feat(tsi1): port report-tsi tool to influxdb 2.x 2019-07-26 11:12:15 -07:00
Max U eb6d0f4478 feat(tsi): report cardinality for all indexes, still needs to be cleaned
Fix iteration logic and clean up
2019-07-26 11:12:00 -07:00
Max U 99c0622ea0 fix(pkg/fs): merge branch 'master' into HEAD 2019-07-25 15:17:15 -07:00
Kelvin Wang a6a7d3471d feat(cmd/influx): add flags for notification rule auth 2019-07-25 15:15:35 -04:00
Kelvin Wang 149cbcf0e6 feat(cmd/influxd/launcher): add notification rule service 2019-07-25 15:15:35 -04:00
Max U 979c075931 Merge branch 'master' into HEAD 2019-07-22 10:21:59 -07:00
Christopher Wolff 63c0f40548 fix(query): use auth-wrapped org and bucket services for query 2019-07-19 20:02:53 -06:00
Kelvin Wang 42c893f31d fix(cmd/influx): user flag shouldn't be ignore 2019-07-16 13:25:13 -04:00
Stuart Carnie 030e11a82a
feat: Allow existing influxdb.ID type to be used as a pflag 2019-07-09 09:20:02 +10:00
Stuart Carnie 00561d5a1b
feedback: Move verify routines to `tsm1` package for consistency
Should have left it there to begin with 🤣
2019-07-09 09:00:41 +10:00
Stuart Carnie 46952afe37
feat(influxd): New influxd verify tsm-blocks command
This command performs verification of TSM blocks

* expected and actual CRC-32 checksums match
* expected and actual min and max timestamps match decoded
  data
2019-07-09 09:00:41 +10:00
Max U 2202d727da fixes merge conflicts 2019-07-08 14:07:04 -04:00
maxunt ca5a599261
Merge branch 'master' into er-rename 2019-07-08 13:42:24 -04:00
Max U fe748128e3 replaces os.Rename calls w api calls to fs.RenameFile. tests now are failing 2019-07-03 13:14:43 -04:00
Ben Johnson 08e24faf4c
feat(tsdb): Add block exporter.
Adds export tooling to `influxd inspect export-blocks` so that we
can dump out block data in SQL format for better analysis during
the debugging process.
2019-07-01 10:10:52 -06:00
Adam Perlin 24baec9e6d Gofmt verify-wal files 2019-06-27 16:28:28 -07:00
Adam Perlin f4faa9b2f5 feat(storage): Small verify-wal output and test tweaks 2019-06-27 16:28:28 -07:00
Adam Perlin c868ece4f6 feat(storage): Initial 2.x verify-wal tool functionality 2019-06-27 16:28:28 -07:00
Kelvin Wang 9dc5438e06 feat(cmd/influxd): add http error handler 2019-06-26 21:39:22 -04:00
Lyon Hill 435c8bbed5
fix(task): add logging into the task analytical store (#14124)
* fix(task): add logging into the task analytical store

* add in more detail around log structure
2019-06-12 20:01:41 -06:00
Alirie Gray 04a427e99e feat(tasks): add runID to Log struct 2019-06-06 11:24:38 -07:00
Jonathan A. Sternberg 21c80f3e93
refactor(query/control): move the controller from flux to influxdb (#13991)
The controller implementation is primarily used by influxdb so it
shouldn't be part of the flux repository. This copies the code from flux
to influxdb so it can be removed from the next flux release.
2019-05-29 09:04:34 -05:00
kelwang 4bbfa8c6f4
Merge pull request #13552 from influxdata/kv_log_time
feat(http): add audit log
2019-05-16 11:10:56 -04:00
Kelvin Wang f75f27c0bd feat(http): add audit log 2019-05-16 10:57:28 -04:00
Iris Scholten 2e26f23f9e
feat(authentication): Add cli args for specifying session length and renewal (#13924)
Co-authored-by: Jade McGough <jade@influxdata.com>

* Add session renew option to launcher and use in middlewhere
* pass session options to services
* Update SessionAutoRenew to SessionRenewDisabled
* Add test for service constructor defaults
* Update changelog
2019-05-15 10:16:47 -07:00
Palak Bhojani 3b6cf6234f Update read/write generate token to have option to create all buckets token 2019-05-09 15:08:30 -07:00
Stuart Carnie fb39ac39ce
fix(storage): Store.Read behavior changed to return unsorted series keys
Closes #13581
2019-04-26 10:38:59 -07:00
Christopher Wolff ab8d964a85 fix(query): remove per-query memory limit from OSS
Fixes #13639.
2019-04-25 15:08:07 -07:00
jlapacik e75d10d6b7 test(launcher): fix ill-formatted query; range must come before filter
Until https://github.com/influxdata/flux/issues/1215 is fixed, the query
writer must make sure to always place a range directly after a from
operation. Otherwise the query will fail planning.
2019-04-25 11:16:11 -07:00
jlapacik 5c973b6830 fix(launcher): call Done on query that errors 2019-04-25 11:16:11 -07:00
Alirie Gray 9f39ddfbef refactor(tasks): move validator to authorizer package 2019-04-24 11:36:54 -07:00
Jade McGough 808acf4a56
Merge pull request #13392 from zhulongcheng/cmd-find-auth
feat(cmd/influx): find auths by org
2019-04-23 10:29:32 -07:00
Nathaniel Cook bc17af2118
Merge pull request #13569 from influxdata/flux-staging
chore(dep): update Flux to v0.27.0
2019-04-22 18:34:39 -06:00
Kelvin Wang 7a72c363f2 remove org from bucket 2019-04-22 18:39:05 -04:00
Kelvin Wang 9d44ac3635 rename bucket organization to org 2019-04-22 18:39:01 -04:00
Nathaniel Cook a49d1696dc Merge branch 'master' into flux-staging 2019-04-22 14:25:33 -06:00
Christopher M. Wolff c9f94d4ee8
refactor(query): add parameters to query controller config (#13554)
Recently added to controller config:
  ConcurrencyQuota
  MemoryBytesQuotaPerQuery
  QueueSize
2019-04-22 12:11:32 -07:00
Lyon Hill 726fbefe9a
Integrate the new changes to tasks (#13473)
* Integrat the new changes to tasks
2019-04-19 08:37:59 -06:00
Nathaniel Cook 4c77e3598b Merge branch 'master' into flux-staging 2019-04-18 11:01:22 -06:00
Todd Persen cd64ec8718 Fix typos in miscellaneous packages 2019-04-17 13:30:22 -07:00
Nathaniel Cook 8b918539db Merge branch 'master' into flux-staging 2019-04-17 12:26:10 -06:00
Michael Desa e00c071c2c
feat(influxdb): add query/write http event recorders
feat(http): add prometheus counters for tracking write/query usage

feat(http/metric): add metric recoder for recording http metrics

feat(prometheus): implement metric.Recorder for prometheus metrics

fix(prometheus): remove erroneous fmt.Printlns

feat(http): add prometheus registry to API backend

This was done as exposing prometheus metrics to a higher level was quite
difficult. It was much simple to simply pass the registry down to
anything that needs it.

feat(cmd/influxd/launcher): pass prom registry in on api backend

feat(http): collect metrics for write and query endpoints

This was much messier than I would have preferred. Future work is
outlined in TODOs.

review(influxdb): rename metric.Metric to metric.Event
2019-04-17 08:33:31 -04:00
zhulongcheng 17304da3da feat(cmd/influx): find auths by org 2019-04-15 14:06:27 +08:00
Jonathan A. Sternberg b68b5053db refactor: replace usages of the spec compiler with the ast compiler (#13222)
This replaces usages of the spec compiler with the ast compiler and it
removes the error message referencing the spec compiler as an available
input.

It does not remove any of the code using the spec compiler that is
involved for proxying requests and it does not remove it from the API.
2019-04-12 07:15:27 -07:00
Christopher M. Wolff 16b9158b39 refactor(task): make tasks use new Query interface (#13219)
Fixes #12883.
2019-04-12 07:15:27 -07:00
kelwang 67bf2f54ac
Merge pull request #13052 from influxdata/auth_update_interface
fix(influxdb): updated auth shall return
2019-04-11 11:24:02 -04:00
Jacob Marble f56c42794b
chore(tracing): Cleanup (#13296)
* chore(tracing): Cleanup

* broken test

* fix unused var

* fix test
2019-04-10 19:28:21 -07:00
kelwang fbd313456a
Merge pull request #13061 from influxdata/swagger_proto_definition
fix(http): swagger proto definition
2019-04-03 15:55:51 -04:00
Kelvin Wang 1cf600aca9 remove proto 2019-04-03 15:42:25 -04:00
Lyon Hill 986a1acdbe
Update task executor to use a TaskService (#13099) 2019-04-02 15:55:31 -06:00
Lyon Hill 83000361c3
Update task coordinator to act as a TaskService middleware (#13068)
* Update task coordinator to act as a TaskService middleware
2019-04-01 16:45:44 -06:00
Kelvin Wang 712010d013 if(influxdb): updated auth shall return 2019-04-01 12:56:29 -04:00
kelwang 22dd44c4d1
Merge pull request #12955 from influxdata/auth_description_update
feat(kv): add auth description update
2019-03-29 14:08:34 -04:00
Lyon Hill c78344c441
update task schedler to use the new task control service (#12949) 2019-03-28 16:52:25 -06:00
kelwang 4d83e886fb
Merge pull request #12967 from zhulongcheng/cmd-kv-svc
refactor(cmd): replace bolt.Client with kv.Service
2019-03-28 12:32:42 -04:00
zhulongcheng 97140920a9 refactor(cmd): replace bolt.Client with kv.Service
Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>
2019-03-28 23:58:23 +08:00
Kelvin Wang a2c0bdbe77 feat(kv): add new update 2019-03-28 11:46:41 -04:00
Lorenzo Affetti 90a48c74f6 test(launcher): test for query memory limits and launcher test helpers 2019-03-27 15:50:35 +01:00
Edd Robinson dbca30dac5 Add integration tests for cache snapshotting 2019-03-25 11:44:01 +00:00
Edd Robinson 16cef36aa2 Move tests around 2019-03-25 11:44:01 +00:00
Edd Robinson af3f7bc9cb Add new cache configuration value 2019-03-25 11:44:01 +00:00
Stuart Carnie 8abb76cb4e
Merge pull request #12710 from influxdata/sgc/data-gen
Add data generation subcommand to influxd
2019-03-20 11:08:49 -07:00
Mark Rushakoff 9541fbb859 fix(task): report query statistics correctly
The synchronous executor was missing a call to ResultIterator.Release.
The asynchronous executor wasn't even calling Query.Statistics.

Also add a test that the scheduler records the statistics to the run
log, and that the statistics are visible from the launcher test. The
launcher test is the most likely place to catch if something goes wrong
in the full stack.
2019-03-20 08:11:14 -07:00
Stuart Carnie 8669e94904
feat(influxd): Add the generate subcommand 2019-03-19 21:52:26 -07:00
Edd Robinson c4cc3ca7bc Fix 2019-03-19 15:12:35 +00:00
Edd Robinson f383ec9225 Add ability to use report-tsm programmatically 2019-03-19 14:29:25 +00:00