Commit Graph

1082 Commits (0cb0da20601ea60a04457ef689a7b6c511473b8b)

Author SHA1 Message Date
Johnny Steenbergen 6694c7e393 chore(pkger): refactor export by stack to reuse CreatePkg functionality
this also makes it so that an association (label) that is added to a
resource is also included in the returned output. There is 1 test that
was changed as part of this work. It is to test for this specific change
in behavior

references: #18646
2020-06-24 12:03:20 -07:00
Brett Buddin 1f422b9b94
fix(dbrp): Delete DBRP mappings when their target Bucket is deleted. (#18699) 2020-06-24 13:40:54 -04:00
Johnny Steenbergen dcc6bd197a chore(influx): update influx stacks rm cmd printout 2020-06-23 18:55:38 -07:00
Johnny Steenbergen d671185bdc fix(pkger): fixup updates for variables where updates from selected were skipped 2020-06-23 08:05:27 -07:00
Johnny Steenbergen 38d44c7980 chore(influx): add support for week duration 2020-06-22 21:02:51 -07:00
Johnny Steenbergen 3c14db1c77 fix(influx): support days as duration type
closes: #18639
2020-06-22 20:07:53 -07:00
Johnny Steenbergen 5db8e2fd5e chore(influx): mark hidden flags that are deprecated as deprecated with help msg 2020-06-22 20:07:53 -07:00
Johnny Steenbergen 4827398fba fix(influx): normalize output of template task diff 2020-06-22 17:30:28 -07:00
Johnny Steenbergen 802afebf8c feat(pkger): add support for selected fields to variable
references: #18240
2020-06-22 17:05:18 -07:00
Alirie Gray 5d3b9e2001
refactor: move name lookup to auth http (#18643) 2020-06-22 16:14:48 -07:00
Johnny Steenbergen 2d4a12fdf6 chore(pkger): accomodate skipping resources that are part of an association 2020-06-22 14:24:33 -07:00
Johnny Steenbergen 5bef654062 fix(influx): remove references to local
all CLI interactions are now to go through the front door (API).

closes: #18616
2020-06-18 17:29:16 -07:00
Johnny Steenbergen 81490d6604 feat(influx): fixup config file env var naming and add support for config directory 2020-06-18 17:09:46 -07:00
Johnny Steenbergen 0f222de331 chore(influx): refactor influx config delete cmd to for consistency and update usage
closes: #18603
2020-06-18 16:55:33 -07:00
Johnny Steenbergen 84723e15d2 feat(influxd): refactor run command to use cli.Program to respect config file 2020-06-18 15:59:53 -07:00
Johnny Steenbergen 59239a1d93 chore(influx): replace all mentions of packages with templates in the CLI 2020-06-18 15:33:52 -07:00
Michael Hall 831be6c356 fix: Convert onboardingRequest RetentionPeriod to a Duration, rather than time.Hour to a uint. Fixes #18547 2020-06-18 14:36:22 -04:00
Lyon Hill 3987d3692b
chore: Clean out old session store feature flag (#18596) 2020-06-18 12:18:34 -06:00
Johnny Steenbergen 8d9e3bb81f feat(influx): provide active config when running bare influx config cmd 2020-06-18 09:29:12 -07:00
Johnny Steenbergen e3e1760b38 feat(influx): extend apply command with actions to skip kind and/or resource
also consolidates the export filters on `kind` in place of `resourceKind`
2020-06-18 09:01:09 -07:00
Johnny Steenbergen ec8c252dbb feat(pkger): extend public apply API with new action to skip resources by kind
closes: #18490
2020-06-18 08:03:34 -07:00
Johnny Steenbergen d1f9807624
fix(pkger): fix flaky test caused by merge race condition (#18594)
one PR got merged, then the other without rebase/rerunning tests. That
is what resulted in this broken test.
2020-06-18 16:10:27 +03:00
Johnny Steenbergen a179d6d473 fix(pkger): delete newly created stack when applying a template that encounters err 2020-06-17 17:57:23 -07:00
Johnny Steenbergen a4e4be7787 feat(pkger): add ability to skip a resource within a template
references: #18490
2020-06-17 17:22:56 -07:00
Johnny Steenbergen aa1e29fb84 feat(influx): extend stacks cmd with update
closes: #18548
2020-06-17 14:46:09 -07:00
Johnny Steenbergen a6df6c95ec chore(influx): update influx stacks usage 2020-06-17 14:46:09 -07:00
Johnny Steenbergen 7e8ab162e7 feat(pkger): extend stacks with update functionality
references: #18548
2020-06-17 09:47:33 -07:00
Adrian Thurston 5d1a759170
feat: annotate context with feature flags when handling flux queries (#18506)
Annotate the context with feature flags when handling flux queries in influxdb.
Taking advantage of this in flux end-to-end tests. Using a custom flagger that
can set overrides based on the test case that is about to be run, allowing us
to enable features in the end-to-end tests.
2020-06-17 16:55:29 +03:00
jlapacik a19604c0ea refactor: windowed read operation should include aggregate name 2020-06-16 18:05:21 -07:00
Johnny Steenbergen 61cd72b0cd chore(influx): update usage and soften comparisons for kind matching on export
closes: #18550
2020-06-16 15:31:39 -07:00
Johnny Steenbergen 18eff154a6 feat(influx): provide for remote files in the template commands 2020-06-16 14:44:51 -07:00
Johnny Steenbergen 870a3bb48c chore(influx): extend stacks output with sources 2020-06-16 14:00:56 -07:00
Lyon Hill 009b8ec98f
feat: start using the new org handler from the tenant service. (#18371)
* feat: start using the new org handler from the tenant service.

The rest of the tenant system is in place except the org http api handler and the
user api handler.

* fix: update the label service in org handler and add links
2020-06-16 12:56:31 -06:00
Johnny Steenbergen b977568390 feat(pkger): extend pkger to provide sources of templates to each template 2020-06-16 08:04:37 -07:00
jlapacik 7f1caec697
feat: limit cursors (#18467)
* feat(storage): first array cursor

* feat: add first and last to rpc messages

* test(launcher): push down group first and group last

* feat(storage): window first array cursor

* test(launcher): push down bare first and bare last

* feat(storage): add capabilities for group first and group last

* refactor: rename first to limit

* refactor: make zero value for every period meaningful

* refactor: standardize launcher pushdown tests
2020-06-15 12:21:35 -07:00
Christopher M. Wolff 8fa5d3f591
feat(query): add test and feature flag for pushing down sum (#18484) 2020-06-12 13:28:03 -07:00
Pavel Zavora a719bcd1e9 chore(influx): use and pass a single context in write cmd processing 2020-06-12 05:53:20 +02:00
Johnny Steenbergen c70c3faa11 chore(influx): remove client timeout on write cmd's retriever 2020-06-11 11:26:38 -07:00
Pavel Zavora 55e58c9d5d chore(doc): apply proofreading 2020-06-11 10:21:44 -07:00
Pavel Zavora 6d91f67bbe feat(cmd/influx/write): write data from url 2020-06-11 10:21:44 -07:00
Jonathan A. Sternberg db686349e7
feat(storage/flux): support full aggregate window push down (#18399)
This enables a new rule that will push down the full `aggregateWindow`
query including the `duplicate` and `window(every: inf)` that recombines
the tables. When the full rule is used, the table is not split into
tables for each window and instead retains itself as a single table. The
start or stop column is renamed to `_time` and `_start` and `_stop` will
be the boundaries of the query.
2020-06-10 13:21:41 -05:00
Johnny Steenbergen 1d75e3e8e9 feat(influx): provide means to provide trace debug ids to httpc client 2020-06-09 18:18:43 -07:00
Faith Chikwekwe 1bf2ce1a32 feat(query): register bare aggregate 2020-06-09 14:24:41 -07:00
Jonathan A. Sternberg 36b0a90b2c
tests(launcher): add a launcher test for read window aggregate push down (#18412)
This adds a launcher test for the read window aggregate push down to
verify that it is done when a query is sent with the appropriate
pattern, the output is correct, and that the metric is incremented that
signals the push down happened.
2020-06-09 15:20:54 -05:00
Johnny Steenbergen 34b3dc77fb feat(influx): move nested commands to root for stacks, export, and rename pkg to apply
this is the beginning of consolidating packages under the moniker templates
2020-06-08 10:10:25 -07:00
Johnny Steenbergen be4f989961 fix(pkger): lazy init the pkger store
closes: #18383
2020-06-05 14:17:26 -07:00
Johnny Steenbergen bc9b69b96f fix(pkger): provide charts when export stack dashboards by stack 2020-06-04 15:16:15 -07:00
Johnny Steenbergen a6ead1246e fix(pkger): provide correct stackID for recording pkg application
this bug surfaces when you do not provide a stack ID to the apply call.
the new stack is created, but the resources created are not associated
with it. This remedies that issue.
2020-06-04 13:47:52 -07:00
Johnny Steenbergen d21fce5f6d fix(influx): have delete cmd respect the config settings
closes: #17289
2020-06-02 16:31:49 -07:00
Johnny Steenbergen fd289883fe feat(influx): add User-Agent header to the CLI http calls
closes: #18336
2020-06-02 16:09:11 -07:00
Johnny Steenbergen 81a0982b00 feat(influx): add version to influx CLI
closes: #14821
2020-06-02 16:09:11 -07:00
Johnny Steenbergen 6112c7848d chore(influx): improve usage for influx pkg commands
closes #18324
2020-06-02 13:49:35 -07:00
Johnny Steenbergen 07e351b204 chore(influx): disable failing when providing an unexpected error to influx CLI
closes: #18290
2020-06-02 12:25:21 -07:00
Johnny Steenbergen 4838a94eed feat(pkger): add export stack command to influx CLI
closes: #18271
2020-06-02 08:18:11 -07:00
Johnny Steenbergen 3dcd5d496f feat(pkger): add ability to export by stack
this ability exports all resources associated with a stack by the same
metadata.name fields as the original application had done it. This can
be used as a means to snapshot the current state of the stack. This can
be used for source control or other means.

closes: #18271
2020-06-02 08:18:11 -07:00
Alirie Gray 03ba8f250a
refactor: remove urms from new label service (#18301) 2020-06-01 09:28:03 -07:00
Johnny Steenbergen d3be5d19ea chore(influx): provide stack ID in pkg application commands 2020-05-29 09:24:22 -07:00
Johnny Steenbergen 53794bfae5 feat(pkger): make all pkg applications stateful
if no stack is provided then one will be provided for you.

closes: #17997
2020-05-28 16:59:21 -07:00
Johnny Steenbergen b25b4021c3 chore(pkger): refactor return values for Apply/DryRun to enable extending it
references: #17997
2020-05-28 15:34:15 -07:00
Pavel Závora f9ed497abf
feat(cmd/influx/write): enhance the ability to import CSV files using csv2lp library (#18093)
* feat(cmd/influx/write):  enhance the ability to import CSV files

* feat(cmd/influx/write): rely upon csv2lp package

* chore(cmd/influx/write): rename file to snake case

* chore(cmd/influx): apply PR review comments
2020-05-28 15:28:45 -07:00
Alirie Gray 876238d688
feat: add feature flag for new labels service (#18215) 2020-05-28 08:26:08 -07:00
jlapacik d22380dc8b
Merge pull request #17900 from influxdata/feat/use-algo-w
chore: promote algorithm W to master
2020-05-27 10:20:03 -07:00
Lyon Hill 97dc4d18db
feat: use the new tenant user handler (#18190)
Switch to use the new user handler. We have been using the tenant backend for some
time now and just need to switch over to using tenant front to back.
2020-05-27 08:48:27 -06:00
jlapacik 7db9f4c520 Merge branch 'master' into chore/merge-master 2020-05-26 10:03:42 -07:00
Alirie Gray 7f4ddabe8a
refactor: add new label package (#18078) 2020-05-21 11:30:19 -07:00
greg linton 5ac45ccb8a fix: use skip-verify flag in ping 2020-05-21 11:44:51 -06:00
Jonathan A. Sternberg 0c8d19e896
Merge branch 'master' into feat/use-algo-w 2020-05-18 13:25:26 -05:00
Lyon Hill c459852f8f
feat: integrate the new session system behind a feature flag (#18042) 2020-05-18 11:50:22 -06:00
Gianluca Arbezzano 1cf64fd721
feat: dbrp service
Signed-off-by: Lorenzo Affetti <lorenzo.affetti@gmail.com>
Co-Authored-By: Gianluca Arbezzano <gianarb92@gmail.com>
Co-Authored-By: George MacRorie <gmacrorie@influxdata.com>
Co-Authored-By: Alirie Gray <alirie.gray@gmail.com>
2020-05-15 12:05:38 +02:00
jlapacik 34e581ca0a Merge branch 'master' into chore/merge-master 2020-05-12 11:18:25 -07:00
Johnny Steenbergen 3ad00934c4 fix(influx): fixup display message for onboarding with interactive and rp flag
closes: #17862
2020-05-08 10:03:56 -07:00
Alirie Gray 24cc1cabb8
feat: add feature flag for refactored authorization package (#17944) 2020-05-08 10:00:39 -07:00
Gavin Cabbage 4fd30f5f24
fix(kit/feature): lookup typed flag if base is passed to override (#18012)
* fix(kit/feature): lookup typed flag if base is passed to override

* chore(kit/feature): override base flag test
2020-05-08 09:50:04 -04:00
Johnny Steenbergen 233b6d368d fix(influx): update diff labelmapping print to respect state status 2020-05-07 15:52:52 -07:00
Johnny Steenbergen b0d00425b0 feat(influx): add pkger remove|rm|uninstall stacks command 2020-05-07 15:52:52 -07:00
Johnny Steenbergen e668524847 feat(influx): add pkger list stacks command 2020-05-07 15:52:52 -07:00
Brett Buddin 8d26d9807d
Merge pull request #17970 from influxdata/bb/feature-flag-proxy
feat(http): Allow specific API handlers to be proxied for the Algo-W rollout
2020-05-07 14:20:47 -04:00
jlapacik f3320c7b43 Merge branch 'master' into chore/update-flux 2020-05-07 10:44:34 -07:00
Johnny Steenbergen 37d44d882d chore(pkger): handle edge cases for telegraf configs that manifest from user interaction
closes: #17434
2020-05-06 16:49:50 -07:00
Johnny Steenbergen 3eb5af969a chore(pkger): handle edge cases for tasks that manifest from user interaction
references: #17434
2020-05-06 16:49:50 -07:00
Johnny Steenbergen 7be0d8289b chore(pkger): handle edge cases for rules that manifest from user interaction
references: #17434
2020-05-06 16:18:48 -07:00
Johnny Steenbergen 7f8aa4c40f chore(pkger): handle edge cases for endpoints that manifest from user interaction
references: #17434
2020-05-06 15:56:32 -07:00
Johnny Steenbergen b4b52570b4 chore(pkger): handle edge cases for labels that manifest from user interaction
references: #17434
2020-05-06 15:26:01 -07:00
Johnny Steenbergen d4aa3be8db chore(pkger): handle edge cases for dashboards that manifest from user interaction
references: #17434
2020-05-06 15:12:30 -07:00
Johnny Steenbergen 485cc3ea54 chore(pkger): handle edge cases for checks that manifest from user interaction
references: #17434
2020-05-06 14:57:04 -07:00
Johnny Steenbergen 24dd13bcc6 chore(pkger): handle edge cases for buckets that manifest from user interaction
references: #17434
2020-05-06 14:19:44 -07:00
Johnny Steenbergen f575ea8d41 chore(pkger): handle edge cases that can manifest from users in the platform and stateful pkg applications
references: #17434
2020-05-06 13:01:50 -07:00
jlapacik 4aec0dc48e Merge branch 'master' into chore/update-flux 2020-05-06 10:00:09 -07:00
Brett Buddin c5c4e71dbd
feat(http): Add ability to proxy specific API handlers for Algo-W rollout. 2020-05-06 12:30:05 -04:00
Gavin Cabbage 8af9b3c2d1
refactor(kit/feature): remove target logic; expose bykey (#17949)
* refactor(kit/feature): remove target logic; expose bykey

* refactor(kit/feature): un-variadic-ify bykey arg
2020-05-06 11:13:17 -04:00
Johnny Steenbergen 3fd731511a chore(pkger): make integration stack tests indpendent 2020-05-05 11:01:13 -07:00
Johnny Steenbergen 1d027cf4e0 feat(pkger): enforce metadata.name dns name compliance
this PR includes a lot of small changes to names in existing test pkgs.
the tests are updated to follow suit.

closes: #17940
2020-05-05 01:35:02 -05:00
Johnny Steenbergen 89e34365bb feat(pkger): add the ability to remove a stack and all its associated resources
closes: #17554
2020-05-05 01:35:02 -05:00
Johnny Steenbergen 784b222d4d feat(pkger): enforce metadata.name dns name compliance
this PR includes a lot of small changes to names in existing test pkgs.
the tests are updated to follow suit.

closes: #17940
2020-05-04 12:40:22 -07:00
Johnny Steenbergen 95ad3c6582 feat(pkger): add the ability to remove a stack and all its associated resources
closes: #17554
2020-05-01 16:18:13 -07:00
jlapacik 83b90c3575 Merge branch 'master' into chore/merge-master 2020-04-30 14:05:51 -07:00
Johnny Steenbergen c7e97f1625 feat(pkger): add service and http server integreations for stack lists
references: #17554
2020-04-30 13:24:15 -07:00
jlapacik 2ef9999907 Merge branch 'master' into chore/merge-master 2020-04-30 09:53:04 -07:00
Gavin Cabbage 95913534a0
feat(kit/feature): add feature flag package (#17851)
* feat(kit/feature): add feature flag package

* refactor(kit/feature/_codegen): simplify with fmt.Errorf

* chore(kit/feature): tidy comments
2020-04-30 11:29:43 -04:00
Johnny Steenbergen ff27edbea9 feat(pkger): add support for using URLs associated with stack to apply/dry run 2020-04-29 16:48:00 -07:00
Lyon Hill d720661e77
feat(tenant): change the tenant services default behavior to enabled (#17872)
We have reached the stage wehre the new tenant service is being used and
is stable but we want to get it in more hands and used as the default service.
2020-04-29 14:04:26 -06:00
jlapacik 457637ed22 Merge branch 'master' into chore/merge-master 2020-04-28 13:13:36 -07:00
Johnny Steenbergen 72906a4484 feat(pkger): add support for stateful label mappings
references: #17434
2020-04-24 17:05:55 -07:00
jlapacik 3079d2a8aa Merge branch 'master' into chore/merge-master-into-algo-w 2020-04-24 14:21:26 -07:00
Johnny Steenbergen 1ac383de66 fix(launcher): removed timed contexts for launcher pkger tests 2020-04-24 10:52:50 -07:00
Johnny Steenbergen 1615a2c461 fix(influx): add arg description into config usage 2020-04-24 10:52:50 -07:00
Johnny Steenbergen 3acd860563 feat(pkger): add stateful management for notification rules
references: #17434
2020-04-23 11:47:32 -07:00
jlapacik 63fd3655be Merge branch 'master' into chore/merge-master-into-algo-w 2020-04-22 14:52:59 -07:00
George e150377f48
revert(tenant): integrate the tenant service as the default backend (#17805) (#17832)
This reverts commit 79e9de93cb.
2020-04-22 17:23:17 +01:00
Johnny Steenbergen 653a53fa9b chore(influx): tidy up print summary statements to include pkg names 2020-04-21 16:50:08 -07:00
Johnny Steenbergen 47e5facc81 feat(pkger): add stateful management for telegraf configs 2020-04-21 15:47:49 -07:00
Lyon Hill 79e9de93cb
feat(tenant): integrate the tenant service as the default backend (#17805) 2020-04-21 13:43:56 -06:00
Johnny Steenbergen 43b7d65d02 feat(influx): extend CLI org type to support config orgs in global config 2020-04-21 10:25:05 -07:00
Johnny Steenbergen 5cd57d4f1e fix(influx): make CLI respect root token and host env vars in additionn to config
one thing to note here is we are deleting the default value on the host
flag when it is registered. The config is the fallback and has the default
value set. If the host flag has a default, the determination if the user
set it or not is ambiguous. We can't have that.

closes: #17812
2020-04-21 10:25:05 -07:00
Johnny Steenbergen 596d8fde45 feat(pkger): add stateful management for tasks
notes on this commit. This commit was grueling ;-(. The task API is not a friendly
API to consume. There are a lot of non obvious things going on and almost every
one of them tripped me up. Things of note:

* the http.TaskService does not satisfy the influxdb.TaskService,
  making it impossible to use as a dependency if tasks service gets
  split out
* the APIs for create and update do not share common types. For example:
  creating a task takes every field as a string, but in the update it is
  taken as a options.Duration type. A step further and you'll notice that
  create does not need an option to be provided, but the update does. Its
  jarring trying to understand the indirection here. I struggled mightily
  trying to make sense of it all with the indirection and differing types.
  Made for a very difficult task (no pun intended) when it should have been
  trivial. Opportunity here to fix these up and make this API more uniform
  and remove unneccesary complexity like the options type.
* Nested IDs that get marshaled, are no bueno when you want to marshal a task
  that does not have an ID in it, for either user/org/or self IDs. Its a challenge
  just to do that.
* Lots of logs in the kv.Task portion where we hit errors and log and others where
  we return. It isn't clear what is happening. The kv implementation is also very
  procedural, and I found myself bouncing around like a ping pong ball trying to
  make heads or tails of it.
* There is auth buried deep inside the kv.Task implementation that kept throwing me
  off b/c it kept throwing errors, instead of warns. I assume, not sure if I'm
  correct on this, but that the stuff being logged is determined inconsequential
  to the task working. I had lots of errors from the auth buried in there, and hadn't
  a clue what to make of it....

leaving these notes here as a look back at why working with tasks is so
difficult. This API can improve dramatically. I spent 5x the time trying
to figure out how to use the task API, in procedural calls, than I did
writing the business logic to consume it.... that's a scary realization ;-(

references: #17434
2020-04-21 09:14:20 -07:00
Johnny Steenbergen d1af15c399 chore: remove extranenous fields on http.Task type
also drops a skipped test that has been skipped for over a year. Tried
unskipping it, but now it fails for all sorts of reasons, without the
race flag enabled.
2020-04-20 15:34:58 -07:00
Johnny Steenbergen c483aec2d2 feat(pkger): add stateful management for dashboards 2020-04-20 14:04:45 -07:00
jlapacik 335968a552 Merge branch 'master' into chore/merge-master 2020-04-20 13:59:21 -07:00
Johnny Steenbergen 8251c362ee chore(pkger): refactor parser notification rule state out into stateful type
this PR also drops a bunc of dead code that was necessary for times of integration.

references: #17434
2020-04-17 14:02:29 -07:00
jlapacik 7541af8414 chore: merge master into algow 2020-04-15 14:42:03 -07:00
Johnny Steenbergen 94ae519cc6 chore(pkger): refactor parser notification endpoint state out into stateful type
references: #17434
2020-04-15 14:26:25 -07:00
Johnny Steenbergen c8a79f5653 chore(pkger): refactor parser variable state out into stateful type
references: #17434
2020-04-14 16:48:56 -07:00
Johnny Steenbergen 68183bb156 chore(pkger): refactor embedded types out of stateful types 2020-04-14 14:12:23 -07:00
Johnny Steenbergen c718b676ef chore(pkger): refactor pkger data model to separate parsed and stateful datum 2020-04-14 09:28:09 -07:00
Lorenzo Affetti 6967cc2d58
fix(launcher): se default memory limit for query to unlimited 2020-04-10 21:33:45 +02:00
Johnny Steenbergen 67ccbd4490 fix(influx): add nil check for printing diff of endpoints and checks 2020-04-09 13:15:32 -07:00
Johnny Steenbergen 77bb23fd38 chore(pkger): refactor label mapping diff CLI table output 2020-04-08 15:13:47 -07:00
Johnny Steenbergen cee77081b2 feat(pkger): extend tasks with unique constraints 2020-04-08 14:38:32 -07:00
Johnny Steenbergen 85e31e8194 feat(pkger): update tasks with unique constraints 2020-04-08 13:30:43 -07:00
Pavel Závora 179adb0e9b
Merge pull request #17595 from influxdata/17356/influx-cli-file
feat(cmd/influx): add --file option to query and task commands
2020-04-08 20:45:44 +02:00
Johnny Steenbergen 845718c0d6 feat(pkger): update dashboards with unique constraints 2020-04-08 11:21:28 -07:00
Pavel Závora 3270d3328a
Merge branch 'master' into 17356/influx-cli-file 2020-04-08 19:54:43 +02:00
Johnny Steenbergen dd432360cc feat(pkger): update notification rule with unique constraints 2020-04-08 10:36:21 -07:00
Lyon Hill 33c39796bd
feat(tenant): update the client to use the new onboarding package (#17659) 2020-04-07 13:51:06 -06:00
Alirie Gray 8975fd2365
refactor(tenant): move bucket and urm auth layers to tenant service (#17474)
Co-authored-by: Lyon Hill <lyondhill@gmail.com>
2020-04-07 11:13:27 -07:00
Lyon Hill 4421a39639
feat(tenant): Build out the onboarding system in tenant and integrate it into launcher (#17558)
We are adding in a setup/user route this is not in swagger at the moment but will be
added once we feel it is stable.
2020-04-06 15:58:15 -06:00
Johnny Steenbergen c245f3233b chore(pkger): add stack state management for notification endpoints 2020-04-06 14:56:56 -07:00
Pavel Závora 9cca99d0a4
Merge branch 'master' into 17356/influx-cli-file 2020-04-06 21:04:44 +02:00
Johnny Steenbergen 1e19f38502 chore(pkger): add stack state management for variables 2020-04-06 10:22:55 -07:00
Jonathan A. Sternberg d3fa60991f
Merge branch 'master' into chore/merge-master 2020-04-06 12:17:47 -05:00
Pavel Zavora 37b3673733 chore(cmd/influx): apply proofreading comments #17356 2020-04-04 13:00:41 +02:00
Jonathan A. Sternberg 0ae8bebd75
refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
Jonathan A. Sternberg 469c5849c4
Merge branch 'master' into feat/use-algo-w 2020-04-03 09:30:04 -05:00
Pavel Zavora 4f1953cea5 feat(cmd/influx/task): add --file option #17356 2020-04-03 08:00:56 +02:00
Pavel Zavora 3449f23733 feat(cmd/influx/query): add --file option #17356 2020-04-03 07:31:10 +02:00
Johnny Steenbergen 21d2bf5dc6 chore(pkger): add stack state management for checks 2020-04-02 16:32:20 -07:00
Johnny Steenbergen e6317a04ee chore(pkger): refactor summary/diff types for Endpints|Checks|Variables 2020-04-02 12:35:51 -07:00
Johnny Steenbergen 762e9a422e feat(pkger): add stack state management for labels 2020-04-02 09:03:59 -07:00
Lorenzo Affetti 13fc4f335d
test(launcher): e2e test memory limits 2020-04-02 11:20:42 +02:00
Johnny Steenbergen f5b9a30b1f feat(pkger): extend labels diff and summary types to include PkgName and Remove
the pkgName refers to the unqiue label resource within the pkg and the
Remove field indicates the label will be removed when applying the pkg
2020-04-01 14:13:45 -07:00
Johnny Steenbergen 34c3b35ca3 feat(pkger): add stack state management for buckets 2020-04-01 13:09:14 -07:00
Kelvin Wang abe3a96674 feat(cmd/influx): add config switch back 2020-04-01 12:44:21 -04:00
Johnny Steenbergen 098fd27ab4 feat(pkger): extend DiffBucket with name for existing and new bucket values
provides mapping between pkgName and resource the diff represents. Now that
stacks are in place, the existing bucket may change names.
2020-03-31 13:34:40 -07:00
Pavel Zavora 153bc0bd40 Merge branch 'master' into 17003/writeFromCsv 2020-03-29 21:20:10 +02:00
Pavel Zavora 9e55ac3481 chore(cmd/influx/write): remove unused DryRun flag 2020-03-29 20:30:06 +02:00
Johnny Steenbergen 9f2fcea365 fix: add missing flag register to task run list cmd for json out and hide header flags 2020-03-27 14:20:37 -07:00
Johnny Steenbergen 77900b39cc fix: add missing flag register to task run list cmd for json out and hide header flags 2020-03-27 13:47:31 -07:00
Johnny Steenbergen e767b1e410 fix: add missing flag register to org cmd for json out and hide header flags 2020-03-27 13:31:46 -07:00
Kelvin Wang 5db57c9081 feat(cmd/influx): easy switch config 2020-03-27 15:45:36 -04:00
Johnny Steenbergen 3cb44a0301 feat(influx): add jsonout and hide headers support to task cmd 2020-03-27 12:33:24 -07:00
Johnny Steenbergen 361777acfd feat(influx): add jsonout and hide headers support to auth cmd 2020-03-27 11:49:09 -07:00
Johnny Steenbergen 62a64e9abd feat(influx): add jsonout and hide headers support to user cmd 2020-03-27 11:49:09 -07:00
Brett Buddin 2200143a22
Merge pull request #17462 from influxdata/bb/no-tasks
feat(influxd): flag to disable scheduling of tasks
2020-03-27 14:26:34 -04:00
Russ Savage b0876d4144
Merge branch 'master' into 17003/writeFromCsv 2020-03-27 11:14:52 -07:00
Johnny Steenbergen 7a518380ad feat(influx): add jsonout and hide headers support to config cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen 241e3513e6 feat(influx): add jsonout and hide headers support to setup cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen 08fbdbff1a feat(influx): add jsonout and hide headers support to secret cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen ba57fa5a66 feat(influx): add jsonout and hide headers support to org cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen 34e0754572 feat(influx): add jsonout and hide headers functionality to bucket cmds 2020-03-27 10:29:56 -07:00
Brett Buddin 3d826d96cf
feat(influxd): flag to disable scheduling of tasks 2020-03-27 12:52:07 -04:00
Johnny Steenbergen f0c0b82a7a feat(influx): add json output flag for pkg commands that print tables 2020-03-27 08:32:58 -07:00
Johnny Steenbergen 37646464b3 feat(pkger): add stack init cmd to influx cli
closes: #17235
2020-03-27 08:32:58 -07:00
sranka 9baf17f25b
Merge branch 'master' into 17003/writeFromCsv 2020-03-27 13:36:35 +01:00
Pavel Zavora ede26fce65 chore(cmd/influx/write): q comments 2020-03-26 21:19:33 +01:00
Johnny Steenbergen 8c70dc9b23 feat(pkger): add create stack endpoint for http server 2020-03-26 12:37:43 -07:00
Johnny Steenbergen 7a24e450c1 feat(pkger): add auth for pkger stack CRUDing
adds new AuthAgent type that can be reused across service middleware.
2020-03-26 10:11:59 -07:00
Lorenzo Affetti b9fc4e5668
Merge pull request #17385 from influxdata/la/dup-read
feat(tenant): add duplicate read service
2020-03-25 23:41:29 +01:00
Pavel Zavora 1911854218 chore(cmd/influx): create write's dryrun subcommand with runE middleware 2020-03-25 21:26:18 +01:00
Pavel Zavora 978604cc52 fix(cmd/influx): reuse organization struct for org and org-id flags of write command 2020-03-25 21:22:01 +01:00
Pavel Zavora f871de2076 feat(cmd/influx): introduce dryrun sub-command of write command 2020-03-25 21:22:01 +01:00
Pavel Zavora 60765219ae fix(cmd/influx): revert the way of how config is read when token flag is empty 2020-03-25 21:22:01 +01:00
Pavel Zavora ff3a27aac5 feat(cmd/write): add dry-run flag 2020-03-25 21:22:01 +01:00
Pavel Zavora 3fddd8dea5 chore(cmd/write): use stdin when no file or argument is supplied 2020-03-25 21:22:01 +01:00
Pavel Zavora 82f0365ff6 feat(cmd/write): don't override config unless token migration really happened 2020-03-25 21:21:21 +01:00
Pavel Zavora fd1e4b903f feat(cmd/write): add file option 2020-03-25 21:21:21 +01:00
Pavel Zavora 7ca93e0bfe feat(cmd/write): don't check setup for dry-run executions 2020-03-25 21:17:23 +01:00
Pavel Zavora 8a3feb1bbc feat(cmd/write): add csv format support 2020-03-25 21:17:23 +01:00
Johnny Steenbergen 36d99bfbf8 chore(influx): make runE middleware application explicit from caller 2020-03-25 12:41:11 -07:00
Johnny Steenbergen 7d8bd1e055 chore(pkger): refactor influx pkg cmd to not validate in CLI and have server validate
the pkger.ValidSkipParseError option allows our server to be the one to validate the
the pkg is accurate. If a user has an older version of the UI and our cloud gets updated
with new validation rules,they'll get immediate access to that change without having to
rol their CLI build.

also fixes issue where we swallow initial errors when check setup middleware
fails.
2020-03-25 11:50:14 -07:00
Johnny Steenbergen 2f7aee2f2e chore(influx): small cleanup of pkg command removing duplicate validation 2020-03-25 09:09:48 -07:00
Lorenzo Affetti 1e36e7b3ad
feat(tenant): add duplicate read service 2020-03-25 12:06:28 +01:00
Kelvin Wang 1e9099c45f feat(cmd/influx): add delete bucket by name 2020-03-24 16:10:24 -04:00
Johnny Steenbergen c926accb42 feat(pkger): add create stack implementation for service 2020-03-23 16:30:27 -07:00
Christopher M. Wolff 20c2439230
refactor(http): change *ast.Package to json.RawMessage in query requests (#17316) 2020-03-23 12:39:24 -07:00
Marc Delagrammatikas ea8e6d15d0 refactor: fixes typo in OnboardInitialUser method
Fixes typo introduced by 7b99c28a99
2020-03-20 10:48:20 -07:00
Johnny Steenbergen e116ecaf5e feat(pkger): add CRUD store implmentation 2020-03-20 10:15:02 -07:00
Johnny Steenbergen 2d1186a696 feat(pkger): add human readable random names to pkg resource metadata.name field one export 2020-03-20 08:18:04 -07:00
Johnny Steenbergen 8d546f4197 feat(pkger): extend tasks with ability to define and rename it
closes: #17233
2020-03-19 10:50:53 -07:00
Johnny Steenbergen 51b0b9f681 feat(pkger): extend notification rules with ability to define and rename it 2020-03-19 08:59:07 -07:00
Johnny Steenbergen c6f4d3992e feat(pkger): extend dashboard to be able to define and rename it 2020-03-18 17:02:35 -07:00
Marc Delagrammatikas b73effebb2
Merge pull request #17344 from influxdata/refactor/onboarding
refactor: rename Generate to OnboardInitialUser
2020-03-18 16:40:25 -07:00
Marc Delagrammatikas 7b99c28a99 refactor: rename Generate to OnboardInitialUser
Renaming Generate in anticipation of a new method that will onboard
users other than the initial user. The intent is to simplify multi-user
setups.

Co-authored-by: Chris Goller <goller@gmail.com>
2020-03-18 15:35:26 -07:00
Johnny Steenbergen c31f321d11 chore(pkger): refactors export mechanics to provide unique metadata.name and spec.name
this is applied to all the resoruces that have had the spec.name field applied.
all resources that have not will work in the same way before this commit.
2020-03-18 15:14:48 -07:00
Johnny Steenbergen b3927f4945 feat(pkger): extend telegraf configs to be able to define a config and rename it 2020-03-18 15:14:48 -07:00
Edd Robinson d96cbd4f74
Merge pull request #17016 from influxdata/er-bulk-import
feat(storage): prototype 1.x–2.x migration tooling
2020-03-18 17:57:26 +00:00
Johnny Steenbergen 5711415b78 feat(pkger): extend variables to be able to define a variable and rename it 2020-03-17 12:32:19 -07:00
Johnny Steenbergen 136822da51 feat(pkger): extend endpoints to be able to define a endpoint and rename it 2020-03-17 11:31:33 -07:00
Johnny Steenbergen 43de2fb4e8 feat(pkger): extend checks to be able to define a check and rename it 2020-03-17 08:16:04 -07:00
Johnny Steenbergen 136ca295d1 fix(influx): update completion cmd with more accurate help message 2020-03-17 08:15:38 -07:00
Johnny Steenbergen de32cf94d0 feat(pkger): extend labels to be able to define a label and rename it 2020-03-16 16:20:42 -07:00
Johnny Steenbergen 952d7d7528 feat(pkger): extend buckets to be able to define a bucket and rename it
this work is the first of making resources ALL unique by metadata.name. The
displayName is a means to rename an existing resource. This is all to support
pkger idempotency. The metadata.name field will be the unique identifier within
a pkg.
2020-03-16 14:18:30 -07:00
Johnny Steenbergen 7b1efe5428 feat(influx): add completion command for users to generate the completions for the influx cli 2020-03-16 09:42:10 -07:00
Johnny Steenbergen 5211e559de chore(influx): add test coverage for root influx cmd
this verifies things like token/host and all the root lvl flags are being
set appropriately.
2020-03-13 15:00:12 -07:00
Edd Robinson d6a22c196a refactor: add some links to current issues 2020-03-13 15:24:51 +00:00
Edd Robinson bbe40aeb82 feat: prototype 1.x - 2.x migration tool 2020-03-13 11:00:28 +00:00
Jacob Marble 26ca766459
refactor(tsdb): move series file to its own package (#17224)
* refactor(storage): move type ByTagKey to the only package that uses it

* refactor(tsdb): use types in tsdb/cursors

* refactor(tsdb): remove unused type SeriesIDElems

* refactor(tsdb): inline only use of tsdb.ReadAllSeriesIDIterator

* refactor(tsdb): move series file to its own package

* refactor(storage): remove platform->influxdb aliases
2020-03-12 11:32:52 -07:00
Kelvin Wang c511f06fa5 feat(cmd/influx): add profile management 2020-03-12 11:09:54 -04:00
Ben Johnson 627b6f86bb feat(storage): Series file compaction 2020-03-11 19:31:58 -06:00
Gavin Cabbage f5e8547482
fix(buckets): prevent returning system buckets to unauthorized users (#17117) 2020-03-11 13:06:08 -04:00
Greg f98874566c
fix: allow authorized label service to be called indirectly (#17111)
* fix: allow authorized label service to be called indirectly

17071 exists because pkger loads all service resources as authorized on
start, resulting in them all being authorized when referenced indirectly
(not hit directly via api by consumer). Rather than restructure pkger to
only authorize direct services, this allows proper indirect auth to
labels (the cause of 17071).

* Add orgService to tests

* Add resource types to find orgID from
2020-03-11 10:58:39 -06:00
Sebastian Borza a50e69451e
feat(storageflux): move flux components out to separate package 2020-03-10 17:54:04 -05:00
Jonathan A. Sternberg 4d683859e9
Merge branch 'master' into feat/use-algo-w 2020-03-09 13:31:46 -05:00
Johnny Steenbergen de24c0e813 feat(influx): extend pkg export all cmd to allow for filtering of output
currently, support by filtering labelName and or by resource kind

closes: #17029
2020-03-09 09:27:01 -07:00
Johnny Steenbergen 1c9fd705a3 feat(pkger): add support for exporting org resources filtered by label 2020-03-06 14:51:01 -08:00
Jonathan A. Sternberg 0d6e4e310b
Merge branch 'master' into feat/use-algo-w 2020-03-06 16:46:49 -06:00
Jacob Marble 39b7c2ab76
refactor(storage): export IndexSeriesCursor (#17134)
* refactor(storage): add readSource field accessors

* refactor(storage): remove unused limitSeriesCursor

* refactor(storage): export IndexSeriesCursor

This allows IDPE to use the same implementation, rather than duplicate
code. Also copied unit tests from IDPE.

* chore: go fmt
2020-03-06 14:05:03 -08:00
Johnny Steenbergen 6818925643 feat(pkger): add support for exporting all and filter by resource types
note: all associations are still included for resources that match the
filte criteria.
2020-03-06 11:51:38 -08:00
Johnny Steenbergen 95c72c1679 chore(influx): update setup cmd to allow for duration for retention option
closes: #17107
2020-03-06 08:13:21 -08:00
Jonathan A. Sternberg bcbb9df72e
refactor(task): tasks will now use the flux language service (#17104)
The tasks subsystem will now use the flux language service to parse and
evaluate flux instead of directly interacting with the parser or
runtime. This helps break the dependency on the libflux parser for the
base influxdb package.

This includes the task notification packages which were changed at the
same time.
2020-03-05 14:36:58 -06:00
Jonathan A. Sternberg a907e05426
refactor(http): modify query handler to use a language service (#17074)
The language service abstracts away the parse source which breaks the
dependency without moving any of the code.
2020-03-05 10:32:17 -06:00
Jade McGough fec0a021fd
fix(cmd): use list instead of find in cli (#16805) 2020-03-04 15:39:04 -08:00
Kelvin Wang 4bd60efae1 fix(cmd/influx): fix auth user name 2020-03-04 09:48:18 -05:00
Jonathan A. Sternberg a84df749cc
feat(stdlib): add influxdb source (#17047)
This updates the repl to support the new influxdb source and use it by
default in the repl. It will automatically set some default variables
for the influxdb source to make it easier to use the cli. In particular,
it will set the default organization, token, and the host. The
organization gets set to the one specified in the repl command and the
token gets filled in with the user installed one. The host defaults to
localhost but will change to whichever one was specified on the cli.

In addition, this will replace the http client with one that sets
insecure skip verify if the `--skip-verify` flag is used.
2020-03-02 20:08:19 -06:00
Johnny Steenbergen fca4e13255 fix(pkger): fix issue with imports causing option task to be injected at wrong point
closes: #17069
2020-03-02 15:19:54 -08:00
Jacob Marble 83818e9592
fix(storage): incremental improvments (#17011)
* fix(storage): simplify storage/seriesCursor

storage/seriesCursor releases series file and TSI references sooner.

Remove unhelpful request object, inherited from 1.x

* chore(storage): replace SeriesCursor interface with sole implementation
2020-02-28 11:12:43 -08:00
Kelvin Wang 0ba38e712f chore(cmd/influx): typo 2020-02-28 10:45:13 -05:00
Johnny Steenbergen 46758e3370 fix(pkger): correct the export of tasks to include system type tasks
wrong assumption in original design. The system tasks are actually
the CRUD tasks. Name is a bit confusing for user generated tasks.

closes: #17038
2020-02-27 17:16:12 -08:00
Kelvin Wang 48490cdc9b fix(cmd/influx): ui change for secret 2020-02-27 16:34:51 -05:00
Jonathan A. Sternberg ff848bcd55
refactor(repl): remove the querier from the repl (#17031)
The repl no longer takes in a querier and it will run everything
locally. The spec interface will now not be used and will be removed
from the http endpoint at some point.
2020-02-27 15:06:38 -06:00
Jonathan A. Sternberg 935180e9bd
refactor: update flux for the runtime package (#17002) 2020-02-27 11:31:45 -06:00
Alirie Gray 3120b4c47e
refactor(tasks): add Client to http TaskService (#16912) 2020-02-24 11:41:21 -08:00
jlapacik 2c184ead7f chore: update flux dependency and unskip notification tests
Fixes https://github.com/influxdata/influxdb/issues/16809.
2020-02-21 14:58:41 -08:00
jlapacik 766aa231b5 chore: update flux dependency
Fixes https://github.com/influxdata/influxdb/issues/16810.
2020-02-21 14:03:02 -08:00
Johnny Steenbergen 80751314bc chore(influx): refactor influx cmd to use builder
refators test to use full call paths where possible
2020-02-20 11:27:44 -08:00
tmgordeeva 890c943643
fix(backup): handle backup with no credentials file (#16877)
* fix(backup): handle backup with no credentials file

Backups and restores should work whether or not the original installation uses
a credentials file and whether or not the backup contains a credentials file.
2020-02-14 09:19:58 -08:00
Johnny Steenbergen a632025eb6 fix(influx): fix token env var and default assignment 2020-02-13 13:25:50 -08:00
Johnny Steenbergen 505ce2372c fix(influx): fix issue with locla state overriding env vars for token
closes: #16874
2020-02-13 11:55:41 -08:00
Nathaniel Cook 03f65cf045
fix(influxql): add explicit routing to influxql service (#16832)
Prior to this change influxql requests were sent to the same back end as Flux queries.
This MAY not always be the case. Now InfluxQL queries are specifically routed to the InfluxQLService.
In the case of this OSS build the FluxService and InfluxQLService are the same.
2020-02-12 10:07:29 -07:00
Christopher M. Wolff d6766962d1
test(query): skip tests that are not passing in feat/use-algo-w (#16813) 2020-02-11 15:02:26 -08:00
Stephanie Engel 1d0afefc4e
refactor: update restore cli flag descriptions (#16799) 2020-02-10 12:07:55 -06:00
Kelvin Wang 670d2b7113 feat(cmd/influx): add secret cli 2020-02-10 11:40:06 -05:00
Johnny Steenbergen af6fac9fdf chore(pkg): remove ambiguity in wrong cmd calls within influx pkg cmd
there was an issue where you could call, `influx pkg summarize`
and the influx cli would actually prescribe that to `influx pkg` cmd
and pass summarize as an arg. This removes that ambiguity
2020-02-06 18:06:17 -08:00
Johnny Steenbergen bf0cc56d7f feat(influx): add ability to provide multiple urls to influx pkg command
also provides an interface to mix and match everything together. you can
now provide `-f` flags for file or directories, `-u` flags for urls, and
use the | to pipe in a pkg. all of which can be done at the same time.
2020-02-06 17:16:47 -08:00
Johnny Steenbergen 2d2fb4056b feat(influx): add support for providing directories of pkgs to pkg command
closes: #16657
2020-02-06 15:57:03 -08:00
Johnny Steenbergen e472b013d9 feat(influx): add support for mulitple pkg files to be submitted together 2020-02-06 13:02:35 -08:00
Johnny Steenbergen 7cf6167356 feat(influx): extend pkg command with providing env ref entries
this also extend dry run to provide env refs to it. the refactoring was
to enable that bit. Having the ability to dry run with the env ref entries
means we can dry run the pkg with the env ref values to see the impact before
the application takes place.
2020-02-06 08:48:05 -08:00
Johnny Steenbergen bbdd6bf7fc feat(pkger): add env refs for associations 2020-02-05 09:48:50 -08:00
Johnny Steenbergen 036ba49e12 feat(pkger): add env ref fields for remaining resources 2020-02-05 07:47:12 -08:00
Johnny Steenbergen 64c8707594 feat(pkger): add support for env references for buckets 2020-02-04 17:00:11 -08:00
Johnny Steenbergen 9ee07b097c chore(pkger): refactor http server to use new http.API type 2020-02-04 10:42:54 -08:00
Johnny Steenbergen 343c9b166b chore(pkger): consolidate pkger http server into pkger
this is the last step for pkger to follow the service definition pattern
that is in the works. Some bits from http were moved into kit/transport/http
for reusability. End result is to hopefully axe http pkg for resuable types in
kit. Long ways off still...
2020-02-03 12:39:47 -08:00
Johnny Steenbergen 2b0b32abe8 chore(http): pull out eror handler into kit pkg for portability 2020-02-03 12:39:47 -08:00
Johnny Steenbergen f9ed0ccb82 feat(pkger): add metrics svc middleware 2020-02-03 11:07:46 -08:00
Johnny Steenbergen 12052a942c chore(influx): fixup flag setting in influx tests to use args
this is inspired by: https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/cmd_test.go#L73
2020-02-01 09:08:09 -08:00
Johnny Steenbergen 592e9369a7 feat(pkger): add support for inspecting url paths to grab extension for pkger decoding 2020-01-23 14:14:28 -08:00
Jacob Marble b836ab9c17
feat(storage): implement backup and restore (#16504)
* feat(backup): `influx backup` creates data backup

* feat(backup): initial restore work

* feat(restore): initial restore impl

Adds a restore tool which does offline restore of data and metadata.

* fix(restore): pr cleanup

* fix(restore): fix data dir creation

* fix(restore): pr cleanup

* chore: amend CHANGELOG

* fix: restore to empty dir fails differently

* feat(backup): backup and restore credentials

Saves the credentials file to backups and restores it from backups.

Additionally adds some logging for errors when fetching backup files.

* fix(restore): add missed commit

* fix(restore): pr cleanup

* fix(restore): fix default credentials restore path

* fix(backup): actually copy the credentials file for the backup

* fix: dirs get 0777, files get 0666

* fix: small review feedback

Co-authored-by: tmgordeeva <tanya@influxdata.com>
2020-01-21 14:22:45 -08:00
Johnny Steenbergen 9eb72d4cf9 chore(influx): use disable- for color/table borders in pkg cmd
closes: #16582
2020-01-17 09:51:20 -08:00
Jade McGough 3f7a32f739
fix(pkg): normalize cli arg format (#16580) 2020-01-17 09:31:07 -08:00
Johnny Steenbergen 22c0f787db fix(influx): fix description for reuable org/ord id type
closes: #16579
2020-01-17 09:15:10 -08:00
Johnny Steenbergen 19d2e5580a feat(influx): trim space on credentials file 2020-01-16 07:22:56 -08:00
Johnny Steenbergen 93c8a2a104 feat(pkger): add service logging and tracing middlewares 2020-01-15 12:00:59 -08:00
Kelvin Wang cf5daee66b chore(cmd/influx): refactor user.go
feat(cmd/influx): add user tests
fix(cmd/influx): make golint happier
2020-01-15 13:45:26 -05:00
Kelvin Wang f62d3a25f1 feat(cmd/influx): update password in cli 2020-01-15 13:30:23 -05:00
Johnny Steenbergen 41beaf0bd5 fix(pkger): fixes issue where pkger can't discern the mime/content type of a package
also makes the yaml decoder the default. To foten we end up in application/octet-stream
which is the default for many different mime types. This provides a mechanism
around that so that when the automagical detection fails it can allow the user
to provide it via the CLI.
2020-01-14 15:44:48 -08:00
Johnny Steenbergen 234c458fa0 fix(pkger): fix missing API version in export of existing resources 2020-01-14 14:36:37 -08:00
Johnny Steenbergen 63fd1e2e9a feat(pkger): make pkger packages CRD compliant 2020-01-14 13:20:00 -08:00
Johnny Steenbergen fe12fd051e feat(pkger): add jsonnet support for package files 2020-01-13 09:55:08 -08:00
Johnny Steenbergen 3b62340b31 chore(influx): refactor org cmd with buidler pattern 2020-01-13 07:49:16 -08:00
Johnny Steenbergen fdc3e7658c feat(pkger): add ability to supply a pkg from a url
the following is now possible from the CLI(same in REST API):
  influx pkg -u 1717709ffa/bucket_pkg_json
2020-01-12 07:53:58 -08:00
Johnny Steenbergen 3f56658418 fix(influx): drop persistent pre run func taht double prints help cmd 2020-01-10 17:22:05 -08:00
Johnny Steenbergen 9338a0be97 chore(influx): refactor bucket cmd into builder pattern 2020-01-10 15:20:15 -08:00
Johnny Steenbergen 89939dea4e fix(influx): add env vars to cli usage and normalize usage and flag/env var priority
also rids us of the cobra tutorial code and encapsulates things into funcs
2020-01-10 15:20:15 -08:00
Michael Desa 26e8ee879c
feat: add tool to migrate 1.x chronograf dashboards and variables
feat(pkger): export dashboard and variable *ToResource methods

fix(pkger): add empty selected _measurement to builder config

feat(chronograf): add note & note visibility to dashboard cell

The 1.x DashboardCell struct had migrated since we brought the code into
the InfluxDB codebase. This allows us to migrate cells that were created
since then.

feat(cmd/chronograf-migrator): add 1.x chronograf migrator tool

feat(chronograf-migrator): add function to transpile queries

fix: update spelling of todo comment pkger/models.go

Co-Authored-By: Deniz Kusefoglu <deniz@influxdata.com>

fix(chronograf): add type to DashboardQuery

The type has evolved since this code was moved over from chronograf.
Previously, we did not have access to flux as a type of query.

feat(chonograf-migrator): transpile influxql query to flux if possible

fix(chronograf): omit fields when empty on old chronograf structs

fix: make linter not mad at me

feat(chronograf-migrator): lowercase variable names

fix(pkger): add empty selected measurement to builder config

chore(chronograf-migrator): add basic readme

chore(pkger): export Variable and Dashboard ToResource methods

fix(chronograf-migrator): move flags out of init call
2020-01-10 09:05:19 -08:00
Johnny Steenbergen ba7502aaf5 fix(influx): update influx pkg cmd flag secrets delimter to match vaults using an `=` 2020-01-09 14:22:38 -08:00
Johnny Steenbergen c8aabaf515 chore(http): fixup middleware stack and normalize metrics into same buckets for id fields 2020-01-08 15:05:34 -08:00
Yiqun Zhang 74ba877cb9
feat: opentracing in query execution runtime 2020-01-08 11:16:13 -05:00
Jade McGough 79ab5e5e59
fix(pkger): don't swallow errors when failing to get organization (#16397) 2020-01-03 01:22:54 -08:00
Alirie Gray 6c6bd39ffc
refactor(tasks): remove dead scheduler code (#16252) 2020-01-02 11:41:21 -08:00
Jacob Marble 047afcfc10
fix(tests): make sure NATS port is open for unit tests (#16310)
* fix(tests): make sure NATS port is open for unit tests

Fixes #10628 again

* chore: add comment re possible race
2020-01-02 11:05:56 -08:00
Kelvin Wang f8c0ea032c fix(cmd/influx): show see help, instead of usage 2019-12-31 14:52:55 -05:00
Greg b2531c1f97
fix: improve date in `version` command (#16365)
set date in go like a sane person
2019-12-30 17:56:58 -07:00
Greg 56973b8dc5
fix: add 'version' command to match github bug report template (#15629) 2019-12-30 12:53:52 -07:00
Johnny Steenbergen f1b5e19776 feat(influx): add hide headers flag to influx cli task cmd 2019-12-27 14:41:55 -08:00
Johnny Steenbergen cce279a80e feat(pkger): add ability to provide secrets alongside package when applying
this provides the ability to add secret refs at runtime instead of adding
them to the pkg.
2019-12-27 12:41:42 -08:00
Johnny Steenbergen 935389912a chore(pkger): reorder print statements to be alphabetical 2019-12-26 11:34:48 -08:00
Johnny Steenbergen 1c2421cb9c feat(pkger): add export support for tasks 2019-12-23 15:41:14 -08:00
Johnny Steenbergen c9431bceb8 feat(pkger): add apply functionality for task resource 2019-12-23 13:56:42 -08:00
Johnny Steenbergen 8e87498317 feat(pkger): add dry run functionality for task resource 2019-12-23 11:40:28 -08:00
Johnny Steenbergen af5b7fd7d3 feat(pkger): add export support for notification rules 2019-12-21 14:58:02 -08:00
Greg abd8ce0089
feat(http): add functionality to retrieve/store telegraf config as toml (#16132) 2019-12-20 14:20:13 -07:00
Johnny Steenbergen 61dceaa727 feat(pkger): add application functionality for the notification rules resource 2019-12-20 12:48:46 -08:00
Johnny Steenbergen 02aec6ed29 feat(pkger): add dry run functionality for notification rules 2019-12-19 16:31:22 -08:00
Jade McGough cc0943ceeb
chore(cli): improve walk function documentation (#16176) 2019-12-19 03:22:56 -08:00
Johnny Steenbergen a8a4d3d0b2 feat(pkger): add export functionality to checks resource 2019-12-18 17:52:28 -08:00
Johnny Steenbergen 677e836bf4 feat(pkger): add apply functionality for checks
this work is to support pkger, but was able to add back in the
skipped tests. seeing failures upstream, and didn't catch it in
influxdb b/c the tests were being skipped.

closes: #14799
2019-12-18 15:02:03 -08:00
Johnny Steenbergen 1db3256980 feat(pkger): add check dry run functionality 2019-12-18 12:15:08 -08:00
Johnny Steenbergen f527636fe0 chore(http): refactor user http service to use the httpc.Client 2019-12-17 12:49:14 -08:00
Johnny Steenbergen 1c2b900687 chore(http): refactor auth service http client to use httpc.Client
normalizing the auth service http client to follow suit with other services.
2019-12-17 12:18:16 -08:00
Deary Hudson III d5f8a5fc9f
feat(cmd): apply env vars consistently across cmd (#16225) 2019-12-17 13:55:35 -06:00
Johnny Steenbergen d42bbb3c64 feat(pkger): add support for exporting notification endpoints 2019-12-17 11:33:34 -08:00
Johnny Steenbergen b8652ee178 feat(pkger): add support for secret references to notification endpoints parsing 2019-12-17 11:33:34 -08:00
Johnny Steenbergen a6e768dc7c chore: refactor notication endpoints to make a service out of notification endpoints
this is a blocker for anyone who hits the endpoint services internally. They
had to know that they need to also know of hte secret service then do all that
put/delete alongside the operation. This makes that unified inside the store tx.

one other thing this does is make obvious the dependencies that
notification services has. In this case it is the secrets service it
depends on.
2019-12-17 10:49:06 -08:00
Johnny Steenbergen 39e89eafdf chore(pkger): utilize http client for integration tests for pkger 2019-12-13 09:46:01 -08:00
Deary Hudson III 48e854776e
fix(cmd): adds org svc dep to pkg (#16206) 2019-12-12 11:33:15 -06:00
Johnny Steenbergen 3daaa4d307 feat(pkger): add apply functionality for notification endpoints kind 2019-12-11 15:13:42 -08:00
Johnny Steenbergen 69d7eb4455 feat(pkger): add notification endpoint dry run functionality 2019-12-11 15:13:42 -08:00
Alirie Gray b5ccad3c07
feat(metrics): add run latency to executor metrics (#16190) 2019-12-11 14:50:32 -08:00
Deary Hudson III 336961c757
feat(cmd): bucket create to accept org name as flag (#16187)
* enables the user to specify an organization name when creating a bucket.
2019-12-10 17:46:36 -06:00
Johnny Steenbergen 417d25537f chore(http): refactor org service to use httpc client 2019-12-10 10:49:22 -08:00
Johnny Steenbergen 5cc02de988 feat(httpc): add httpc pkg to resuse code for http client type 2019-12-09 12:17:22 -08:00
Johnny Steenbergen 648a14d148 chore(influx): refactor orgnization cmd
death to unneccessary inits
2019-12-09 11:39:28 -08:00
Johnny Steenbergen ad841608ca chore(http): refactor bucket|dashboard|label|umr|var http clients to use reusable HTTP client
this is a step towards providing a shared http client that manages  pooling connections,
timeouts, and reducing GC for by not creating/GCing a client each req. Bring on the red!
2019-12-09 09:44:41 -08:00
Johnny Steenbergen 521ce543eb fix(pkger): fix flaky test in pkger service tests
tests failign from a data race caused in the tests setup. an incrementing
const needs something to serialzie it (atmoic in this case) to remove that
data race. This touches that up.
2019-12-09 08:59:44 -08:00
Johnny Steenbergen 0225160814 fix(http): provides a reusable http client instead of creating/GCing one each time 2019-12-06 18:15:35 -08:00
Johnny Steenbergen 51f1b73738 feat(pkger): speed up application of pkg with a touch of concurrency
governs the concurrency with a simple semaphore. Defaults to 5
concurrent reqs, anything greater, could put a lot of pressure
on the system as a whole (especially OSS/bolt store).
2019-12-06 18:15:35 -08:00
Johnny Steenbergen ed974ba50a fix(pkger): add telegraf to launcher for public api support 2019-12-06 09:05:51 -08:00
Johnny Steenbergen ea67663ab7 fix(pkger): cleanup leftover bits from telegraf and label mapping misses
telegraf was not being mapped correctly for applying the label mapppings
and touched up a bunch of other issues that came up along the way.
2019-12-06 08:51:32 -08:00
Johnny Steenbergen c76babdce6 feat(pkger): add support for exporting telegraf 2019-12-05 09:58:44 -08:00
Jacob Marble 5f19c6cace
chore: Remove several instances of WithLogger (#15996)
* chore: Remove several instances of WithLogger

* chore: unexport Logger fields

* chore: unexport some more Logger fields

* chore: go fmt

chore: fix test

chore: s/logger/log

chore: fix test

chore: revert http.Handler.Handler constructor initialization

* refactor: integrate review feedback, fix all test nop loggers

* refactor: capitalize all log messages

* refactor: rename two logger to log
2019-12-04 15:10:23 -08:00
Johnny Steenbergen 695211aeda feat(pkger): add dry run and apply functionality for telegraf resources 2019-12-04 13:50:42 -08:00
Nathaniel Cook fd63ff17f3
feat(cmd/influx): add command to manually transpile InfluxQL to Flux (#16119) 2019-12-04 13:31:20 -07:00
Johnny Steenbergen 988fd0ae80 chore(pkger): refactor diff into common types for easier access 2019-11-22 16:09:23 -08:00
Johnny Steenbergen 251651cc97 feat(influx): add pkg summary cmd to influx cli 2019-11-21 16:26:24 -08:00
Johnny Steenbergen c533f8495d chore(influx): add tests for pkg validate cmd 2019-11-21 16:26:24 -08:00
Johnny Steenbergen d98ce676fb chore(pkger): refactor pkger cli into a builder for better reuability and testability 2019-11-21 16:26:24 -08:00
Johnny Steenbergen 9149b6af6f feat(influx): add pkg validate command to validate existing packages
also renames a the commands to start with cmd followed by the args. this
is an attempt to order the commands in a slightly more autocomplete friendly
way.
2019-11-21 16:26:24 -08:00
pierwill 9fd97d1b28
Merge pull request #15976 from pierwill/repl-cmd-description
Edit `influx repl` command description
2019-11-21 11:31:13 -08:00
Johnny Steenbergen 77ddcab2b5 feat(influx): add nix pipe support to influx pkg cmd 2019-11-21 10:55:12 -08:00
Johnny Steenbergen 9c525ad413 feat(pkger): add ability to export all and defined list of resources via influx cli to a package
refers: #15921
2019-11-21 10:55:12 -08:00
Johnny Steenbergen a92b632e05 feat(influx): add ability to drop headers from bucket find cli cmd 2019-11-21 10:55:12 -08:00
Chris Goller da2edb88bb fix(cmd/influxd): add mutex for open/close of temp engine 2019-11-20 16:39:47 -06:00
Chris Goller 0f5df301ca refactor(storage/readservice): rename View interface to Viewer 2019-11-20 16:10:37 -06:00
Chris Goller 354b58005f fix(cmd/influxd): prefix temporary engine dir with e2e 2019-11-20 16:04:27 -06:00
Chris Goller f9c5021782 feat(influxd/launcher): add tmp filesystem backed engine for e2e 2019-11-20 15:54:32 -06:00
Johnny Steenbergen 4036e6c426 feat(pkger): add authentication to service dependencies for pkger
closes: #15897
2019-11-20 11:12:14 -08:00
Johnny Steenbergen dc2d931f00 feat: add support for setting password and org for a new user in the cli
one thing to note here is that new endpoint was created. there was no
endpoint for setting an initial password that worked. The existin endpoint
was a bit messy and coupled across multiple routes. Having multiple auth
schemes proved incredibly taxing to write against.
2019-11-20 09:16:31 -08:00
Johnny Steenbergen 4d5ac08fff chore(influx): refactor auth cli cmd 2019-11-19 12:36:52 -08:00
pierwill 8196d280cd Edit `influx repl` command description 2019-11-19 11:27:26 -08:00
Johnny Steenbergen a875a6a7ea chore(pkger): add tests to pkg new cli command 2019-11-18 12:19:15 -08:00
Jade McGough 1606b089b4
fix(cli): add organization back to bucket response (#15947) 2019-11-18 09:45:03 -08:00