Commit Graph

1185 Commits (a321e72d1590464138532614b87bc3a06abea873)

Author SHA1 Message Date
Stuart Carnie 06fac044e5
fix(storage): Implement SeriesCardinality, which is per-bucket
Fixed unit tests
2020-08-25 14:52:00 -07:00
Stuart Carnie 7ec178f54c
feat(influxd): Perform checks to determine if prior version exists
Closes #19408
2020-08-24 15:40:25 -07:00
Stuart Carnie cfd089b77a
revert(storage): Revert changes from 1501351
Reverted 1501351623
2020-08-24 10:08:46 -07:00
Stuart Carnie 6474c8c9fa
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	storage/engine.go
#	storage/engine_test.go
#	storage/wal/wal_test.go
#	tsdb/tsm1/engine_delete_prefix.go
#	tsdb/tsm1/engine_delete_prefix_test.go
#	tsdb/tsm1/engine_test.go
#	v1/tsdb/engine/tsm1/wal.go
2020-08-24 09:56:18 -07:00
Ben Johnson 1501351623 feat(influxql): Implement DELETE & DROP MEASUREMENT 2020-08-21 13:32:47 -06:00
Stuart Carnie c01a62d5d4
chore(task): Remove unused code 2020-08-20 16:59:26 -07:00
Stuart Carnie f46e36b6ac
Merge remote-tracking branch 'origin/master' into sgc/tsm1 2020-08-17 09:27:00 -07:00
Stuart Carnie 80428fe2a9
fix(influx): httpClient global is cached, resulting in flaky tests 2020-08-14 15:10:24 -07:00
Johnny Steenbergen c0b593ec7d feat(influx): add active-config flag to override config on single command call
closes: #19318
2020-08-14 13:33:14 -07:00
Stuart Carnie b3734695c5
Merge remote-tracking branch 'origin/master' into sgc/tsm1 2020-08-14 12:37:41 -07:00
Stuart Carnie 8a7dcc21fb
feat(influxql): Initial implementation of InfluxQL query engine
* Some tests are broken or do not pass; follow up PRs will resolve that
2020-08-14 12:37:30 -07:00
Johnny Steenbergen 99ab43fb91 fix(influx): add missing description field to auth output
this PR also extends the create auth to include ability to
set the auth description

closes: #19156
2020-08-14 12:05:55 -07:00
Stuart Carnie 56e27b8893
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	go.mod
#	go.sum
#	query/promql/internal/promqltests/go.mod
2020-08-12 09:07:30 -07:00
George 2636e976b9
chore(query): use dbrp v2 service in flux influx.v1 dependencies (#19108)
* chore(query): use dbrp v2 service in flux influx.v1 dependencies

* chore: update transpiler to use dbrp mapping service v2
2020-08-12 11:08:25 +01:00
Stuart Carnie 057285e23a
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	query/logging.go
#	query/logging_test.go
#	query/stdlib/influxdata/influxdb/rules.go
#	query/stdlib/influxdata/influxdb/rules_test.go
#	query/stdlib/testing/testing.go
#	storage/flux/reader.go
#	storage/flux/table.gen.go
#	storage/flux/table.gen.go.tmpl
#	storage/flux/table.go
#	storage/flux/table_test.go
2020-08-11 10:25:01 -07:00
Jonathan A. Sternberg d83fae37f6
fix(cmd/influx): query cli should not explicitly request gzipped content (#19250)
The `net/http` package default transport will request content gzipped
automatically if `DisableCompression` is set to false (which is the
default). If the transport does it automatically, it will decompress it
automatically which is what was the original intention of the code. But,
if it is requested explicitly, then go will not decompress the data
automatically.
2020-08-07 11:30:03 -07:00
Johnny Steenbergen 536e2c9811 feat(pkger): parameterize task queries
references: #18237
2020-08-05 16:14:06 -07:00
jlapacik 46c7345dae
feat: enable pushdowns for sum, count, min, and max by default (#19227) 2020-08-05 12:06:35 -07:00
Johnny Steenbergen efd82a2483 feat(influx): add support for dashboards 2020-08-05 09:14:01 -07:00
Faith Chikwekwe d48dc690a6
feat(query/stdlib): add min and max to ReadGroup (#19158)
Enables the mix and max aggregates for the ReadGroupAggregte pushdown behind a feature flag.

Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
2020-08-05 09:40:26 -05:00
Johnny Steenbergen 41cb12aeec feat(pkger): add parameterization to dashboard queries
references: #18237
2020-08-04 17:02:34 -07:00
George 5e22e0101d
chore(auth): remove unnecessary URM service from Bucket authorizer (#19060) 2020-08-04 14:37:14 +01:00
Stuart Carnie 49067de49f
fix(launcher): Fix launcher tests 2020-08-03 15:17:37 -07:00
Stuart Carnie 840d0a994f
fix(inspect): Add export-index command for tsdb 1.x 2020-08-03 15:17:17 -07:00
Stuart Carnie 262023ae4a
fix(launcher): influxd inspect commands now start instantly
Lazily initialize flux, which increases startup time considerably
2020-08-03 15:16:36 -07:00
Stuart Carnie d7434216e2
fix(storage): Use correct engine paths
Remove redundant repl.go after rebasing on 8dd8d1f79e
2020-08-03 09:21:04 -07:00
Stuart Carnie 8cfcfb0300
fix(cmd): Resolve build issues with influx command and tests 2020-08-03 09:21:04 -07:00
Stuart Carnie 21c3733464
fix(storage): meta.Client persists to kv and updates via BucketService
Includes initial migration to add metadata bucket
2020-08-03 09:21:02 -07:00
Stuart Carnie f86fcd24d5
fix(launcher): Fix unit tests after rebase 2020-08-03 09:20:51 -07:00
Stuart Carnie 89532f0c29
refactor: move v2/v1/models to v2/models 2020-08-03 09:20:51 -07:00
Stuart Carnie 7c225cb3ac
chore: More cleanup 2020-08-03 09:20:50 -07:00
Stuart Carnie 26c18ac0a5
chore: Converging on 1.x tsdb 2020-08-03 09:20:48 -07:00
Edd Robinson 2b175291be
refactor: WIP removing tsbd 2020-08-03 09:18:34 -07:00
Stuart Carnie a97ec1f34e
feat: Initial commit with working reads 2020-08-03 09:18:34 -07:00
Stuart Carnie e3060c291c
refactor: tsdb store builds an runs 2020-08-03 09:18:32 -07:00
Lyon Hill 0a9e8fdb4a
chore: update task tests to use the tenant service (#19169)
* chore: update task tests to use the tenant service

After the introduction of the tenant system we need to switch the testing frameworks
to use it instead of the old kv system

* chore: update onboarding to allow injected middleware
2020-08-03 09:33:46 -06:00
Alirie Gray d1b8e98798
refactor: remove nested orgs labels route (#19104) 2020-07-30 10:53:14 -07:00
Jonathan A. Sternberg 8dd8d1f79e
feat(cmd/influx): modify the query cli to use the http api (#19076)
This modifies the query cli to remove the flux runtime dependency and
uses the public http api to execute the query. It then uses flux's csv
decoder to read the raw response.

This removes any dependency on the flux runtime and substantially
reduces the binary size and the startup execution time.
2020-07-30 12:44:48 -05:00
Deniz Kusefoglu f490dd9693
feat(autoAggregate): BE work for autoAggregate (#19129)
* feat(autoAgg): fix pkger test

* feat(autoAgg): refrain from adding createEmpty to check query if exists

* feat(autoAgg): Fix check tests

* feat(autoAgg): Add fillValues to backend

* feat(autoAggregate): Add fillValues to swagger

* feat(autoAgg): indentation
2020-07-29 09:32:36 -07:00
Jonathan A. Sternberg 0cdbd496f4
fix(query): paginate bucket results in the bucket lookup (#19111)
The `buckets()` command would use a bucket lookup that wrapped the
`FindBuckets` API. It did not use the pagination aspect of this API
correctly. When the underlying implementation was changed to a version
that correctly implemented pagination, this broke the query `buckets()`
command. Since it was query that used the API incorrectly rather than a
regression in the `FindBuckets` implementation, this fixes the usage to
correctly use pagination.
2020-07-29 11:23:13 -05:00
Johnny Steenbergen e7310b414c fix(pkger): update stacks with snapshot of all prevoius event resources 2020-07-28 15:58:59 -07:00
Johnny Steenbergen d768132aaa feat(pkger): make envRef default values support more types
references: #18237
2020-07-28 12:22:46 -07:00
Johnny Steenbergen a652cdf552 chore(pkger): axe deprecated /packges route tree 2020-07-24 09:33:30 -07:00
Johnny Steenbergen d1791d390f fix(influx): register global flags on telegraf cmds 2020-07-23 14:36:00 -07:00
Johnny Steenbergen fd42c092d0 fix(influx): enforce flag validation
closes: #18629
2020-07-23 14:36:00 -07:00
Jonathan A. Sternberg 8678a22ee3
feat(storage/flux): add tests for min/max pushdowns (#19028) 2020-07-23 16:07:30 -05:00
Johnny Steenbergen aee64f1901 chore(influx): drop REPL command
closes: #18676
2020-07-23 11:17:46 -07:00
Christopher M. Wolff 8b106bcee1
feat(storage): add mean aggregate array cursor and tests (#19019) 2020-07-23 09:49:53 -07:00
Johnny Steenbergen 76c2134767 feat(influx): enable dynamic configs destination
introduces the new flag --configs-path to the influx CLI. This new
flag has a corresponding env var INFLUX_CONFIGS_PATH. It is useful
to export this env var in a shell dotfile for consumption throughout the
box.

closes: #17979
2020-07-23 08:36:49 -07:00
Russ Savage 3009579b85
fix(migrate): remove cli migrate command (#19004) 2020-07-22 08:35:57 -07:00
Johnny Steenbergen 8b058597d6 chore(fs): refactor global file consts into internal/fs 2020-07-21 14:27:52 -07:00
Johnny Steenbergen 86894d4337 feat(influx): add telegraf resource support to influx CLI
closes: #17654
2020-07-20 15:37:43 -07:00
jlapacik 4d8547f0fe test: launcher tests for window offset 2020-07-20 12:23:37 -07:00
Ben Johnson c28eb70856 feat(mincore): Add page fault limiter
This commit adds `mincore.Limiter` which throttles page faults caused
by mmap() data. It works by periodically calling `mincore()` to determine
which pages are not resident in memory and using `rate.Limiter` to
throttle accessing using a token bucket algorithm.
2020-07-17 09:37:31 -06:00
Lyon Hill a31b651057
feat(task): Add new permission lookup pattern for executor (#18920)
* feat(task): Add new permission lookup pattern for executor

We can now use the user service to populate task owners permissions.
This should improve the task lookup time and decouple the task system
from the URM system. In the future we will have the ability to better isolate
tenant pieces from the rest of the service.

* feat: add feature flagging
2020-07-13 14:47:58 -06:00
Johnny Steenbergen 16500ee35f chore(pkger): drop deprecated influx pkg command tree 2020-07-10 09:05:13 -07:00
George b8f5604613
revert(tasks): Add new permission lookup pattern for executor (#18869) (#18915)
This reverts commit e9e4d794cf.
2020-07-10 11:05:07 +01:00
Johnny Steenbergen 944b097628 feat(pkger): extend stacks API with uninstall ability
this new ability removes the resources associated with the stack
and adds the uninstall event.
2020-07-09 17:05:53 -07:00
Lyon Hill e9e4d794cf
feat(task): Add new permission lookup pattern for executor (#18869)
We can now use the user service to populate task owners permissions.
This should improve the task lookup time and decouple the task system
from the URM system. In the future we will have the ability to better isolate
tenant pieces from the rest of the service.
2020-07-09 14:06:46 -06:00
jlapacik e6e55038e8 test: descending array cursor should include end time 2020-07-09 12:22:25 -07:00
Johnny Steenbergen 8b6788fdd2 feat(pkger): make stacks event sourced
closes: #18874
2020-07-08 13:40:48 -07:00
greg linton e4d33f1066 fix: don't overwrite build date set via ldflags 2020-07-07 16:15:00 -06:00
jlapacik 9f9be91828 feat: remove feature flags for first and last pushdowns 2020-07-07 14:15:48 -07:00
Johnny Steenbergen f804afc6ac fix(pkger): enforce flag parsing on export all and apply CLI commands
closes: #18850
2020-07-06 13:11:59 -07:00
Alirie Gray e02e950ed0
refactor: add new tenant system struct to consolidate services (#18833) 2020-07-06 10:49:51 -07:00
Ben Johnson 6b0b4d7c4e fix(storage): Refactor LoggingPointsWriter to use BucketFinder
This commit changes the writer to use `storage.BucketFinder` which
is a subset of the `influxdb.BucketService` interface.
2020-07-02 12:46:43 -06:00
George 4a6bc1d74f
chore: remove kv Session service and sessionsv1 bucket (#18823)
* chore: remove sessionsv1 bucket

* chore: add extra configuration to sessions.Service
2020-07-02 15:15:08 +01:00
jlapacik 25309c398d test: windowed aggregates should filter empty series 2020-07-01 16:58:50 -07:00
jlapacik 3246b3c7ad refactor: remove feature flag for certain pushdowns 2020-07-01 12:59:39 -07:00
Ben Johnson 482442ecc1 feat(storage): Add logging points writer
This commit adds a LoggingPointsWriter which wraps a PointsWriter
and provides logging when a write fails.
2020-07-01 11:41:29 -06:00
George 96d84b9126
refactor: migrator and introduce Store.(Create|Delete)Bucket (#18570)
* refactor: migrator and introduce Store.(Create|Delete)Bucket

feat: kvmigration internal utility to create / managing kv store migrations

fix: ensure migrations applied in all test cases

* chore: update kv and migration documentation
2020-07-01 12:08:20 +01:00
Johnny Steenbergen e851228102 feat(pkger): extend template diff types with kind
closes: #18804
2020-06-30 17:22:34 -07:00
Johnny Steenbergen ffe5d941d3 feat(pkger): extend template Summary with discrete kinds for each summary type
references: #18804
2020-06-30 16:47:15 -07:00
Johnny Steenbergen b9e6744807 chore(pkger): finalize adoption of templates naming convention
closes: #18580
2020-06-30 16:33:45 -07:00
Lyon Hill 5776350a53
feat: switch to use the new tenant bucket service (#18738) 2020-06-30 14:48:42 -06:00
Johnny Steenbergen b5fcb06883 fix(pkger): stop swallowing parser errors from pkger parser in http remote service 2020-06-29 17:31:59 -07:00
Johnny Steenbergen 952007001b chore(pkger): drop mentions of pkgs from within service models
references: #18580
2020-06-29 16:43:40 -07:00
Johnny Steenbergen 2927f0e718 feat(pkger): add stable HTTP APIs for stacks and templates
references: #18580
2020-06-29 13:45:32 -07:00
jlapacik fef23ee4d1 test: launcher tests for window last and bare last pushdowns 2020-06-29 13:12:47 -07:00
Johnny Steenbergen 2825427cf5 chore(pkger): convert packages endpoints into new naming convention
note: going to make this evolution in two steps so that we have a simple
rollback to get back to a working state. We'll be maintaining both packages
and the new templates and stacks endpoints for a while as users start to
move onto a newer CLI version. Sunsetting by end of July.

references: #18580
2020-06-29 09:45:58 -07:00
Johnny Steenbergen 2f2140e7a7 feat(influx): extend stacks update cmd with ability to add resources
closes: #18646
2020-06-29 07:03:52 -07:00
Jonathan A. Sternberg 5aeca082c8
chore: update staticcheck and fix newly identified lint checks (#18737) 2020-06-26 18:54:09 -05:00
Johnny Steenbergen fdcf8000f6 feat(pkger): extend stacks with ability to add resources without applying
references: #18646
2020-06-26 14:47:52 -07:00
Johnny Steenbergen 0f7ab73199 chore(pkger): drop behavior to update stack when exporting 2020-06-26 14:47:52 -07:00
Jonathan A. Sternberg 58bd5b9854
fix(storage/flux): the count aggregate will fill in zero values instead of null (#18735) 2020-06-26 15:43:03 -05:00
Alirie Gray b35479640a
refactor: move checks service to new package (#18671) 2020-06-26 12:52:15 -07:00
Johnny Steenbergen a6a5d0d43f fix(pkger): update handling of diff dashboard charts 2020-06-26 11:55:19 -07:00
Johnny Steenbergen fdc1da6bc5 chore(pkger): drop field no longer in use
this was missed in a previous PR wehre we added the status in place of the
remove boolean flag
2020-06-26 10:21:12 -07:00
Johnny Steenbergen 846b7d0207 feat(pkger): add ability to export stack with additional resources and update stack with associated exports
references: #18646
2020-06-25 21:25:30 -07:00
Johnny Steenbergen 29d4091e0a feat(influx): extend influx export command with ability to export stack
closes: #18646
2020-06-25 21:25:30 -07:00
Lyon Hill 8522e19b6e
feat: add a embedded handler for label service api (#18745)
We will now be able to embed the label mappings apis into other services
2020-06-25 17:10:06 -06:00
jlapacik 7039d87a4f test: launcher tests for window first 2020-06-25 14:37:07 -07:00
David McKay 67fad644f2 fix: remove redundant break statements 2020-06-25 18:17:24 +01:00
David McKay 79431d1c46 feat: allow restricting TLS version and ciphers 2020-06-25 18:17:24 +01:00
David McKay e97a0eb027 chore: fix tests 2020-06-25 18:16:57 +01:00
David McKay b3c738fc53 fix: have tests use non-default value and support pkger 2020-06-25 18:16:57 +01:00
Johnny Steenbergen cb8fe33da8 chore(pkger): drop reference to pkg in PkgImpactSummary type 2020-06-25 09:47:33 -07:00
Johnny Steenbergen f554563cea chore(pkger): refactor independent stack export functionality out of existence
the Export behavior (renamed from CreatePkg) now provides for stackID as
another input. With this we are able to remove the additional endpoint
/api/v2/packages/stacks/:stack_id/export. It now fits into the
/api/v2/packages/export endpoint as another req body parameter. This also
makes all export functionality in teh same space, encapsulated both in the
endpoint and within the service layer :-).

references: #18646
2020-06-25 09:47:33 -07:00
Johnny Steenbergen 52cd625687 fix(influx): drop global flags and replace with locals
many spots in the CLI that global flags show up cause confusion or just
add overhead with no value. This cleans that up. Other commands may
have token removed if it does not pertain.

commands that do not have global flags:
  * influx
  * influx completion
  * influx config (all sub commands as well)
  * influx template
  * influx template validate
  * influx transpile
  * influx version
  * all root commands that have no actions, aka influx organization
2020-06-24 15:33:06 -07:00
Johnny Steenbergen 5612930a83 fix(influx): select an active config when deleting the active config 2020-06-24 15:18:08 -07:00
Johnny Steenbergen 74722d5191 fix(influx): stop influx set command forcing url 2020-06-24 15:18:08 -07:00
Johnny Steenbergen a7d29b1446 fix(influx): provide validation for config host urls
closes: #18706
2020-06-24 13:11:06 -07:00
Johnny Steenbergen 6bac4373ca feat(influx): improve long flags for config commands
this deprecates the old flags, but they are still accessible if using them
explictly. They are hidden from the -h message. When used the CLI prints out
a message indicating the flag is deprecated and to use the new flag instead.
2020-06-24 13:11:06 -07:00
Johnny Steenbergen 6694c7e393 chore(pkger): refactor export by stack to reuse CreatePkg functionality
this also makes it so that an association (label) that is added to a
resource is also included in the returned output. There is 1 test that
was changed as part of this work. It is to test for this specific change
in behavior

references: #18646
2020-06-24 12:03:20 -07:00
Brett Buddin 1f422b9b94
fix(dbrp): Delete DBRP mappings when their target Bucket is deleted. (#18699) 2020-06-24 13:40:54 -04:00
Johnny Steenbergen dcc6bd197a chore(influx): update influx stacks rm cmd printout 2020-06-23 18:55:38 -07:00
Johnny Steenbergen d671185bdc fix(pkger): fixup updates for variables where updates from selected were skipped 2020-06-23 08:05:27 -07:00
Johnny Steenbergen 38d44c7980 chore(influx): add support for week duration 2020-06-22 21:02:51 -07:00
Johnny Steenbergen 3c14db1c77 fix(influx): support days as duration type
closes: #18639
2020-06-22 20:07:53 -07:00
Johnny Steenbergen 5db8e2fd5e chore(influx): mark hidden flags that are deprecated as deprecated with help msg 2020-06-22 20:07:53 -07:00
Johnny Steenbergen 4827398fba fix(influx): normalize output of template task diff 2020-06-22 17:30:28 -07:00
Johnny Steenbergen 802afebf8c feat(pkger): add support for selected fields to variable
references: #18240
2020-06-22 17:05:18 -07:00
Alirie Gray 5d3b9e2001
refactor: move name lookup to auth http (#18643) 2020-06-22 16:14:48 -07:00
Johnny Steenbergen 2d4a12fdf6 chore(pkger): accomodate skipping resources that are part of an association 2020-06-22 14:24:33 -07:00
Johnny Steenbergen 5bef654062 fix(influx): remove references to local
all CLI interactions are now to go through the front door (API).

closes: #18616
2020-06-18 17:29:16 -07:00
Johnny Steenbergen 81490d6604 feat(influx): fixup config file env var naming and add support for config directory 2020-06-18 17:09:46 -07:00
Johnny Steenbergen 0f222de331 chore(influx): refactor influx config delete cmd to for consistency and update usage
closes: #18603
2020-06-18 16:55:33 -07:00
Johnny Steenbergen 84723e15d2 feat(influxd): refactor run command to use cli.Program to respect config file 2020-06-18 15:59:53 -07:00
Johnny Steenbergen 59239a1d93 chore(influx): replace all mentions of packages with templates in the CLI 2020-06-18 15:33:52 -07:00
Michael Hall 831be6c356 fix: Convert onboardingRequest RetentionPeriod to a Duration, rather than time.Hour to a uint. Fixes #18547 2020-06-18 14:36:22 -04:00
Lyon Hill 3987d3692b
chore: Clean out old session store feature flag (#18596) 2020-06-18 12:18:34 -06:00
Johnny Steenbergen 8d9e3bb81f feat(influx): provide active config when running bare influx config cmd 2020-06-18 09:29:12 -07:00
Johnny Steenbergen e3e1760b38 feat(influx): extend apply command with actions to skip kind and/or resource
also consolidates the export filters on `kind` in place of `resourceKind`
2020-06-18 09:01:09 -07:00
Johnny Steenbergen ec8c252dbb feat(pkger): extend public apply API with new action to skip resources by kind
closes: #18490
2020-06-18 08:03:34 -07:00
Johnny Steenbergen d1f9807624
fix(pkger): fix flaky test caused by merge race condition (#18594)
one PR got merged, then the other without rebase/rerunning tests. That
is what resulted in this broken test.
2020-06-18 16:10:27 +03:00
Johnny Steenbergen a179d6d473 fix(pkger): delete newly created stack when applying a template that encounters err 2020-06-17 17:57:23 -07:00
Johnny Steenbergen a4e4be7787 feat(pkger): add ability to skip a resource within a template
references: #18490
2020-06-17 17:22:56 -07:00
Johnny Steenbergen aa1e29fb84 feat(influx): extend stacks cmd with update
closes: #18548
2020-06-17 14:46:09 -07:00
Johnny Steenbergen a6df6c95ec chore(influx): update influx stacks usage 2020-06-17 14:46:09 -07:00
Johnny Steenbergen 7e8ab162e7 feat(pkger): extend stacks with update functionality
references: #18548
2020-06-17 09:47:33 -07:00
Adrian Thurston 5d1a759170
feat: annotate context with feature flags when handling flux queries (#18506)
Annotate the context with feature flags when handling flux queries in influxdb.
Taking advantage of this in flux end-to-end tests. Using a custom flagger that
can set overrides based on the test case that is about to be run, allowing us
to enable features in the end-to-end tests.
2020-06-17 16:55:29 +03:00
jlapacik a19604c0ea refactor: windowed read operation should include aggregate name 2020-06-16 18:05:21 -07:00
Johnny Steenbergen 61cd72b0cd chore(influx): update usage and soften comparisons for kind matching on export
closes: #18550
2020-06-16 15:31:39 -07:00
Johnny Steenbergen 18eff154a6 feat(influx): provide for remote files in the template commands 2020-06-16 14:44:51 -07:00
Johnny Steenbergen 870a3bb48c chore(influx): extend stacks output with sources 2020-06-16 14:00:56 -07:00
Lyon Hill 009b8ec98f
feat: start using the new org handler from the tenant service. (#18371)
* feat: start using the new org handler from the tenant service.

The rest of the tenant system is in place except the org http api handler and the
user api handler.

* fix: update the label service in org handler and add links
2020-06-16 12:56:31 -06:00
Johnny Steenbergen b977568390 feat(pkger): extend pkger to provide sources of templates to each template 2020-06-16 08:04:37 -07:00
jlapacik 7f1caec697
feat: limit cursors (#18467)
* feat(storage): first array cursor

* feat: add first and last to rpc messages

* test(launcher): push down group first and group last

* feat(storage): window first array cursor

* test(launcher): push down bare first and bare last

* feat(storage): add capabilities for group first and group last

* refactor: rename first to limit

* refactor: make zero value for every period meaningful

* refactor: standardize launcher pushdown tests
2020-06-15 12:21:35 -07:00
Christopher M. Wolff 8fa5d3f591
feat(query): add test and feature flag for pushing down sum (#18484) 2020-06-12 13:28:03 -07:00
Pavel Zavora a719bcd1e9 chore(influx): use and pass a single context in write cmd processing 2020-06-12 05:53:20 +02:00
Johnny Steenbergen c70c3faa11 chore(influx): remove client timeout on write cmd's retriever 2020-06-11 11:26:38 -07:00
Pavel Zavora 55e58c9d5d chore(doc): apply proofreading 2020-06-11 10:21:44 -07:00
Pavel Zavora 6d91f67bbe feat(cmd/influx/write): write data from url 2020-06-11 10:21:44 -07:00
Jonathan A. Sternberg db686349e7
feat(storage/flux): support full aggregate window push down (#18399)
This enables a new rule that will push down the full `aggregateWindow`
query including the `duplicate` and `window(every: inf)` that recombines
the tables. When the full rule is used, the table is not split into
tables for each window and instead retains itself as a single table. The
start or stop column is renamed to `_time` and `_start` and `_stop` will
be the boundaries of the query.
2020-06-10 13:21:41 -05:00
Johnny Steenbergen 1d75e3e8e9 feat(influx): provide means to provide trace debug ids to httpc client 2020-06-09 18:18:43 -07:00
Faith Chikwekwe 1bf2ce1a32 feat(query): register bare aggregate 2020-06-09 14:24:41 -07:00
Jonathan A. Sternberg 36b0a90b2c
tests(launcher): add a launcher test for read window aggregate push down (#18412)
This adds a launcher test for the read window aggregate push down to
verify that it is done when a query is sent with the appropriate
pattern, the output is correct, and that the metric is incremented that
signals the push down happened.
2020-06-09 15:20:54 -05:00
Johnny Steenbergen 34b3dc77fb feat(influx): move nested commands to root for stacks, export, and rename pkg to apply
this is the beginning of consolidating packages under the moniker templates
2020-06-08 10:10:25 -07:00
Johnny Steenbergen be4f989961 fix(pkger): lazy init the pkger store
closes: #18383
2020-06-05 14:17:26 -07:00
Johnny Steenbergen bc9b69b96f fix(pkger): provide charts when export stack dashboards by stack 2020-06-04 15:16:15 -07:00
Johnny Steenbergen a6ead1246e fix(pkger): provide correct stackID for recording pkg application
this bug surfaces when you do not provide a stack ID to the apply call.
the new stack is created, but the resources created are not associated
with it. This remedies that issue.
2020-06-04 13:47:52 -07:00
Johnny Steenbergen d21fce5f6d fix(influx): have delete cmd respect the config settings
closes: #17289
2020-06-02 16:31:49 -07:00
Johnny Steenbergen fd289883fe feat(influx): add User-Agent header to the CLI http calls
closes: #18336
2020-06-02 16:09:11 -07:00
Johnny Steenbergen 81a0982b00 feat(influx): add version to influx CLI
closes: #14821
2020-06-02 16:09:11 -07:00
Johnny Steenbergen 6112c7848d chore(influx): improve usage for influx pkg commands
closes #18324
2020-06-02 13:49:35 -07:00
Johnny Steenbergen 07e351b204 chore(influx): disable failing when providing an unexpected error to influx CLI
closes: #18290
2020-06-02 12:25:21 -07:00
Johnny Steenbergen 4838a94eed feat(pkger): add export stack command to influx CLI
closes: #18271
2020-06-02 08:18:11 -07:00
Johnny Steenbergen 3dcd5d496f feat(pkger): add ability to export by stack
this ability exports all resources associated with a stack by the same
metadata.name fields as the original application had done it. This can
be used as a means to snapshot the current state of the stack. This can
be used for source control or other means.

closes: #18271
2020-06-02 08:18:11 -07:00
Alirie Gray 03ba8f250a
refactor: remove urms from new label service (#18301) 2020-06-01 09:28:03 -07:00
Johnny Steenbergen d3be5d19ea chore(influx): provide stack ID in pkg application commands 2020-05-29 09:24:22 -07:00
Johnny Steenbergen 53794bfae5 feat(pkger): make all pkg applications stateful
if no stack is provided then one will be provided for you.

closes: #17997
2020-05-28 16:59:21 -07:00
Johnny Steenbergen b25b4021c3 chore(pkger): refactor return values for Apply/DryRun to enable extending it
references: #17997
2020-05-28 15:34:15 -07:00
Pavel Závora f9ed497abf
feat(cmd/influx/write): enhance the ability to import CSV files using csv2lp library (#18093)
* feat(cmd/influx/write):  enhance the ability to import CSV files

* feat(cmd/influx/write): rely upon csv2lp package

* chore(cmd/influx/write): rename file to snake case

* chore(cmd/influx): apply PR review comments
2020-05-28 15:28:45 -07:00
Alirie Gray 876238d688
feat: add feature flag for new labels service (#18215) 2020-05-28 08:26:08 -07:00
jlapacik d22380dc8b
Merge pull request #17900 from influxdata/feat/use-algo-w
chore: promote algorithm W to master
2020-05-27 10:20:03 -07:00
Lyon Hill 97dc4d18db
feat: use the new tenant user handler (#18190)
Switch to use the new user handler. We have been using the tenant backend for some
time now and just need to switch over to using tenant front to back.
2020-05-27 08:48:27 -06:00
jlapacik 7db9f4c520 Merge branch 'master' into chore/merge-master 2020-05-26 10:03:42 -07:00
Alirie Gray 7f4ddabe8a
refactor: add new label package (#18078) 2020-05-21 11:30:19 -07:00
greg linton 5ac45ccb8a fix: use skip-verify flag in ping 2020-05-21 11:44:51 -06:00
Jonathan A. Sternberg 0c8d19e896
Merge branch 'master' into feat/use-algo-w 2020-05-18 13:25:26 -05:00
Lyon Hill c459852f8f
feat: integrate the new session system behind a feature flag (#18042) 2020-05-18 11:50:22 -06:00
Gianluca Arbezzano 1cf64fd721
feat: dbrp service
Signed-off-by: Lorenzo Affetti <lorenzo.affetti@gmail.com>
Co-Authored-By: Gianluca Arbezzano <gianarb92@gmail.com>
Co-Authored-By: George MacRorie <gmacrorie@influxdata.com>
Co-Authored-By: Alirie Gray <alirie.gray@gmail.com>
2020-05-15 12:05:38 +02:00
jlapacik 34e581ca0a Merge branch 'master' into chore/merge-master 2020-05-12 11:18:25 -07:00
Johnny Steenbergen 3ad00934c4 fix(influx): fixup display message for onboarding with interactive and rp flag
closes: #17862
2020-05-08 10:03:56 -07:00
Alirie Gray 24cc1cabb8
feat: add feature flag for refactored authorization package (#17944) 2020-05-08 10:00:39 -07:00
Gavin Cabbage 4fd30f5f24
fix(kit/feature): lookup typed flag if base is passed to override (#18012)
* fix(kit/feature): lookup typed flag if base is passed to override

* chore(kit/feature): override base flag test
2020-05-08 09:50:04 -04:00
Johnny Steenbergen 233b6d368d fix(influx): update diff labelmapping print to respect state status 2020-05-07 15:52:52 -07:00
Johnny Steenbergen b0d00425b0 feat(influx): add pkger remove|rm|uninstall stacks command 2020-05-07 15:52:52 -07:00
Johnny Steenbergen e668524847 feat(influx): add pkger list stacks command 2020-05-07 15:52:52 -07:00
Brett Buddin 8d26d9807d
Merge pull request #17970 from influxdata/bb/feature-flag-proxy
feat(http): Allow specific API handlers to be proxied for the Algo-W rollout
2020-05-07 14:20:47 -04:00
jlapacik f3320c7b43 Merge branch 'master' into chore/update-flux 2020-05-07 10:44:34 -07:00
Johnny Steenbergen 37d44d882d chore(pkger): handle edge cases for telegraf configs that manifest from user interaction
closes: #17434
2020-05-06 16:49:50 -07:00
Johnny Steenbergen 3eb5af969a chore(pkger): handle edge cases for tasks that manifest from user interaction
references: #17434
2020-05-06 16:49:50 -07:00
Johnny Steenbergen 7be0d8289b chore(pkger): handle edge cases for rules that manifest from user interaction
references: #17434
2020-05-06 16:18:48 -07:00
Johnny Steenbergen 7f8aa4c40f chore(pkger): handle edge cases for endpoints that manifest from user interaction
references: #17434
2020-05-06 15:56:32 -07:00
Johnny Steenbergen b4b52570b4 chore(pkger): handle edge cases for labels that manifest from user interaction
references: #17434
2020-05-06 15:26:01 -07:00
Johnny Steenbergen d4aa3be8db chore(pkger): handle edge cases for dashboards that manifest from user interaction
references: #17434
2020-05-06 15:12:30 -07:00
Johnny Steenbergen 485cc3ea54 chore(pkger): handle edge cases for checks that manifest from user interaction
references: #17434
2020-05-06 14:57:04 -07:00
Johnny Steenbergen 24dd13bcc6 chore(pkger): handle edge cases for buckets that manifest from user interaction
references: #17434
2020-05-06 14:19:44 -07:00
Johnny Steenbergen f575ea8d41 chore(pkger): handle edge cases that can manifest from users in the platform and stateful pkg applications
references: #17434
2020-05-06 13:01:50 -07:00
jlapacik 4aec0dc48e Merge branch 'master' into chore/update-flux 2020-05-06 10:00:09 -07:00
Brett Buddin c5c4e71dbd
feat(http): Add ability to proxy specific API handlers for Algo-W rollout. 2020-05-06 12:30:05 -04:00
Gavin Cabbage 8af9b3c2d1
refactor(kit/feature): remove target logic; expose bykey (#17949)
* refactor(kit/feature): remove target logic; expose bykey

* refactor(kit/feature): un-variadic-ify bykey arg
2020-05-06 11:13:17 -04:00
Johnny Steenbergen 3fd731511a chore(pkger): make integration stack tests indpendent 2020-05-05 11:01:13 -07:00
Johnny Steenbergen 1d027cf4e0 feat(pkger): enforce metadata.name dns name compliance
this PR includes a lot of small changes to names in existing test pkgs.
the tests are updated to follow suit.

closes: #17940
2020-05-05 01:35:02 -05:00
Johnny Steenbergen 89e34365bb feat(pkger): add the ability to remove a stack and all its associated resources
closes: #17554
2020-05-05 01:35:02 -05:00
Johnny Steenbergen 784b222d4d feat(pkger): enforce metadata.name dns name compliance
this PR includes a lot of small changes to names in existing test pkgs.
the tests are updated to follow suit.

closes: #17940
2020-05-04 12:40:22 -07:00
Johnny Steenbergen 95ad3c6582 feat(pkger): add the ability to remove a stack and all its associated resources
closes: #17554
2020-05-01 16:18:13 -07:00
jlapacik 83b90c3575 Merge branch 'master' into chore/merge-master 2020-04-30 14:05:51 -07:00
Johnny Steenbergen c7e97f1625 feat(pkger): add service and http server integreations for stack lists
references: #17554
2020-04-30 13:24:15 -07:00
jlapacik 2ef9999907 Merge branch 'master' into chore/merge-master 2020-04-30 09:53:04 -07:00
Gavin Cabbage 95913534a0
feat(kit/feature): add feature flag package (#17851)
* feat(kit/feature): add feature flag package

* refactor(kit/feature/_codegen): simplify with fmt.Errorf

* chore(kit/feature): tidy comments
2020-04-30 11:29:43 -04:00
Johnny Steenbergen ff27edbea9 feat(pkger): add support for using URLs associated with stack to apply/dry run 2020-04-29 16:48:00 -07:00
Lyon Hill d720661e77
feat(tenant): change the tenant services default behavior to enabled (#17872)
We have reached the stage wehre the new tenant service is being used and
is stable but we want to get it in more hands and used as the default service.
2020-04-29 14:04:26 -06:00
jlapacik 457637ed22 Merge branch 'master' into chore/merge-master 2020-04-28 13:13:36 -07:00
Johnny Steenbergen 72906a4484 feat(pkger): add support for stateful label mappings
references: #17434
2020-04-24 17:05:55 -07:00
jlapacik 3079d2a8aa Merge branch 'master' into chore/merge-master-into-algo-w 2020-04-24 14:21:26 -07:00
Johnny Steenbergen 1ac383de66 fix(launcher): removed timed contexts for launcher pkger tests 2020-04-24 10:52:50 -07:00
Johnny Steenbergen 1615a2c461 fix(influx): add arg description into config usage 2020-04-24 10:52:50 -07:00
Johnny Steenbergen 3acd860563 feat(pkger): add stateful management for notification rules
references: #17434
2020-04-23 11:47:32 -07:00
jlapacik 63fd3655be Merge branch 'master' into chore/merge-master-into-algo-w 2020-04-22 14:52:59 -07:00
George e150377f48
revert(tenant): integrate the tenant service as the default backend (#17805) (#17832)
This reverts commit 79e9de93cb.
2020-04-22 17:23:17 +01:00
Johnny Steenbergen 653a53fa9b chore(influx): tidy up print summary statements to include pkg names 2020-04-21 16:50:08 -07:00
Johnny Steenbergen 47e5facc81 feat(pkger): add stateful management for telegraf configs 2020-04-21 15:47:49 -07:00
Lyon Hill 79e9de93cb
feat(tenant): integrate the tenant service as the default backend (#17805) 2020-04-21 13:43:56 -06:00
Johnny Steenbergen 43b7d65d02 feat(influx): extend CLI org type to support config orgs in global config 2020-04-21 10:25:05 -07:00
Johnny Steenbergen 5cd57d4f1e fix(influx): make CLI respect root token and host env vars in additionn to config
one thing to note here is we are deleting the default value on the host
flag when it is registered. The config is the fallback and has the default
value set. If the host flag has a default, the determination if the user
set it or not is ambiguous. We can't have that.

closes: #17812
2020-04-21 10:25:05 -07:00
Johnny Steenbergen 596d8fde45 feat(pkger): add stateful management for tasks
notes on this commit. This commit was grueling ;-(. The task API is not a friendly
API to consume. There are a lot of non obvious things going on and almost every
one of them tripped me up. Things of note:

* the http.TaskService does not satisfy the influxdb.TaskService,
  making it impossible to use as a dependency if tasks service gets
  split out
* the APIs for create and update do not share common types. For example:
  creating a task takes every field as a string, but in the update it is
  taken as a options.Duration type. A step further and you'll notice that
  create does not need an option to be provided, but the update does. Its
  jarring trying to understand the indirection here. I struggled mightily
  trying to make sense of it all with the indirection and differing types.
  Made for a very difficult task (no pun intended) when it should have been
  trivial. Opportunity here to fix these up and make this API more uniform
  and remove unneccesary complexity like the options type.
* Nested IDs that get marshaled, are no bueno when you want to marshal a task
  that does not have an ID in it, for either user/org/or self IDs. Its a challenge
  just to do that.
* Lots of logs in the kv.Task portion where we hit errors and log and others where
  we return. It isn't clear what is happening. The kv implementation is also very
  procedural, and I found myself bouncing around like a ping pong ball trying to
  make heads or tails of it.
* There is auth buried deep inside the kv.Task implementation that kept throwing me
  off b/c it kept throwing errors, instead of warns. I assume, not sure if I'm
  correct on this, but that the stuff being logged is determined inconsequential
  to the task working. I had lots of errors from the auth buried in there, and hadn't
  a clue what to make of it....

leaving these notes here as a look back at why working with tasks is so
difficult. This API can improve dramatically. I spent 5x the time trying
to figure out how to use the task API, in procedural calls, than I did
writing the business logic to consume it.... that's a scary realization ;-(

references: #17434
2020-04-21 09:14:20 -07:00
Johnny Steenbergen d1af15c399 chore: remove extranenous fields on http.Task type
also drops a skipped test that has been skipped for over a year. Tried
unskipping it, but now it fails for all sorts of reasons, without the
race flag enabled.
2020-04-20 15:34:58 -07:00
Johnny Steenbergen c483aec2d2 feat(pkger): add stateful management for dashboards 2020-04-20 14:04:45 -07:00
jlapacik 335968a552 Merge branch 'master' into chore/merge-master 2020-04-20 13:59:21 -07:00
Johnny Steenbergen 8251c362ee chore(pkger): refactor parser notification rule state out into stateful type
this PR also drops a bunc of dead code that was necessary for times of integration.

references: #17434
2020-04-17 14:02:29 -07:00
jlapacik 7541af8414 chore: merge master into algow 2020-04-15 14:42:03 -07:00
Johnny Steenbergen 94ae519cc6 chore(pkger): refactor parser notification endpoint state out into stateful type
references: #17434
2020-04-15 14:26:25 -07:00
Johnny Steenbergen c8a79f5653 chore(pkger): refactor parser variable state out into stateful type
references: #17434
2020-04-14 16:48:56 -07:00
Johnny Steenbergen 68183bb156 chore(pkger): refactor embedded types out of stateful types 2020-04-14 14:12:23 -07:00
Johnny Steenbergen c718b676ef chore(pkger): refactor pkger data model to separate parsed and stateful datum 2020-04-14 09:28:09 -07:00
Lorenzo Affetti 6967cc2d58
fix(launcher): se default memory limit for query to unlimited 2020-04-10 21:33:45 +02:00
Johnny Steenbergen 67ccbd4490 fix(influx): add nil check for printing diff of endpoints and checks 2020-04-09 13:15:32 -07:00
Johnny Steenbergen 77bb23fd38 chore(pkger): refactor label mapping diff CLI table output 2020-04-08 15:13:47 -07:00
Johnny Steenbergen cee77081b2 feat(pkger): extend tasks with unique constraints 2020-04-08 14:38:32 -07:00
Johnny Steenbergen 85e31e8194 feat(pkger): update tasks with unique constraints 2020-04-08 13:30:43 -07:00
Pavel Závora 179adb0e9b
Merge pull request #17595 from influxdata/17356/influx-cli-file
feat(cmd/influx): add --file option to query and task commands
2020-04-08 20:45:44 +02:00
Johnny Steenbergen 845718c0d6 feat(pkger): update dashboards with unique constraints 2020-04-08 11:21:28 -07:00
Pavel Závora 3270d3328a
Merge branch 'master' into 17356/influx-cli-file 2020-04-08 19:54:43 +02:00
Johnny Steenbergen dd432360cc feat(pkger): update notification rule with unique constraints 2020-04-08 10:36:21 -07:00
Lyon Hill 33c39796bd
feat(tenant): update the client to use the new onboarding package (#17659) 2020-04-07 13:51:06 -06:00
Alirie Gray 8975fd2365
refactor(tenant): move bucket and urm auth layers to tenant service (#17474)
Co-authored-by: Lyon Hill <lyondhill@gmail.com>
2020-04-07 11:13:27 -07:00
Lyon Hill 4421a39639
feat(tenant): Build out the onboarding system in tenant and integrate it into launcher (#17558)
We are adding in a setup/user route this is not in swagger at the moment but will be
added once we feel it is stable.
2020-04-06 15:58:15 -06:00
Johnny Steenbergen c245f3233b chore(pkger): add stack state management for notification endpoints 2020-04-06 14:56:56 -07:00
Pavel Závora 9cca99d0a4
Merge branch 'master' into 17356/influx-cli-file 2020-04-06 21:04:44 +02:00
Johnny Steenbergen 1e19f38502 chore(pkger): add stack state management for variables 2020-04-06 10:22:55 -07:00
Jonathan A. Sternberg d3fa60991f
Merge branch 'master' into chore/merge-master 2020-04-06 12:17:47 -05:00
Pavel Zavora 37b3673733 chore(cmd/influx): apply proofreading comments #17356 2020-04-04 13:00:41 +02:00
Jonathan A. Sternberg 0ae8bebd75
refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
Jonathan A. Sternberg 469c5849c4
Merge branch 'master' into feat/use-algo-w 2020-04-03 09:30:04 -05:00
Pavel Zavora 4f1953cea5 feat(cmd/influx/task): add --file option #17356 2020-04-03 08:00:56 +02:00
Pavel Zavora 3449f23733 feat(cmd/influx/query): add --file option #17356 2020-04-03 07:31:10 +02:00
Johnny Steenbergen 21d2bf5dc6 chore(pkger): add stack state management for checks 2020-04-02 16:32:20 -07:00
Johnny Steenbergen e6317a04ee chore(pkger): refactor summary/diff types for Endpints|Checks|Variables 2020-04-02 12:35:51 -07:00
Johnny Steenbergen 762e9a422e feat(pkger): add stack state management for labels 2020-04-02 09:03:59 -07:00
Lorenzo Affetti 13fc4f335d
test(launcher): e2e test memory limits 2020-04-02 11:20:42 +02:00
Johnny Steenbergen f5b9a30b1f feat(pkger): extend labels diff and summary types to include PkgName and Remove
the pkgName refers to the unqiue label resource within the pkg and the
Remove field indicates the label will be removed when applying the pkg
2020-04-01 14:13:45 -07:00
Johnny Steenbergen 34c3b35ca3 feat(pkger): add stack state management for buckets 2020-04-01 13:09:14 -07:00
Kelvin Wang abe3a96674 feat(cmd/influx): add config switch back 2020-04-01 12:44:21 -04:00
Johnny Steenbergen 098fd27ab4 feat(pkger): extend DiffBucket with name for existing and new bucket values
provides mapping between pkgName and resource the diff represents. Now that
stacks are in place, the existing bucket may change names.
2020-03-31 13:34:40 -07:00
Pavel Zavora 153bc0bd40 Merge branch 'master' into 17003/writeFromCsv 2020-03-29 21:20:10 +02:00
Pavel Zavora 9e55ac3481 chore(cmd/influx/write): remove unused DryRun flag 2020-03-29 20:30:06 +02:00
Johnny Steenbergen 9f2fcea365 fix: add missing flag register to task run list cmd for json out and hide header flags 2020-03-27 14:20:37 -07:00
Johnny Steenbergen 77900b39cc fix: add missing flag register to task run list cmd for json out and hide header flags 2020-03-27 13:47:31 -07:00
Johnny Steenbergen e767b1e410 fix: add missing flag register to org cmd for json out and hide header flags 2020-03-27 13:31:46 -07:00
Kelvin Wang 5db57c9081 feat(cmd/influx): easy switch config 2020-03-27 15:45:36 -04:00
Johnny Steenbergen 3cb44a0301 feat(influx): add jsonout and hide headers support to task cmd 2020-03-27 12:33:24 -07:00
Johnny Steenbergen 361777acfd feat(influx): add jsonout and hide headers support to auth cmd 2020-03-27 11:49:09 -07:00
Johnny Steenbergen 62a64e9abd feat(influx): add jsonout and hide headers support to user cmd 2020-03-27 11:49:09 -07:00
Brett Buddin 2200143a22
Merge pull request #17462 from influxdata/bb/no-tasks
feat(influxd): flag to disable scheduling of tasks
2020-03-27 14:26:34 -04:00
Russ Savage b0876d4144
Merge branch 'master' into 17003/writeFromCsv 2020-03-27 11:14:52 -07:00
Johnny Steenbergen 7a518380ad feat(influx): add jsonout and hide headers support to config cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen 241e3513e6 feat(influx): add jsonout and hide headers support to setup cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen 08fbdbff1a feat(influx): add jsonout and hide headers support to secret cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen ba57fa5a66 feat(influx): add jsonout and hide headers support to org cmd 2020-03-27 10:59:50 -07:00
Johnny Steenbergen 34e0754572 feat(influx): add jsonout and hide headers functionality to bucket cmds 2020-03-27 10:29:56 -07:00
Brett Buddin 3d826d96cf
feat(influxd): flag to disable scheduling of tasks 2020-03-27 12:52:07 -04:00
Johnny Steenbergen f0c0b82a7a feat(influx): add json output flag for pkg commands that print tables 2020-03-27 08:32:58 -07:00
Johnny Steenbergen 37646464b3 feat(pkger): add stack init cmd to influx cli
closes: #17235
2020-03-27 08:32:58 -07:00
sranka 9baf17f25b
Merge branch 'master' into 17003/writeFromCsv 2020-03-27 13:36:35 +01:00
Pavel Zavora ede26fce65 chore(cmd/influx/write): q comments 2020-03-26 21:19:33 +01:00
Johnny Steenbergen 8c70dc9b23 feat(pkger): add create stack endpoint for http server 2020-03-26 12:37:43 -07:00
Johnny Steenbergen 7a24e450c1 feat(pkger): add auth for pkger stack CRUDing
adds new AuthAgent type that can be reused across service middleware.
2020-03-26 10:11:59 -07:00
Lorenzo Affetti b9fc4e5668
Merge pull request #17385 from influxdata/la/dup-read
feat(tenant): add duplicate read service
2020-03-25 23:41:29 +01:00
Pavel Zavora 1911854218 chore(cmd/influx): create write's dryrun subcommand with runE middleware 2020-03-25 21:26:18 +01:00
Pavel Zavora 978604cc52 fix(cmd/influx): reuse organization struct for org and org-id flags of write command 2020-03-25 21:22:01 +01:00
Pavel Zavora f871de2076 feat(cmd/influx): introduce dryrun sub-command of write command 2020-03-25 21:22:01 +01:00
Pavel Zavora 60765219ae fix(cmd/influx): revert the way of how config is read when token flag is empty 2020-03-25 21:22:01 +01:00
Pavel Zavora ff3a27aac5 feat(cmd/write): add dry-run flag 2020-03-25 21:22:01 +01:00
Pavel Zavora 3fddd8dea5 chore(cmd/write): use stdin when no file or argument is supplied 2020-03-25 21:22:01 +01:00
Pavel Zavora 82f0365ff6 feat(cmd/write): don't override config unless token migration really happened 2020-03-25 21:21:21 +01:00
Pavel Zavora fd1e4b903f feat(cmd/write): add file option 2020-03-25 21:21:21 +01:00
Pavel Zavora 7ca93e0bfe feat(cmd/write): don't check setup for dry-run executions 2020-03-25 21:17:23 +01:00
Pavel Zavora 8a3feb1bbc feat(cmd/write): add csv format support 2020-03-25 21:17:23 +01:00
Johnny Steenbergen 36d99bfbf8 chore(influx): make runE middleware application explicit from caller 2020-03-25 12:41:11 -07:00
Johnny Steenbergen 7d8bd1e055 chore(pkger): refactor influx pkg cmd to not validate in CLI and have server validate
the pkger.ValidSkipParseError option allows our server to be the one to validate the
the pkg is accurate. If a user has an older version of the UI and our cloud gets updated
with new validation rules,they'll get immediate access to that change without having to
rol their CLI build.

also fixes issue where we swallow initial errors when check setup middleware
fails.
2020-03-25 11:50:14 -07:00
Johnny Steenbergen 2f7aee2f2e chore(influx): small cleanup of pkg command removing duplicate validation 2020-03-25 09:09:48 -07:00
Lorenzo Affetti 1e36e7b3ad
feat(tenant): add duplicate read service 2020-03-25 12:06:28 +01:00
Kelvin Wang 1e9099c45f feat(cmd/influx): add delete bucket by name 2020-03-24 16:10:24 -04:00
Johnny Steenbergen c926accb42 feat(pkger): add create stack implementation for service 2020-03-23 16:30:27 -07:00
Christopher M. Wolff 20c2439230
refactor(http): change *ast.Package to json.RawMessage in query requests (#17316) 2020-03-23 12:39:24 -07:00
Marc Delagrammatikas ea8e6d15d0 refactor: fixes typo in OnboardInitialUser method
Fixes typo introduced by 7b99c28a99
2020-03-20 10:48:20 -07:00
Johnny Steenbergen e116ecaf5e feat(pkger): add CRUD store implmentation 2020-03-20 10:15:02 -07:00
Johnny Steenbergen 2d1186a696 feat(pkger): add human readable random names to pkg resource metadata.name field one export 2020-03-20 08:18:04 -07:00
Johnny Steenbergen 8d546f4197 feat(pkger): extend tasks with ability to define and rename it
closes: #17233
2020-03-19 10:50:53 -07:00
Johnny Steenbergen 51b0b9f681 feat(pkger): extend notification rules with ability to define and rename it 2020-03-19 08:59:07 -07:00
Johnny Steenbergen c6f4d3992e feat(pkger): extend dashboard to be able to define and rename it 2020-03-18 17:02:35 -07:00
Marc Delagrammatikas b73effebb2
Merge pull request #17344 from influxdata/refactor/onboarding
refactor: rename Generate to OnboardInitialUser
2020-03-18 16:40:25 -07:00
Marc Delagrammatikas 7b99c28a99 refactor: rename Generate to OnboardInitialUser
Renaming Generate in anticipation of a new method that will onboard
users other than the initial user. The intent is to simplify multi-user
setups.

Co-authored-by: Chris Goller <goller@gmail.com>
2020-03-18 15:35:26 -07:00
Johnny Steenbergen c31f321d11 chore(pkger): refactors export mechanics to provide unique metadata.name and spec.name
this is applied to all the resoruces that have had the spec.name field applied.
all resources that have not will work in the same way before this commit.
2020-03-18 15:14:48 -07:00
Johnny Steenbergen b3927f4945 feat(pkger): extend telegraf configs to be able to define a config and rename it 2020-03-18 15:14:48 -07:00
Edd Robinson d96cbd4f74
Merge pull request #17016 from influxdata/er-bulk-import
feat(storage): prototype 1.x–2.x migration tooling
2020-03-18 17:57:26 +00:00
Johnny Steenbergen 5711415b78 feat(pkger): extend variables to be able to define a variable and rename it 2020-03-17 12:32:19 -07:00
Johnny Steenbergen 136822da51 feat(pkger): extend endpoints to be able to define a endpoint and rename it 2020-03-17 11:31:33 -07:00
Johnny Steenbergen 43de2fb4e8 feat(pkger): extend checks to be able to define a check and rename it 2020-03-17 08:16:04 -07:00
Johnny Steenbergen 136ca295d1 fix(influx): update completion cmd with more accurate help message 2020-03-17 08:15:38 -07:00
Johnny Steenbergen de32cf94d0 feat(pkger): extend labels to be able to define a label and rename it 2020-03-16 16:20:42 -07:00
Johnny Steenbergen 952d7d7528 feat(pkger): extend buckets to be able to define a bucket and rename it
this work is the first of making resources ALL unique by metadata.name. The
displayName is a means to rename an existing resource. This is all to support
pkger idempotency. The metadata.name field will be the unique identifier within
a pkg.
2020-03-16 14:18:30 -07:00
Johnny Steenbergen 7b1efe5428 feat(influx): add completion command for users to generate the completions for the influx cli 2020-03-16 09:42:10 -07:00
Johnny Steenbergen 5211e559de chore(influx): add test coverage for root influx cmd
this verifies things like token/host and all the root lvl flags are being
set appropriately.
2020-03-13 15:00:12 -07:00
Edd Robinson d6a22c196a refactor: add some links to current issues 2020-03-13 15:24:51 +00:00
Edd Robinson bbe40aeb82 feat: prototype 1.x - 2.x migration tool 2020-03-13 11:00:28 +00:00
Jacob Marble 26ca766459
refactor(tsdb): move series file to its own package (#17224)
* refactor(storage): move type ByTagKey to the only package that uses it

* refactor(tsdb): use types in tsdb/cursors

* refactor(tsdb): remove unused type SeriesIDElems

* refactor(tsdb): inline only use of tsdb.ReadAllSeriesIDIterator

* refactor(tsdb): move series file to its own package

* refactor(storage): remove platform->influxdb aliases
2020-03-12 11:32:52 -07:00
Kelvin Wang c511f06fa5 feat(cmd/influx): add profile management 2020-03-12 11:09:54 -04:00
Ben Johnson 627b6f86bb feat(storage): Series file compaction 2020-03-11 19:31:58 -06:00
Gavin Cabbage f5e8547482
fix(buckets): prevent returning system buckets to unauthorized users (#17117) 2020-03-11 13:06:08 -04:00
Greg f98874566c
fix: allow authorized label service to be called indirectly (#17111)
* fix: allow authorized label service to be called indirectly

17071 exists because pkger loads all service resources as authorized on
start, resulting in them all being authorized when referenced indirectly
(not hit directly via api by consumer). Rather than restructure pkger to
only authorize direct services, this allows proper indirect auth to
labels (the cause of 17071).

* Add orgService to tests

* Add resource types to find orgID from
2020-03-11 10:58:39 -06:00
Sebastian Borza a50e69451e
feat(storageflux): move flux components out to separate package 2020-03-10 17:54:04 -05:00
Jonathan A. Sternberg 4d683859e9
Merge branch 'master' into feat/use-algo-w 2020-03-09 13:31:46 -05:00
Johnny Steenbergen de24c0e813 feat(influx): extend pkg export all cmd to allow for filtering of output
currently, support by filtering labelName and or by resource kind

closes: #17029
2020-03-09 09:27:01 -07:00
Johnny Steenbergen 1c9fd705a3 feat(pkger): add support for exporting org resources filtered by label 2020-03-06 14:51:01 -08:00
Jonathan A. Sternberg 0d6e4e310b
Merge branch 'master' into feat/use-algo-w 2020-03-06 16:46:49 -06:00
Jacob Marble 39b7c2ab76
refactor(storage): export IndexSeriesCursor (#17134)
* refactor(storage): add readSource field accessors

* refactor(storage): remove unused limitSeriesCursor

* refactor(storage): export IndexSeriesCursor

This allows IDPE to use the same implementation, rather than duplicate
code. Also copied unit tests from IDPE.

* chore: go fmt
2020-03-06 14:05:03 -08:00
Johnny Steenbergen 6818925643 feat(pkger): add support for exporting all and filter by resource types
note: all associations are still included for resources that match the
filte criteria.
2020-03-06 11:51:38 -08:00
Johnny Steenbergen 95c72c1679 chore(influx): update setup cmd to allow for duration for retention option
closes: #17107
2020-03-06 08:13:21 -08:00
Jonathan A. Sternberg bcbb9df72e
refactor(task): tasks will now use the flux language service (#17104)
The tasks subsystem will now use the flux language service to parse and
evaluate flux instead of directly interacting with the parser or
runtime. This helps break the dependency on the libflux parser for the
base influxdb package.

This includes the task notification packages which were changed at the
same time.
2020-03-05 14:36:58 -06:00
Jonathan A. Sternberg a907e05426
refactor(http): modify query handler to use a language service (#17074)
The language service abstracts away the parse source which breaks the
dependency without moving any of the code.
2020-03-05 10:32:17 -06:00
Jade McGough fec0a021fd
fix(cmd): use list instead of find in cli (#16805) 2020-03-04 15:39:04 -08:00
Kelvin Wang 4bd60efae1 fix(cmd/influx): fix auth user name 2020-03-04 09:48:18 -05:00
Jonathan A. Sternberg a84df749cc
feat(stdlib): add influxdb source (#17047)
This updates the repl to support the new influxdb source and use it by
default in the repl. It will automatically set some default variables
for the influxdb source to make it easier to use the cli. In particular,
it will set the default organization, token, and the host. The
organization gets set to the one specified in the repl command and the
token gets filled in with the user installed one. The host defaults to
localhost but will change to whichever one was specified on the cli.

In addition, this will replace the http client with one that sets
insecure skip verify if the `--skip-verify` flag is used.
2020-03-02 20:08:19 -06:00
Johnny Steenbergen fca4e13255 fix(pkger): fix issue with imports causing option task to be injected at wrong point
closes: #17069
2020-03-02 15:19:54 -08:00
Jacob Marble 83818e9592
fix(storage): incremental improvments (#17011)
* fix(storage): simplify storage/seriesCursor

storage/seriesCursor releases series file and TSI references sooner.

Remove unhelpful request object, inherited from 1.x

* chore(storage): replace SeriesCursor interface with sole implementation
2020-02-28 11:12:43 -08:00
Kelvin Wang 0ba38e712f chore(cmd/influx): typo 2020-02-28 10:45:13 -05:00
Johnny Steenbergen 46758e3370 fix(pkger): correct the export of tasks to include system type tasks
wrong assumption in original design. The system tasks are actually
the CRUD tasks. Name is a bit confusing for user generated tasks.

closes: #17038
2020-02-27 17:16:12 -08:00
Kelvin Wang 48490cdc9b fix(cmd/influx): ui change for secret 2020-02-27 16:34:51 -05:00
Jonathan A. Sternberg ff848bcd55
refactor(repl): remove the querier from the repl (#17031)
The repl no longer takes in a querier and it will run everything
locally. The spec interface will now not be used and will be removed
from the http endpoint at some point.
2020-02-27 15:06:38 -06:00
Jonathan A. Sternberg 935180e9bd
refactor: update flux for the runtime package (#17002) 2020-02-27 11:31:45 -06:00
Alirie Gray 3120b4c47e
refactor(tasks): add Client to http TaskService (#16912) 2020-02-24 11:41:21 -08:00
jlapacik 2c184ead7f chore: update flux dependency and unskip notification tests
Fixes https://github.com/influxdata/influxdb/issues/16809.
2020-02-21 14:58:41 -08:00
jlapacik 766aa231b5 chore: update flux dependency
Fixes https://github.com/influxdata/influxdb/issues/16810.
2020-02-21 14:03:02 -08:00
Johnny Steenbergen 80751314bc chore(influx): refactor influx cmd to use builder
refators test to use full call paths where possible
2020-02-20 11:27:44 -08:00
tmgordeeva 890c943643
fix(backup): handle backup with no credentials file (#16877)
* fix(backup): handle backup with no credentials file

Backups and restores should work whether or not the original installation uses
a credentials file and whether or not the backup contains a credentials file.
2020-02-14 09:19:58 -08:00
Johnny Steenbergen a632025eb6 fix(influx): fix token env var and default assignment 2020-02-13 13:25:50 -08:00
Johnny Steenbergen 505ce2372c fix(influx): fix issue with locla state overriding env vars for token
closes: #16874
2020-02-13 11:55:41 -08:00