Commit Graph

547 Commits (db/update-protos)

Author SHA1 Message Date
vlastahajek 8763bb1af9 feat(upgrade): upgrade databases 2020-10-08 09:39:30 -07:00
Stuart Carnie 78d0262217 fix: Remove incorrect implementation of delete APIs and disable HTTP API
This commit removes incorrect implementations of the `DeleteBucket`
and `DeleteBucketRangePredicate` APIs from the storage package,
which remained after the transition to the tsdb 1.x storage engine.

Secondly, this PR utilizes the `ENotImplemented` error code to inform
users which call the `/api/v2/delete`
2020-09-24 11:11:46 -07:00
Stuart Carnie 46db75d9a9 fix: ShardGroupDuration is updated for retention period updates
Fixes #19518
2020-09-18 07:31:48 -07:00
Christopher M. Wolff e7cbbaa722
feat: upgrade Flux to v0.83.2 (#19569) 2020-09-16 17:59:15 -07:00
Gershon Shif af0c328095
chore(packaging): build rpm and deb packages (#19567)
- Update CIrcleCI configuration to start release process on an RC build
- Update .goreleaser.yml:
   - Start building armel and armhf binaries and rpm and debian packages.
   - Generate sha256 checksum file.
- launcher.go: do not use `max` module to escape integeroverflow problem for armel and armhf builds
- Start using `v0.142.0` of goreleaser
- Added pre and post install/uninstall scripts for rpm amd deb packages
2020-09-16 12:36:44 -07:00
Stuart Carnie 6f0cf049ca feat: Port shard precreation service from InfluxDB 1.x
Provides new configuration parameters:

```
--storage-shard-precreator-advance-period
--storage-shard-precreator-check-interval
```

Closes #19520
2020-09-09 13:34:22 -07:00
Stuart Carnie e265f60b55 fix: Improvements in response to PR feedback
* Pass context.Context to Service.Open
* Remove redundant comments
* Bind to retention.Config configuration to be consistent with 1.x
2020-09-09 10:32:06 -07:00
Stuart Carnie 7c2be6e780 feat: Port 1.x retention policy enforcement service
Configuration of the check interval is available via

```
--storage-retention-check-interval
```

Closes #19309
2020-09-09 10:32:06 -07:00
Stuart Carnie feb2596f3a feat: Expose a subset of InfluxQL coordinator tuning options
Closes #19507
2020-09-05 09:44:34 -07:00
Stuart Carnie 111f39c8b1 feat: Add TSM 1.x storage options as flags
Closes #19505
2020-09-04 15:56:57 -07:00
Stuart Carnie 4266eb5935 chore: Remove page-fault-rate flag, which is not available 2020-09-04 15:56:57 -07:00
Stuart Carnie 7964f86ffc
fix: switch port to 8086
fix(readme): update the port and setup
2020-09-03 14:40:29 -07:00
Stuart Carnie b3138d2ead
fix: Ensure TemporaryEngine returns new inner TSDB store 2020-09-01 10:50:44 -07:00
Stuart Carnie a7239c007e
fix: separate flag to always permit initial user setup
This is not required for e2e tests
2020-08-31 16:38:54 -07:00
Stuart Carnie a607ac30b9
chore: Re-enable `TemporaryEngine` via `--e2e-testing` 2020-08-31 13:50:20 -07:00
Stuart Carnie dee8977d2c
chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
Stuart Carnie 06fac044e5
fix(storage): Implement SeriesCardinality, which is per-bucket
Fixed unit tests
2020-08-25 14:52:00 -07:00
Stuart Carnie 7ec178f54c
feat(influxd): Perform checks to determine if prior version exists
Closes #19408
2020-08-24 15:40:25 -07:00
Stuart Carnie cfd089b77a
revert(storage): Revert changes from 1501351
Reverted 1501351623
2020-08-24 10:08:46 -07:00
Stuart Carnie 6474c8c9fa
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	storage/engine.go
#	storage/engine_test.go
#	storage/wal/wal_test.go
#	tsdb/tsm1/engine_delete_prefix.go
#	tsdb/tsm1/engine_delete_prefix_test.go
#	tsdb/tsm1/engine_test.go
#	v1/tsdb/engine/tsm1/wal.go
2020-08-24 09:56:18 -07:00
Ben Johnson 1501351623 feat(influxql): Implement DELETE & DROP MEASUREMENT 2020-08-21 13:32:47 -06:00
Stuart Carnie c01a62d5d4
chore(task): Remove unused code 2020-08-20 16:59:26 -07:00
Stuart Carnie 8a7dcc21fb
feat(influxql): Initial implementation of InfluxQL query engine
* Some tests are broken or do not pass; follow up PRs will resolve that
2020-08-14 12:37:30 -07:00
Stuart Carnie 057285e23a
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	query/logging.go
#	query/logging_test.go
#	query/stdlib/influxdata/influxdb/rules.go
#	query/stdlib/influxdata/influxdb/rules_test.go
#	query/stdlib/testing/testing.go
#	storage/flux/reader.go
#	storage/flux/table.gen.go
#	storage/flux/table.gen.go.tmpl
#	storage/flux/table.go
#	storage/flux/table_test.go
2020-08-11 10:25:01 -07:00
Johnny Steenbergen 536e2c9811 feat(pkger): parameterize task queries
references: #18237
2020-08-05 16:14:06 -07:00
jlapacik 46c7345dae
feat: enable pushdowns for sum, count, min, and max by default (#19227) 2020-08-05 12:06:35 -07:00
Johnny Steenbergen efd82a2483 feat(influx): add support for dashboards 2020-08-05 09:14:01 -07:00
Faith Chikwekwe d48dc690a6
feat(query/stdlib): add min and max to ReadGroup (#19158)
Enables the mix and max aggregates for the ReadGroupAggregte pushdown behind a feature flag.

Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
2020-08-05 09:40:26 -05:00
Johnny Steenbergen 41cb12aeec feat(pkger): add parameterization to dashboard queries
references: #18237
2020-08-04 17:02:34 -07:00
George 5e22e0101d
chore(auth): remove unnecessary URM service from Bucket authorizer (#19060) 2020-08-04 14:37:14 +01:00
Stuart Carnie 49067de49f
fix(launcher): Fix launcher tests 2020-08-03 15:17:37 -07:00
Stuart Carnie 262023ae4a
fix(launcher): influxd inspect commands now start instantly
Lazily initialize flux, which increases startup time considerably
2020-08-03 15:16:36 -07:00
Stuart Carnie 8cfcfb0300
fix(cmd): Resolve build issues with influx command and tests 2020-08-03 09:21:04 -07:00
Stuart Carnie 21c3733464
fix(storage): meta.Client persists to kv and updates via BucketService
Includes initial migration to add metadata bucket
2020-08-03 09:21:02 -07:00
Stuart Carnie f86fcd24d5
fix(launcher): Fix unit tests after rebase 2020-08-03 09:20:51 -07:00
Stuart Carnie 7c225cb3ac
chore: More cleanup 2020-08-03 09:20:50 -07:00
Stuart Carnie 26c18ac0a5
chore: Converging on 1.x tsdb 2020-08-03 09:20:48 -07:00
Edd Robinson 2b175291be
refactor: WIP removing tsbd 2020-08-03 09:18:34 -07:00
Stuart Carnie a97ec1f34e
feat: Initial commit with working reads 2020-08-03 09:18:34 -07:00
Stuart Carnie e3060c291c
refactor: tsdb store builds an runs 2020-08-03 09:18:32 -07:00
Lyon Hill 0a9e8fdb4a
chore: update task tests to use the tenant service (#19169)
* chore: update task tests to use the tenant service

After the introduction of the tenant system we need to switch the testing frameworks
to use it instead of the old kv system

* chore: update onboarding to allow injected middleware
2020-08-03 09:33:46 -06:00
Alirie Gray d1b8e98798
refactor: remove nested orgs labels route (#19104) 2020-07-30 10:53:14 -07:00
Deniz Kusefoglu f490dd9693
feat(autoAggregate): BE work for autoAggregate (#19129)
* feat(autoAgg): fix pkger test

* feat(autoAgg): refrain from adding createEmpty to check query if exists

* feat(autoAgg): Fix check tests

* feat(autoAgg): Add fillValues to backend

* feat(autoAggregate): Add fillValues to swagger

* feat(autoAgg): indentation
2020-07-29 09:32:36 -07:00
Jonathan A. Sternberg 0cdbd496f4
fix(query): paginate bucket results in the bucket lookup (#19111)
The `buckets()` command would use a bucket lookup that wrapped the
`FindBuckets` API. It did not use the pagination aspect of this API
correctly. When the underlying implementation was changed to a version
that correctly implemented pagination, this broke the query `buckets()`
command. Since it was query that used the API incorrectly rather than a
regression in the `FindBuckets` implementation, this fixes the usage to
correctly use pagination.
2020-07-29 11:23:13 -05:00
Johnny Steenbergen e7310b414c fix(pkger): update stacks with snapshot of all prevoius event resources 2020-07-28 15:58:59 -07:00
Johnny Steenbergen d768132aaa feat(pkger): make envRef default values support more types
references: #18237
2020-07-28 12:22:46 -07:00
Johnny Steenbergen a652cdf552 chore(pkger): axe deprecated /packges route tree 2020-07-24 09:33:30 -07:00
Jonathan A. Sternberg 8678a22ee3
feat(storage/flux): add tests for min/max pushdowns (#19028) 2020-07-23 16:07:30 -05:00
Christopher M. Wolff 8b106bcee1
feat(storage): add mean aggregate array cursor and tests (#19019) 2020-07-23 09:49:53 -07:00
jlapacik 4d8547f0fe test: launcher tests for window offset 2020-07-20 12:23:37 -07:00
Ben Johnson c28eb70856 feat(mincore): Add page fault limiter
This commit adds `mincore.Limiter` which throttles page faults caused
by mmap() data. It works by periodically calling `mincore()` to determine
which pages are not resident in memory and using `rate.Limiter` to
throttle accessing using a token bucket algorithm.
2020-07-17 09:37:31 -06:00
Lyon Hill a31b651057
feat(task): Add new permission lookup pattern for executor (#18920)
* feat(task): Add new permission lookup pattern for executor

We can now use the user service to populate task owners permissions.
This should improve the task lookup time and decouple the task system
from the URM system. In the future we will have the ability to better isolate
tenant pieces from the rest of the service.

* feat: add feature flagging
2020-07-13 14:47:58 -06:00
George b8f5604613
revert(tasks): Add new permission lookup pattern for executor (#18869) (#18915)
This reverts commit e9e4d794cf.
2020-07-10 11:05:07 +01:00
Johnny Steenbergen 944b097628 feat(pkger): extend stacks API with uninstall ability
this new ability removes the resources associated with the stack
and adds the uninstall event.
2020-07-09 17:05:53 -07:00
Lyon Hill e9e4d794cf
feat(task): Add new permission lookup pattern for executor (#18869)
We can now use the user service to populate task owners permissions.
This should improve the task lookup time and decouple the task system
from the URM system. In the future we will have the ability to better isolate
tenant pieces from the rest of the service.
2020-07-09 14:06:46 -06:00
jlapacik e6e55038e8 test: descending array cursor should include end time 2020-07-09 12:22:25 -07:00
Johnny Steenbergen 8b6788fdd2 feat(pkger): make stacks event sourced
closes: #18874
2020-07-08 13:40:48 -07:00
jlapacik 9f9be91828 feat: remove feature flags for first and last pushdowns 2020-07-07 14:15:48 -07:00
Alirie Gray e02e950ed0
refactor: add new tenant system struct to consolidate services (#18833) 2020-07-06 10:49:51 -07:00
Ben Johnson 6b0b4d7c4e fix(storage): Refactor LoggingPointsWriter to use BucketFinder
This commit changes the writer to use `storage.BucketFinder` which
is a subset of the `influxdb.BucketService` interface.
2020-07-02 12:46:43 -06:00
George 4a6bc1d74f
chore: remove kv Session service and sessionsv1 bucket (#18823)
* chore: remove sessionsv1 bucket

* chore: add extra configuration to sessions.Service
2020-07-02 15:15:08 +01:00
jlapacik 25309c398d test: windowed aggregates should filter empty series 2020-07-01 16:58:50 -07:00
jlapacik 3246b3c7ad refactor: remove feature flag for certain pushdowns 2020-07-01 12:59:39 -07:00
Ben Johnson 482442ecc1 feat(storage): Add logging points writer
This commit adds a LoggingPointsWriter which wraps a PointsWriter
and provides logging when a write fails.
2020-07-01 11:41:29 -06:00
George 96d84b9126
refactor: migrator and introduce Store.(Create|Delete)Bucket (#18570)
* refactor: migrator and introduce Store.(Create|Delete)Bucket

feat: kvmigration internal utility to create / managing kv store migrations

fix: ensure migrations applied in all test cases

* chore: update kv and migration documentation
2020-07-01 12:08:20 +01:00
Johnny Steenbergen e851228102 feat(pkger): extend template diff types with kind
closes: #18804
2020-06-30 17:22:34 -07:00
Johnny Steenbergen ffe5d941d3 feat(pkger): extend template Summary with discrete kinds for each summary type
references: #18804
2020-06-30 16:47:15 -07:00
Johnny Steenbergen b9e6744807 chore(pkger): finalize adoption of templates naming convention
closes: #18580
2020-06-30 16:33:45 -07:00
Lyon Hill 5776350a53
feat: switch to use the new tenant bucket service (#18738) 2020-06-30 14:48:42 -06:00
Johnny Steenbergen b5fcb06883 fix(pkger): stop swallowing parser errors from pkger parser in http remote service 2020-06-29 17:31:59 -07:00
Johnny Steenbergen 952007001b chore(pkger): drop mentions of pkgs from within service models
references: #18580
2020-06-29 16:43:40 -07:00
Johnny Steenbergen 2927f0e718 feat(pkger): add stable HTTP APIs for stacks and templates
references: #18580
2020-06-29 13:45:32 -07:00
jlapacik fef23ee4d1 test: launcher tests for window last and bare last pushdowns 2020-06-29 13:12:47 -07:00
Johnny Steenbergen 2825427cf5 chore(pkger): convert packages endpoints into new naming convention
note: going to make this evolution in two steps so that we have a simple
rollback to get back to a working state. We'll be maintaining both packages
and the new templates and stacks endpoints for a while as users start to
move onto a newer CLI version. Sunsetting by end of July.

references: #18580
2020-06-29 09:45:58 -07:00
Johnny Steenbergen 2f2140e7a7 feat(influx): extend stacks update cmd with ability to add resources
closes: #18646
2020-06-29 07:03:52 -07:00
Jonathan A. Sternberg 5aeca082c8
chore: update staticcheck and fix newly identified lint checks (#18737) 2020-06-26 18:54:09 -05:00
Johnny Steenbergen fdcf8000f6 feat(pkger): extend stacks with ability to add resources without applying
references: #18646
2020-06-26 14:47:52 -07:00
Johnny Steenbergen 0f7ab73199 chore(pkger): drop behavior to update stack when exporting 2020-06-26 14:47:52 -07:00
Jonathan A. Sternberg 58bd5b9854
fix(storage/flux): the count aggregate will fill in zero values instead of null (#18735) 2020-06-26 15:43:03 -05:00
Alirie Gray b35479640a
refactor: move checks service to new package (#18671) 2020-06-26 12:52:15 -07:00
Johnny Steenbergen a6a5d0d43f fix(pkger): update handling of diff dashboard charts 2020-06-26 11:55:19 -07:00
Johnny Steenbergen 846b7d0207 feat(pkger): add ability to export stack with additional resources and update stack with associated exports
references: #18646
2020-06-25 21:25:30 -07:00
Lyon Hill 8522e19b6e
feat: add a embedded handler for label service api (#18745)
We will now be able to embed the label mappings apis into other services
2020-06-25 17:10:06 -06:00
jlapacik 7039d87a4f test: launcher tests for window first 2020-06-25 14:37:07 -07:00
David McKay 67fad644f2 fix: remove redundant break statements 2020-06-25 18:17:24 +01:00
David McKay 79431d1c46 feat: allow restricting TLS version and ciphers 2020-06-25 18:17:24 +01:00
David McKay e97a0eb027 chore: fix tests 2020-06-25 18:16:57 +01:00
David McKay b3c738fc53 fix: have tests use non-default value and support pkger 2020-06-25 18:16:57 +01:00
Johnny Steenbergen cb8fe33da8 chore(pkger): drop reference to pkg in PkgImpactSummary type 2020-06-25 09:47:33 -07:00
Johnny Steenbergen f554563cea chore(pkger): refactor independent stack export functionality out of existence
the Export behavior (renamed from CreatePkg) now provides for stackID as
another input. With this we are able to remove the additional endpoint
/api/v2/packages/stacks/:stack_id/export. It now fits into the
/api/v2/packages/export endpoint as another req body parameter. This also
makes all export functionality in teh same space, encapsulated both in the
endpoint and within the service layer :-).

references: #18646
2020-06-25 09:47:33 -07:00
Johnny Steenbergen 6694c7e393 chore(pkger): refactor export by stack to reuse CreatePkg functionality
this also makes it so that an association (label) that is added to a
resource is also included in the returned output. There is 1 test that
was changed as part of this work. It is to test for this specific change
in behavior

references: #18646
2020-06-24 12:03:20 -07:00
Brett Buddin 1f422b9b94
fix(dbrp): Delete DBRP mappings when their target Bucket is deleted. (#18699) 2020-06-24 13:40:54 -04:00
Johnny Steenbergen d671185bdc fix(pkger): fixup updates for variables where updates from selected were skipped 2020-06-23 08:05:27 -07:00
Johnny Steenbergen 802afebf8c feat(pkger): add support for selected fields to variable
references: #18240
2020-06-22 17:05:18 -07:00
Alirie Gray 5d3b9e2001
refactor: move name lookup to auth http (#18643) 2020-06-22 16:14:48 -07:00
Johnny Steenbergen 2d4a12fdf6 chore(pkger): accomodate skipping resources that are part of an association 2020-06-22 14:24:33 -07:00
Johnny Steenbergen 81490d6604 feat(influx): fixup config file env var naming and add support for config directory 2020-06-18 17:09:46 -07:00
Johnny Steenbergen 84723e15d2 feat(influxd): refactor run command to use cli.Program to respect config file 2020-06-18 15:59:53 -07:00
Lyon Hill 3987d3692b
chore: Clean out old session store feature flag (#18596) 2020-06-18 12:18:34 -06:00
Johnny Steenbergen ec8c252dbb feat(pkger): extend public apply API with new action to skip resources by kind
closes: #18490
2020-06-18 08:03:34 -07:00
Johnny Steenbergen d1f9807624
fix(pkger): fix flaky test caused by merge race condition (#18594)
one PR got merged, then the other without rebase/rerunning tests. That
is what resulted in this broken test.
2020-06-18 16:10:27 +03:00
Johnny Steenbergen a179d6d473 fix(pkger): delete newly created stack when applying a template that encounters err 2020-06-17 17:57:23 -07:00
Johnny Steenbergen a4e4be7787 feat(pkger): add ability to skip a resource within a template
references: #18490
2020-06-17 17:22:56 -07:00
Johnny Steenbergen 7e8ab162e7 feat(pkger): extend stacks with update functionality
references: #18548
2020-06-17 09:47:33 -07:00
Adrian Thurston 5d1a759170
feat: annotate context with feature flags when handling flux queries (#18506)
Annotate the context with feature flags when handling flux queries in influxdb.
Taking advantage of this in flux end-to-end tests. Using a custom flagger that
can set overrides based on the test case that is about to be run, allowing us
to enable features in the end-to-end tests.
2020-06-17 16:55:29 +03:00
jlapacik a19604c0ea refactor: windowed read operation should include aggregate name 2020-06-16 18:05:21 -07:00
Lyon Hill 009b8ec98f
feat: start using the new org handler from the tenant service. (#18371)
* feat: start using the new org handler from the tenant service.

The rest of the tenant system is in place except the org http api handler and the
user api handler.

* fix: update the label service in org handler and add links
2020-06-16 12:56:31 -06:00
Johnny Steenbergen b977568390 feat(pkger): extend pkger to provide sources of templates to each template 2020-06-16 08:04:37 -07:00
jlapacik 7f1caec697
feat: limit cursors (#18467)
* feat(storage): first array cursor

* feat: add first and last to rpc messages

* test(launcher): push down group first and group last

* feat(storage): window first array cursor

* test(launcher): push down bare first and bare last

* feat(storage): add capabilities for group first and group last

* refactor: rename first to limit

* refactor: make zero value for every period meaningful

* refactor: standardize launcher pushdown tests
2020-06-15 12:21:35 -07:00
Christopher M. Wolff 8fa5d3f591
feat(query): add test and feature flag for pushing down sum (#18484) 2020-06-12 13:28:03 -07:00
Jonathan A. Sternberg db686349e7
feat(storage/flux): support full aggregate window push down (#18399)
This enables a new rule that will push down the full `aggregateWindow`
query including the `duplicate` and `window(every: inf)` that recombines
the tables. When the full rule is used, the table is not split into
tables for each window and instead retains itself as a single table. The
start or stop column is renamed to `_time` and `_start` and `_stop` will
be the boundaries of the query.
2020-06-10 13:21:41 -05:00
Faith Chikwekwe 1bf2ce1a32 feat(query): register bare aggregate 2020-06-09 14:24:41 -07:00
Jonathan A. Sternberg 36b0a90b2c
tests(launcher): add a launcher test for read window aggregate push down (#18412)
This adds a launcher test for the read window aggregate push down to
verify that it is done when a query is sent with the appropriate
pattern, the output is correct, and that the metric is incremented that
signals the push down happened.
2020-06-09 15:20:54 -05:00
Johnny Steenbergen be4f989961 fix(pkger): lazy init the pkger store
closes: #18383
2020-06-05 14:17:26 -07:00
Johnny Steenbergen bc9b69b96f fix(pkger): provide charts when export stack dashboards by stack 2020-06-04 15:16:15 -07:00
Johnny Steenbergen a6ead1246e fix(pkger): provide correct stackID for recording pkg application
this bug surfaces when you do not provide a stack ID to the apply call.
the new stack is created, but the resources created are not associated
with it. This remedies that issue.
2020-06-04 13:47:52 -07:00
Johnny Steenbergen 4838a94eed feat(pkger): add export stack command to influx CLI
closes: #18271
2020-06-02 08:18:11 -07:00
Johnny Steenbergen 3dcd5d496f feat(pkger): add ability to export by stack
this ability exports all resources associated with a stack by the same
metadata.name fields as the original application had done it. This can
be used as a means to snapshot the current state of the stack. This can
be used for source control or other means.

closes: #18271
2020-06-02 08:18:11 -07:00
Alirie Gray 03ba8f250a
refactor: remove urms from new label service (#18301) 2020-06-01 09:28:03 -07:00
Johnny Steenbergen 53794bfae5 feat(pkger): make all pkg applications stateful
if no stack is provided then one will be provided for you.

closes: #17997
2020-05-28 16:59:21 -07:00
Johnny Steenbergen b25b4021c3 chore(pkger): refactor return values for Apply/DryRun to enable extending it
references: #17997
2020-05-28 15:34:15 -07:00
Alirie Gray 876238d688
feat: add feature flag for new labels service (#18215) 2020-05-28 08:26:08 -07:00
jlapacik d22380dc8b
Merge pull request #17900 from influxdata/feat/use-algo-w
chore: promote algorithm W to master
2020-05-27 10:20:03 -07:00
Lyon Hill 97dc4d18db
feat: use the new tenant user handler (#18190)
Switch to use the new user handler. We have been using the tenant backend for some
time now and just need to switch over to using tenant front to back.
2020-05-27 08:48:27 -06:00
jlapacik 7db9f4c520 Merge branch 'master' into chore/merge-master 2020-05-26 10:03:42 -07:00
Alirie Gray 7f4ddabe8a
refactor: add new label package (#18078) 2020-05-21 11:30:19 -07:00
Jonathan A. Sternberg 0c8d19e896
Merge branch 'master' into feat/use-algo-w 2020-05-18 13:25:26 -05:00
Lyon Hill c459852f8f
feat: integrate the new session system behind a feature flag (#18042) 2020-05-18 11:50:22 -06:00
Gianluca Arbezzano 1cf64fd721
feat: dbrp service
Signed-off-by: Lorenzo Affetti <lorenzo.affetti@gmail.com>
Co-Authored-By: Gianluca Arbezzano <gianarb92@gmail.com>
Co-Authored-By: George MacRorie <gmacrorie@influxdata.com>
Co-Authored-By: Alirie Gray <alirie.gray@gmail.com>
2020-05-15 12:05:38 +02:00
jlapacik 34e581ca0a Merge branch 'master' into chore/merge-master 2020-05-12 11:18:25 -07:00
Alirie Gray 24cc1cabb8
feat: add feature flag for refactored authorization package (#17944) 2020-05-08 10:00:39 -07:00
Gavin Cabbage 4fd30f5f24
fix(kit/feature): lookup typed flag if base is passed to override (#18012)
* fix(kit/feature): lookup typed flag if base is passed to override

* chore(kit/feature): override base flag test
2020-05-08 09:50:04 -04:00
Brett Buddin 8d26d9807d
Merge pull request #17970 from influxdata/bb/feature-flag-proxy
feat(http): Allow specific API handlers to be proxied for the Algo-W rollout
2020-05-07 14:20:47 -04:00
jlapacik f3320c7b43 Merge branch 'master' into chore/update-flux 2020-05-07 10:44:34 -07:00
Johnny Steenbergen 37d44d882d chore(pkger): handle edge cases for telegraf configs that manifest from user interaction
closes: #17434
2020-05-06 16:49:50 -07:00
Johnny Steenbergen 3eb5af969a chore(pkger): handle edge cases for tasks that manifest from user interaction
references: #17434
2020-05-06 16:49:50 -07:00
Johnny Steenbergen 7be0d8289b chore(pkger): handle edge cases for rules that manifest from user interaction
references: #17434
2020-05-06 16:18:48 -07:00
Johnny Steenbergen 7f8aa4c40f chore(pkger): handle edge cases for endpoints that manifest from user interaction
references: #17434
2020-05-06 15:56:32 -07:00
Johnny Steenbergen b4b52570b4 chore(pkger): handle edge cases for labels that manifest from user interaction
references: #17434
2020-05-06 15:26:01 -07:00
Johnny Steenbergen d4aa3be8db chore(pkger): handle edge cases for dashboards that manifest from user interaction
references: #17434
2020-05-06 15:12:30 -07:00
Johnny Steenbergen 485cc3ea54 chore(pkger): handle edge cases for checks that manifest from user interaction
references: #17434
2020-05-06 14:57:04 -07:00
Johnny Steenbergen 24dd13bcc6 chore(pkger): handle edge cases for buckets that manifest from user interaction
references: #17434
2020-05-06 14:19:44 -07:00
Johnny Steenbergen f575ea8d41 chore(pkger): handle edge cases that can manifest from users in the platform and stateful pkg applications
references: #17434
2020-05-06 13:01:50 -07:00
jlapacik 4aec0dc48e Merge branch 'master' into chore/update-flux 2020-05-06 10:00:09 -07:00
Brett Buddin c5c4e71dbd
feat(http): Add ability to proxy specific API handlers for Algo-W rollout. 2020-05-06 12:30:05 -04:00
Gavin Cabbage 8af9b3c2d1
refactor(kit/feature): remove target logic; expose bykey (#17949)
* refactor(kit/feature): remove target logic; expose bykey

* refactor(kit/feature): un-variadic-ify bykey arg
2020-05-06 11:13:17 -04:00
Johnny Steenbergen 3fd731511a chore(pkger): make integration stack tests indpendent 2020-05-05 11:01:13 -07:00
Johnny Steenbergen 1d027cf4e0 feat(pkger): enforce metadata.name dns name compliance
this PR includes a lot of small changes to names in existing test pkgs.
the tests are updated to follow suit.

closes: #17940
2020-05-05 01:35:02 -05:00
Johnny Steenbergen 89e34365bb feat(pkger): add the ability to remove a stack and all its associated resources
closes: #17554
2020-05-05 01:35:02 -05:00
Johnny Steenbergen 784b222d4d feat(pkger): enforce metadata.name dns name compliance
this PR includes a lot of small changes to names in existing test pkgs.
the tests are updated to follow suit.

closes: #17940
2020-05-04 12:40:22 -07:00
Johnny Steenbergen 95ad3c6582 feat(pkger): add the ability to remove a stack and all its associated resources
closes: #17554
2020-05-01 16:18:13 -07:00
jlapacik 83b90c3575 Merge branch 'master' into chore/merge-master 2020-04-30 14:05:51 -07:00
Johnny Steenbergen c7e97f1625 feat(pkger): add service and http server integreations for stack lists
references: #17554
2020-04-30 13:24:15 -07:00
jlapacik 2ef9999907 Merge branch 'master' into chore/merge-master 2020-04-30 09:53:04 -07:00
Gavin Cabbage 95913534a0
feat(kit/feature): add feature flag package (#17851)
* feat(kit/feature): add feature flag package

* refactor(kit/feature/_codegen): simplify with fmt.Errorf

* chore(kit/feature): tidy comments
2020-04-30 11:29:43 -04:00
Johnny Steenbergen ff27edbea9 feat(pkger): add support for using URLs associated with stack to apply/dry run 2020-04-29 16:48:00 -07:00
Lyon Hill d720661e77
feat(tenant): change the tenant services default behavior to enabled (#17872)
We have reached the stage wehre the new tenant service is being used and
is stable but we want to get it in more hands and used as the default service.
2020-04-29 14:04:26 -06:00
jlapacik 457637ed22 Merge branch 'master' into chore/merge-master 2020-04-28 13:13:36 -07:00
Johnny Steenbergen 72906a4484 feat(pkger): add support for stateful label mappings
references: #17434
2020-04-24 17:05:55 -07:00
jlapacik 3079d2a8aa Merge branch 'master' into chore/merge-master-into-algo-w 2020-04-24 14:21:26 -07:00
Johnny Steenbergen 1ac383de66 fix(launcher): removed timed contexts for launcher pkger tests 2020-04-24 10:52:50 -07:00
Johnny Steenbergen 3acd860563 feat(pkger): add stateful management for notification rules
references: #17434
2020-04-23 11:47:32 -07:00
jlapacik 63fd3655be Merge branch 'master' into chore/merge-master-into-algo-w 2020-04-22 14:52:59 -07:00
George e150377f48
revert(tenant): integrate the tenant service as the default backend (#17805) (#17832)
This reverts commit 79e9de93cb.
2020-04-22 17:23:17 +01:00
Johnny Steenbergen 47e5facc81 feat(pkger): add stateful management for telegraf configs 2020-04-21 15:47:49 -07:00
Lyon Hill 79e9de93cb
feat(tenant): integrate the tenant service as the default backend (#17805) 2020-04-21 13:43:56 -06:00
Johnny Steenbergen 596d8fde45 feat(pkger): add stateful management for tasks
notes on this commit. This commit was grueling ;-(. The task API is not a friendly
API to consume. There are a lot of non obvious things going on and almost every
one of them tripped me up. Things of note:

* the http.TaskService does not satisfy the influxdb.TaskService,
  making it impossible to use as a dependency if tasks service gets
  split out
* the APIs for create and update do not share common types. For example:
  creating a task takes every field as a string, but in the update it is
  taken as a options.Duration type. A step further and you'll notice that
  create does not need an option to be provided, but the update does. Its
  jarring trying to understand the indirection here. I struggled mightily
  trying to make sense of it all with the indirection and differing types.
  Made for a very difficult task (no pun intended) when it should have been
  trivial. Opportunity here to fix these up and make this API more uniform
  and remove unneccesary complexity like the options type.
* Nested IDs that get marshaled, are no bueno when you want to marshal a task
  that does not have an ID in it, for either user/org/or self IDs. Its a challenge
  just to do that.
* Lots of logs in the kv.Task portion where we hit errors and log and others where
  we return. It isn't clear what is happening. The kv implementation is also very
  procedural, and I found myself bouncing around like a ping pong ball trying to
  make heads or tails of it.
* There is auth buried deep inside the kv.Task implementation that kept throwing me
  off b/c it kept throwing errors, instead of warns. I assume, not sure if I'm
  correct on this, but that the stuff being logged is determined inconsequential
  to the task working. I had lots of errors from the auth buried in there, and hadn't
  a clue what to make of it....

leaving these notes here as a look back at why working with tasks is so
difficult. This API can improve dramatically. I spent 5x the time trying
to figure out how to use the task API, in procedural calls, than I did
writing the business logic to consume it.... that's a scary realization ;-(

references: #17434
2020-04-21 09:14:20 -07:00
Johnny Steenbergen d1af15c399 chore: remove extranenous fields on http.Task type
also drops a skipped test that has been skipped for over a year. Tried
unskipping it, but now it fails for all sorts of reasons, without the
race flag enabled.
2020-04-20 15:34:58 -07:00
Johnny Steenbergen c483aec2d2 feat(pkger): add stateful management for dashboards 2020-04-20 14:04:45 -07:00
jlapacik 335968a552 Merge branch 'master' into chore/merge-master 2020-04-20 13:59:21 -07:00
Johnny Steenbergen 8251c362ee chore(pkger): refactor parser notification rule state out into stateful type
this PR also drops a bunc of dead code that was necessary for times of integration.

references: #17434
2020-04-17 14:02:29 -07:00
jlapacik 7541af8414 chore: merge master into algow 2020-04-15 14:42:03 -07:00
Johnny Steenbergen 94ae519cc6 chore(pkger): refactor parser notification endpoint state out into stateful type
references: #17434
2020-04-15 14:26:25 -07:00
Johnny Steenbergen c8a79f5653 chore(pkger): refactor parser variable state out into stateful type
references: #17434
2020-04-14 16:48:56 -07:00
Johnny Steenbergen 68183bb156 chore(pkger): refactor embedded types out of stateful types 2020-04-14 14:12:23 -07:00
Johnny Steenbergen c718b676ef chore(pkger): refactor pkger data model to separate parsed and stateful datum 2020-04-14 09:28:09 -07:00
Lorenzo Affetti 6967cc2d58
fix(launcher): se default memory limit for query to unlimited 2020-04-10 21:33:45 +02:00
Johnny Steenbergen dd432360cc feat(pkger): update notification rule with unique constraints 2020-04-08 10:36:21 -07:00
Alirie Gray 8975fd2365
refactor(tenant): move bucket and urm auth layers to tenant service (#17474)
Co-authored-by: Lyon Hill <lyondhill@gmail.com>
2020-04-07 11:13:27 -07:00
Lyon Hill 4421a39639
feat(tenant): Build out the onboarding system in tenant and integrate it into launcher (#17558)
We are adding in a setup/user route this is not in swagger at the moment but will be
added once we feel it is stable.
2020-04-06 15:58:15 -06:00
Johnny Steenbergen c245f3233b chore(pkger): add stack state management for notification endpoints 2020-04-06 14:56:56 -07:00
Johnny Steenbergen 1e19f38502 chore(pkger): add stack state management for variables 2020-04-06 10:22:55 -07:00
Jonathan A. Sternberg d3fa60991f
Merge branch 'master' into chore/merge-master 2020-04-06 12:17:47 -05:00
Jonathan A. Sternberg 0ae8bebd75
refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
Jonathan A. Sternberg 469c5849c4
Merge branch 'master' into feat/use-algo-w 2020-04-03 09:30:04 -05:00
Johnny Steenbergen 21d2bf5dc6 chore(pkger): add stack state management for checks 2020-04-02 16:32:20 -07:00
Johnny Steenbergen 762e9a422e feat(pkger): add stack state management for labels 2020-04-02 09:03:59 -07:00
Lorenzo Affetti 13fc4f335d
test(launcher): e2e test memory limits 2020-04-02 11:20:42 +02:00
Johnny Steenbergen 34c3b35ca3 feat(pkger): add stack state management for buckets 2020-04-01 13:09:14 -07:00
Brett Buddin 3d826d96cf
feat(influxd): flag to disable scheduling of tasks 2020-03-27 12:52:07 -04:00
Johnny Steenbergen 37646464b3 feat(pkger): add stack init cmd to influx cli
closes: #17235
2020-03-27 08:32:58 -07:00
Johnny Steenbergen 8c70dc9b23 feat(pkger): add create stack endpoint for http server 2020-03-26 12:37:43 -07:00
Johnny Steenbergen 7a24e450c1 feat(pkger): add auth for pkger stack CRUDing
adds new AuthAgent type that can be reused across service middleware.
2020-03-26 10:11:59 -07:00
Lorenzo Affetti 1e36e7b3ad
feat(tenant): add duplicate read service 2020-03-25 12:06:28 +01:00
Christopher M. Wolff 20c2439230
refactor(http): change *ast.Package to json.RawMessage in query requests (#17316) 2020-03-23 12:39:24 -07:00
Marc Delagrammatikas ea8e6d15d0 refactor: fixes typo in OnboardInitialUser method
Fixes typo introduced by 7b99c28a99
2020-03-20 10:48:20 -07:00
Johnny Steenbergen e116ecaf5e feat(pkger): add CRUD store implmentation 2020-03-20 10:15:02 -07:00
Johnny Steenbergen 2d1186a696 feat(pkger): add human readable random names to pkg resource metadata.name field one export 2020-03-20 08:18:04 -07:00
Johnny Steenbergen 8d546f4197 feat(pkger): extend tasks with ability to define and rename it
closes: #17233
2020-03-19 10:50:53 -07:00
Johnny Steenbergen 51b0b9f681 feat(pkger): extend notification rules with ability to define and rename it 2020-03-19 08:59:07 -07:00