Commit Graph

11526 Commits (5bde0b5be61500953611e89644bfacccdc9d2231)

Author SHA1 Message Date
Nathaniel Cook 5bde0b5be6 fix: Update query services to use Request type
Moves idpe.QueryService into platform/query.ProxyQueryService
Splits the Request into ProxyRequest and Request.

Changes query.QueryService and query.AsyncQueryService to use a Request
type. This means that the Compiler interface is consumed by the service
to abstract out transpilation vs Flux compilation vs raw spec.

The transpiler handler is removed.

There are separate http handlers and service implementations for each of
the three query services.

Query logging types are moved into platform.

The ResultIterator now expects Cancel to always be called.

The fluxd binary exposes the query endpoint specified in the swagger
file.
2018-08-08 15:31:35 -06:00
Lyon Hill 31015cb322
Merge pull request #590 from influxdata/task/now
refactor(task): set now on every execution
2018-08-08 13:10:27 -06:00
Lyon Hill e1ecceaca0 refactor(task): make setting now on every execution
By switching to passing a spec it allows us more control
2018-08-08 12:50:24 -06:00
Christopher M. Wolff cef8447115
Merge pull request #576 from influxdata/cwolff-table-format
Take into account ':<type>' when computing column header widths
2018-08-08 08:25:21 -07:00
Lyon Hill 3873ac0c65
Merge pull request #578 from influxdata/task/connect
feat(task): connect the api to tasks
2018-08-07 16:57:38 -06:00
Lyon Hill 212210eaec make necessary changes 2018-08-07 16:51:33 -06:00
Lyon Hill 02d1b6507b feat(task): connect the api to tasks
We need a coordination layer to facilitate the communication in the api to the task service.
The api was also not connected in main to the http service.
2018-08-07 15:53:17 -06:00
Mark Rushakoff 24ea772ee4 test(task): cache parsed options in test
This is to work around slow parsing (#484).

This change saves about 2 seconds on tests for task/backend and
task/backend/bolt. It saves around 45 seconds on enterprise tests.
2018-08-07 12:46:50 -07:00
Christopher Wolff d7f64171cb Take into account ':<type>' when computing column header widths 2018-08-07 11:12:38 -07:00
Lyon Hill a647f10c14
Merge pull request #560 from influxdata/task/enable
feat(task): allow tasks to be enabled and disabled.
2018-08-07 09:26:45 -06:00
Michael Desa f2c47e0889
Merge pull request #556 from influxdata/feature/sources
Add sources to platform
2018-08-07 11:18:36 -04:00
Michael Desa 91c35e7d41 review(bolt): update pr with review comments
dep(platform): run dep ensure
2018-08-07 11:08:51 -04:00
Andrew Watkins 1a9e1f26f0 Fix overzealous deletion 2018-08-07 10:50:42 -04:00
Michael Desa 640fb3e213 chore(testing): update test package to use correct source type 2018-08-07 10:50:41 -04:00
Andrew Watkins 6c09bc6815 Remove auth 2018-08-07 10:50:08 -04:00
Andrew Watkins b941ae6a54 chore(chronograf): Remove UserNavBlock from app
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa 707283b478 fix(http/influxdb): use dot as delimiter in dbrp 2018-08-07 10:45:14 -04:00
Michael Desa 95714f3b29 fix(platform): omit id from bucket if empty in JSON response 2018-08-07 10:45:14 -04:00
Michael Desa b421b5f522 fix(bolt): use source in oss influxdb bucket service
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa 0a4196b504 feat(http/influxdb): add http bucket service for oss influxdb
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa 840044f58c feat(http/influxdb): add influxdb client for oss sources
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa 6dbe11b318 feat(bolt): add bucket service to source on retrieval
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa 503be5b0ef feat(bolt): add zap logger to bolt client
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa 1b0ad7128b feat(http/influxdb): add stubbed out v1 influxdb bucket service
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:14 -04:00
Michael Desa af62beb75b feat(http): add get sources buckets route
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa ea25a1a72b feat(platform): add bucket service to source struct
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa 01bde22840 chore(platform): add .vscode to gitignore
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa 46e1f4c475 feat(cmd/idpd): use bolt source handler in idpd
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa 472154504c feat(http): allow for v2 paths in serve http
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa 40e504340f feat(bolt): add boltdb implementation of sources service
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa da7c3594bd feat(testing): add source service conformance tests
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa add2eafc86 feat(http): add source http handler for source crud
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Michael Desa 1d43597f8c platform: add source type and source service interface
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-07 10:45:13 -04:00
Lyon Hill 63b9adf86c feat(task): allow tasks to be enabled and disabled. 2018-08-06 15:24:34 -06:00
Jonathan A. Sternberg af6fe59902
Merge pull request #541 from influxdata/js-flux-readme
docs(query): modify the flux readme to turn it into a getting started instead
2018-08-06 14:04:57 -05:00
Jonathan A. Sternberg 418d486488 docs(query): modify the flux readme to turn it into a getting started instead
For details, the user can always look at the spec, but a good getting
started guide that works is needed.

At the moment, this does not use the influx command. It does include
instructions for how to get started with docker since that is easiest to
setup and use.
2018-08-06 13:48:27 -05:00
Adam Perlin 0e80e5774b
Flux drop and rename functions (#482)
* Add Flux Rename, Drop, and Keep functions.

* Add flux language tests for drop and rename; bugfixes around constructing drop/rename procedures

* Correct autcomplete error, remove debug statements

* Fix additional autocomplete error

* Add support for fn parameter to flux drop and rename functions

* Remove unneeded renameDropTransformation field

* WIP initial thoughts about merge/procedure rewrite logic

* Remove unnecessary external columnFn types

* Add additional query tests for drop/rename, add error when drop or rename refers to column that doesn't exist

* Change swapped test names

* Add keep function implementation

* Refactor rename/drop implementation to make use of helper methods

* Remove test skips forqueries that produce an expected error

* Make predicate return value logic clearer in drop implementation

* Add group key support to drop/rename/keep, update unit and query tests accordingly

* WIP refactor drop and rename to use new SchemaMutator interface

* Add unit tests for refactored drop, keep, and rename; bug fixes

* Update file structure for flux schema mutation functions

* Refactor mutation functions and interface

* Address final review drop/rename PR review comments

* Add builtin import to make sure builtins are initialized if test drop_rename_keep_test is run as standalone

* Small aesthetic change to schema_mutators.go
2018-08-06 11:19:55 -07:00
Mark Rushakoff 264a420f07 chore: move stray chronograf files to correct directory 2018-08-06 09:37:00 -07:00
Mark Rushakoff 4745f27bef fix(task/backend): return useful error when validating empty script
After we started parsing options inside of the task validation methods,
we accidentally shadowed the "missing script" error when the script was
empty. This restores the behavior of telling the user "missing script"
rather than a cryptic syntax error.
2018-08-03 17:13:15 -07:00
Lyon Hill ec9bf78a78
Merge pull request #540 from influxdata/refactor/task-meta
refactor(task): Move task meta into the backend
2018-08-03 16:08:16 -06:00
Lyon Hill 7f6d51f45d add in comments 2018-08-03 14:27:07 -06:00
Lyon Hill 80fe53f2b6 refactor(task): Move task meta into the backend
Task meta belongs with the rest of the task backend content.
2018-08-03 14:27:07 -06:00
Jade McGough 1896364c7c owner mapping -> user resource mapping 2018-08-02 11:07:03 -07:00
Mark Rushakoff faf5408a7b fix(http): increase errorHeaderMaxLength
The limit was introduced in 510325ea5c but
it didn't specify why 64 was chosen.

According to https://stackoverflow.com/a/6160643, we should be able to
assume at least 8kb of space for HTTP headers, so I'm assuming 256 bytes
should be sufficient to avoid truncating most error messages, without
being likely to hit the total HTTP header limit.

Fixes #530.
2018-08-01 16:04:36 -07:00
Lyon Hill 6280b2a5d1
Merge pull request #529 from influxdata/task/refactor-logwriter
feat(task): update the scheduler and logwriter interface
2018-08-01 16:15:09 -06:00
Lyon Hill 0661d05b1f update mock scheduler 2018-08-01 13:36:47 -06:00
Lyon Hill 3ba8784fed fix bad commit with merge issue 2018-08-01 13:36:47 -06:00
Lyon Hill 6bba50a2a1 minor cleanup 2018-08-01 13:32:54 -06:00
Lyon Hill 69761a98f7 feat(task): update the scheduler and logwriter interface
Preperatory change that should enable us to build more complex log writers.
2018-08-01 13:32:54 -06:00
Michael Desa e598ee45ed
Merge pull request #532 from influxdata/revert/ids
Revert #442
2018-08-01 15:21:12 -04:00