Commit Graph

11680 Commits (a8018532b2a9d6a6be4a6bf69d29a32723c969ed)

Author SHA1 Message Date
Mark Rushakoff a5371de0d0 fix(task): undo accidental type rename 2018-08-14 14:34:20 -07:00
Jonathan A. Sternberg 079d8d3588
Merge pull request #635 from influxdata/js-controller-queueing-metric
fix(query/control): fix the queueing metric
2018-08-14 16:07:24 -05:00
Nathaniel Cook d483ac8f0f chore: Specify calendar intervals, windowing and time zone behavior
Durations are changed to be a 3 vector to form a linear basis of
seconds, days, and months.
Interval comprehensions are introduced to be able to define complex
calendar intervals.
Specification is added around time zones.

The window function is update to default to not returning incomplete
windows.
2018-08-14 15:07:03 -06:00
Jonathan A. Sternberg 27c59297bc fix(query/control): fix the queueing metric
We decremented all, but forgot to decrement queueing when it was set and
the query spec could not be validated.
2018-08-14 16:02:46 -05:00
Jonathan A. Sternberg 5666ff3a90
Merge pull request #634 from influxdata/js-controller-set-err-deadlock
fix(query/control): remove a deadlock
2018-08-14 15:59:17 -05:00
Jonathan A. Sternberg 9f829ae5bf fix(query/control): remove a deadlock
The call to `setErr` would grab a lock that `Pop` used, but `setErr`
requires the controller run loop to be executing for it to work. If we
reverse the order of these calls, it should be fine.
2018-08-14 15:49:15 -05:00
Jade McGough 70ccb78c5d chore(task): update run schema 2018-08-14 13:33:05 -07:00
Nathaniel Cook 6729921c6d Merged pull request #630 from influxdata/nc-fluxd-metrics-doc
update Flux metrics docs
2018-08-14 12:16:47 -06:00
Nathaniel Cook 7985d5dd58 update Flux metrics docs 2018-08-14 11:41:02 -06:00
Jonathan A. Sternberg a591f2f90b
Merge pull request #628 from influxdata/js-controller-metrics
fix(query/control): fix controller metrics
2018-08-14 12:31:43 -05:00
Jonathan A. Sternberg 46605ac6b3 fix(query/control): finish the parent span once
When the controller moves to one of the finished states, it will finish
the parent span so that can be recorded. It presently will do this
multiple times when transitioning between different finished states.
2018-08-14 11:45:25 -05:00
Jonathan A. Sternberg f6e5feacbe fix(query/control): finish the parent span if compiling or queueing fails
This normally happens within the finishing states, but when compiling or
queueing fails it never enters those finished states and is instead
discarded. We need to signal that the query itself has finished in the
metrics.
2018-08-14 11:29:34 -05:00
Adam 6329f28064
feat(query/execute): Add Grow() functions to the table builder interface (#549)
* Added GrowXX functions to allocator.go

* Added Grow functions to table builder interface
2018-08-13 20:43:44 -04:00
Jonathan A. Sternberg 3e7a04e887
Merge pull request #624 from influxdata/js-godoc-query-package
docs(query): add package docs for the packages in the query package
2018-08-13 16:07:16 -05:00
Jonathan A. Sternberg c38e68c4b1
Merge pull request #570 from influxdata/js-document-query-control-package
docs(query/control): document the query/control package
2018-08-13 15:56:22 -05:00
Jonathan A. Sternberg a563ab4f34 docs(query/control): document the query/control package
This documents the responsibilities of what the Controller does and is
expected to do. It describes some behaviors that aren't implemented, but
acts as a guide for what the Controller should do as we continue
developing the query engine and improving the internal mechanics.
2018-08-13 15:49:14 -05:00
jlapacik 1cae025928
Merge pull request #604 from influxdata/jl-new-duration-literals
new duration literals
2018-08-13 13:45:49 -07:00
jlapacik f1e5da8656 add day and week literals to Flux grammar 2018-08-13 13:40:43 -07:00
Jonathan A. Sternberg 73b4b1d0d8 docs(query): add package docs for the packages in the query package 2018-08-13 15:21:02 -05:00
jlapacik 80247016ec
Merge pull request #475 from influxdata/jl-new-join
new join implementation
2018-08-13 13:19:45 -07:00
jlapacik 27b2093116 new join implementation
This commit provides a new join implementation that can join
tables with different group keys. It also implements a strategy
for evicting stale data from the join operation's cache when
it can be determined that a table will no longer be joined.

Currently early table eviction from the buffers of the join occurs
when the left-most group key column of both input streams are equal
and that column is part of the join key.
2018-08-13 10:51:57 -07:00
Mark Rushakoff 0759cd28e6 feat(task): allow specifying when task scheduling should start
More specifically, introduce a `scheduleAfter` argument to
Store.CreateTask. The previous behavior was leaving a new task's meta
LatestComplete value set to zero, which meant that the first run of a
schedule would start from 1970. Now, it's set to time.Now unless
otherwise specified.

Updates #595.
2018-08-13 10:47:08 -07:00
Jorge Landivar 6a861f2648
Merge pull request #602 from influxdata/task_name_uniqueness
task name modification and uniqueness
2018-08-10 18:31:35 -05:00
docmerlin (j. Emrys Landivar) 5b52f75f7e task name modification and uniqueness 2018-08-10 18:24:41 -05:00
Stuart Carnie 782396a7a8
Merge pull request #606 from influxdata/sgc-influxdb-branch
Use platform branch on influxDB
2018-08-10 12:31:40 -07:00
Stuart Carnie 13beb5a2b2 Use platform branch on influxDB 2018-08-10 10:58:13 -07:00
Mark Rushakoff cbccbcecf5 chore: fix typo in filename 2018-08-10 08:22:47 -07:00
Michael Desa 7b10d5e844
Merge pull request #536 from influxdata/feature/query-v1-sources
Support flux page in platform
2018-08-10 10:24:25 -04:00
Iris Scholten 4f94b6ded8
Merge pull request #600 from influxdata/feat/json-query-requests
feat(http): support posting queries as a json body
2018-08-09 18:39:17 -07:00
Iris Scholten f1137b9b24 feat(http): support posting queries as a json body
Co-authored-by: Chris Goller <goller@gmail.com>
2018-08-09 17:08:25 -07:00
Mark Rushakoff 42ce671724 chore: only set one run_id field on runner logs
We were previously doing `r.logger = r.logger.With(...)`, which ended up
duplicating the provided field in the log output. Now ensure that we
only set the run_id once in a logger.
2018-08-09 13:43:00 -07:00
Michael Desa 5aad8ceb9e review(platform): update PR as suggested in review 2018-08-09 15:37:23 -04:00
Nathaniel Cook 846455a487 Merged pull request #505 from influxdata/nc-query-service
Update the vairous QueryService to be consistent
2018-08-08 15:53:29 -06:00
Nathaniel Cook e17518d57e chore: Add string method to dbrp mapper filter 2018-08-08 15:31:37 -06:00
Nathaniel Cook 6bf2820e81 update README 2018-08-08 15:31:37 -06:00
Nathaniel Cook 5bde0b5be6 fix: Update query services to use Request type
Moves idpe.QueryService into platform/query.ProxyQueryService
Splits the Request into ProxyRequest and Request.

Changes query.QueryService and query.AsyncQueryService to use a Request
type. This means that the Compiler interface is consumed by the service
to abstract out transpilation vs Flux compilation vs raw spec.

The transpiler handler is removed.

There are separate http handlers and service implementations for each of
the three query services.

Query logging types are moved into platform.

The ResultIterator now expects Cancel to always be called.

The fluxd binary exposes the query endpoint specified in the swagger
file.
2018-08-08 15:31:35 -06:00
Lyon Hill 31015cb322
Merge pull request #590 from influxdata/task/now
refactor(task): set now on every execution
2018-08-08 13:10:27 -06:00
Lyon Hill e1ecceaca0 refactor(task): make setting now on every execution
By switching to passing a spec it allows us more control
2018-08-08 12:50:24 -06:00
Michael Desa 64e9cff2be feat(platform): ensure that Source implements query interface 2018-08-08 13:51:15 -04:00
Andrew Watkins 5568298297 chore(chronograf): fix rebase onto master 2018-08-08 10:48:44 -07:00
Michael Desa 2af8a38777 fix(chronograf): connecting to a source no longer takes you to host page
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-08 09:38:27 -07:00
Michael Desa 30fc5282f6 feat(http): add status feed to platform links 2018-08-08 09:38:27 -07:00
Andrew Watkins 7e30baf3da Import updateScript 2018-08-08 09:38:27 -07:00
Michael Desa 3b400952d9 fix(http): get time series data properly 2018-08-08 09:37:37 -07:00
Andrew Watkins fcb930e19b Change #partition to #group 2018-08-08 09:37:37 -07:00
Michael Desa fc382defb8 add retention policy name to bucket 2018-08-08 09:37:37 -07:00
Michael Desa ffe645d6e2 feat(platform): support flux queries for 1x sources 2018-08-08 09:37:37 -07:00
Michael Desa abc20e5e05 feat(platform): add chronograf language server to platform binary
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-08 09:37:37 -07:00
Andrew Watkins b25a6d1d46 Get buckets using buckets link 2018-08-08 09:36:43 -07:00
Andrew Watkins 2d7f54de2a feature(chronograf): use sources instead of services for flux builder
Co-authored-by: Andrew Watkins <andrew.watkinz@gmail.com>
Co-authored-by: Michael Desa <mjdesa@gmail.com>
2018-08-08 09:36:43 -07:00