44fb090468
test(flux/e2e): export skip list
2019-05-13 19:14:52 +02:00
ae25f0c448
Merge remote-tracking branch 'origin/master' into flux-staging
2019-05-09 15:29:00 -04:00
dd56c23343
fix(query/influxql): update transpiler for moved/renamed code ( #13740 )
...
The `databases()` function was moved into the `influxdata/influxdb/v1`
package and so it wouldn't work anymore. The `percentile()` call was
changed to `quantile()` and the argument was changed to `q`. This also
updates `median()` to use `median()` since we now produce AST's and not
the spec so we can use the `median()` definition instead.
2019-05-09 11:22:32 -05:00
415f698491
Merge pull request #13830 from influxdata/fix/to_heterogeneous
...
Fix/to heterogeneous
2019-05-08 16:45:46 -04:00
397c33a0dc
fix(stdlib/influxdata): fix influxdb.to function to process heterogeneous tables
2019-05-08 09:37:43 -04:00
dc59629f69
fix(influxdb): better error message when range not pushed down
...
Fixes https://github.com/influxdata/flux/issues/1224 .
2019-05-07 09:59:58 -07:00
faab75968b
refactor(storage): remove Read method from Store interface
2019-05-03 11:02:20 -07:00
7333847e2a
refactor(influxdb): remove and/or transfer duplicated tests
2019-05-03 11:02:20 -07:00
0ce05e7ad6
refactor(influxdb): remove old FromProcedureSpec
2019-05-03 11:02:20 -07:00
33418aac2c
test(flux/e2e): skip flaky window_generate_empty test
2019-05-02 18:19:07 +02:00
e50508a349
feat(influxdb): enable group pushdown rule
...
Closes #13623 .
2019-05-01 10:35:10 -07:00
95aa194498
feat(storage): ReadGroup RPC definitions and storage reader
2019-05-01 10:35:10 -07:00
5f87134ca8
feat(query): physical group operation and pushdown rule
...
test(query): group pushdown rule
2019-05-01 10:35:10 -07:00
1a254a3293
feat(stdlib): enable the tag keys optimization for meta queries ( #13705 )
2019-04-30 21:32:47 -05:00
fb39ac39ce
fix(storage): Store.Read behavior changed to return unsorted series keys
...
Closes #13581
2019-04-26 10:38:59 -07:00
46d2d0012b
fix(storage): translate _measurement and _field to the proper strings ( #13662 )
...
The RPC call should translate `_measurement` and `_field` to their
proper shortened byte strings when requesting the tag values.
This also fixes the planner rewrites to return the root node even when
no rewrite happened as this is required by the planner.
2019-04-26 10:36:51 -07:00
e651b020b2
refactor(query): enable new planner rules and remove old rules
2019-04-25 11:16:11 -07:00
01bfcf822b
Merge point parse & explode ( #12377 )
...
Merge point parse & explode
2019-04-24 10:30:16 -06:00
272f340c30
Merge point parse & explode.
2019-04-24 10:12:15 -06:00
5e77bd1e28
feat(query): implement the read tag values rpc call in the query engine ( #13559 )
...
If a pattern is seen that matches the `v1.tagValues(...)` call, then it
will be replaced with a direct RPC call to read the tag values for the
selected tag key which should be better optimized than reading from the
storage engine tsm1 files.
2019-04-23 12:56:35 -05:00
bc17af2118
Merge pull request #13569 from influxdata/flux-staging
...
chore(dep): update Flux to v0.27.0
2019-04-22 18:34:39 -06:00
7a72c363f2
remove org from bucket
2019-04-22 18:39:05 -04:00
9d44ac3635
rename bucket organization to org
2019-04-22 18:39:01 -04:00
a49d1696dc
Merge branch 'master' into flux-staging
2019-04-22 14:25:33 -06:00
c9f94d4ee8
refactor(query): add parameters to query controller config ( #13554 )
...
Recently added to controller config:
ConcurrencyQuota
MemoryBytesQuotaPerQuery
QueueSize
2019-04-22 12:11:32 -07:00
e5657ca62b
feat(query): implement the read tag keys rpc call in the query engine ( #13513 )
...
If a pattern is seen that matches reading the tag keys, it will be
replaced with a direct RPC call to read the tag keys which should be
better optimized than reading from the storage engine tsm1 files.
2019-04-22 14:09:44 -05:00
c98c29c1d1
feat(query): add push down rule for filters to read range procedure ( #13512 )
...
The read range procedure that uses the new rpc endpoints will now accept
filters using the same rules as the previous physical from procedure
spec.
2019-04-18 18:18:41 -05:00
4c77e3598b
Merge branch 'master' into flux-staging
2019-04-18 11:01:22 -06:00
4c1cdd2095
fix(query): add panic stack to logs for query logging recovery
2019-04-18 10:57:43 -06:00
07f98e31e7
fix(query): fix misc tests with new master Flux
2019-04-18 10:51:35 -06:00
cd64ec8718
Fix typos in miscellaneous packages
2019-04-17 13:30:22 -07:00
8b918539db
Merge branch 'master' into flux-staging
2019-04-17 12:26:10 -06:00
d0517f288a
fix(query): return statistics even in encoder error case
...
The ProxyQueryServiceAsyncBridge was not returning statistics when there
was an encoder error. Because the encoder was just writing to an
io.Writer, it was possible that a remote disconnect could happen and
statistics could not be reported.
2019-04-16 09:51:13 -07:00
89bf535602
test(stdlib): skip flaky range test ( #13405 )
2019-04-15 10:08:50 -07:00
77f1b0da4b
fix(query): re-enable some from/to bucket tests ( #13334 )
2019-04-12 07:15:27 -07:00
29df88127f
refactor(query/preauthorizer): preauthorizer now uses a BucketsAccessed method that accepts AST ( #13302 )
2019-04-12 07:15:27 -07:00
20b492bb13
refactor(influxql): compile with planner options ( #13288 )
2019-04-12 07:15:27 -07:00
6c3f1a05b9
refactor(query): allow code to compile despite BucketsAccessed ( #13282 )
...
BucketsAccessed doesn't work currently with a private flux.Spec.
See this issue: https://github.com/influxdata/influxdb/issues/13278
This set of changes just allows code to compile until #13278 is fixed.
Note that preauthorization is not working in the meantime.
Fixes #13275 .
2019-04-12 07:15:27 -07:00
5e09aa178b
fix(query): make mock Query close its results channel ( #13242 )
2019-04-12 07:15:27 -07:00
16b9158b39
refactor(task): make tasks use new Query interface ( #13219 )
...
Fixes #12883 .
2019-04-12 07:15:27 -07:00
dec149d22d
refactor(query): update testing InfluxQL testing compiler to use new interface ( #13107 )
...
Fixes influxdata/flux#1099 .
2019-04-12 07:15:27 -07:00
f37e65f26c
fix(query): change logging bridge to be a service instead
...
It is no longer necessary for the query logging to be a bridge as the
stats are available for consumption from the ProxyQueryService.
This change changes the logging bridge to directly implement the proxy
query service instead of implementing a bridge.
2019-04-11 14:46:45 -06:00
f56c42794b
chore(tracing): Cleanup ( #13296 )
...
* chore(tracing): Cleanup
* broken test
* fix unused var
* fix test
2019-04-10 19:28:21 -07:00
be674622c6
Revert "fix(inmem): remove the old inmem implementation"
2019-04-09 14:24:40 -04:00
d0022dfd5c
Merge pull request #13039 from zhulongcheng/rm-inmem-impl
...
fix(inmem): remove the old inmem implementation
2019-04-09 13:06:50 -04:00
8078b915fd
refactor(storage): ReadFilter storage operation
2019-04-08 15:59:37 -07:00
cacd6a8223
fix(inmem): replace inmem.Service with kv.Service
2019-04-08 15:18:38 +08:00
72726cbe85
Merge branch 'master' into flux-staging
2019-04-01 10:59:43 -05:00
c4ae25ca39
Merge pull request #12812 from influxdata/test/memory-limits
...
test(launcher): test for query memory limits and launcher test helpers
2019-03-28 15:48:16 +01:00
f945b84642
refactor(stdlb): Change plan.PlanNode to plan.Node ( #12906 )
2019-03-27 14:19:04 -07:00
ca6f2ad0c6
Merge branch 'master' into flux-staging
2019-03-27 09:42:48 -06:00
90a48c74f6
test(launcher): test for query memory limits and launcher test helpers
2019-03-27 15:50:35 +01:00
a49bb73c04
chore: update Flux to v0.23.0
2019-03-26 18:04:18 +01:00
56e688beee
fix(query): add Check method to query service interfaces ( #12866 )
...
Fixes influxdata/idpe#2756 .
2019-03-25 20:05:44 -07:00
d18c6e5ffe
fix(query/stdlib/influxdb): return error on point explosion ( #12774 )
2019-03-20 15:45:31 +01:00
adbfddb0ef
Flux staging ( #12760 )
...
* deps: update flux-staging to master of both influxdb and flux (#12698 )
* test(stdlib): skip failing window test due to new trigger optimization (#12708 )
* chore: update Flux to v0.22.0
2019-03-19 22:19:24 -07:00
490499267b
fix(query): allow multiple calls to Release proxy bridge iterator
...
The asyncStatsResultIterator used inside QueryServiceProxyBridge assumed
that Release would only be called once. The godoc for ResultIterator
specifies that it is safe to call Release multiple times. Now, you can
do that without causing Release to block indefinitely.
2019-03-19 16:06:43 -07:00
9324d5c1a1
test(stdlib): skip failing window test due to new trigger optimization ( #12708 )
2019-03-19 09:16:47 -07:00
862f168967
deps: update flux-staging to master of both influxdb and flux ( #12698 )
2019-03-18 16:13:02 -05:00
124a2c6b6c
test(stdlib): fix mismatched planner node types ( #12695 )
2019-03-18 14:54:48 -05:00
0d045630c8
fix(query): release the query results before requesting statistics ( #12622 )
...
The statistics are only finalized after release is called. Defer a call
to release to ensure they are released, but explicitly release on
success to ensure that the statistics are finalized from all sources
before returning them.
2019-03-14 11:12:53 -05:00
e3ac5ffecf
feat(query/mock): create a mock object for the query interface ( #12628 )
2019-03-14 11:08:48 -05:00
dcc052b1c2
fix(query): fix same bucket name with different orgs
2019-03-08 20:37:05 -05:00
603a1f26e0
use tracing.StartSpanFromContext
2019-03-07 12:12:31 -07:00
ed4e3e130b
return n with error
2019-03-07 12:12:31 -07:00
9541e861a3
goimports -w -local github.com/influxdata/influxdb
2019-03-07 12:12:31 -07:00
92fa813c45
add spans to multiple services
2019-03-07 12:12:31 -07:00
e28ecdc0e9
refactor(query): make queryd present ProxyQueryService ( #12360 )
...
Fixes influxdata/idpe#2014 .
2019-03-07 07:32:13 -08:00
9549cc4d97
fix(storage/reads): track memory allocations when reading from storage ( #12404 )
2019-03-06 15:29:45 -06:00
b9c7ec439e
feat(influxd): Tracing refactor ( #12318 )
...
* feat(launcher): Tracing to log disabled by default
* remove traceLogger and use opentracing directly
* add Jaeger tracing
* go vet && go fmt
2019-03-04 11:48:11 -08:00
12d35f1a50
Revert "Merge point parse & explode."
...
This reverts commit 1004abc3e1
2019-03-02 06:23:04 -07:00
1004abc3e1
Merge point parse & explode.
2019-03-01 15:55:37 -07:00
70507670c3
feat(storage/reads): add scanned values and bytes metadata to the query ( #12156 )
...
This updates influxdb to use the new arbitrary metadata that can be
attached by a source and adds metadata entries for the cursor
statistics.
2019-02-25 14:44:18 -06:00
26e7f641b7
Merge branch 'master' into flux-staging
2019-02-25 13:00:28 -07:00
0d3d0d4d78
chore(influxdb): add context to storage.PointsWriter
2019-02-25 11:11:20 -05:00
cf81141689
fix(e2e-tests): make task use default bucket from user fixture ( #12139 )
...
* fix(e2e-tests): make task use default bucket from user fixture
* fix(query_test): update pre-auth test now that from is bucket aware
2019-02-25 12:38:04 +01:00
5369c189b0
Merge pull request #11894 from influxdata/fix/buckets-accessed
...
fix(query/stdlib/influxdb): make FromOpSpec a BucketAwareSpec
2019-02-25 09:16:55 +01:00
4c0262befe
test(stdlib/testing): added new test driver to run builtin tests ( #11916 )
2019-02-21 22:03:29 -05:00
0977a651df
fix(task): create authorization when using token to create task
2019-02-15 12:11:55 -08:00
b68043ae8c
fix(query/stdlib/influxdb): make FromOpSpec a BucketAwareSpec
2019-02-14 17:38:48 +01:00
f30820cb46
fix(query/influxql): normalize selectors when an interval is present ( #11760 )
...
The selector will be normalized to the start time interval when `GROUP
BY time(X)` is present in the query.
2019-02-11 10:51:59 -06:00
698de51e67
refactor(query): update to reflect changes to windows
2019-02-08 08:39:52 -08:00
3e8b0fe807
refactor(query): separate "from" into logical and physical procedures
...
Fixes influxdata/flux#270 .
2019-02-07 12:59:54 -08:00
204d919a92
refactor(query/influxql): use ast compile function from flux ( #11749 )
2019-02-07 10:02:23 -06:00
8b20b52f51
refactor(query/influxql): modify the transpiler interface to produce an AST ( #11662 )
...
This refactors everything to generate and use a flux AST when
transpiling an influxql query. This also updates the spectests so they
use flux instead of writing out the AST and compare the resulting
AST's.
2019-02-06 10:18:33 -06:00
c0ba465604
fix: multiple compatibility issues with flux@master
2019-02-05 17:46:54 +01:00
ce00375298
refactor(query/stlib): move from implementation from Flux
2019-02-05 17:46:46 +01:00
d4d8bdd3a0
refactor(query): update import path for CreateSourceFromDecoder
2019-01-22 14:36:31 -07:00
c4e71bf412
Use orgID when to function reports its write buckets. ( #11363 )
...
* Use orgID when to function reports its write buckets.
fixes #11231
2019-01-22 14:13:50 -07:00
10b7e087e7
fix(query): improve preauthorizer errors on unknown buckets
...
When trying to create a task that writes to an unknown bucket,
previously the error message would resemble:
could not find bucket {<nil> 0xc0000dfcc0 <nil> 0xc0000dfce0}: <not found> bucket not found
Now print something human-readable:
could not find write bucket with filter: [Bucket Name: b, Org Name: a]: <not found> bucket not found
2019-01-18 16:22:15 -08:00
c60031a6b7
fix(influxdb): change resource to resource type
2019-01-15 12:57:57 -05:00
d0603457b7
refactor(flux): make packages mirror Flux namespaces
2019-01-14 18:00:45 -07:00
622106caaa
Merge branch 'master' into flux-staging
2019-01-14 17:03:57 -07:00
f8f1c1e7b6
Merge pull request #10954 from influxdata/feature/update_task_options
...
feat(tasks): update task options from api
2019-01-11 14:58:10 -06:00
3a2231be98
Merge branch 'master' into flux-staging
2019-01-11 13:47:49 -07:00
1708a41fa7
refactor: update query functions for Flux builtins
2019-01-11 13:11:57 -07:00
a2674fa03d
feat(tasks): update task options from api
2019-01-11 11:55:46 -06:00
944de4157a
fix(influxdb): add org id to permissions
...
filter out resources that have mission IDs
fix(influxdb): simplify auth check in PermissionAllowed
review(platform): update as noted in review
fix(influxdb): ensure permission has valid org id
2019-01-11 12:23:28 -05:00
5266cba346
deps: updates for packages and imports ( #10962 )
2019-01-10 14:33:25 -08:00
a59e6b8d25
refactor: rename DoArrow to Do ( #2372 )
...
See influxdata/flux#783 for details.
2019-01-10 10:30:25 -07:00
Lorenzo Affetti
Adam
Jonathan A. Sternberg
Adam
jlapacik
Stuart Carnie
Nathaniel Cook
Ben Johnson
Kelvin Wang
Christopher M. Wolff
Todd Persen
Mark Rushakoff
Jacob Marble
kelwang
zhulongcheng
Jacob Marble
Michael Desa
Lyon Hill
Jorge Landivar