07c9a7c921
fix(stdlib): unskip stateChanges end to end test
...
Closes https://github.com/influxdata/influxdb/issues/17064 .
2020-03-12 15:44:56 -07:00
400d710bc0
refactor(storage/reads): remove the storage dependency on libflux ( #17109 )
...
This removes the storage dependency on libflux by moving the interfaces
it implements to the `query` package so it can reference the definitions
rather than the package with the implementation and the registration
with the runtime. This breaks the dependency where a storage package
depends on a flux runtime package.
2020-03-06 19:59:16 -06:00
0d6e4e310b
Merge branch 'master' into feat/use-algo-w
2020-03-06 16:46:49 -06:00
3250fb1453
fix(stdlib): update flux dependency and unskip test
2020-03-05 08:24:51 -08:00
027d29dd30
chore: update to Flux version v0.63.0 ( #17083 )
2020-03-03 13:17:37 -08:00
a84df749cc
feat(stdlib): add influxdb source ( #17047 )
...
This updates the repl to support the new influxdb source and use it by
default in the repl. It will automatically set some default variables
for the influxdb source to make it easier to use the cli. In particular,
it will set the default organization, token, and the host. The
organization gets set to the one specified in the repl command and the
token gets filled in with the user installed one. The host defaults to
localhost but will change to whichever one was specified on the cli.
In addition, this will replace the http client with one that sets
insecure skip verify if the `--skip-verify` flag is used.
2020-03-02 20:08:19 -06:00
03cfdba832
fix(stdlib): unskip flux end to end tests
...
Closes https://github.com/influxdata/influxdb/issues/16812 .
2020-03-02 13:47:03 -08:00
0872af8553
refactor: update semantic builtin lookups to use runtime now ( #17066 )
2020-03-02 14:51:49 -06:00
935180e9bd
refactor: update flux for the runtime package ( #17002 )
2020-02-27 11:31:45 -06:00
2535d54087
chore: update to Flux v0.60.0 ( #16936 )
2020-02-19 15:02:21 -08:00
d6766962d1
test(query): skip tests that are not passing in feat/use-algo-w ( #16813 )
2020-02-11 15:02:26 -08:00
0f3aabc954
refactor(query): let influxdb build against algo-w branch ( #16673 )
2020-01-24 14:36:09 -08:00
74ba877cb9
feat: opentracing in query execution runtime
2020-01-08 11:16:13 -05:00
9194d89bbc
feat(query/stdlib): prevent a filter push down if the filter needs to keep empty tables ( #16295 )
...
The storage engine isn't capable of sending back empty tables when a
series is empty. Because of this, we disable the push down and let flux
do the filtering in the case where there is a filter and it is specified
to keep the empty tables.
2020-01-06 12:23:31 -06:00
ad841608ca
chore(http): refactor bucket|dashboard|label|umr|var http clients to use reusable HTTP client
...
this is a step towards providing a shared http client that manages pooling connections,
timeouts, and reducing GC for by not creating/GCing a client each req. Bring on the red!
2019-12-09 09:44:41 -08:00
d7ddcf5abc
feat(query): enable optimized pivot push down rule ( #16073 )
...
Use the optimized pivot when the influxdb source is being used.
2019-12-03 09:16:19 -06:00
51c92fd0ed
test(query): reskip flakey test
...
https://github.com/influxdata/influxdb/issues/15667
2019-10-30 14:22:59 -07:00
7aa1fccee0
test(query): unskip skipped PromQL transpiler end-to-end .flux tests
2019-10-30 10:40:03 -07:00
33c3f92329
fix(query/stdlib): fix rewritten pushable expressions when a logical expression is present ( #15557 )
...
When `exists` was used in conjunction with any other pushed down
expression, the `exists` was not rewritten properly because the rewrite
did not descend into logical expressions.
This is now fixed so those expressions will be rewritten correctly. This
affected the following form:
filter(fn: (r) => r._measurement == "cpu" and exists r.host)
It did not affect the following:
filter(fn: (r) => r._measurement == "cpu")
|> filter(fn: (r) => exists r.host)
2019-10-23 15:59:20 -07:00
f82e6b2626
chore(query/stdlib): skip flaky tests regarding storage meta queries ( #15451 )
2019-10-17 09:54:44 -07:00
74829b025c
refactor(query/stdlib): update flux end to end tests for package subtests ( #15392 )
2019-10-15 09:18:21 -05:00
26dbd9225c
feat(query/stdlib/experimental): add experimental.to() implementation to OSS
2019-09-20 14:31:58 -07:00
9532c9d170
fix(testing): skip unbounded e2e test
2019-09-19 17:51:45 +02:00
ab835c8e0e
refactor(dependencies): use new dependency injection framework ( #15174 )
...
refactor(dependencies): use new dependency injection framework
2019-09-19 17:01:17 +02:00
7102febafd
fix(testing): skip promql e2e tests
2019-09-13 18:49:00 +02:00
d56af6eb29
fix(query): Ensure tags are sorted before passing to PointsWriter
...
Writes directly to a PointsWriter require the tag key, value pairs
are sorted in lexicographically ascending order. This commit uses
new API from the `models` package to ensure this invariant is
maintained.
2019-09-11 16:37:57 -07:00
bea3a18330
fix(query/stdlib): use auth correctly in the v1.databases() call ( #14927 )
...
The `v1.databases()` call did not correctly filter buckets based on
auth. Fortunately, it did not cause any improper permissions such as
allowing a person to see buckets that they had no read access to.
The error instead was that if a user did not have read access to one of
the buckets that was returned, the entire command would fail rather than
filter out the bucket that didn't have permissions.
This changes it so that if the user doesn't gets an unauthorized error
when accessing a bucket, it will filter it from the list instead of
failing. It also changes it so the error message is marked as
`ENotFound` instead of as an internal error.
2019-09-05 10:35:23 -05:00
454003841a
build(flux): upgrade to Flux v0.42.0
...
Skips a test that requires special dependencies to pass.
2019-08-30 13:02:30 -06:00
fcfdd2b1ef
build(flux): update to latest flux master
2019-08-26 16:46:17 -06:00
f97929614c
test(query): roll back some changes to end_to_end_test.go
2019-08-26 16:46:17 -06:00
808ebb9590
fix(query): update usage of interpreter dependencies
2019-08-26 16:46:17 -06:00
6303e2dcc5
test(query): skip holt_winters_panic test
...
added executor dependencies where needed
2019-08-26 16:46:17 -06:00
4b339dd0cf
fix(query/to): make orgID default to the context org
...
This change makes it so that if an org or orgID are missing on calls to the `to` function
that the orgID is retrieved from the request context.
This is consistent with how `from` works.
2019-08-23 11:03:26 -06:00
6b54abb51e
test(query): skip holt_winters_panic test
2019-08-22 13:11:13 -06:00
19fe098888
chore(ci): update go-tools
2019-08-22 10:55:05 -05:00
7498c06d3f
test(query): skip check and http_endpoint Flux tests
2019-08-21 09:59:01 -06:00
6a0fa44093
fix(query): update code for changes to scoped compiler
2019-08-21 09:59:01 -06:00
1b8ab3c2f2
fix(query): remove http.to and update test cases that used it
2019-08-21 09:59:01 -06:00
c61646d0f4
feat(query/stdlib): add an experimental "to" function ( #14664 )
2019-08-21 09:59:01 -06:00
cd2bfb9b22
refactor(query/stdlib): update tests for new Flux test name conventions ( #14669 )
2019-08-21 09:59:01 -06:00
9d94b7500d
fix(flux): Fix hanging test by ensuring results are read
...
Closes #14574
2019-08-12 16:47:03 -07:00
ef238ae064
skipping failing e2e tests
2019-08-06 12:48:32 +02:00
b303d54584
perf(query): hoist bucket lookups so we do not look up per table
...
perf(query): hoist bucket lookups so we do not look up per table
2019-08-05 16:02:33 -05:00
24c1f21e4e
WIP
2019-08-05 13:16:51 -05:00
42bb664aaf
feat(query): add storage request duration metric ( #14534 )
...
influxdata/idpe#4126
2019-08-02 08:53:14 -07:00
e4c89cbe0c
feat(query/stdlib): push down exists operator to storage ( #14538 )
...
The `exists` operator now gets pushed down to storage correctly. If
`exists` is used on a tag, then it will be rewritten to `tag != ""`
which is how storage defines if a tag exists. If `not exists` is used,
then it will use `tag == ""` which is how you would query storage for
only if a tag doesn't exist.
The `tag == ""` and `tag != ""` are different. For `tag == ""`, the
predicate is impossible for the storage layer to return true with.
Ideally, we would just rewrite this to return nothing and we wouldn't
bother with even querying storage. Instead, we just do not rewrite this
predicate because it cannot be rewritten to make sense with storage. If
we see `tag != ""`, it is the only one that can be passed through as-is
because `tag != ""` returns the same values as `exists tag`. It will
return true for every non-null value.
2019-08-02 09:31:10 -05:00
e142f6ca7c
fix(query): add LookupName method to dependency interfaces (needed by flux to()) ( #14498 )
2019-08-01 10:10:43 -07:00
3855ad9f33
chore: update Flux to v0.37.2
2019-07-24 12:57:37 -07:00
63c0f40548
fix(query): use auth-wrapped org and bucket services for query
2019-07-19 20:02:53 -06:00
ee7ff84d8b
feat(query/stdlib): update influxdb sources to use flux error codes ( #14346 )
...
Update the influxdb sources to be annotated with flux error codes. This
will enable us to identify different response codes for these
operations.
2019-07-16 09:15:46 -05:00
92a4ee53cf
fix(query): skip tests
2019-07-12 11:15:58 -06:00
a0f585bd56
fix(query/stdlib): remove skip from the flux e2e tests ( #14253 )
...
The underlying bug that caused them to be flaky has been fixed.
2019-07-03 12:03:22 -05:00
3d9b9fe36f
chore(query): disable flaky end to end tests for flux ( #14231 )
2019-06-28 10:15:47 -05:00
d85ef69e19
Merge remote-tracking branch 'origin/master' into flux-staging
2019-06-19 13:38:49 -04:00
1d84bf6516
fix(stdlib/testing): skip flaky test regexp_replaceAllString
2019-06-18 16:25:59 -04:00
15f66d1b98
moved field declaration line
2019-06-18 08:51:34 -07:00
f45d616eaa
added test case
2019-06-18 08:51:34 -07:00
13b397bb3c
fix(stdlib): Fixed to() creating too many rows for multiple fields
...
If a table has multiple field values, to() no longer writes rows multiple times.
2019-06-18 08:51:34 -07:00
42c8ce3481
fix(query/stdlib): remove skips for tests that were flaky from table.Do ( #14048 )
2019-06-03 11:56:25 -05:00
2b1c1ec143
fix(storage/reads): fix the storage tables to work correctly with multiple transformations ( #14016 )
...
The storage table reader will now work correctly when there are multiple
outputs. The table interface now implements the new table and column
reader interfaces and works properly with `execute.CopyTable`. The
source uses `execute.CopyTable` to buffer the table in memory when there
are multiple output transformations.
2019-05-30 12:31:54 -05:00
c560e27e1d
chore(flux): update to Flux v0.31.1 ( #14015 )
2019-05-29 15:48:23 -05:00
ebdbc394fc
chore(flux): update to Flux v0.31.0 ( #14002 )
...
* refactor(storage/reads): update the table implementation for the interface change (#13994 )
* chore(flux): update to Flux v0.31.0
2019-05-28 17:24:26 -05:00
fa849d5c0b
chore(testing) skip flakey test
2019-05-28 10:49:16 -05:00
8ebd6c8315
chore(query): add missing skip tests from merge
2019-05-15 10:18:08 -06:00
44fb090468
test(flux/e2e): export skip list
2019-05-13 19:14:52 +02:00
415f698491
Merge pull request #13830 from influxdata/fix/to_heterogeneous
...
Fix/to heterogeneous
2019-05-08 16:45:46 -04:00
397c33a0dc
fix(stdlib/influxdata): fix influxdb.to function to process heterogeneous tables
2019-05-08 09:37:43 -04:00
dc59629f69
fix(influxdb): better error message when range not pushed down
...
Fixes https://github.com/influxdata/flux/issues/1224 .
2019-05-07 09:59:58 -07:00
faab75968b
refactor(storage): remove Read method from Store interface
2019-05-03 11:02:20 -07:00
7333847e2a
refactor(influxdb): remove and/or transfer duplicated tests
2019-05-03 11:02:20 -07:00
0ce05e7ad6
refactor(influxdb): remove old FromProcedureSpec
2019-05-03 11:02:20 -07:00
33418aac2c
test(flux/e2e): skip flaky window_generate_empty test
2019-05-02 18:19:07 +02:00
e50508a349
feat(influxdb): enable group pushdown rule
...
Closes #13623 .
2019-05-01 10:35:10 -07:00
95aa194498
feat(storage): ReadGroup RPC definitions and storage reader
2019-05-01 10:35:10 -07:00
5f87134ca8
feat(query): physical group operation and pushdown rule
...
test(query): group pushdown rule
2019-05-01 10:35:10 -07:00
1a254a3293
feat(stdlib): enable the tag keys optimization for meta queries ( #13705 )
2019-04-30 21:32:47 -05:00
fb39ac39ce
fix(storage): Store.Read behavior changed to return unsorted series keys
...
Closes #13581
2019-04-26 10:38:59 -07:00
46d2d0012b
fix(storage): translate _measurement and _field to the proper strings ( #13662 )
...
The RPC call should translate `_measurement` and `_field` to their
proper shortened byte strings when requesting the tag values.
This also fixes the planner rewrites to return the root node even when
no rewrite happened as this is required by the planner.
2019-04-26 10:36:51 -07:00
e651b020b2
refactor(query): enable new planner rules and remove old rules
2019-04-25 11:16:11 -07:00
01bfcf822b
Merge point parse & explode ( #12377 )
...
Merge point parse & explode
2019-04-24 10:30:16 -06:00
272f340c30
Merge point parse & explode.
2019-04-24 10:12:15 -06:00
5e77bd1e28
feat(query): implement the read tag values rpc call in the query engine ( #13559 )
...
If a pattern is seen that matches the `v1.tagValues(...)` call, then it
will be replaced with a direct RPC call to read the tag values for the
selected tag key which should be better optimized than reading from the
storage engine tsm1 files.
2019-04-23 12:56:35 -05:00
7a72c363f2
remove org from bucket
2019-04-22 18:39:05 -04:00
9d44ac3635
rename bucket organization to org
2019-04-22 18:39:01 -04:00
e5657ca62b
feat(query): implement the read tag keys rpc call in the query engine ( #13513 )
...
If a pattern is seen that matches reading the tag keys, it will be
replaced with a direct RPC call to read the tag keys which should be
better optimized than reading from the storage engine tsm1 files.
2019-04-22 14:09:44 -05:00
c98c29c1d1
feat(query): add push down rule for filters to read range procedure ( #13512 )
...
The read range procedure that uses the new rpc endpoints will now accept
filters using the same rules as the previous physical from procedure
spec.
2019-04-18 18:18:41 -05:00
8b918539db
Merge branch 'master' into flux-staging
2019-04-17 12:26:10 -06:00
89bf535602
test(stdlib): skip flaky range test ( #13405 )
2019-04-15 10:08:50 -07:00
77f1b0da4b
fix(query): re-enable some from/to bucket tests ( #13334 )
2019-04-12 07:15:27 -07:00
f56c42794b
chore(tracing): Cleanup ( #13296 )
...
* chore(tracing): Cleanup
* broken test
* fix unused var
* fix test
2019-04-10 19:28:21 -07:00
8078b915fd
refactor(storage): ReadFilter storage operation
2019-04-08 15:59:37 -07:00
72726cbe85
Merge branch 'master' into flux-staging
2019-04-01 10:59:43 -05:00
c4ae25ca39
Merge pull request #12812 from influxdata/test/memory-limits
...
test(launcher): test for query memory limits and launcher test helpers
2019-03-28 15:48:16 +01:00
f945b84642
refactor(stdlb): Change plan.PlanNode to plan.Node ( #12906 )
2019-03-27 14:19:04 -07:00
ca6f2ad0c6
Merge branch 'master' into flux-staging
2019-03-27 09:42:48 -06:00
90a48c74f6
test(launcher): test for query memory limits and launcher test helpers
2019-03-27 15:50:35 +01:00
a49bb73c04
chore: update Flux to v0.23.0
2019-03-26 18:04:18 +01:00
56e688beee
fix(query): add Check method to query service interfaces ( #12866 )
...
Fixes influxdata/idpe#2756 .
2019-03-25 20:05:44 -07:00
d18c6e5ffe
fix(query/stdlib/influxdb): return error on point explosion ( #12774 )
2019-03-20 15:45:31 +01:00
9324d5c1a1
test(stdlib): skip failing window test due to new trigger optimization ( #12708 )
2019-03-19 09:16:47 -07:00
862f168967
deps: update flux-staging to master of both influxdb and flux ( #12698 )
2019-03-18 16:13:02 -05:00
124a2c6b6c
test(stdlib): fix mismatched planner node types ( #12695 )
2019-03-18 14:54:48 -05:00
dcc052b1c2
fix(query): fix same bucket name with different orgs
2019-03-08 20:37:05 -05:00
9549cc4d97
fix(storage/reads): track memory allocations when reading from storage ( #12404 )
2019-03-06 15:29:45 -06:00
12d35f1a50
Revert "Merge point parse & explode."
...
This reverts commit 1004abc3e1
2019-03-02 06:23:04 -07:00
1004abc3e1
Merge point parse & explode.
2019-03-01 15:55:37 -07:00
70507670c3
feat(storage/reads): add scanned values and bytes metadata to the query ( #12156 )
...
This updates influxdb to use the new arbitrary metadata that can be
attached by a source and adds metadata entries for the cursor
statistics.
2019-02-25 14:44:18 -06:00
26e7f641b7
Merge branch 'master' into flux-staging
2019-02-25 13:00:28 -07:00
0d3d0d4d78
chore(influxdb): add context to storage.PointsWriter
2019-02-25 11:11:20 -05:00
4c0262befe
test(stdlib/testing): added new test driver to run builtin tests ( #11916 )
2019-02-21 22:03:29 -05:00
b68043ae8c
fix(query/stdlib/influxdb): make FromOpSpec a BucketAwareSpec
2019-02-14 17:38:48 +01:00
698de51e67
refactor(query): update to reflect changes to windows
2019-02-08 08:39:52 -08:00
3e8b0fe807
refactor(query): separate "from" into logical and physical procedures
...
Fixes influxdata/flux#270 .
2019-02-07 12:59:54 -08:00
c0ba465604
fix: multiple compatibility issues with flux@master
2019-02-05 17:46:54 +01:00
ce00375298
refactor(query/stlib): move from implementation from Flux
2019-02-05 17:46:46 +01:00
d4d8bdd3a0
refactor(query): update import path for CreateSourceFromDecoder
2019-01-22 14:36:31 -07:00
c4e71bf412
Use orgID when to function reports its write buckets. ( #11363 )
...
* Use orgID when to function reports its write buckets.
fixes #11231
2019-01-22 14:13:50 -07:00
d0603457b7
refactor(flux): make packages mirror Flux namespaces
2019-01-14 18:00:45 -07:00
jlapacik
Jonathan A. Sternberg
Christopher M. Wolff
Yiqun Zhang
Johnny Steenbergen
Lorenzo Affetti
Stuart Carnie
Nathaniel Cook
Adam
docmerlin (j. Emrys Landivar)
roshie548
Adam
Ben Johnson
Kelvin Wang
Jacob Marble
Michael Desa
Lyon Hill