Commit Graph

238 Commits (99cfbfe8cf8f1c857c888aa633cc656507955c8b)

Author SHA1 Message Date
Daniel Moran cc6accf106
chore: delete old-style DBRP mapping (#22339) 2021-08-30 18:27:11 -04:00
Jonathan A. Sternberg f94783e016
build(flux): update flux to master and change renamed structs (#22281) 2021-08-26 10:07:02 -05:00
William Baker 2339432132
chore: remove duplicate flux test (#22035)
* chore: remove duplicate flux test

* test: convert to a pushdown test
2021-08-04 08:38:43 -06:00
Jonathan A. Sternberg d0b1f5a80e
feat: update flux components to use flux/array instead of arrow/array (#21971)
This updates the flux integration to use the `flux/array` package rather
than directly using the `arrow/array` package.

Flux recently switched to wrapping the array types from arrow and
creating its own array package to be used for table columns instead of
directly referencing the arrow package. This allows us to keep a
consistent interface, but potentially change internal implementations
without changing downstream consumers. Most recently, the
`*array.String` type has some of its own optimizations for certain array
patterns.

This change updates the flux integration to use the new API.
2021-07-29 15:31:31 -05:00
William Baker 8e80798c33
fix: field metaqueries take fast path if predicate is only on `_measurement` (#21962)
* fix: field metaqueries take fast path if predicate is only on `_measurement`

* chore: update CHANGELOG

* test: add test for fields with measurement predicate
2021-07-29 13:57:06 -06:00
Daniel Moran 5d84c602c8
build: upgrade staticcheck, fix new linter warnings (#21957) 2021-07-27 20:37:23 -04:00
Christopher M. Wolff 9ecddda5ae
test: add acceptance tests and table tests for group|>first/last (#21853) 2021-07-15 09:53:51 -07:00
Christopher M. Wolff 66d9ee8751
test: add tests for group and count/sum (#21852) 2021-07-15 09:52:29 -07:00
Jonathan A. Sternberg 0fec03bbfa
refactor(query): rename the kind for experimental-to so that it is different from native flux (#21834)
The kind for experimental-to is in conflict with the one used by native
flux. In the past, native flux didn't use the kind and expected
implementations to register their own procedure spec with that value.

In the latest Flux, this isn't the case and it is using the kind for a
native implementation. As we have not implemented the requirements for
the native implementation, we are still replacing the procedure spec but
using a different name that's unique to our implementation.
2021-07-12 13:08:17 -05:00
Jonathan A. Sternberg ce48262c31
feat(storage/flux): support table.fill() within aggregate window pushdown (#21519) 2021-05-19 20:22:56 -05:00
Sam Arnold a40e2920b4
fix: flux to function name conflict (#21496) 2021-05-18 10:40:06 -04:00
Sam Arnold 8124973e0f
fix: disable MergeFiltersRule until it is more stable (#21356)
Add a test to make sure this stays fixed.
2021-05-03 14:25:44 -04:00
Faith Chikwekwe 7bde3413b3
feat(query): enable min/max pushdown (#20994)
* feat(query): enable min/max pushdown

* fix(query): fix the group last pushdown to use descending cursors

* test(storage): add read group test with no agg

Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
2021-04-20 12:56:43 -07:00
Paul Hummer aab53c3d2f
build(flux): update flux to v0.112.0 (#21150) 2021-04-06 12:19:19 -06:00
Sean Brickley f862f8cb1f
fix(storage): Detect need for descending cursor in WindowAggregate (#21140)
* fix(storage): Detect need for descending cursor in WindowAggregate

* chore: Format + comments

* chore: PR cosmetic feedback (#21141)

Co-authored-by: Phil Bracikowski <pbracikowski+git@influxdata.com>

* chore: rename testcase and fix comments

Co-authored-by: Phil Bracikowski <pbracikowski+git@influxdata.com>
2021-04-05 18:33:07 -04:00
Daniel Moran 00afd95cb7
refactor: automated move of errors and id from root to kit (#21101)
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-03-30 14:10:02 -04:00
Jonathan A. Sternberg 7b74bb41fc
fix(fluxtest): fix load storage to read/write the bucket correctly (#21058) 2021-03-26 15:58:04 -05:00
Paul Hummer a0dc56f6b2 build(flux): update flux to v0.107.0 2021-03-09 13:25:39 -07:00
Sean Brickley a0d962cc23 chore(flux): Upgrade Flux to v0.104.0 2021-02-02 16:35:33 -05:00
Jonathan A. Sternberg 719c8495f2
feat(fluxtest): add support for testing/expect planner rules (#20662) 2021-02-01 15:53:05 -06:00
Jonathan A. Sternberg 06020b2a49
feat(query/stdlib): promote schema and fill optimizations from feature flags (#20634) 2021-01-29 09:48:02 -06:00
Daniel Moran afdcb18655
refactor: simplify how we set the top-level influxd logger (#20374) 2020-12-21 11:15:08 -08:00
Daniel Moran 15b9531273
fix: correct various typos (#19987)
Co-authored-by: kumakichi <xyesan@gmail.com>
2020-11-11 13:54:21 -05:00
Adrian Thurston 30ad7281aa
refactor: replace builtin package with fluxinit/static (#3304) (#19909)
A static initialization is not desirable in the main binaries, as it forces all
paths of code to init, but it is still useful in tests. It allows static
intialization to be performed once for all tests and eliminates the need to
always add the FluxInit call. Added a fluxinit/static package that calls
fluxinit.FluxInit() to replace the builtin package. This hides the nature of
the initialization and makes it clear that it is mandatory initialization code
getting called.
2020-11-05 16:54:28 -08:00
Yiqun (Ethan) Zhang 17fcd2dce2
feat: make sure the query plan nodes have unique ids (#19879) 2020-11-02 11:15:39 -06:00
jl fbe85ef548 feat: enable window pushdowns 2020-10-30 18:09:38 -07:00
jl b9d3dbcc0f refactor: remove capabilities from planner tests 2020-10-30 18:09:38 -07:00
Christopher M. Wolff 5a60488729
fix: make tagKeys and tagValues work for edge cases involving _field (#19856) 2020-10-30 10:37:08 -07:00
Faith Chikwekwe 5e1cdda597 feat(storage): enable window agg mean pushdown 2020-10-27 12:53:54 -07:00
Paul Hummer 4da32637ed build(flux): update Flux to v0.89.0 2020-10-14 10:51:01 -06:00
Faith Chikwekwe 47ed97c3fa
Merge pull request #19683 from influxdata/test/unskip-agg-med
feat(query/stdlib): unskip agg window median test
2020-10-05 07:50:04 -07:00
Faith Chikwekwe a68fc740b7 feat(query/stdlib): unskip agg window median test 2020-10-02 13:45:24 -07:00
Adrian Thurston feb41819ec
fix: convert flux e2e test harness to two-pass (#19672)
It appears that the double write caused by using to() inside a separate
execution environment (experimental.chain) causes flux e2e tests to behave
unpredictably, when coupled with the 1.x storage engine. Removing the second
write by using two passes, one to write to the db, then another to run the
test, eliminates the flakiness. Verified by running e2e tests in parallel times
8 for 12 hours without any flakiness observed. Before the fix, the flakiness
would take approx 30 minutes on avgerage to exhibit.

This commit also removes universe/to_time from the skipped tests because it was
added when this flakiness was discovered.
2020-10-01 16:38:21 -07:00
Jonathan A. Sternberg bde1209349
fix(tsdb): exclude the stop time from the array cursor (#19622)
This is a backport of #14262 to the 1.x storage engine. The 1.x storage
engine is now the primary engine for open source so when we switched we
regressed to the old behavior.

This also fixes `go generate` for the tsm1 package by running `tmpl`
with `go run` instead of assuming the correct one is installed in the
path.
2020-09-28 12:04:30 -05:00
Stuart Carnie b17acf8b31 fix: Ensure temporary bucket and test data is removed after each test
This is required to keep the system resources low when running
the Flux end-to-end tests, which create a bucket for each test. A
bucket creates at least 17 files after the first write:

* 8 for the `_series` segment files
* 8 for the `index` log files
* 1 for the `wal`
2020-09-21 13:05:50 -07:00
Christopher M. Wolff e7cbbaa722
feat: upgrade Flux to v0.83.2 (#19569) 2020-09-16 17:59:15 -07:00
Brett Buddin b917d8d9b0
chore(influxdb): Placate the linter. 2020-08-27 15:46:32 -04:00
Stuart Carnie dee8977d2c
chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
Stuart Carnie 31f4b1a403
fix(flux): Fix broken tests merged from master 2020-08-26 09:44:45 -07:00
Stuart Carnie 39ab4a10c5
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	cmd/influxd/launcher/query_test.go
#	go.mod
#	go.sum
#	query/promql/internal/promqltests/go.mod
#	task/backend/executor/executor.go
#	task/backend/executor/support_test.go
2020-08-26 09:26:43 -07:00
Stuart Carnie 8ff350557f
fix(flux): Skip failing tests to facilitate merge to master
Closes #19442
2020-08-26 09:24:09 -07:00
Paul Hummer df41d42457 build(flux): update Flux to v0.82.2 2020-08-25 08:04:28 -06:00
Stuart Carnie 56e27b8893
Merge remote-tracking branch 'origin/master' into sgc/tsm1
# Conflicts:
#	go.mod
#	go.sum
#	query/promql/internal/promqltests/go.mod
2020-08-12 09:07:30 -07:00
George 2636e976b9
chore(query): use dbrp v2 service in flux influx.v1 dependencies (#19108)
* chore(query): use dbrp v2 service in flux influx.v1 dependencies

* chore: update transpiler to use dbrp mapping service v2
2020-08-12 11:08:25 +01:00
Paul Hummer 9d7330a1c1 build(flux): update Flux to v0.79.0 2020-08-11 10:27:12 -06:00
jlapacik 46c7345dae
feat: enable pushdowns for sum, count, min, and max by default (#19227) 2020-08-05 12:06:35 -07:00
Faith Chikwekwe d48dc690a6
feat(query/stdlib): add min and max to ReadGroup (#19158)
Enables the mix and max aggregates for the ReadGroupAggregte pushdown behind a feature flag.

Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
2020-08-05 09:40:26 -05:00
Stuart Carnie 0a644dceed
fix(storage): BufferedPointsWriter is for a single org / bucket only
Fixes experimental.to tests
2020-08-03 15:15:00 -07:00
Stuart Carnie f3501aa338
fix(stdlib): Fix unit tests and improved to implementation 2020-08-03 09:21:04 -07:00
Stuart Carnie 81e3a017de
fix(testing): Fix compilation errors 2020-08-03 09:21:04 -07:00