Commit Graph

34871 Commits (aee9f817d846d3538ede3e5f24d5946f72c3c095)

Author SHA1 Message Date
Jonathan A. Sternberg d0b1f5a80e
feat: update flux components to use flux/array instead of arrow/array (#21971)
This updates the flux integration to use the `flux/array` package rather
than directly using the `arrow/array` package.

Flux recently switched to wrapping the array types from arrow and
creating its own array package to be used for table columns instead of
directly referencing the arrow package. This allows us to keep a
consistent interface, but potentially change internal implementations
without changing downstream consumers. Most recently, the
`*array.String` type has some of its own optimizations for certain array
patterns.

This change updates the flux integration to use the new API.
2021-07-29 15:31:31 -05:00
William Baker 8e80798c33
fix: field metaqueries take fast path if predicate is only on `_measurement` (#21962)
* fix: field metaqueries take fast path if predicate is only on `_measurement`

* chore: update CHANGELOG

* test: add test for fields with measurement predicate
2021-07-29 13:57:06 -06:00
Dane Strandboge 52ccb238af
chore: deletetsm command tests (#21949) 2021-07-29 13:32:06 -05:00
William Baker 4db7978b32
feat(telemetry): Do not record telemetry data for invalid requests; replace invalid static asset paths with a slug (#21958)
* feat: record telemetry data only on successful response codes

* feat: re-write request path in file handler

* fix: use a slug for the replacement path

* chore: update CHANGELOG

* fix: report for 5XX also

* fix: address review comments
2021-07-29 10:22:11 -06:00
Daniel Moran 5d84c602c8
build: upgrade staticcheck, fix new linter warnings (#21957) 2021-07-27 20:37:23 -04:00
William Baker 096a478ff6
fix: return 404 instead of links page on bad /api/v2 requests (#21950)
* fix: return 404 instead of links page on bad /api/v2 requests

* chore: update CHANGELOG
2021-07-27 11:35:29 -06:00
Daniel Moran 9d81f4a096
fix: prevent silently dropped writes with overlapping shards (#21946)
Co-authored-by: Geoffrey Wossum <gwossum@influxdata.com>
2021-07-27 12:15:08 -04:00
mcfarlm3 9f13f1c309
feat: port influxd inspect build-tsi (#21936)
* feat: port influxd inspect build-tsi

* refactor: changes based on code review, not including logging changes

* refactor: improved logging based on code review

* chore: updated CHANGELOG.md

Co-authored-by: Michelle McFarland <michellemcfarland@Michelles-MacBook-Pro.local>
2021-07-27 08:26:22 -07:00
Jamie Strandboge bf5965d22b
chore: upgrade to golang-jwt 3.2.1 to fix CVE-2020-26160 (#21925)
CVE-2020-26160[0] is an access restriction bypass under certain
circumstances when validating audience checks. The original
dgrijalva/jwt-go project is no longer maintained[1] and will not be
issuing a fix for this CVE[2]. Instead, they have transferred ownership
to golang-jwt/jwt[2][3][4].

The following was performed:

1. update chronograf and jsonweb to import golang-jwt/jwt
2. go mod edit -require github.com/golang-jwt/jwt@v3.2.1+incompatible
3. go mod edit -droprequire github.com/dgrijalva/jwt-go
4. go mod tidy
5. make
6. make test

References:
[0] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-26160
[1] dgrijalva/jwt-go#462
[2] dgrijalva/jwt-go#463
[3] https://github.com/dgrijalva/jwt-go/blob/master/README.md
[4] https://github.com/golang-jwt/jwt
2021-07-23 15:19:11 -05:00
Daniel Moran 8dc74f1132
build: update deb and rpm names to match 2.0.8 (#21940) 2021-07-23 15:01:25 -04:00
Greg f9914e8908
chore: add route to delete individual secret (#21938) 2021-07-23 12:44:41 -06:00
Daniel Moran eeeb886d65
build: recommend influx-cli in packaging, add section to README (#21875) 2021-07-23 12:05:02 -04:00
Cody Shepherd 035e11e3ca
chore: perftests should use API instead of influx cli (#21909) 2021-07-22 11:04:47 -07:00
pierwill d8611bfcd9
build: verify checksum of Go download in CI (#21911) 2021-07-22 11:47:59 -05:00
William Baker e7685fff01
feat: add `ui-disabled` flag to run server with UI disabled (#21910)
* feat: add `ui-disabled` flag to run server with UI disabled

* chore: update CHANGELOG
2021-07-21 19:52:57 -06:00
davidby-influx a78729b2ff
chore: add logging to compaction (#21707) (#21900)
Compaction logging will generate intermediate information on
volume of data written and output files created, as well as
improve some of the anti-entropy messages related to compaction.

Closes https://github.com/influxdata/influxdb/issues/21704

(cherry picked from commit 73bdb2860e)

Closes https://github.com/influxdata/influxdb/issues/21706
2021-07-21 09:43:21 -07:00
mcfarlm3 3b86c32468
feat: port `influxd inspect dump-wal` (#21888)
* feat: porting influxd inspect dump-wal from 1.x

* refactor: adapted 1.x logic to cobra command syntax

* refactor: improved clarity of printed output and help documentation

* chore: ran make fmt

* chore: updated CHANGELOG.md

* refactor: made small changes suggested in code review
2021-07-21 09:15:37 -07:00
Daniel Moran 858be90139
fix: regenerate protos using gogo 1.3.2 (#21880)
* Regenerate protos using gogo 1.3.2
* Add protos to generate, add checkgenerate to CI
* Address proto warning
* Add generator tooling to Makefile
* Delete recursive Makefiles, simplify generation run by goreleaser
* Use env bash for fetch-ui-assets
* Add static-data to clean target
2021-07-20 15:11:46 -04:00
davidby-influx dd34f5fd9d
chore: add more logging
tsdb.Engine.IsIdle and tsdb.Engine.Digest now return a reason string for why the engine & shard are not idle.
Callers can then use this string for logging, if desired. The returned reason does not allocate memory, so the
caller may want to add the shard ID and path for more information in the log. This is intended to be used in
calls from the anti-entropy service in Enterprise.

(cherry picked from commit bf45841359)

fixes https://github.com/influxdata/influxdb/issues/21448

(cherry picked from commit c8da9bafbf)

closes https://github.com/influxdata/influxdb/issues/21894
2021-07-20 11:57:52 -07:00
Dane Strandboge 0136c7e63d
feat: port `influx inspect report-tsm` to 2.x (#21814) 2021-07-20 12:08:30 -05:00
Daniel Moran 4d76491746
chore: delete as many files from chronograf/ as we can to still build (#21893) 2021-07-20 12:33:22 -04:00
Cody Shepherd 7ea348db35
chore: enable query performance tests (#21892) 2021-07-20 09:05:06 -07:00
Daniel Moran abc337a07c
chore: delete more unused chronograf code (#21889) 2021-07-20 11:13:56 -04:00
William Baker 19047b95b7
fix: task scheduler test uses a fixed time (#21884)
* fix: task scheduler test uses a fixed time

* fix: use a string constant for time format
2021-07-20 08:35:06 -06:00
Daniel Moran 94738dbf34
chore: delete more unused chronograf code (#21881) 2021-07-19 16:48:37 -04:00
Faith Chikwekwe 9ff953c400
build(flux): update flux to v0.123.0 (#21879)
* build(flux): update flux to v0.123.0

* fix(cmd/influxd/launcher): modify selector aggregate tests to use create empty false

Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
2021-07-19 13:20:32 -07:00
mcfarlm3 5d8c0b4b17
feat: port `influxd inspect report-tsi` to 2.x (#21788)
* feat: port influxd inspect report-tsi

* chore: restored tsi1.IsIndexDir() functionality

* refactor: changed inspect report-tsi to work with 2.x file system structure

* chore: fixed output tab alignment

* chore: ran make fmt

* chore: ran make fmt on changed file after resolving merge conflicts

* refactor: made changes based on code review

* refactor: avoiding defer build-up in loop

* refactor: replaced path with filepath and added shardIdx closures

* chore: updated changelog

* refactor: handled shardIdx closures in error case

Co-authored-by: Michelle McFarland <michellemcfarland@Michelles-MacBook-Pro.local>
2021-07-19 08:37:28 -07:00
Cody Shepherd c8de72ddbc
fix: systemd unit should block on startup until http endpoint is ready (#21850)
* fix: systemd unit should block on startup until http endpoint is ready

* chore: update changelog
2021-07-16 08:13:26 -07:00
Dane Strandboge c62d4cdc24
refactor: move to `filepath.WalkDir` for slight performance gain in Go 1.16 (#21858) 2021-07-16 09:11:11 -05:00
Cody Shepherd 865a030420
chore: change commit and branch keys to fields instead of tags (#21824)
context: configuring unique data as tags causes series cardinality to
grow in an unbounded manner; data with unique values should be set
as fields
2021-07-15 10:19:59 -07:00
Christopher M. Wolff 9ecddda5ae
test: add acceptance tests and table tests for group|>first/last (#21853) 2021-07-15 09:53:51 -07:00
Christopher M. Wolff 66d9ee8751
test: add tests for group and count/sum (#21852) 2021-07-15 09:52:29 -07:00
Dane Strandboge 31780ba845
feat: create `influxd inspect verify-wal` command (#21828) 2021-07-15 11:38:20 -05:00
Daniel Moran fa1c352132
fix: don't assume bash when displaying interactive CLI prompts (#21839) 2021-07-14 18:12:56 -04:00
Daniel Moran ba8f91f1d9
fix: improve error message when onboarding requests are missing data (#21849) 2021-07-14 15:52:19 -04:00
Christopher M. Wolff b1aa943e1b
build(flux): update flux to v0.122.0 (#21846)
* build(flux): update flux to v0.122.0

* fix: update group|>last pushdown to choose last row with greatest time

Row order output by group() is not defined, but this change makes the
result consistent with Flux to allow acceptance tests to pass.
2021-07-14 12:03:29 -07:00
William Baker e7871130ed
fix: update cron package to obtain "1w" support (#21844)
* fix: update cron spackage to obtain "w" support

* chore: update CHANGELOG

* test: add a regression test for the 1w interval in the task scheduler
2021-07-14 12:11:19 -05:00
William Baker b5b36b2804
feat: migrations for annotations & notebooks resource types on operator token (#21840)
* feat: migration for operator token to include permissions for annotations and notebooks

* feat: run migrations for restored dbs

* chore: cleanup go.mod

* chore: better description comment for migration

* fix: fixed cursor return condition

* fix: hard code the list of old operator permissions

* feat: run migrations prior to swapping restored dbs

* fix: fix the sqlite migrator

* chore: update CHANGELOG
2021-07-14 09:23:25 -05:00
Cody Shepherd bffdb0f859
chore: perftests should use API now that `influx` cmd is gone (#21815) 2021-07-13 09:44:33 -07:00
Jonathan A. Sternberg 0fec03bbfa
refactor(query): rename the kind for experimental-to so that it is different from native flux (#21834)
The kind for experimental-to is in conflict with the one used by native
flux. In the past, native flux didn't use the kind and expected
implementations to register their own procedure spec with that value.

In the latest Flux, this isn't the case and it is using the kind for a
native implementation. As we have not implemented the requirements for
the native implementation, we are still replacing the procedure spec but
using a different name that's unique to our implementation.
2021-07-12 13:08:17 -05:00
William Baker ff31c9b8fa
docs: README for annotations, notebooks, and sqlite (#21832)
* docs: sqlite package docs

* docs: annotations and notebooks README

* chore: fix typos & corrections
2021-07-12 12:18:12 -05:00
Sam Arnold 962b9d7d02
fix: simplify file set, remove series file member (#21831) 2021-07-12 10:43:20 -04:00
Dane Strandboge 60de82e40a
chore: move to os/io over ioutil for `influx inspect` code (#21827) 2021-07-09 15:12:00 -05:00
William Baker 0cb0da2060
chore: modify/delete some chronograf refs (#21802)
* chore: modify/delete some chronograf refs

* chore: update CHANGELOG
2021-07-08 09:14:03 -05:00
Daniel Moran 06b403ca57
build: delete `influx` CLI code, remove it from build (#21797) 2021-07-07 09:29:20 -04:00
Adrian Thurston 733c7d1c7e
build(flux): update flux to v0.120.1 (#21799) 2021-07-06 14:07:29 -07:00
Daniel Moran ae9eb3e847
fix: error instead of panic for statement rewrite failure (#21800)
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-07-06 16:35:34 -04:00
William Baker ea5e6eabcb
feat: transfer static asset handling into own package (#21785)
* feat: transfer static asset handling into own package

* chore: added some tests

* fix: update swagger script per review

* fix: make into bash script
2021-07-06 12:54:01 -05:00
Dane Strandboge 6a99416ab2
feat: port `influxd inspect deletetsm` to 2.x (#21786) 2021-07-06 12:20:30 -05:00
Dane Strandboge ba31a0e260
feat: port `influx inspect dumptsi` subcommand (#21784) 2021-07-06 11:40:21 -05:00