Commit Graph

14778 Commits (933a14e16f0232c5ec883644b7363a59da7bcd90)

Author SHA1 Message Date
Brandon Pfeifer 933a14e16f
chore: fix package permissions (1.10) (#24304)
* chore: replace "package builder" shell/docker implemention with python

* chore: remove unused packaging files
2023-06-26 12:23:31 -04:00
alespour 57fb6ef327
chore: upgrade to Go 1.19.10 (#24297) 2023-06-20 09:52:35 -05:00
Brandon Pfeifer 8f45c5b15c
chore: generate "influxdb.${CIRCLE_TAG}.digests" for each release (#24272) 2023-06-08 06:21:47 -04:00
davidby-influx fd0f0ce7cb
fix: prevent world-writable MANIFEST files (#24235) (#24238)
When a new MANIFEST file is created, set
its permissions to 644, not 666

closes https://github.com/influxdata/influxdb/issues/24233

(cherry picked from commit aad79e471f)
2023-05-23 17:06:33 -05:00
Brandon Pfeifer 8c654cee32
chore: use remote package signing (#24207) 2023-04-18 22:22:32 -04:00
Jamie Strandboge bed84f31ea
chore: upgrade to Go 1.19.8 (#24200) 2023-04-12 15:56:56 -05:00
Brandon Pfeifer 0531823cf1
chore: enable release workflow from pre-release tags (#23988) 2023-03-09 12:23:47 -05:00
Jeffrey Smith II fce0d1c863
chore: update to go 1.19 (#24119)
* chore: update to go 1.19.6

* chore: gofmt

* test: fix tests for sort order change

* chore: generate pb

* feat: upgrade flux to v0.188.0 (#23911)

* feat: upgrade flux to 0.171.0

Tests failing, safety commit

First step in https://github.com/influxdata/influxdb/issues/23815

* fix: remove "org" parameter" from writeOptSource

I attempted to implement the "orgOpt" argument in a similar fashion
to f6669f7512. However, it looks like Flux doesn't accept "org" as
a parameter to "load". It responds with:

Error calling function \"load\" @113:16-113:30: error calling function \"to\" @6:19-6:47: unused arguments [org]

This brings us from 194 passing to 570 passing.

* fix: temporarily disable broken flux tests

These tests expect rows to be stored in a certain order. However,
nothing is specifying the sort order. This has been fixed in a
later update to flux: (see 3d6f47ded).

Temporarily disable these tests until we include a fixed
version of the flux tests.

* chore: add tests from a492993012

This fixes "test-flux.sh" so it runs tests within the "flux/"
directory. This uncovered some other issues with the tests
located within "flux/". These also needed to be updated
to match the newer flux API.

* feat: upgrade flux to 0.172.0

This includes changes made in "cbbf4b27da". Since "test.go" in 2.x
diverged from 1.x, some modifications were required to make this
compatible.

* feat: upgrade flux to 0.173.0

* feat: upgrade flux to v0.174.0

* fix: Update the condition when reseting cursor (#23522)

Filters that contain `or` may change between cursor resets so we must remember to update the condition in the read cursor.

```flux
|> filter(fn: (r) => ((r["_field"] == "field1" and r["_value"]==true) or (r["_field"] == "field2" and r["_value"] == false)))
```

Closes https://github.com/influxdata/flux/issues/4804

* feat: upgrade flux to 0.174.1

* feat: upgrade flux to 0.175.0

* chore: remove end-to-end tests

These were removed in a492993 for 2.x. These tests prevent "go test ./..."
from completing. As stated in the original commit, these tests should now be
handled by the "fluxtest" harness.

* feat: upgrade flux to 0.176.0

Some tests needed to be disabled within the flux harness. This is a
result of enabling "Optimize Aggregate Window" in flux@05a1065f.
These tests are not present in 2.x. Therefore, I am unsure if
the breakage is resolved in a later commit.

* feat: upgrade flux to 0.177.0

* feat: upgrade flux to 0.178.0

* feat: upgrade flux to v0.179.0

This removes all invocations of "flux.RegisterOpSpec". According
to flux@e39096d5, "flux.RegisterOpSpec" does nothing in the
current version of flux and was removed.

* chore: update fluxtest skip list (#23633)

* chore: manually backport 785a465e9a

This removes the reference to "flux.Spec".

* build(flux): update flux to v0.181.0 (#23682)

* build(flux): update flux to v0.184.2

* chore: skip more Flux acceptance tests

There are issues for each skip detailed in test-flux.sh.

* feat: upgrade flux to v0.185.0

This adds "FluxTesting" to the "HTTPD" configuration. This option is
hidden and disabled by default. When "FluxTesting" is set, it
enables the default testing flags for "Flux".

These flags allow the "vectorized float tests" and tests requiring
the "removeRedundantSortNodes" and "labelPolymorphism" flag
enabled to work. These changes are based off of d8553c002e.

flux@3d6f47ded is included within this version of Flux. Therefore
we can now include the "group_*" tests.

* feat: upgrade flux to 0.186.0

* feat: upgrade flux to 0.187.0

* feat: upgrade flux to 0.188.0

* fix: re-run ./generate.sh with updated protoc

* fix: restrict cores to match CircleCI documentation

Co-authored-by: davidby-influx <dbyrne@influxdata.com>
Co-authored-by: Markus Westerlind <marwes91@gmail.com>
Co-authored-by: Sean Brickley <sean@wabr.io>
Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
Co-authored-by: Christopher M. Wolff <chris.wolff@influxdata.com>

---------

Co-authored-by: Brandon Pfeifer <bpfeifer@influxdata.com>
Co-authored-by: davidby-influx <dbyrne@influxdata.com>
Co-authored-by: Markus Westerlind <marwes91@gmail.com>
Co-authored-by: Sean Brickley <sean@wabr.io>
Co-authored-by: Jonathan A. Sternberg <jonathan@influxdata.com>
Co-authored-by: Christopher M. Wolff <chris.wolff@influxdata.com>
2023-03-03 10:05:05 -05:00
Jamie Strandboge 154f23b4a6
chore: update Go to 1.18.9 (#23969) 2022-12-07 15:32:46 -06:00
Vlasta Hajek 636fbb3f79
fix: :db/:rp -> :dbrp, fixed create bucket, update bucket (#23898)
Fix URL processing for V2 buckets API, add error checking.
2022-11-10 15:21:35 -08:00
Vlasta Hajek e6e0fd2d9c
fix: listBuckets properly returns wrapped response (#23879)
closes https://github.com/influxdata/influxdb/issues/23861
2022-11-09 09:05:21 -08:00
Ben Tasker a9bf1d54c1
fix: don't write skipped shard messages to the line protocol output destination (#23727)
This switches so that the message

    skipped missing file: /path/to/tsm.tsm

is written to stdErr instead of stdout (or the output file if `-out` has been provided)
2022-11-07 16:54:22 +00:00
davidby-influx 7e0fd2a97f
fix: log errors in continuous query statistics storage (#23822) (#23825)
Backport of https://github.com/influxdata/influxdb/pull/23822

(cherry picked from commit bfccddc7b6)
2022-10-19 08:52:29 -07:00
Jamie Strandboge 6d27dffda3
chore: upgrade to Go 1.18.7 (#23820) 2022-10-18 15:14:37 -05:00
Brandon Pfeifer 63cbda134f
chore: update to use scheduled pipeline (1.10) (#23809)
* chore: update to use scheduled pipeline

* chore: add documentation to scheduled pipelines
2022-10-18 12:22:16 -04:00
davidby-influx fa677d08c6
feat: add version number to debug/vars (#23795) (#23796)
closes https://github.com/influxdata/influxdb/issues/23793

(cherry picked from commit d862a82515)

closes https://github.com/influxdata/influxdb/issues/23794
2022-10-13 12:07:14 -07:00
davidby-influx 514f024b7d
fix: use copy when a rename spans volumes (#23785) (#23792)
When a file rename fails with EXDEV
(cross device or volume error), copy the
file and delete the original instead

Differs from master branch by overwriting
existing files instead of erring.

closes https://github.com/influxdata/influxdb/issues/22997

(cherry picked from commit 0913276ff0)

* fix: add tests for file rename across volumes (#23787)

Also move shared code from file_unix.go

(cherry picked from commit bc8d9ea9f3)

closes https://github.com/influxdata/influxdb/issues/23791
2022-10-13 11:56:35 -07:00
Brandon Pfeifer 6a4a7e13e4
chore: upgrade to Go 1.18.6 (#23746) 2022-09-26 10:10:43 -04:00
Brandon Pfeifer 817eca94de
chore: add protoc-gen script to releng (#23696) 2022-08-31 16:42:16 -04:00
Brandon Pfeifer f359c28d62
feat: enable static-pie builds (1.10) (#23640)
* feat: enable static pie builds

* fix: update cross-builder to fix 'rdynamic'
2022-08-19 12:34:38 -04:00
davidby-influx 4aa7cd88e8
feat: add type conflict checker to influx_inspect (#23616) (#23617)
adds two commands "check-schema" and
"merge-schema" to influx_inspect.
These test for field type conflicts
in all fields.idx beneath a directory
and merges the derived schemas if
"check-schema" has been run multiple
times on different directories

(cherry picked from commit 84c4f676b0)
2022-08-10 15:14:05 -07:00
Brandon Pfeifer 0efbb07642
chore: use 1.x signing key (#23609) 2022-08-10 13:37:35 -04:00
Brandon Pfeifer 39b4ee5fa0
feat: upgrade musl to 1.2.3 (#23601) 2022-08-02 12:09:20 -04:00
davidby-influx 02c1cad6a6
fix: generalize test for Windows (#23580) (#23581)
Also eliminate race condition in tests

(cherry picked from commit 7e37a7ad16)
(cherry picked from commit eb3cc88772)
2022-07-21 14:13:37 -07:00
davidby-influx 823f63d625
fix: restore in-memory Manifest on write error (#23552) (#23577)
Do not update the `FileSet` or `activeLogFile` field in the in-memory
Partition structure if the Manifest file is not correctly saved to
the disk.

closes https://github.com/influxdata/influxdb/issues/23553

(cherry picked from commit a8732dcf52)

closes https://github.com/influxdata/influxdb/issues/23555
2022-07-20 16:05:34 -07:00
davidby-influx 4db8ab54f6
fix: add paths to tsi log and index file errors (#23557) (#23576)
Add paths to various TSI errors on opening and unmarshaling files
to help poinpoint the corrupt files.

Closes https://github.com/influxdata/influxdb/issues/23556

(cherry picked from commit 25cea95beb)

closes https://github.com/influxdata/influxdb/issues/23559
2022-07-20 14:38:14 -07:00
davidby-influx 05a0b540dd
fix: create TSI MANIFEST files atomically (#23539) (#23575)
When a MANIFEST file is created in TSI, it
should be written to a temp file, then
atomically renamed, to avoid overwriting
the existing file only to fail on the
later write.

closes https://github.com/influxdata/influxdb/issues/23536

(cherry picked from commit 061cf55f2a)

closes https://github.com/influxdata/influxdb/issues/23537
2022-07-20 14:21:21 -07:00
davidby-influx cbfc7c12c3
fix: improve error messages opening index partitions (#23532) (#23573)
Where possible, add the file path path to any errors
on opening, reading, (un)marshaling, or validating
the various files comprising a partition

closes https://github.com/influxdata/influxdb/issues/23506

(cherry picked from commit a2dd708a26)

closes https://github.com/influxdata/influxdb/issues/23533
2022-07-20 13:58:27 -07:00
davidby-influx bf34bce6ea
fix: add reporttsi to the help text (#23566) (#23574)
reporttsi was not listed as a command in the influx_inspect help text.

(cherry picked from commit 5c22d6c729)

closes https://github.com/influxdata/influxdb/issues/23567
2022-07-20 13:51:21 -07:00
Brandon Pfeifer 3f4a4cad00
build: upgrade to Go 1.18.4 (#23570) 2022-07-20 12:18:53 -04:00
Brandon Pfeifer e3c9e3e7e4
chore: Publish Packages and CHANGELOG.md to S3 (1.10) (#23548)
* chore: split workflow into "release" and "snapshot"

* feat: sign release packages

* feat: publish changelog to S3

* feat: publish packages to S3
2022-07-14 15:18:02 -04:00
Brandon Pfeifer adbf24562d
feat: use new changelogger (#23509)
This also regenerates CHANGELOG_frozen.md (from version 1.8.0 - 1.9.7)
so that it is compatible with the new changelogger.
2022-07-01 12:37:55 -04:00
davidby-influx e8aa5a1625
chore: update flux to 0.170.1 (#23490)
Last version before new test framework
2022-06-23 13:18:51 -07:00
Geoffrey Wossum ee881ec558
fix: eliminate race condition on Monitor.globalTags (#23471)
close #23470

(cherry picked from commit dd356e0bcc)
2022-06-16 20:11:52 -05:00
davidby-influx 75ed51b9c3
fix: lost TSI reference / close TagValueSeriesIDIterator in error case (#23461) (#23463)
(cherry picked from commit 8bd4fc502d)

closes https://github.com/influxdata/influxdb/issues/23460

Co-authored-by: Dane Strandboge <dstrandboge@influxdata.com>
2022-06-16 11:58:10 -07:00
davidby-influx 07ee889eb3
fix: fully clean up partially opened TSI (#23430) (#23446)
When one partition in a TSI fails to open, all previously opened
partitions should be cleaned up, and remaining partitions
should not be opened

closes https://github.com/influxdata/influxdb/issues/23427

(cherry picked from commit d3db48e93d)

closes https://github.com/influxdata/influxdb/issues/23431
2022-06-13 12:51:34 -07:00
davidby-influx d0dd842149
fix: remember shards that fail Open(), avoid repeated attempts (#23437) (#23444)
If a shard cannot be opened, store its ID and last error.
Prevent future attempts to open during this invocation of
influxDB. This information is not persisted.

closes https://github.com/influxdata/influxdb/issues/23428
closes https://github.com/influxdata/influxdb/issues/23426

(cherry picked from commit 54ac7e54ed)

closes https://github.com/influxdata/influxdb/issues/23433
closes https://github.com/influxdata/influxdb/issues/23435
2022-06-13 12:51:19 -07:00
davidby-influx 5f1e5bf4d9
feat: log the log level regardless of log level (#23425) (#23445)
(cherry picked from commit febf7a927c)

Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2022-06-13 15:38:04 -04:00
davidby-influx ec38d1688c
feat: estimate Cloud2 cardinality on 1.X databases (#23351) (#23417)
feat: estimate Cloud2 cardinality on 1.X databases

To ease migrations to Cloud 2 installations from
1.X databases, estimate Cloud 2 cardinality for
a data node (or OSS system).

closes https://github.com/influxdata/influxdb/issues/23356

(cherry picked from commit ef90bc830f)

closes https://github.com/influxdata/influxdb/issues/23416
2022-06-10 10:40:05 -07:00
davidby-influx b22fe17061
fix: do not rename files on mmap failure (#23396) (#23421)
If NewTSMReader() fails because mmap fails, do not
rename the file, because the error is probably
caused by vm.max_map_count being too low

closes https://github.com/influxdata/influxdb/issues/23172

(cherry picked from commit ec412f793b)

closes https://github.com/influxdata/influxdb/issues/23413
2022-06-10 10:38:44 -07:00
davidby-influx 3635e1c1b1
fix: replace unprintable and invalid characters in errors (#23387) (#23418)
Replace unprintable and invalid characters with '?'
in logged errors.  Truncate consecutive runs of them to
only 3 repeats of '?'

closes https://github.com/influxdata/influxdb/issues/23386

(cherry picked from commit 0ae0bd6e2e)

closes https://github.com/influxdata/influxdb/issues/23390
2022-06-09 09:26:23 -07:00
Jamie Strandboge 37de66461f
chore: update gopkg.in/yaml.v3 to 3.0.1 (#23399) 2022-06-07 15:27:10 -05:00
Dane Strandboge c3b2e2328f
build: upgrade to Go 1.18.3 (#23412) 2022-06-07 13:22:47 -05:00
Brandon Pfeifer 98c8db57da
chore: upgrade flux to v0.167.0 in 1.10 (#23350)
* chore: backport 8334dd0a23 to 1.x

* chore: upgrade flux to v0.167.0

* chore: update flux to latest version (#23249)

* chore: update flux to latest version

* fix: backport "convert allocator to interface"

* fix: construct `span` during dependency injection
2022-05-17 16:27:38 -04:00
davidby-influx ed80cc6a1c
feat: log slow queries even without query logging (#23320) (#23338)
Log long-running queries if "log-queries-after" > 0,
even if general query logging is not enabled.

closes https://github.com/influxdata/influxdb/issues/23147

(cherry picked from commit 1c89102276)

closes https://github.com/influxdata/influxdb/issues/23337
2022-05-11 13:42:29 -07:00
J. Emrys Landivar aa53a85774
fix(flux): inject sane defaults dependency for flux (#23309) (#23314)
This is to prevent an error and also to remove the size limit for
queries.
/ # cat broke.flux 
import "types"

host="http://127.0.0.1:8086"
token="myuser:mypass"

from(bucket: "vehicle_communication/30days", host: host, token: token)
    |> range(start: -1h)
    |> filter(fn: (r) => types.isType(v: r["_value"], type: "int"))
    |> aggregateWindow(every: 1m, fn: mean)



/ # cat broke.flux | /influx -username influx_support -type flux -password <pass>
{"error":"failed to initialize execute state: Provider.ReaderFor called on an error dependency"}
2022-04-29 12:22:25 -05:00
Brandon Pfeifer 8f78c4bb02
chore: backport semantic PR and commit message checks (#23306)
* chore: use common semantic PR and commit message checks (#23300)

After this is merged, the old semantic checker can be disabled, and its config file removed from the repository.

* chore: remove previous semantic pull request config (#23305)

* chore: remove previous semantic pull request config

* chore: update pull request template, conventional commit version

Co-authored-by: Jacob Marble <jacobmarble@influxdata.com>
2022-04-27 11:09:06 -04:00
davidby-influx d01ea61465
feat: stub out bucket members, owners, and labels (#23294)
For the V2 buckets API, stub out the unsupportable endpoints.
2022-04-25 11:42:01 -07:00
davidby-influx ce40acb298
feat: partial /v2/api/buckets support: create, delete, list, retrieve, update (#23284)
Partially implements the /v2/api/buckets
POST for create a bucket
DELETE for deleting a bucket
GET for listing buckets
GET for retrieving one bucket
PATCH for modifying a bucket

See here for API details:
https://docs.influxdata.com/influxdb/cloud/api/#tag/Buckets
2022-04-21 16:36:19 -07:00
Geoffrey Wossum 160cf678d5
fix: MeasurementsCardinality should not be less than 0 (#23286)
Clamp the value of Store.MeasurementsCardinality so that it can not be less
than 0. This primarily shows up as a negative `numMeasurements` value in
/debug/vars under some circumstances.

refs #23285
2022-04-21 13:32:12 -05:00