Commit Graph

35269 Commits (46ec649b9c2ed2ef7f5c33e8dd7301db44d3e6ee)

Author SHA1 Message Date
Jeffrey Smith II 6f50e70960
feat: replicate based on bucket name rather than id (#23638)
* feat: add the ability to replicate based on bucket name rather than bucket id.

- This adds compatibility with 1.x replication targets

* fix: improve error checking and add tests

* fix: add additional constraint to replications table

* fix: use OR not AND for constraint

* feat: delete invalid replications on downgrade

* fix: should be less than 2.4

* test: add test around down migration and cleanup migration code

* fix: use nil instead of platform.ID(1) for better consistency

* fix: fix tests

* fix: fix tests
2022-08-18 14:21:59 -04:00
Sean Brickley 48fb5ce6f9
chore: update fluxtest skip list (#23633) 2022-08-17 18:03:23 -04:00
Andrew Lee 187f991d54
fix: improve virtual DBRP default handling (#23626) 2022-08-16 14:02:31 -06:00
Brandon Pfeifer 90d45e8709
feat: enable static-pie builds (2.x) (#23630)
* chore: fix build commands for new cross-builder

* fix: use xcc to determine compiler

* fix: use correct compiler for darwin tests

* fix: update perftest to 22.04 image
2022-08-16 11:53:08 -04:00
Jonathan A. Sternberg c2c9d17d71
build(flux): update flux to v0.179.0 (#23627) 2022-08-16 09:37:28 -05:00
Andrew Lee afbbfaca87
fix: fix virtual DBRP FindMany, make virtual bucket default if not overridden (#23623)
* fix: fix find dbrps, make bucket default if not overridden

* fix: allow filtering of virtual DBRPs, filter in shard mapper

* fix: update tests to mock for virtual filter for shards and update server test
2022-08-12 11:16:37 -06:00
Christopher M. Wolff 78c969e510
build(flux): update flux to v0.178.0 (#23615) 2022-08-09 13:53:22 -07:00
Sean Brickley cd4f93b22d
build(flux): update flux to v0.177.1 (#23612) 2022-08-08 16:06:12 -04:00
Andrew Lee adeac8beea
feat: add virtual DBRP mappings based on bucket name (#23606)
* feat: add virtual DBRP mapping based on bucket name

* fix: improve error handling logic

* fix: update physical dbrp tests

* fix: update influxql tests with auto-mapped buckets

* fix: add virtual filtering and testing for virtual dbrps
2022-08-03 15:44:04 -06:00
Dane Strandboge f7b1905ed7
fix: do not delete replication on remote config delete (#23493) 2022-08-02 11:03:23 -05:00
Christopher M. Wolff 7e7d1dbf4a
build(flux): update flux to v0.177.0 (#23597) 2022-08-01 14:05:06 -07:00
Jeffrey Smith II 67ccbae8ff
feat: add the concept of an instance owner (#23497)
* feat: Add the instance owner concept

* feat: improve handling of instance resource type

* fix: remove relic of cloud/oss split

* feat: Add an instance id. This gets set during onboarding and can be used to uniquely identify that instance.

* chore: Revert "feat: Add an instance id. This gets set during onboarding and can be used to uniquely identify that instance."

This reverts commit 6a712df61e.

We decided to stick with the "singleton" 1 id for now, as there is not a clear need for unique identifiers.
2022-08-01 09:42:06 -04:00
Ikko Ashimine f0072ef230
chore(pkger): fix typo in README.md (#23542)
prexisting -> preexisting
2022-07-28 15:30:19 -04:00
Jonathan A. Sternberg c58bbabc98
build(flux): update flux to v0.176.0 (#23585) 2022-07-26 10:59:05 -05:00
Jonathan A. Sternberg a9f751f44a
feat(query): add planner rule for converting aggregate window to a push down (#23586) 2022-07-26 10:19:26 -05:00
davidby-influx 619eb1cae6
fix: restore in-memory Manifest on write error (#23552) (#23578)
Do not update the `FileSet` or `activeLogFile` field in the in-memory
Partition structure if the Manifest file is not correctly saved to
the disk.

closes https://github.com/influxdata/influxdb/issues/23553

(cherry picked from commit a8732dcf52)

closes https://github.com/influxdata/influxdb/issues/23554
2022-07-25 10:53:09 -07:00
Brandon Pfeifer 37562c7c00
build: upgrade to Go 1.18.4 (#23571) 2022-07-20 12:19:17 -04:00
davidby-influx f762346ecc
fix: add paths to tsi log and index file errors (#23557) (#23562)
Add paths to various TSI errors on opening and unmarshaling files
to help poinpoint the corrupt files.

Closes https://github.com/influxdata/influxdb/issues/23556

(cherry picked from commit 25cea95beb)

closes https://github.com/influxdata/influxdb/issues/23558
2022-07-19 15:45:42 -07:00
Brandon Pfeifer 85dc15851e
chore: upgrade CircleCI Mac OSX image (#23565) 2022-07-19 18:18:44 -04:00
Sam Dillard 91a83ba509
chore: Update PULL_REQUEST_TEMPLATE.md (#23270)
* chore: Update PULL_REQUEST_TEMPLATE.md

This is part of an initiative to disseminate PR-specific information for all PR stakeholders. In addition to reviewers, this information is needed by product and docs.

* chore: Update PULL_REQUEST_TEMPLATE.md

* chore: Apply suggestions from code review

Co-authored-by: Sam Arnold <sarnold@influxdata.com>

Co-authored-by: Jeffrey Smith II <jsmith@influxdata.com>
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2022-07-19 09:04:52 -04:00
davidby-influx 00edb77253
fix: create TSI MANIFEST files atomically (#23539) (#23546)
When a MANIFEST file is created in TSI, it
should be written to a temp file, then
atomically renamed, to avoid overwriting
the existing file only to fail on the
later write.

closes https://github.com/influxdata/influxdb/issues/23536

(cherry picked from commit 061cf55f2a)

closes https://github.com/influxdata/influxdb/issues/23538
2022-07-14 09:13:11 -07:00
davidby-influx 4789d5402a
fix: improve error messages opening index partitions (#23532) (#23535)
Where possible, add the file path path to any errors
on opening, reading, (un)marshaling, or validating
the various files comprising a partition

closes https://github.com/influxdata/influxdb/issues/23506

(cherry picked from commit a2dd708a26)

closes https://github.com/influxdata/influxdb/issues/23534
2022-07-13 13:20:47 -07:00
Simon Richardson 33a7add745
test(label): Invalid closure capture (#23353)
Whilst working on cloud labels, I noticed that the label storage test
isn't correctly capturing the testScenario. This is because t.Parallel()
is in use, so only the "delete" scenario will only ever be tested.

The following changes fix that, by capturing the testScenario in a local
variable so that the test function can use that correctly.

As a drive-by, I fixed the error referencing the wrong expectation.
2022-07-13 15:15:13 +01:00
Brandon Pfeifer 4b2949a67a
build: upload release and nightly CHANGELOG.md (#23527) 2022-07-12 20:58:35 -04:00
Sunil Kartikey 4da4d03fe2
build(flux): update flux to v0.174.1 (#23531) 2022-07-12 19:03:30 +01:00
Markus Westerlind 69a95dc2d6
fix: Update the condition when reseting cursor (#23522)
Filters that contain `or` may change between cursor resets so we must remember to update the condition in the read cursor.

```flux
|> filter(fn: (r) => ((r["_field"] == "field1" and r["_value"]==true) or (r["_field"] == "field2" and r["_value"] == false)))
```

Closes https://github.com/influxdata/flux/issues/4804
2022-07-08 18:50:42 +01:00
Sean Brickley 4d33c702e8
build(flux): update flux to v0.174.0 (#23518) 2022-07-05 18:46:53 -04:00
Nathaniel Cook 07bab31fe6
build(flux): update flux to v0.173.0 (#23505)
* build(flux): update flux to v0.173.0

* fix(fluxfmt): update tests for newline in Flux fmt

Flux fmt now explicitly adds a newline to the end of a file, updating
tests accordingly.
2022-06-30 11:39:07 -06:00
Brandon Pfeifer e7cf52298f
feat: implement nightly docker builds without goreleaser (#23498) 2022-06-27 17:23:11 -04:00
Guillaume Claret 3fcc085480
chore: Fix link in the README (#23488) 2022-06-27 12:45:01 -06:00
Jonathan A. Sternberg cbbf4b27da
build(flux): update flux to v0.172.0 (#23494)
* build(flux): update flux to v0.172.0

* refactor(fluxtest): updates the flux test executor to the new interface
2022-06-24 16:32:46 -05:00
Brandon Pfeifer 76cfddb63b
fix: emit zipfile for windows (#23487) 2022-06-23 10:33:03 -04:00
Brandon Pfeifer 85e4e6317e
build: fix release workflow (#23475)
* build: fix release workflow

* fix: allow for multi-digit minor/patch versions
2022-06-17 16:33:46 -04:00
Brandon Pfeifer 83bb8ed2fc
build: update frozen changelog (#23477) 2022-06-17 16:24:47 -04:00
Jeffrey Smith II bf5e6eb0d5
feat: Update Contributing.md to be more accurate for a clean checkout (#23465)
* feat: Update Contributing.md to be more accurate for a clean checkout

* chore: minor formatting
2022-06-17 15:07:42 -04:00
Sam Arnold 21885a7c33
fix: log the log level at startup (#23472) 2022-06-17 14:30:26 -04:00
Jeffrey Smith II 090f681737
feat: Add remotes and replications to telemetry (#23456)
* feat: start work on remotes/replications phone home data

* feat: add remotes/replications phone home data (no tests

* refactor: use erroring binary conversions

* style: gofmt

* refactor: improve some error handling

* style: cleanup

* feat: add tests

* refactor: just list remotes/replications rather than decrement

* chore: linting fix

Co-authored-by: DStrand1 <dstrandboge@influxdata.com>
2022-06-16 14:48:06 -04:00
Dane Strandboge 8bd4fc502d
fix: lost TSI reference / close TagValueSeriesIDIterator in error case (#23461) 2022-06-16 13:35:45 -05:00
Dane Strandboge 9e556864a3
fix: replications remote write failure can deadlock remote writer (#23458) 2022-06-16 11:57:24 -05:00
Jeffrey Smith II 692b0d5153
feat: add instance-id flag for identifying edge nodes (#23447)
* feat: add instance-id flag for identifying edge nodes

* refactor: rename tag to _instance_id
2022-06-16 12:18:11 -04:00
Christopher M. Wolff a492993012
build(flux): update flux to v0.171.0 (#23453)
* build(flux): update flux to v0.171.0

* chore: remove testing.loadStorage from tests

Also update skip lists in Flux test harness

* chore: remove now redundant Go end-to-end unit tests

This testing is all now provided by the `fluxtest` harness.
2022-06-14 15:09:59 -07:00
davidby-influx 53580ead1d
fix: remember shards that fail Open(), avoid repeated attempts (#23437) (#23455)
If a shard cannot be opened, store its ID and last error.
Prevent future attempts to open during this invocation of
influxDB. This information is not persisted.

closes https://github.com/influxdata/influxdb/issues/23428
closes https://github.com/influxdata/influxdb/issues/23426

(cherry picked from commit 54ac7e54ed)

closes https://github.com/influxdata/influxdb/issues/23434
closes https://github.com/influxdata/influxdb/issues/23436
2022-06-14 13:01:11 -07:00
Brandon Pfeifer 841be3ca10
build: remove goreleaser for build workflow (#23423) 2022-06-14 15:55:23 -04:00
Sam Arnold a8054f8497
test: add openapi spec validation to OSS grace tests (#23452) 2022-06-14 15:17:53 -04:00
davidby-influx a9df3f8a7c
fix: fully clean up partially opened TSI (#23430) (#23454)
When one partition in a TSI fails to open, all previously opened
partitions should be cleaned up, and remaining partitions
should not be opened

closes https://github.com/influxdata/influxdb/issues/23427

(cherry picked from commit d3db48e93d)

closes https://github.com/influxdata/influxdb/issues/23432
2022-06-14 11:49:16 -07:00
Jeffrey Smith II d705841a00
feat: error when creating v1 auth with a nonexistent bucket id (#23422)
* feat: error when creating v1 auth with a nonexistent bucket id

* fix: only check for buckets

* refactor: test cleanup for clarity
2022-06-13 15:52:28 -04:00
Jeffrey Smith II a10adf6b0e
feat: add fields to tasks bucket to match cloud (#23406)
* feat: add name field to tasks bucket to match cloud (#23156)

* refactor: Cleanup function signature

* feat: add more fields
2022-06-08 14:19:00 -04:00
Dane Strandboge 910d5a2bac
build: upgrade Go to 1.18.3 (#23410) 2022-06-07 13:09:28 -05:00
davidby-influx 8c9768cdb7
fix: replace unprintable and invalid characters in errors (#23387) (#23395)
Replace unprintable and invalid characters with '?'
in logged errors.  Truncate consecutive runs of them to
only 3 repeats of '?'

closes https://github.com/influxdata/influxdb/issues/23386

(cherry picked from commit 0ae0bd6e2e)

closes https://github.com/influxdata/influxdb/issues/23389
2022-06-01 14:42:51 -07:00
Jamie Strandboge ab8be8016b
chore: update jsonparser to 1.1.1 and yaml.v3 to 3.0.1 (#23385)
* chore: update jsonparser to 1.1.1 and yaml.v3 to 3.0.1

Perform:

  $ go mod edit -require github.com/buger/jsonparser@v1.1.1
  $ go mod edit -require gopkg.in/yaml.v3@v3.0.1
  $ go mod tidy

* chore(tests): adjust for whitespace in test output
2022-06-01 11:20:37 -05:00