Commit Graph

151 Commits (8ed55e72b85b0807c97d3d1d7d12e9f07c9737e9)

Author SHA1 Message Date
Jeffrey Smith II c2eac86131
feat: port report-db command from 1.x (#23922)
* feat: port report-db command from 1.x

* chore: fix linting

* chore: rename db to bucket

* chore: fix linting
2022-11-21 11:23:13 -05:00
Abirdcfly c433342830
chore: remove duplicate word in comments (#23685)
Signed-off-by: Abirdcfly <fp544037857@gmail.com>

Signed-off-by: Abirdcfly <fp544037857@gmail.com>
2022-09-13 11:00:52 -05:00
davidby-influx a9df3f8a7c
fix: fully clean up partially opened TSI (#23430) (#23454)
When one partition in a TSI fails to open, all previously opened
partitions should be cleaned up, and remaining partitions
should not be opened

closes https://github.com/influxdata/influxdb/issues/23427

(cherry picked from commit d3db48e93d)

closes https://github.com/influxdata/influxdb/issues/23432
2022-06-14 11:49:16 -07:00
Dane Strandboge 82d1123e78
build: upgrade to Go 1.18.1 (#23252) 2022-04-13 15:24:27 -05:00
Sam Arnold e20b5e99a6
fix: remove nats for scraper processing (#23107)
* fix: remove nats for scraper processing

Scrapers now use go channels instead of NATS and interprocess communication.
This should fix #23085 .

Additionally, found and fixed #23106 .

* chore: fix formatting

* chore: fix static check and go.mod

* test: fix some flaky tests

* fix: mark NATS arguments as deprecated
2022-02-10 11:23:18 -05:00
davidby-influx 4fd4bd019f
fix: use copy when a rename spans volumes (#22995)
When a file rename fails with EXDEV
(cross device or volume error), copy the
file and delete the original instead.

closes https://github.com/influxdata/influxdb/issues/22890

Co-authored-by: Chris Pahl <sahib@online.de>
2021-12-14 12:58:44 -08:00
Daniel Moran 1aac92c5ee
refactor: remove replications.current_queue_size_bytes from sqlite (#22832)
Maintaining the current queue size in a SQL column would require
updating the DB on every queue operation. Avoid that contention by
instead looking up the current size on the in-memory durable queue
struct, which is already tracked & updated as data enters & leaves
the queue.
2021-11-05 14:35:12 -04:00
Dane Strandboge f4e9ae94ca
build: upgrade protobuf library (#22654) 2021-11-02 16:00:54 -05:00
mcfarlm3 8825cd5d50
feat: replication apis durable queue management (#22719)
* feat: added durable queue management to replications service

* refactor: improved mapping of replication streams to durable queues

* refactor: modified replication stream durable queues to use user-specified engine path

* chore: generated test mocks for replications DurableQueueManager

* chore: add test coverage for replications durable queue manager

* refactor: made changes based on code review, added mutex to durableQueueManager, improved error logging

* chore: ran make fmt

* refactor: further improvements to error logging
2021-10-26 12:14:29 -07:00
Dane Strandboge de7f052e5a
chore: fix `dump_tsi` deadlock (#22705) 2021-10-20 12:43:02 -05:00
Daniel Moran d307e0a2dc
chore: delete miscellaneous unused code (#22465)
* Delete unused `CreateFileWithReplacement` function
* Delete unused `http/server.go`
2021-09-13 15:48:17 -04:00
Sam Arnold 5015297d40
fix: more expressive errors (#22448)
* fix: more expressive errors

Closes #22446

* fix: server only logging for untyped errors

* chore: fix formatting
2021-09-13 15:12:35 -04:00
Daniel Moran 372c481278
chore: delete unused code that doesn't build on Windows (#22443) 2021-09-13 10:55:45 -04:00
Daniel Moran 1c2d68b0cb
build: upgrade to go1.17 (#22363) 2021-09-01 16:09:02 -04:00
Daniel Moran 37088e8f53
feat(influxql): Add hyper log log operators (#22322)
In addition to helping with normal queries, this can improve the 'SHOW CARDINALITY'
meta-queries.


Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-08-30 15:46:46 -04:00
Jonathan A. Sternberg f94783e016
build(flux): update flux to master and change renamed structs (#22281) 2021-08-26 10:07:02 -05:00
Daniel Moran 891e7d4782
feat: port durable queue from InfluxDB enterprise (#22187) 2021-08-12 17:59:11 -04:00
Daniel Moran 22c6b78c62
build: fix generation when vendoring dependencies (#22089) 2021-08-06 15:06:36 -04:00
Dane Strandboge c62d4cdc24
refactor: move to `filepath.WalkDir` for slight performance gain in Go 1.16 (#21858) 2021-07-16 09:11:11 -05:00
Daniel Moran 06b403ca57
build: delete `influx` CLI code, remove it from build (#21797) 2021-07-07 09:29:20 -04:00
Daniel Moran d747e7ec4e
feat: add config parameters to toggle WAL concurrency and timeouts (#21621)
* feat: add context parameter to Take() method on fixed limiter
* refactor: plumb context through to uses of Take()
* test: update tests to pass context as needed
* feat: add config toggles for setting WAL write concurrency & timeout
2021-06-09 11:03:53 -04:00
Yun Zhao ce536037dc
fix(tsm1): limit concurrent WAL encodings to reduce memory pressure under heavy write load (#20814)
Co-authored-by: zhaoyun.248 <zhaoyun.248@bytedance.com>
2021-06-03 16:11:36 -04:00
Daniel Moran f6b073348b
build: delete vendored copy of gogo protos (#21098) 2021-03-30 14:26:05 -04:00
Daniel Moran 00afd95cb7
refactor: automated move of errors and id from root to kit (#21101)
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-03-30 14:10:02 -04:00
Daniel Moran b1283bc998
build: fix 'go generate' and regenerate the universe (#21089) 2021-03-30 10:32:14 -04:00
Daniel Moran 6515a79413
fix: update doc links to point at new site (#20754) 2021-02-16 12:37:56 -05:00
Sam Arnold 781fa0e846 chore: add goimports 2021-01-29 14:06:52 -05:00
Daniel Moran 15b9531273
fix: correct various typos (#19987)
Co-authored-by: kumakichi <xyesan@gmail.com>
2020-11-11 13:54:21 -05:00
Mark Rushakoff 4c5aea8103 chore: remove unreferenced pkg/hll package 2020-10-28 12:38:01 -04:00
Mark Rushakoff c11ce82d2f chore: remove unreferenced pkg/bufio package 2020-10-28 12:38:01 -04:00
Ayan George bd47d8efe1
fix: Type-convert fs.Bavail for portability (#19816)
Prior to this patch, DiskUsage() would calculate bytes available
by multiplying blocks available by block size in bytes:

  disk.Avail = fs.Bavail * uint64(fs.Bsize)

Under some versions of Unix, fs.Bavail is of type uint64 and on
others (like FreeBSD) it is of type int64.

This causes a compile time error:

  $ go build
  # github.com/influxdata/influxdb/v2/pkg/fs
  ./fs_unix.go:81:25: invalid operation: fs.Bavail * uint64(fs.Bsize) (mismatched types int64 and uint64)

This patch type-converts fs.Bavail to unit64 to ensure that all
types in the expression align.

This prevents compile time errors under FreeBSD and other platforms
where fs.Bavail isn't uint64.
2020-10-26 05:32:04 -04:00
sans 7dcaf5c639
fix: typos (#19734) 2020-10-13 09:50:32 -07:00
vlastahajek 8763bb1af9 feat(upgrade): upgrade databases 2020-10-08 09:39:30 -07:00
Stuart Carnie abdfdf07c1 fix: Panic when p is < what was read from rd 2020-09-29 13:44:18 -07:00
Pavel Závora 58b37582bc
Merge pull request #19595 from influxdata/19588/linenumber
fix(pkg/csv2lp): report actual line numbers
2020-09-26 09:33:41 +02:00
pierwill feacde0dca
docs: Edit csv2lp README
s/prepend/append in `:strict`
2020-09-23 10:25:32 -07:00
Pavel Zavora e1591077cd feat(pkg/csv2lp): use LineReader to report actual line numbers that go's csv.Reader cannot 2020-09-21 07:54:17 +02:00
Pavel Zavora 94d2cb3518 feat(pkg/csv2lp): add LineReader to report correct line numbers 2020-09-20 12:59:27 +02:00
Pavel Zavora 8e2d2ce77b chore(pkg/csv2lp): test csv2lp.CsvToLineProtocol.Comma 2020-09-20 11:24:56 +02:00
Christopher M. Wolff e7cbbaa722
feat: upgrade Flux to v0.83.2 (#19569) 2020-09-16 17:59:15 -07:00
Pavel Závora 2c32938a78
Merge pull request #19466 from influxdata/19452/csv2lp
fix(pkg/csv2lp): do not override existing line part in group annotation
2020-09-12 12:10:14 +02:00
Pavel Zavora 13a801b830 fix(pkg/csv2lp): do not override existing line part in group annotation #19452 2020-09-12 11:40:54 +02:00
Pavel Zavora 2c25044a8c chore: apply review comments 2020-09-12 11:29:05 +02:00
Pavel Zavora 60c4984f51 chore: apply review comments 2020-09-12 11:13:27 +02:00
Pavel Zavora 7fc590fb6f chore: doc only 2020-09-12 11:13:27 +02:00
Pavel Zavora fe2c7dfae0 chore(pkg/csv2lp): improve Test_CsvToLineProtocol_RowSkipped 2020-09-12 11:13:27 +02:00
Pavel Zavora b21b4014e6 feat(pkg/csv2lp): document concat annotation 2020-09-12 11:13:27 +02:00
Pavel Zavora c5d841efdf feat(pkg/csv2lp): add concat annotation 2020-09-12 11:13:27 +02:00
Pavel Zavora 05c8a00b8d feat(pkg/csv2lp): add RowSkippedListener to inform about rejected records #18742 2020-09-12 11:13:27 +02:00
Pavel Zavora b51866e7be chore(pkg/csv2lp): improve doc 2020-09-12 11:13:27 +02:00