Commit Graph

83 Commits (docs/contrib-fixes)

Author SHA1 Message Date
Dane Strandboge 82d1123e78
build: upgrade to Go 1.18.1 (#23252) 2022-04-13 15:24:27 -05:00
Jonathan A. Sternberg 72c4c55609
build(flux): update flux to v0.162.0 (#23255) 2022-04-05 16:10:41 -05:00
Sam Arnold b970e359dc
feat: remaining storage metrics from OSS engine (#22938)
* fix: simplify disk size tracking

* refactor: EngineTags in tsdb package

* fix: fewer compaction buckets and dead code removal

* feat: shard metrics

* chore: formatting

* feat: tsdb store metrics

* feat: retention check metrics

* chore: fix go vet

* fix: review comments
2021-12-02 09:01:46 -05:00
Sam Arnold edb21abe91
feat: metrics for wal subsystem (#22918)
https://github.com/influxdata/influxdb/issues/20026
2021-11-23 12:17:52 -05:00
Sam Arnold feb459c785
feat: metrics for cache subsystem (#22915)
* fix: drop complicated cache metrics and document remaining

* feat: metrics for cache
2021-11-23 10:11:22 -05:00
Dane Strandboge de7f052e5a
chore: fix `dump_tsi` deadlock (#22705) 2021-10-20 12:43:02 -05:00
Daniel Moran 233f277c07
test: check post-compaction series file sizes before reopening (#22534) 2021-09-21 16:48:44 -04:00
Daniel Moran 1291b1a218
test: update various tests to pass on Windows (#22484)
* Generalize checks for no-such-file errors to pass on Windows
* Close temp tombstone file before trying to delete it in test
* Generalize upgrade tests to work on Windows
2021-09-20 08:25:11 -04:00
Daniel Moran 140148edfb
test: close temp sfile before running buildtsi compaction test (#22481) 2021-09-14 17:34:55 -04:00
Daniel Moran ccd96929c5
test: don't assume unix paths in reporttsi tests (#22461) 2021-09-13 15:24:10 -04:00
Sam Arnold 5015297d40
fix: more expressive errors (#22448)
* fix: more expressive errors

Closes #22446

* fix: server only logging for untyped errors

* chore: fix formatting
2021-09-13 15:12:35 -04:00
Daniel Moran 6f39255fc8
fix: ensure files are closed before they are deleted or moved in `deletetsm` (#22458)
* Close files before deleting parent dir in tests
* Use platform-independent function to rename output
* Close source TSM file before overwriting it
2021-09-13 14:39:50 -04:00
Daniel Moran f36960d263
fix: detect noninteractive prompt when displaying warning in buildtsi (#22442) 2021-09-13 11:26:58 -04:00
Daniel Moran 12fff64760
fix: make TSI index compact old and too-large log files (#22334)
*  TSI index should compact old or too-large log files
* Old tsl files should be compacted without new writes
* Add extra logging when disk size test fails


Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-08-30 18:27:48 -04:00
mcfarlm3 337169f1fd
chore: added unit test coverage to inspect build-tsi 2.x command (#22262)
* chore: add test coverage for inspect build-tsi command

* refactor: moved repeated code into separate functions

* refactor: minor variable naming change

* refactor: added manifest check for index files and made minor flag naming changes to build-tsi

* fix: changed check from NotNil to NotZero
2021-08-24 12:46:02 -07:00
mcfarlm3 115822aeda
refactor: small changes to usage and flag naming for consistency (#22292) 2021-08-24 12:45:20 -07:00
mcfarlm3 a160a1d47c
chore: add unit test coverage to inspect report-tsi command (#22153)
* chore: add unit test coverage to inspect report-tsi command

* chore: add additional test cases and data for inspect report-tsi command

* refactor: made small changes based on code review

* chore: added line protocol files for tsi test data

Co-authored-by: Michelle McFarland <michellemcfarland@Michelles-MacBook-Pro.local>
2021-08-12 08:55:42 -07:00
Dane Strandboge c2f6705008
chore: remove some flaky checks from `dump_tsm_test` (#22144)
* comment out and link to issue #22145
2021-08-10 14:43:52 -05:00
Dane Strandboge c960e11dc7
chore: fix dump_tsm test failing (#22130)
* chore: fix dump_tsm test missing flag
* chore: flush written data with multiple tested keys
2021-08-09 14:24:06 -05:00
mcfarlm3 3c1d841df6
chore: add unit test coverage to inspect dump-wal (#21994)
* chore: add unit test coverage to inspect dump-wal

* chore: ran make fmt

* refactor: small styling change in conditional statement

* refactor: passed cobra cmd as pointer instead of an object

Co-authored-by: Michelle McFarland <michellemcfarland@Michelles-MacBook-Pro.local>
2021-07-30 15:32:46 -07:00
Dane Strandboge 09f5f48aeb
chore: add test cases for `inspect dump-tsm` (#21956) 2021-07-29 16:35:01 -05:00
Dane Strandboge 52ccb238af
chore: deletetsm command tests (#21949) 2021-07-29 13:32:06 -05:00
mcfarlm3 9f13f1c309
feat: port influxd inspect build-tsi (#21936)
* feat: port influxd inspect build-tsi

* refactor: changes based on code review, not including logging changes

* refactor: improved logging based on code review

* chore: updated CHANGELOG.md

Co-authored-by: Michelle McFarland <michellemcfarland@Michelles-MacBook-Pro.local>
2021-07-27 08:26:22 -07:00
mcfarlm3 3b86c32468
feat: port `influxd inspect dump-wal` (#21888)
* feat: porting influxd inspect dump-wal from 1.x

* refactor: adapted 1.x logic to cobra command syntax

* refactor: improved clarity of printed output and help documentation

* chore: ran make fmt

* chore: updated CHANGELOG.md

* refactor: made small changes suggested in code review
2021-07-21 09:15:37 -07:00
Dane Strandboge 0136c7e63d
feat: port `influx inspect report-tsm` to 2.x (#21814) 2021-07-20 12:08:30 -05:00
mcfarlm3 5d8c0b4b17
feat: port `influxd inspect report-tsi` to 2.x (#21788)
* feat: port influxd inspect report-tsi

* chore: restored tsi1.IsIndexDir() functionality

* refactor: changed inspect report-tsi to work with 2.x file system structure

* chore: fixed output tab alignment

* chore: ran make fmt

* chore: ran make fmt on changed file after resolving merge conflicts

* refactor: made changes based on code review

* refactor: avoiding defer build-up in loop

* refactor: replaced path with filepath and added shardIdx closures

* chore: updated changelog

* refactor: handled shardIdx closures in error case

Co-authored-by: Michelle McFarland <michellemcfarland@Michelles-MacBook-Pro.local>
2021-07-19 08:37:28 -07:00
Dane Strandboge c62d4cdc24
refactor: move to `filepath.WalkDir` for slight performance gain in Go 1.16 (#21858) 2021-07-16 09:11:11 -05:00
Dane Strandboge 31780ba845
feat: create `influxd inspect verify-wal` command (#21828) 2021-07-15 11:38:20 -05:00
Sam Arnold 962b9d7d02
fix: simplify file set, remove series file member (#21831) 2021-07-12 10:43:20 -04:00
Dane Strandboge 60de82e40a
chore: move to os/io over ioutil for `influx inspect` code (#21827) 2021-07-09 15:12:00 -05:00
Dane Strandboge 6a99416ab2
feat: port `influxd inspect deletetsm` to 2.x (#21786) 2021-07-06 12:20:30 -05:00
Dane Strandboge ba31a0e260
feat: port `influx inspect dumptsi` subcommand (#21784) 2021-07-06 11:40:21 -05:00
Dane Strandboge 7c529d929a
feat: port `influxd inspect dump-tsm` (#21761)
This differs from the 1.x implementation as the blocks and index in-depth printout will now only happen if explicitly stated, instead of being printed with filterKey set
2021-07-02 15:51:36 -05:00
Dane Strandboge 8e8953f2c5
refactor: reorganize inspect subcommands for better package hierarchy (#21763) 2021-06-30 11:46:47 -05:00
Dane Strandboge 3c715d6851
feat: Port influxd inspect verify-tombstone subcommand (#21646) 2021-06-28 15:14:30 -05:00
Dane Strandboge 8b90d23088
feat: Port influxd inspect verify-tsm (#21615)
* feat: port tsm-inspect command to dbv2

* test: add test code for tsm-verify

* chore: delete old tsm-verify code stubs

* docs: update changelog

* chore: test for broken checksums more thoroughly
2021-06-09 10:38:51 -05:00
Dane Strandboge c665c749fe
feat: Port influxd inspect verify-seriesfile (#21635)
* feat: Port influxd inspect verify-seriesfile

* chore: clean up logic, use zaptest logger

* chore: better error handling

* chore: generic error return statement

* chore: collapse nil check into if-block

Co-authored-by: Daniel Moran <danxmoran@gmail.com>

* chore: update changelog

Co-authored-by: Daniel Moran <danxmoran@gmail.com>
2021-06-08 15:19:21 -05:00
Daniel Moran 00afd95cb7
refactor: automated move of errors and id from root to kit (#21101)
Co-authored-by: Sam Arnold <sarnold@influxdata.com>
2021-03-30 14:10:02 -04:00
Daniel Moran 4ef09e1ccb
feat(cmd/inflxud): add support for writing to stdout in `export-lp` (#21046) 2021-03-23 14:59:16 -04:00
Daniel Moran 49b83b58ee
refactor: remove panics from CLI kit code and influxd CLI setup (#20863) 2021-03-04 17:18:21 -05:00
Daniel Moran a668a9ed0a
feat(cmd/influxd): add `influxd inspect export-lp` command to export LP (#20467) 2021-01-25 14:28:36 -08:00
Stuart Carnie aa8064a43a fix: PR Feedback 2020-11-13 08:47:52 +11:00
Stuart Carnie 42aabb28fc chore: Do not use global viper APIs, which breaks testing 2020-11-13 08:47:52 +11:00
Daniel Moran 518098e4f3
fix(cmd/influxd): suggest running with -h on error instead of printing usage (#19995) 2020-11-11 16:37:36 -05:00
Stuart Carnie dee8977d2c
chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
Stuart Carnie 840d0a994f
fix(inspect): Add export-index command for tsdb 1.x 2020-08-03 15:17:17 -07:00
Stuart Carnie 26c18ac0a5
chore: Converging on 1.x tsdb 2020-08-03 09:20:48 -07:00
Edd Robinson 2b175291be
refactor: WIP removing tsbd 2020-08-03 09:18:34 -07:00
Jonathan A. Sternberg 0ae8bebd75
refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
Jacob Marble 26ca766459
refactor(tsdb): move series file to its own package (#17224)
* refactor(storage): move type ByTagKey to the only package that uses it

* refactor(tsdb): use types in tsdb/cursors

* refactor(tsdb): remove unused type SeriesIDElems

* refactor(tsdb): inline only use of tsdb.ReadAllSeriesIDIterator

* refactor(tsdb): move series file to its own package

* refactor(storage): remove platform->influxdb aliases
2020-03-12 11:32:52 -07:00