influxdb/tsdb/engine/tsm1
davidby-influx 7ad612b0d7
fix: discard excessive errors () ()
The tsmBatchKeyIterator discards excessive errors to avoid
out-of-memory crashes when compacting very corrupt files.
Any error beyond DefaultMaxSavedErrors (100) will be
discarded instead of appended to the error slice.

closes https://github.com/influxdata/influxdb/issues/22328

(cherry picked from commit e53f75e06d)

closes https://github.com/influxdata/influxdb/issues/22381
2021-09-03 14:57:36 -07:00
..
DESIGN.md chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
array_cursor.gen.go fix(storage): cursor requests are [start, stop] instead of [start, stop) () 2021-04-30 12:15:06 -04:00
array_cursor.gen.go.tmpl fix(storage): cursor requests are [start, stop] instead of [start, stop) () 2021-04-30 12:15:06 -04:00
array_cursor_iterator.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
array_cursor_iterator.gen.go.tmpl chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
array_cursor_iterator.go fix(storage): cursor requests are [start, stop] instead of [start, stop) () 2021-04-30 12:15:06 -04:00
array_cursor_test.go fix(storage): cursor requests are [start, stop] instead of [start, stop) () 2021-04-30 12:15:06 -04:00
array_encoding.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
array_encoding_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
batch_boolean.go fix: typos () 2020-10-13 09:50:32 -07:00
batch_boolean_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
batch_float.go fix: correct various typos () 2020-11-11 13:54:21 -05:00
batch_float_test.go chore(influxdb): Placate the linter. 2020-08-27 15:46:32 -04:00
batch_integer.go fix: typos () 2020-10-13 09:50:32 -07:00
batch_integer_test.go refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo () 2021-06-17 09:18:55 -04:00
batch_string.go fix: typos () 2020-10-13 09:50:32 -07:00
batch_string_test.go refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo () 2021-06-17 09:18:55 -04:00
batch_timestamp.go fix: typos () 2020-10-13 09:50:32 -07:00
batch_timestamp_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
bit_reader.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
bit_reader_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
bool.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
bool_test.go refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo () 2021-06-17 09:18:55 -04:00
cache.go fix(tsm1): fix calculation of tsmFullCompactionQueue statistic () 2021-06-04 10:26:37 -04:00
cache_race_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
cache_test.go refactor(tsm1): delete unused Write method on cache () 2021-03-09 09:09:20 -05:00
compact.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
compact.gen.go.tmpl chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
compact.gen.go.tmpldata chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
compact.go fix: discard excessive errors () () 2021-09-03 14:57:36 -07:00
compact_test.go fix: avoid compaction queue stats flutter () 2021-08-17 14:03:54 -07:00
digest.go fix: Do not close connection twice in DigestWithOptions () () 2021-06-10 13:32:36 -07:00
digest_reader.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
digest_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
digest_writer.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
digest_writer_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
encoding.gen.go chore(influxdb): Placate the linter. 2020-08-27 15:46:32 -04:00
encoding.gen.go.tmpl chore(influxdb): Placate the linter. 2020-08-27 15:46:32 -04:00
encoding.gen.go.tmpldata chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
encoding.gen_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
encoding.go chore(influxdb): Placate the linter. 2020-08-27 15:46:32 -04:00
encoding_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
engine.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
engine.gen.go.tmpl chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
engine.go feat(influxql): Add hyper log log operators () 2021-08-30 15:46:46 -04:00
engine_cursor.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
engine_internal_test.go feat: add config parameters to toggle WAL concurrency and timeouts () 2021-06-09 11:03:53 -04:00
engine_test.go feat(tsi): optimize series iteration () 2021-08-27 09:59:23 -04:00
file_store.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store.gen.go.tmpl chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store.gen.go.tmpldata chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store.go feat: add config parameters to toggle WAL concurrency and timeouts () 2021-06-09 11:03:53 -04:00
file_store_array.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store_array_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store_key_iterator.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store_key_iterator_test.go fix(tsm1): fix data race when accessing tombstone stats () 2021-02-18 20:23:57 -05:00
file_store_observer.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
file_store_test.go feat: add config parameters to toggle WAL concurrency and timeouts () 2021-06-09 11:03:53 -04:00
float.go fix: typos () 2020-10-13 09:50:32 -07:00
float_test.go refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo () 2021-06-17 09:18:55 -04:00
int.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
int_test.go refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo () 2021-06-17 09:18:55 -04:00
iterator.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
iterator.gen.go.tmpl chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
iterator.gen.go.tmpldata chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
iterator.go feat(tsi): optimize series iteration () 2021-08-27 09:59:23 -04:00
iterator_test.go test: replace influxlogger with zaptest logger () 2021-02-11 10:12:39 -05:00
mmap_unix.go build: upgrade to go1.17 () 2021-09-01 16:09:02 -04:00
mmap_windows.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
pools.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
predicate.go fix: correct various typos () 2020-11-11 13:54:21 -05:00
predicate_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
reader.gen.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
reader.gen.go.tmpl chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
reader.gen.go.tmpldata chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
reader.go chore: fix typo () 2021-05-01 08:55:47 -04:00
reader_test.go fix: discard excessive errors () () 2021-09-03 14:57:36 -07:00
ring.go refactor: Remove unused function add and unused variable keysHint () 2021-02-25 08:31:00 -05:00
ring_test.go refactor: Remove unused function add and unused variable keysHint () 2021-02-25 08:31:00 -05:00
scheduler.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
scheduler_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
string.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
string_test.go refactor: delete old backup/restore CLI commands, replace with dependency on new CLI repo () 2021-06-17 09:18:55 -04:00
timestamp.go fix: typos () 2020-10-13 09:50:32 -07:00
timestamp_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00
tombstone.go fix(tsm1): mark tombstone stats as loaded to enable caching () 2021-02-19 11:11:51 -05:00
tombstone_test.go fix(tsm1): fix data race when accessing tombstone stats () 2021-02-18 20:23:57 -05:00
wal.go feat: add config parameters to toggle WAL concurrency and timeouts () 2021-06-09 11:03:53 -04:00
wal_test.go feat: add config parameters to toggle WAL concurrency and timeouts () 2021-06-09 11:03:53 -04:00
writer.go fix: correct various typos () 2020-11-11 13:54:21 -05:00
writer_test.go chore: move v2/v1/tsdb → v2/tsdb 2020-08-26 10:46:47 -07:00