influxdb/tsdb/engine/tsm1
Jason Wilder 0dbd4893da Optimize shard index loading
On data sets with many series and potentially large series keys,
the cost of parsing the key and re-indexing can be high.

Loading the TSM keys into the index was being done repeatedly for
series that were already index by an earlier TSM file.  This was
wasted worked and slows down shard loading.

Parsing the key was also innefficient and allocated a new string
slice.  This was simplified to remove that allocation.
2016-05-12 14:02:42 -06:00
..
DESIGN.md doc: remove the implication that the wal directory is inside the shard directory. 2016-02-15 05:33:22 +11:00
bit_reader.go optimize tsm1.BitReader 2016-04-19 11:34:17 -06:00
bit_reader_test.go optimize tsm1.BitReader 2016-04-19 11:34:17 -06:00
bool.go tsm1 query engine alloc reduction 2016-04-11 14:50:59 -06:00
bool_test.go tsm1 query engine alloc reduction 2016-04-11 14:50:59 -06:00
cache.go fix cache memory size of engine 2016-05-09 21:29:34 +08:00
cache_race_test.go Fix deadlock when running backup 2016-03-14 12:36:48 -06:00
cache_test.go Add DeleteSeries and DeleteSeriesRange 2016-04-27 13:09:53 -06:00
compact.go Fix memory spike when compacting overwritten points 2016-05-05 22:31:30 -06:00
compact_test.go Fix memory spike when compacting overwritten points 2016-05-05 22:31:30 -06:00
cursor.go rename influxdb/influxdb to influxdata/influxdb 2016-02-10 10:26:18 -07:00
encoding.go Fix case where Merge return unsorted values 2016-05-09 15:40:34 -06:00
encoding_test.go Add benchmark for Merge 2016-05-10 08:39:55 -06:00
engine.go Optimize shard index loading 2016-05-12 14:02:42 -06:00
engine_test.go Fix shards not getting assigned to series on restart 2016-05-02 11:36:05 -06:00
file_store.go wip 2016-05-10 11:01:03 -05:00
file_store_test.go wip 2016-05-10 11:01:03 -05:00
file_unix.go Fix tombstone rename on windows 2016-04-27 13:09:53 -06:00
file_windows.go Remove redundant windows build tags 2016-05-03 14:22:02 +01:00
float.go optimize tsm1.FloatDecoder 2016-04-21 08:49:12 -06:00
float_test.go tsm1 query engine alloc reduction 2016-04-11 14:50:59 -06:00
int.go update dep: simple8b @ b421ab40 2016-04-22 09:46:05 -06:00
int_test.go tsm1 query engine alloc reduction 2016-04-11 14:50:59 -06:00
iterator.gen.go Fix overwriting points returning wrong value 2016-05-03 09:21:31 -06:00
iterator.gen.go.tmpl Fix overwriting points returning wrong value 2016-05-03 09:21:31 -06:00
iterator.gen.go.tmpldata Changed type-switch a few places to reduce allocations. 2016-03-11 15:57:05 -05:00
iterator.go Propagate the limit option to the low level iterators 2016-04-15 18:23:54 -04:00
mmap_solaris.go ran go fmt on mmap_solaris.go #4787 2015-12-07 17:41:26 -08:00
mmap_unix.go Remove MAP_POPULATE 2016-01-08 08:45:27 -07:00
mmap_windows.go fix munmap bug in the windows 2016-01-31 10:46:46 +08:00
pools.go integer support 2016-02-10 09:40:25 -07:00
reader.go Fix loading huge series into RAM when points are overwritten 2016-05-05 09:34:44 -06:00
reader_test.go Don't add tombstone for timerange not contained by file 2016-04-27 13:09:53 -06:00
string.go tsm1 query engine alloc reduction 2016-04-11 14:50:59 -06:00
string_test.go tsm1 query engine alloc reduction 2016-04-11 14:50:59 -06:00
timestamp.go update dep: simple8b @ b421ab40 2016-04-22 09:46:05 -06:00
timestamp_test.go update dep: simple8b @ b421ab40 2016-04-22 09:46:05 -06:00
tombstone.go Fix V2 tombstone reading file position 2016-05-02 11:36:04 -06:00
tombstone_test.go Prevent writing empty tombstone files 2016-05-02 11:36:04 -06:00
wal.go Prevent truncated WAL entries from panicing 2016-04-27 13:09:53 -06:00
wal_test.go Remove debugging from test output 2016-04-27 13:09:53 -06:00
writer.go Sepearate IndexWriter from TSMIndex 2016-04-27 13:09:52 -06:00
writer_test.go Remove NewTSMReaderWithOptions 2016-04-27 13:09:52 -06:00