3108eea330
Merge pull request #9291 from influxdata/bj-fix-series-file-delete
...
Fix series file removal after DROP DATABASE.
2018-01-08 13:20:02 -07:00
fe2116a4fc
Fix series file removal after DROP DATABASE.
2018-01-08 11:40:06 -07:00
1ea41b0dd6
Merge pull request #9287 from influxdata/dn-return-digest-size
...
fix #9286 : return digest size
2018-01-08 13:30:56 -05:00
1c452d83cb
fix #9286 : return digest size
2018-01-08 13:15:14 -05:00
c0a46d2d3d
Fix series file compaction stall.
...
The series file compaction previously did not snapshot the max
offset before compacting and would keep compacting until it reached
the end of segment file. This caused more entries than expected into
the RHH map and this map gets exponentially slower as it gets close
to full.
2018-01-08 09:53:01 -07:00
88ce43a639
Merge pull request #9285 from influxdata/bj-series-file-windows
...
WIP: Close series file on database deletion.
2018-01-08 09:51:58 -07:00
6f32f15fd3
Add closed series file checks.
2018-01-08 09:11:29 -07:00
370d363d38
Close series file on database deletion.
2018-01-05 13:33:35 -07:00
86c443cb02
Change series dir location
2018-01-05 16:40:23 +00:00
83d0ec8359
Optimise TagKeys and fix duplication bug
2018-01-05 12:51:21 +00:00
6b4a21cdb2
Merge pull request #9282 from benbjohnson/fix-series-segment-replay
...
Fix series segment replay.
2018-01-04 18:32:53 -07:00
eab6333c27
Fix SeriesSegment replay.
2018-01-04 18:28:02 -07:00
b647c9d29b
Merge pull request #9278 from hpbieker/hpb-compacting-sorting-2
...
Fixed issue where compacting did not sort when blocks are unsorted and overlapping
2018-01-04 13:21:18 -07:00
a85306c53e
Updated mergeUnsigned by running "go generate ./tsdb/engine/tsm1".
2018-01-04 19:35:01 +01:00
f73a710320
More insight into assertion
2018-01-04 16:23:50 +00:00
c13910a51f
Don't try to load .series directory
2018-01-04 16:23:50 +00:00
28e6a1a7c2
Fix series file key/id map compaction.
2018-01-04 09:16:29 -07:00
7a273ccdb5
Fixed issue where compacting did not sort when block are unsorted and overlapping.
2018-01-04 15:25:26 +01:00
bf66f20388
Merge pull request #9267 from hpbieker/hpb-compacting-sorting
...
Sort blocks by time when compacting
2018-01-03 17:43:38 -07:00
3ac428920c
Merge pull request #9276 from benbjohnson/fix-series-index-compaction
...
Fix series index compaction.
2018-01-03 15:13:19 -07:00
48648e828d
Fix series index compaction.
2018-01-03 12:47:07 -07:00
31c50532db
Add series existence check in tsi1.
2018-01-03 12:20:35 -07:00
98486a284a
Merge pull request #9265 from benbjohnson/series-file-compaction
...
Sequential series file id & series file segmentation
2018-01-03 10:05:59 -07:00
3900c948a2
Fix requested changes.
2018-01-03 10:04:12 -07:00
f9ea54198f
rename series directory
2018-01-03 15:44:58 +00:00
c892bf15a1
Fix missing sorting of blocks when compacting.
2018-01-03 10:21:11 +01:00
ee185e18b7
Added unit test TestCompactor_Compact_UnsortedBlocks.
2018-01-03 09:42:36 +01:00
52630e69d7
Integrate SeriesFileCompactor
2018-01-02 12:20:03 -07:00
56980b0d24
Segment series file
2017-12-29 11:57:45 -07:00
4ab1542cfc
Series file compactor.
2017-12-29 11:57:45 -07:00
ed207b54c3
updates after TSI / series file merge
2017-12-29 10:58:25 -07:00
638caf3b58
ensure correctly aligned for 32-bit architecture
2017-12-29 07:58:52 -07:00
455013a486
updates per PR review comments
2017-12-29 07:58:52 -07:00
98aa368b7f
prefer NameBytes
2017-12-29 07:58:52 -07:00
5dfe3b2645
inmem startup improvments
...
* only call ParseTags when necessary
* remove dependency on inmem.Series in tsdb test package
* Measurement and Series are no longer exported. Their use is restricted
to the inmem package
* improve Measurement and Series types by exporting immutable
fields and removing unnecessary APIs and locks
Reduced startup time from 28s to 17s. Overall improvement including
#9162 reduces startup from 46s to 17s for 1MM series across 14 shards.
2017-12-29 07:58:52 -07:00
ba17264ddd
fixes after merge
2017-12-27 17:29:32 -07:00
c986cac76e
improve performance when writes exceed max tag values or series
...
```
benchmark old ns/op new ns/op delta
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxValuesExceeded-8 6175374 2714158 -56.05%
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxValuesNotExceeded-8 344502 326312 -5.28%
BenchmarkShardIndex_CreateSeriesListIfNotExists_NoMaxValues-8 346734 329961 -4.84%
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxSeriesExceeded-8 2414945 1996223 -17.34%
benchmark old allocs new allocs delta
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxValuesExceeded-8 45377 128 -99.72%
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxValuesNotExceeded-8 33 20 -39.39%
BenchmarkShardIndex_CreateSeriesListIfNotExists_NoMaxValues-8 33 20 -39.39%
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxSeriesExceeded-8 15219 71 -99.53%
benchmark old bytes new bytes delta
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxValuesExceeded-8 1354539 480114 -64.56%
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxValuesNotExceeded-8 2101 1261 -39.98%
BenchmarkShardIndex_CreateSeriesListIfNotExists_NoMaxValues-8 2100 1261 -39.95%
BenchmarkShardIndex_CreateSeriesListIfNotExists_MaxSeriesExceeded-8 707247 477737 -32.45%
```
2017-12-27 17:27:03 -07:00
f240a930c7
Preserve original mmap in series file.
2017-12-21 20:00:05 -07:00
895ca7a04b
Adjust 386 max series file size.
2017-12-21 14:50:07 -07:00
4fd48cfcd1
Replace in-memory series file map with rhh.
2017-12-21 12:57:21 -07:00
4d7426ebbd
Fix race bug.
2017-12-21 10:12:21 -07:00
679335d027
Measurement iterator fix.
2017-12-20 15:43:17 -07:00
553c092484
Merge branch 'er-tsi-index-part' of https://github.com/influxdata/influxdb into er-tsi-index-part
2017-12-20 15:22:24 -07:00
d8b1d208c0
rebase
2017-12-20 15:13:34 -07:00
9767660b8f
Use MeasurementIterator
2017-12-19 19:23:01 +00:00
8b2dbf4d83
Merge branch 'er-tsi-index-part' of https://github.com/influxdata/influxdb into er-tsi-index-part
2017-12-19 10:33:02 -07:00
107291c6b0
series file refactor
2017-12-19 10:31:33 -07:00
72c0ec89fd
Fix race on in-memory index
2017-12-18 16:22:19 +00:00
bde66f19bc
Adjust series file size and partitions
2017-12-18 13:17:42 +00:00
38af43d5eb
Fix engine test races
2017-12-15 23:19:18 +00:00
Ben Johnson
David Norton
Edd Robinson
Jason Wilder
Hans P. Bieker
hpbieker
Stuart Carnie