00f570441b
Convert TSMKeyIterator to return blocks
2015-12-16 11:16:17 -07:00
59a57d8f73
Convert CacheKeyIterator to return encoded blocks
2015-12-16 11:16:17 -07:00
0623648140
Add chunking support back to TSMKeyIterator
...
Was removed when MergeIterator was deleted.
2015-12-16 11:16:17 -07:00
31b97c3fe0
Add max points per block back for CacheKeyIterator
...
Was removed when MergeIterator was removeed.
2015-12-16 11:16:16 -07:00
45e87cdfe4
Strip checksum when returning block from ReadBytes
2015-12-16 11:16:16 -07:00
97435b9124
Return minTime/maxTime from BlockIterator.Read
2015-12-16 11:16:16 -07:00
ce6de9728e
Add test for BlockIterator with multiple blocks for a key
2015-12-16 11:16:16 -07:00
4a3037814f
Add WriteBlock to TSMWriter
2015-12-16 11:16:16 -07:00
d99c1f944e
Add BlockIterator for reading TSM blocks without decoding
2015-12-16 11:16:16 -07:00
928aef04cd
Split data_file.go into reader.go and writer.go
2015-12-16 11:16:16 -07:00
47317d73b4
Merge pull request #5131 from influxdb/site-fixes
...
Default data logging to on
2015-12-16 10:03:25 -08:00
ad1044dde9
typo: unkown -> unknown
2015-12-15 18:10:47 -05:00
d45048455a
Default data logging to on
2015-12-15 13:15:38 -08:00
0e4bc275d8
Merge pull request #5115 from influxdb/site-fixes
...
Log TSM initialization
2015-12-15 13:13:17 -08:00
01ac0b3f23
Tweak compaction log messages
2015-12-15 10:33:13 -08:00
d89e233567
Merge pull request #5100 from influxdb/dgn-fix-4303
...
fix #4303 : don't drop from multiple databases
2015-12-15 07:27:05 -05:00
a6cdb5229d
Log tsm initialization
2015-12-14 15:50:56 -08:00
3014fb90e4
fix #4303 : don't drop from multiple databases
2015-12-12 13:54:23 -05:00
75764517f6
Merge pull request #5082 from li-ang/fix_x
...
Fix wrong value of countCompacting in WAL
2015-12-11 10:07:56 -08:00
03f8cd3956
Add comment explaining magic number
2015-12-10 11:46:40 -08:00
631ecc23de
Fix growing destination buffer during WAL entry encoding
...
The test to see if the destination buffer for encoding and decoding a WAL
entry was broken and would cause a panic if there were large batches that
would overflow the buffer size.
Fixes #5075
2015-12-10 11:46:40 -08:00
34bdffdb00
Fix wrong value of countCompacting in wal
2015-12-10 17:47:20 +08:00
b7000c80dd
count with fill(none) will drop 0 valued intervals
2015-12-09 15:20:47 -07:00
da08304780
Merge pull request #4940 from li-ang/fix_aggregative_query_err
...
Fix distributed aggregative query error
2015-12-09 11:04:40 -08:00
992aea7bd3
Merge pull request #5060 from influxdb/jw-drop-db
...
Cancel writing TSM files when engine closes
2015-12-08 16:16:07 -07:00
b192136887
Merge pull request #5058 from influxdb/pd-update-compaction-logic
...
Update TSM compaction logic
2015-12-08 18:14:15 -05:00
27cc2ea0cc
Update compact.Plan
2015-12-08 18:01:31 -05:00
d7cff651d1
Cancel writing TSM files when engine closes
...
If the engine is closed while a compaction is going on, the close call
blocks until the goroutine exits. This could be several minutes because
the control does not return back up to the channel selector while there is
still data to write.
2015-12-08 15:41:53 -07:00
96445a53a7
Update TSM compaction logic
...
* Update compaction to look at newest files of the smallest step first
* Update compaction to look at older files in larger steps if newer files don't have enough small steps to compact
* Changed the TestDefaultCompactionPlanner_CombineSequence test to reflect what's possible now. We'd only have multiple files in the same generation if the all files but one were over the max allowable size.
* Clean up the logic on when full compactions are run and when planning can be skipped
2015-12-08 17:33:38 -05:00
62cb3a1e9b
Merge pull request #5057 from influxdb/jw-5046
...
Fix leaking TSM files when compacting
2015-12-08 13:11:46 -07:00
3543917a74
Avoid allocating strings during search
2015-12-08 13:02:17 -07:00
99c313ddae
Fix leaking TSM files when compacting
...
The files being read were not closed after the compaction ran causing
them to leak.
Fixes #5046
2015-12-08 12:55:30 -07:00
9d82e24ca0
Fix performance of dropping large number of keys
2015-12-08 10:47:06 -07:00
f245b44afa
Set full compaction duration option on planner
...
Was set on engine and not planner so it was always 0.
2015-12-08 09:56:36 -07:00
d32aeb2535
Merge pull request #5031 from influxdb/jw-mintime
...
Dedupe points at query time if there are overlapping blocks
2015-12-07 21:28:29 -07:00
87892d79da
Dedupe points at query time if there are overlapping blocks
2015-12-07 21:10:10 -07:00
bb386219f4
ran go fmt on mmap_solaris.go #4787
2015-12-07 17:41:26 -08:00
0f889a77d1
fix tsm1 for Solaris #4787 , passes unit tests now
2015-12-07 17:14:26 -08:00
c13f8e9128
Fix wrong results of distributed aggregative query
2015-12-08 07:08:46 +08:00
4f30d396ae
Merge pull request #5026 from influxdb/jw-mintime
...
Optimize TSM queries with time filter
2015-12-07 15:49:58 -07:00
a2583d2be1
Reduce lock contention when planning TSM queries
2015-12-07 15:42:36 -07:00
4da20c49e9
Optimize TSM file scanning for time queries
...
Move the index locations planning to be lazily created after the first
seek when we know what time and direction we're searching for. This
allows files and blocks to be skip before having to scan the files index.
This improves queries times with time filters wherne there are many TSM
files on disk.
2015-12-07 15:42:36 -07:00
99fa678932
Test and variable rename for aggregate math
...
Fixes nits from https://github.com/influxdb/influxdb/pull/5013 .
2015-12-07 14:18:49 -08:00
5d5afcbe50
Merge pull request #5013 from mengjinglei/fix-math-panic
...
fix aggregate math query
2015-12-07 14:07:48 -08:00
ae4140d384
Merge pull request #5000 from influxdb/nc-issue#4849
...
Update Derivative for PositionPoint objects
2015-12-07 13:59:15 -07:00
93d6afec97
Merge pull request #5019 from influxdb/jw-mintime
...
Remove min time from TSM blocks
2015-12-07 15:00:12 -05:00
7ffbbc1072
make fill previous for count() queries work
2015-12-07 12:51:40 -07:00
06bc25d64b
add integration tests for derivative calls and all other valid functions, convert PositionPoint to float64
2015-12-07 12:51:39 -07:00
8096c6b845
Update TSM, address PR #5011 comments
...
* Moved TSM file extension to a constant
* Fixed typos
* Changed group.size() back to being a uint64 since it can have multiple files up to 4GB each.
2015-12-07 14:47:17 -05:00
820b0d31d6
Update TSM to delete from the WAL/cache
...
* Update cache loader to delete entries from cache
* Add cache.Delete()
* Update delete to look at keys in the Cache in addition to the FileStore
* Update cache compaction to never happen if the cache is empty
2015-12-07 14:35:48 -05:00
Jason Wilder
Philip O'Toole
Alexandre Viau
Philip O'Toole
dgnorton
liang@qiniu.com
Nathaniel Cook
Jason Wilder
Paul Dix
Fazal Majid
Nathaniel Cook