Commit Graph

8793 Commits (992aea7bd34c8e8e62bf5131613984de05f88b62)

Author SHA1 Message Date
Jason Wilder 992aea7bd3 Merge pull request #5060 from influxdb/jw-drop-db
Cancel writing TSM files when engine closes
2015-12-08 16:16:07 -07:00
Paul Dix b192136887 Merge pull request #5058 from influxdb/pd-update-compaction-logic
Update TSM compaction logic
2015-12-08 18:14:15 -05:00
Paul Dix 27cc2ea0cc Update compact.Plan 2015-12-08 18:01:31 -05:00
Jason Wilder d7cff651d1 Cancel writing TSM files when engine closes
If the engine is closed while a compaction is going on, the close call
blocks until the goroutine exits.  This could be several minutes because
the control does not return back up to the channel selector while there is
still data to write.
2015-12-08 15:41:53 -07:00
Paul Dix 96445a53a7 Update TSM compaction logic
* Update compaction to look at newest files of the smallest step first
* Update compaction to look at older files in larger steps if newer files don't have enough small steps to compact
* Changed the TestDefaultCompactionPlanner_CombineSequence test to reflect what's possible now. We'd only have multiple files in the same generation if the all files but one were over the max allowable size.
* Clean up the logic on when full compactions are run and when planning can be skipped
2015-12-08 17:33:38 -05:00
Jason Wilder 62cb3a1e9b Merge pull request #5057 from influxdb/jw-5046
Fix leaking TSM files when compacting
2015-12-08 13:11:46 -07:00
Jason Wilder 81fd80eb89 Merge pull request #5051 from influxdb/jw-search
Avoid allocating strings during search
2015-12-08 13:10:21 -07:00
Jason Wilder 3543917a74 Avoid allocating strings during search 2015-12-08 13:02:17 -07:00
Jason Wilder 99c313ddae Fix leaking TSM files when compacting
The files being read were not closed after the compaction ran causing
them to leak.

Fixes #5046
2015-12-08 12:55:30 -07:00
Philip O'Toole ffd232461a Merge pull request #5055 from influxdb/skipped_c_tests
Skip cluster tests until fixed
2015-12-08 11:10:50 -08:00
Philip O'Toole cfc000a688 Skip cluster tests until fixed 2015-12-08 10:58:53 -08:00
Jason Wilder 8f6b6f9cb5 Merge pull request #5053 from influxdb/jw-tsm-deletes
Fix performance of dropping large number of keys
2015-12-08 11:47:41 -07:00
Philip O'Toole f40e6ee243 Nightly is now 0.10.0
[ci skip]
2015-12-08 10:00:57 -08:00
Jason Wilder 9d82e24ca0 Fix performance of dropping large number of keys 2015-12-08 10:47:06 -07:00
Jason Wilder 7a9019cf41 Merge pull request #5052 from influxdb/jw-compact-full2
Set full compaction duration option on planner
2015-12-08 10:05:38 -07:00
Jason Wilder f245b44afa Set full compaction duration option on planner
Was set on engine and not planner so it was always 0.
2015-12-08 09:56:36 -07:00
Paul Dix b341fdf90f Update CHANGELOG.md 2015-12-08 10:19:47 -05:00
Philip O'Toole 4f7479b174 Merge pull request #5043 from influxdb/fix_monitor_error
More precise error checking
2015-12-08 07:04:37 -08:00
Philip O'Toole ddb4039564 More precise error checking
This is due to currently brittle error "marshalling" in our system, so a
more precise compare is required.

Fixes issue #5037.
2015-12-08 06:47:52 -08:00
Paul Dix 6b040c82f0 Update CHANGELOG.md 2015-12-08 09:40:45 -05:00
Paul Dix a8b3358121 Update CHANGELOG.md 2015-12-08 09:34:32 -05:00
Philip O'Toole 9c65e1750a Update CHANGELOG for PR 5016
[ci skip]
2015-12-07 20:29:02 -08:00
Jason Wilder d32aeb2535 Merge pull request #5031 from influxdb/jw-mintime
Dedupe points at query time if there are overlapping blocks
2015-12-07 21:28:29 -07:00
Philip O'Toole c6ba1bff2a Merge pull request #5016 from oiooj/master
Fix raftState close panic
2015-12-07 20:27:31 -08:00
Jason Wilder 87892d79da Dedupe points at query time if there are overlapping blocks 2015-12-07 21:10:10 -07:00
Philip O'Toole ff4c30bc8c Merge pull request #5029 from influxdb/dont_quit_udp_on_bad_parse
Drop UDP point on bad parse and keep going
2015-12-07 19:48:11 -08:00
Philip O'Toole a5cb913035 Drop UDP point on bad parse and keep going
Fixes issue #4992.
2015-12-07 19:47:59 -08:00
oiooj 134546ee18 Fix raftState close panic 2015-12-08 11:41:25 +08:00
Philip O'Toole 70225ec662 Remove duplicate feature listing from 0.9.6
[ci skip]
2015-12-07 19:17:11 -08:00
Paul Dix c7af658a12 Update CHANGELOG.md 2015-12-07 21:15:01 -05:00
Paul Dix f7b8321228 Merge pull request #5027 from Apsalar/solaris-tsm1-issue#4787
fix tsm1 for Solaris #4787, passes unit tests now
2015-12-07 21:13:42 -05:00
Fazal Majid bb386219f4 ran go fmt on mmap_solaris.go #4787 2015-12-07 17:41:26 -08:00
Philip O'Toole f326c6c0e4 Add 0.9.7 section to CHANGELOG
[ci skip]
2015-12-07 17:39:56 -08:00
Philip O'Toole 204f160f3e Bump admin UI to 0.9.7
[ci skip]
2015-12-07 17:35:36 -08:00
Philip O'Toole c0418149c9 master is not 0.9.7
[ci skip]
2015-12-07 17:32:56 -08:00
Fazal Majid 0f889a77d1 fix tsm1 for Solaris #4787, passes unit tests now 2015-12-07 17:14:26 -08:00
Jason Wilder 4f30d396ae Merge pull request #5026 from influxdb/jw-mintime
Optimize TSM queries with time filter
2015-12-07 15:49:58 -07:00
Philip O'Toole 940b4e2a0c Merge pull request #5023 from influxdb/agg_math_nit
Test and variable rename for aggregate math
2015-12-07 14:43:44 -08:00
Jason Wilder a2583d2be1 Reduce lock contention when planning TSM queries 2015-12-07 15:42:36 -07:00
Jason Wilder 948973292b Update influx_inspect to handle min time removed from blocks 2015-12-07 15:42:36 -07:00
Jason Wilder 4da20c49e9 Optimize TSM file scanning for time queries
Move the index locations planning to be lazily created after the first
seek when we know what time and direction we're searching for.  This
allows files and blocks to be skip before having to scan the files index.

This improves queries times with time filters wherne there are many TSM
files on disk.
2015-12-07 15:42:36 -07:00
Philip O'Toole 99fa678932 Test and variable rename for aggregate math
Fixes nits from https://github.com/influxdb/influxdb/pull/5013.
2015-12-07 14:18:49 -08:00
Philip O'Toole 5d5afcbe50 Merge pull request #5013 from mengjinglei/fix-math-panic
fix aggregate math query
2015-12-07 14:07:48 -08:00
Nathaniel Cook ae4140d384 Merge pull request #5000 from influxdb/nc-issue#4849
Update Derivative for PositionPoint objects
2015-12-07 13:59:15 -07:00
Paul Dix 93d6afec97 Merge pull request #5019 from influxdb/jw-mintime
Remove min time from TSM blocks
2015-12-07 15:00:12 -05:00
Paul Dix 19f2a75229 Merge pull request #5011 from influxdb/pd-compaction-settings
Update TSM, remove old version, add config
2015-12-07 15:00:00 -05:00
Nathaniel Cook 7ffbbc1072 make fill previous for count() queries work 2015-12-07 12:51:40 -07:00
Nathaniel Cook 06bc25d64b add integration tests for derivative calls and all other valid functions, convert PositionPoint to float64 2015-12-07 12:51:39 -07:00
Paul Dix 8096c6b845 Update TSM, address PR #5011 comments
* Moved TSM file extension to a constant
* Fixed typos
* Changed group.size() back to being a uint64 since it can have multiple files up to 4GB each.
2015-12-07 14:47:17 -05:00
Paul Dix 820b0d31d6 Update TSM to delete from the WAL/cache
* Update cache loader to delete entries from cache
* Add cache.Delete()
* Update delete to look at keys in the Cache in addition to the FileStore
* Update cache compaction to never happen if the cache is empty
2015-12-07 14:35:48 -05:00