Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
8,931 Commits
218 Branches
453 Tags
356 MiB
Commit Graph

8931 Commits (f3e97fdba5e08ec4b02635a05c230c0ab0b4ecf3)

Author SHA1 Message Date
Philip O'Toole 4a5f8c88d1 Switch Circle testing of tsm1 to tsm2 2015-12-05 08:30:15 -08:00
Philip O'Toole 7296de1fac Merge pull request #4999 from influxdb/cache_sort 
Always copy the Cache values for query and merge with snapshot
 2015-12-05 08:15:13 -08:00
Philip O'Toole 1b12ff9c1c Only take write-lock for Values when necessary 2015-12-05 08:06:01 -08:00
Jason Wilder 6592615958 Updated compaction strategy 
This changes compacting files to merge sequences of files in lower generations
up to later generations
 2015-12-04 23:30:39 -07:00
Philip O'Toole 789ab10658 Merge hot cache values with snapshots 
This change starts by building the sequence of entries, which also
allows the required size of destination buffer to be calculated. Then
the buffer is allocated up-front in 1 call.

Each snapshot and hot value-set is appended to the buffer. If ordering
is violated at anytime, set the 'needSort' flag. Sorting, if necessary,
is performed just before returning the data.
 2015-12-04 20:58:02 -08:00
Philip O'Toole 859877fd09 Move all sort logic to entry type 2015-12-04 20:21:16 -08:00
Philip O'Toole 6e91679fab Always copy the Cache values for query 2015-12-04 15:37:45 -08:00
Paul Dix 9637446ba9 Merge pull request #4990 from influxdb/pd-loadmetadata-wal 
Update TSM engine, WAL and encoding
 2015-12-04 18:21:47 -05:00
Michael Desa 14b5ed3001 Merge pull request #4961 from influxdb/md-stress-cluster 
Add cluster support to stress test
 2015-12-04 15:20:31 -08:00
Nathaniel Cook bb111574ce Merge pull request #4996 from influxdb/nc-issue#4404 
Stub out DELETE in parser to return better error
 2015-12-04 15:01:16 -07:00
Nathaniel Cook 3227951069 Stub out DELETE in parser to return better error 2015-12-04 14:47:44 -07:00
Paul Dix 33506e4d3e Update TSM cache and engine LoadMetadataIndex 2015-12-04 16:40:01 -05:00
Paul Dix b0f3dcc8cc Update TSM metadata loading and write snapshot 
* Update WriteSnapshot to always call synchronously
* Update LoadMetadataIndex to load WAL metadata from the cache
 2015-12-04 16:03:17 -05:00
Jason Wilder 357b88c439 Increment sequence of max generation when compaction files 2015-12-04 13:46:28 -07:00
Nathaniel Cook dd9d50125d Merge pull request #4993 from influxdb/nc-issue#4666 
Validate previous value in derivative calls
 2015-12-04 13:17:48 -07:00
Nathaniel Cook bd6961a00e Validate previous value in derivative calc as well 2015-12-04 13:01:37 -07:00
Philip O'Toole 4f69936564 Add more math unit tests to server-level tests 2015-12-04 11:23:35 -08:00
Philip O'Toole 3540f4c168 Fix typo in CHANGELOG 
[ci skip]
 2015-12-04 11:06:30 -08:00
Philip O'Toole 90001e3670 Update CHANGELOG for PR 4984 
[ci skip]
 2015-12-04 11:06:03 -08:00
Philip O'Toole 5c63ccaa6f Revert "Merge pull request #4988 from influxdb/revert-4984-fix-query-panic" 
This reverts commit 44ff2f87db, reversing
changes made to 6fa016447f.
 2015-12-04 11:05:02 -08:00
Jason Wilder 52bec1f7f6 Change TSM file naming to generation-sequence.tsm 2015-12-04 11:51:33 -07:00
Jason Wilder 479469994a Optimize FileStats calls 
FileStats called frequently during compaction planning was too expensive because
they were cleared out every time a file replaced causing them all to be reloaded.
Insted, we grab the stats that are already maintained by the files themselves from
the files when needed.
 2015-12-04 11:16:39 -07:00
Jason Wilder 054e8aa56a Merge pull request #4982 from influxdb/jw-regressions 
Avoid repetitive index searches when iterating over cursors
 2015-12-04 11:10:34 -07:00
Jason Wilder 70710df910 Fix typo 2015-12-04 10:02:59 -07:00
Jason Wilder c7e37766e7 Avoid repetitive index searches when iterating over cursors 
First pass at TSM cursor iteration ended up searching the file indexes
too frequently and hurt performance.  This changes that to search it once
and then have the cursor hold onto the block locations to seek
to.  Doubles the query performance from the first iteration, but still a lot
of room for improvement.
 2015-12-04 10:02:59 -07:00
Jason Wilder 4b7cc6720a Merge pull request #4983 from influxdb/jw-tsm-deletes2 
Implement delete series/measurement
 2015-12-04 10:02:11 -07:00
Jason Wilder c54a3da0ca Implement delete series/measurement 2015-12-04 09:10:26 -07:00
Paul Dix eafb703afc Update TSM engine, WAL and encoding 
* Add InfluxQLType to Values to map the TSM type to InfluxQL
* Fix bug in WAL where close wouldn't nil out the currentSegment after closing it
* Export writeSnapshot to be used in tests, add argument to run it async or not
* Update reloadCache to load temporary metadata information in the engine
* Update LoadMetadataIndex to use the temp WAL metadata information
 2015-12-04 11:09:39 -05:00
Mark Rushakoff d2f8a10f96 Merge pull request #4891 from influxdb/duration-must-have-units 
InfluxQL: FormatDuration uses "u" for microsecond units
 2015-12-04 08:05:21 -08:00
Philip O'Toole 89a3490cae Merge pull request #4989 from influxdb/cache_rename 
Fix comment and remove snapshot stutter
 2015-12-04 07:43:26 -08:00
Philip O'Toole f939e49f0f Fix comment and remove snapshot stutter 2015-12-04 07:29:58 -08:00
Philip O'Toole 5ed416c4f9 Update CHANGELOG for PR4866 
[ci skip]
 2015-12-04 06:21:00 -08:00
Philip O'Toole 44ff2f87db Merge pull request #4988 from influxdb/revert-4984-fix-query-panic 
Revert "fix raw math query panic"
 2015-12-04 06:19:59 -08:00
Philip O'Toole 3264b853cc Revert "fix raw math query panic" 2015-12-04 06:19:06 -08:00
Philip O'Toole 6fa016447f Merge pull request #4984 from mengjinglei/fix-query-panic 
fix raw math query panic
 2015-12-04 06:17:19 -08:00
Philip O'Toole 30a1a0ef8d Update CHANGELOG for recent merges 
[ci skip]
 2015-12-04 06:03:02 -08:00
Philip O'Toole c76b109ef4 Merge pull request #4858 from viru/fix-nested-aggr 
Validate nested aggregations in queries
 2015-12-04 05:58:29 -08:00
Paul Dix b7bae53405 Merge pull request #4980 from influxdb/cursor_desc 
Fix descending cache cursor
 2015-12-04 07:02:13 -05:00
mengjingleli 2602dd241f fix raw math query panic 2015-12-04 15:17:31 +08:00
Adarsha 6a0e60c67e Added mmap implementation for Windows 
Added mmap implementation for Windows. It uses MapViewOfFile similar to Bolt's implementation. MapViewOfFile  returns a pointer and not a byte array. Bolt changed their data structure to support it. 

Instead of changing the implementation of tsm data structure, I used a trick shown in https://groups.google.com/forum/#!topic/golang-nuts/g0nLwQI9www to use SliceHeader to convert the pointer into a slice.
 2015-12-04 10:20:43 +05:30
Adarsha 205fa1b70e Removed Syscall.Mmap to use platform specific mmap 
Removed Syscall.Mmap to use platform specific mmap, ran fmt
 2015-12-04 10:12:24 +05:30
Adarsha d39d0a5c90 Removed Syscall.Mmap to use platform specific mmap 
Updates lines 1794 and 2304 to use mmamp in windows or unix versions instead of Syscall.Mmap
 2015-12-04 09:17:13 +05:30
Jason Wilder 49b47d3584 Merge pull request #4978 from influxdb/jw-regressions 
TSM dev regression fixes
 2015-12-03 20:31:51 -07:00
Philip O'Toole 2d79d7e35f Fix descending cache cursor 2015-12-03 14:34:29 -08:00
Jason Wilder 94e5dc075b Change default stress batch size to 5000 
10000 is too large and causes a lot of allocations.  5000 doubles the
throughput.
 2015-12-03 14:41:46 -07:00
Jason Wilder 66c9ef862e Fix regressions 
Something broke with writing to the WAL now that compactions are running
concurrently.  There was also a performance problem with Next/Prev doing
twice as many searches as necessary.
 2015-12-03 14:25:03 -07:00
Cory LaNou b73b21f062 Merge pull request #4975 from influxdb/issue-4974 
Fix data race in TSDB
 2015-12-03 13:59:55 -06:00
Cory LaNou 7e1dc0231d fix data race in TSDB 2015-12-03 13:52:27 -06:00
Jason Wilder a8f4af36af Merge pull request #4969 from influxdb/jw-tsm-query 
TSM Queries
 2015-12-03 12:46:29 -07:00
Jason Wilder adf5c5b223 Replace Next/Prev with Scan 2015-12-03 12:39:13 -07:00