Commit Graph

8557 Commits (1ce8d6290bd656840eccab01c39359e4b87f7654)

Author SHA1 Message Date
Jason Wilder 1ce8d6290b Remove values pool replacement
Getting an intermittent test failure with this so removing it for now since compactions
are still able to keep up without it.  Will need to look into this further because the
allocations is still very high and will affect compactions over longer periods of time.
2015-11-24 13:40:07 -07:00
Jason Wilder 0832a03333 Move pools to separate file 2015-11-24 09:44:37 -07:00
Jason Wilder a6541937f8 Add dumptsmdev to influx_inspect
Allow inspecting the updated TSM format.
2015-11-24 08:50:13 -07:00
Jason Wilder 25206c729c Add compactor type 2015-11-24 08:50:07 -07:00
Jason Wilder f70323cb89 Add MergeIterator
MergeIterator will be used to merge multiple TSM KeyIterators and the
WAL KeyIterator using a stream based iteration approach.  Each iteration
cycle returns a key and values ordered in way to write a new TSM file
optimally.
2015-11-23 14:59:15 -07:00
Jason Wilder 5334271e26 Add KeyIterator for WAL segments
This provides and interface and type to combine multiple WAL segments
in order and then allow the values to be read in an order suitable for
writing to a TSM file.
2015-11-23 14:59:15 -07:00
Jason Wilder a8c6f09cb3 Merge pull request #4845 from influxdb/jw-tsm3
Extract TSM WAL
2015-11-23 14:15:41 -07:00
Jason Wilder d2b045f89b Code cleanup 2015-11-23 14:03:50 -07:00
Jason Wilder 697cfe604b Add stubbed out dev tsm engine
Starting to integrate some of the components into a engine that is
usable for development purposes.  This allows the code to evolve while
keeping the existing TSM engine in tact for reference.

Currently, just the WAL is wired up so writes can be tested.  Other engine
functions will panic the server if called.
2015-11-23 13:55:34 -07:00
Jason Wilder 7461b61bf2 Fix race in WAL and WALSegmentWriter
WAL currentSegmentWriter was not accessed under a mutex.  The WALSegmentWriter
also did not use a mutex to protect the underlying writer.
2015-11-23 13:55:34 -07:00
Jason Wilder aa00ef953a Fix typo in func names 2015-11-23 13:55:34 -07:00
Jason Wilder e2b1a09ece Implemment WAL write/delete functions 2015-11-23 13:55:33 -07:00
Jason Wilder afc0d5bfb9 Add WALSegmentReader/Writer
Basic types for reading and writing WAL segment files.
2015-11-23 13:55:33 -07:00
Jason Wilder 151b33d000 Rename wal.go to log.go
This is the existing WAL + cache implementation.  Moving it to a separate file
so that it can remain intact while a refactoring to a independent WAL can occur.

The WAL was also named Log in the code so this names file more closely to the concept
in the code.
2015-11-23 13:53:30 -07:00
Philip O'Toole 1a77c76245 Merge pull request #4863 from influxdb/simple_wal_cache
Move to simpler cache
2015-11-23 12:49:58 -08:00
Philip O'Toole 7f6279b9ad Add `go clean` to build docs
[ci skip]
2015-11-23 10:51:16 -08:00
Philip O'Toole 524ede8e5b Merge pull request #4883 from danbst/patch-1
fix collectd manual typo
2015-11-23 09:10:43 -08:00
Данило Глинський (Danylo Hlynskyi) 8ba35c3b8c fix collectd manual typo 2015-11-23 18:54:47 +02:00
Philip O'Toole 46988d22c7 Update CHANGELOG for PR 4790
[ci skip]
2015-11-23 07:45:19 -08:00
Philip O'Toole 42392869f4 Merge pull request #4855 from runner-mei/patch-3
fix TestCluster_OpenRaft is timeout
2015-11-23 07:43:32 -08:00
runner ce26ee35fa fix TestCluster_OpenRaft is timeout #4853
This bug is produce by tcp buffer, must flush tcp stream after the copy L53, but Flush is not exists in the net.TcpConn struct.
2015-11-22 13:34:37 +08:00
Philip O'Toole 8fe2469c75 Make it clear where `go install` puts the binaries
[ci skip]
2015-11-21 16:55:56 -08:00
Philip O'Toole 37818fbffc Fix typo in build instructions
[ci skip]
2015-11-21 16:52:09 -08:00
Philip O'Toole 96c4ae9f4f Final tweaks to build instructions
[ci skip]
2015-11-21 16:51:10 -08:00
Philip O'Toole 6b5f5b2fe8 Update CONTRIBUTING.md 2015-11-21 16:50:20 -08:00
Philip O'Toole 52a94156e1 Clarify build vs. install
[ci skip]
2015-11-21 16:48:38 -08:00
Philip O'Toole b1daac7ef7 Group build directions together
[ci skip]
2015-11-21 16:43:42 -08:00
Philip O'Toole 19f53d8a75 Add some simple benchmarks 2015-11-20 21:09:44 -08:00
Philip O'Toole 5b573b9248 Move to simpler cache
This cache simply evicts as much as possible whenever a checkpoint is
set.
2015-11-20 21:09:24 -08:00
Philip O'Toole 3ae624e502 Merge pull request #4817 from mengjinglei/fix-MinMax
fix issue #4816 some aggregate function work incorrectly in cluster mode
2015-11-20 18:58:07 -08:00
mengjinglei 580f71ffc8 updated CHANGELOG.md 2015-11-21 09:47:41 +08:00
mengjinglei 9b6cdb4622 fix Top&Bottom function 2015-11-21 09:36:55 +08:00
mengjingleli c94077e23a fix min&max 2015-11-21 09:29:17 +08:00
Mark Bates 298b149836 Merge pull request #4860 from influxdb/fix-enterprise-usage
%s will convert a float to a less than useful string. %v is better.
2015-11-20 15:57:01 -05:00
Mark Bates 98632778dd %s will convert a float to a less than useful string. %v is better. 2015-11-20 15:43:35 -05:00
Mark Bates 5cca0d2864 Merge pull request #4859 from influxdb/fix-enterprise-usage
ServerID and ClusterID need to be strings when being sent to Enterprise.
2015-11-20 15:33:54 -05:00
Mark Bates c71e323d63 ServerID and ClusterID need to be strings when being sent to Enterprise. 2015-11-20 15:22:27 -05:00
Philip O'Toole 83b78fbc25 Correct reversed write timeouts
[ci skip]
2015-11-20 11:55:01 -08:00
Philip O'Toole 15d9a6316a Calculate MD5 sums during packaging 2015-11-20 11:36:19 -08:00
Philip O'Toole b2419ca95d Clarify when precreation may happen
[ci skip]
2015-11-20 11:22:43 -08:00
Philip O'Toole b1c5a36b0d Merge pull request #4846 from jsternberg/feature/allow-nan-in-graphite-service
Allow NaN as a valid value on the graphite service
2015-11-20 08:09:51 -08:00
Jonathan A. Sternberg 5fa36639db Allow NaN as a valid value on the graphite service
The canonical graphite implementation will read and discard NaN values
instead of throwing an error when reading on the line receiver protocol.
Since this is the default behavior for graphite, InfluxDB should have
the same behavior for compatibility.

Previously, a NaN value would result in an error printed to the console.
When you have a large number of NaN values being sent every minute, this
results in the log file filling with useless messages.
2015-11-20 11:07:25 -05:00
Jason Wilder 6df6abea0e Update changelog 2015-11-20 09:05:07 -07:00
Jason Wilder d2c94fce16 Merge pull request #4841 from e-dard/points-refactor
Fix parsing issues in models.scanKey
2015-11-20 09:03:05 -07:00
Philip O'Toole 82e2ff5863 Merge pull request #4854 from influxdb/g_stat_typo
Fix minor typo in variable name
2015-11-20 07:55:37 -08:00
Philip O'Toole d86a02eeab Fix minor typo in variable name 2015-11-20 07:48:42 -08:00
Philip O'Toole ca8530d5d9 0.9.5. is out
[ci skip]
2015-11-20 07:31:05 -08:00
Philip O'Toole 67b17a7ede Merge pull request #4843 from viru/lint-fixes
Comment additions to services to satisfy golint
2015-11-20 07:11:46 -08:00
Philip O'Toole f6f25a1689 Merge pull request #4837 from gobwas/patch-1
Rename `NewClient` to `NewHTTPClient`
2015-11-20 06:41:55 -08:00
Philip O'Toole 8ef5a056ba Merge pull request #4815 from li-ang/fix_4801
Fix aggregate output across the cluster
2015-11-20 06:40:18 -08:00