Commit Graph

197 Commits (6e636264f2c1f0155e59879ad26222862ea4941d)

Author SHA1 Message Date
Philip O'Toole 01ac0b3f23 Tweak compaction log messages 2015-12-15 10:33:13 -08:00
Alexandre Viau b8ea35ffe3 removed trailing space 2015-12-13 16:58:05 -05:00
Tim Raymond 120e9e8421 Remove Registration section from example config
Since the registration service has been removed, this section of the
example config is irrelevant.
2015-12-10 16:24:15 -05:00
Paul Dix 8096c6b845 Update TSM, address PR #5011 comments
* Moved TSM file extension to a constant
* Fixed typos
* Changed group.size() back to being a uint64 since it can have multiple files up to 4GB each.
2015-12-07 14:47:17 -05:00
Paul Dix 937233d988 Update TSM compaction planning logic
* Update Plan to do a full compaction if cold for writes
* Remove MaxFileSize as a config variable from Compactor. Should be a set constant
* Update Plan to keep track of if the last check was fully compacted so we can skip future planning calls
* Update compact min file count to 3 so that compactions run more frequently
2015-12-07 08:26:30 -05:00
Paul Dix 1bee7d1512 Update TSM, remove old version, add config
* remove rolloverTSMFileSize constant that is no longer used
* remove the maxGenerationFileCount since it is no longer a limitation that's necessary with the new compaction scheme. We no longer read WAL segments as part of the compaction so memory is only used as we read in each individual key
* remove minFileCount and switch to a user configurable variable
* remove the mutex from WALSegmentWriter. There's never more than one open in the WAL at one time and it's not exported through any function so the lock on the WAL should be used. This simplified keeping track of the last write time and removed a bunch of unnecessary locks.
* update WALSegmentWriter.Write to take the compressed bytes so that encoding and compression can occur before the call to write (while we don't hold the WAL lock)
* remove a bunch of unnecessary locking in WAL.writeToLog
* Add check for TSM file magic number and vesion
* Remove old tsm, log, and unused cursor code
* Remove references to tsm1dev everywhere except in the inspector
* Clean up config options for compaction and snapshotting
* Remove old TSM configuration options
* Update the config.sample.toml with TSM options
* Update WAL compact to force if it has been cold for writes for a configurable period of time (1h by default)
2015-12-06 18:50:39 -05:00
gunnaraasen fccd6a9399 Clarify engine comment about tsm1 2015-12-02 00:09:50 -08:00
Philip O'Toole 83b78fbc25 Correct reversed write timeouts
[ci skip]
2015-11-20 11:55:01 -08:00
Philip O'Toole b2419ca95d Clarify when precreation may happen
[ci skip]
2015-11-20 11:22:43 -08:00
Philip O'Toole 4281da6688 Correct WAL logging enabled flag
[ci skip]
2015-11-17 08:07:55 -08:00
Philip O'Toole 7ea9b3e49e Allow openTSDB point errors logging to be disabled 2015-11-13 14:54:54 -08:00
Ross McDonald bd186195db Restructured filesystem hierarchy, and updated pre/post installation scripts to ease upgrade progress. Also adding first iteration of new build script (build.py).
New package filesystem hierarchy:
	 - /var/lib/influxdb => Data directories
	 - /usr/lib/influxdb => Scripts and other miscellaneous files
	 - /etc/influxdb => Configuration
	 - /usr/bin/ => Where InfluxDB binaries will live
2015-11-12 10:42:41 -06:00
Cory LaNou a4c54cb0a8 clarify config comment 2015-11-11 11:16:40 -06:00
Cory LaNou 615024ac47 update sample config (was missing cluster-tracing as well). 2015-11-11 10:58:33 -06:00
Cameron Sparr 9625953d3e Add UDP OS buffer size recommendations 2015-11-10 11:00:11 -07:00
Philip O'Toole cb548a65ef Clearly mark tsm1 as experimental in sample config
[ci skip]
2015-11-04 08:27:17 -08:00
Philip O'Toole 3ee1f19316 Add precreation section to sample config 2015-10-28 08:19:37 -07:00
Philip O'Toole 7d22fc75a3 Support configurable purge interval 2015-10-26 13:07:25 -07:00
Philip O'Toole 667ad3342a Refactor registration as a service
Registration also involves statistics and diagnostics upload, for the
purposes of remote management. This means there will be long-running
goroutines in effect. Therefore move the code to a service model.
2015-10-19 15:01:14 -07:00
Philip O'Toole 73f18d5dc4 More information about Enterprise registration
[ci skip]
2015-10-15 14:04:57 -07:00
Philip O'Toole 7521b9a897 Add Enterprise registration configuration details
[ci skip]
2015-10-15 14:04:19 -07:00
Philip O'Toole f298e88b39 Auto-create UDP service database
All other services operate like this, so make UDP service consistent.
2015-10-14 08:30:09 -07:00
Paul Dix 40ff4f4a86 Change default to bz1 2015-10-06 15:30:34 -07:00
Philip O'Toole dbba6356df Whitespace clean-up
[ci skip]
2015-10-02 23:30:00 -07:00
Philip O'Toole 5e72fec32c Update sample config with HH retry-max-interval
[ci skip]
2015-10-01 12:20:35 -07:00
Philip O'Toole 66d3ef1ce0 shard-writer-timeout defaults to 2x write-timeout
[ci skip]
2015-09-30 16:56:23 -07:00
Philip O'Toole a196d3663a Allow configuration of UDP retention policy
Fixes issue #4529
2015-09-28 15:17:56 -07:00
Philip O'Toole b079d201a0 Document openTSDB defaults in sample config
[ci skip]
2015-09-25 14:04:37 -07:00
Philip O'Toole 1fc61a428c Add default Graphite database to sample config
[ci skip]
2015-09-24 18:50:24 -07:00
Philip O'Toole 620d3740ad More corrections of monitor sample config
[ci skip]
2015-09-18 15:31:44 -07:00
Philip O'Toole c5b6c72fdd Correct comments in monitor config block
[ci skip]
2015-09-18 15:30:36 -07:00
Philip O'Toole f73bc6ff19 Merge pull request #4140 from influxdb/engine_config
Make engine configurable
2015-09-16 21:17:43 -07:00
Philip O'Toole e49644ea94 Update CHANGELOG 2015-09-16 19:30:02 -07:00
Philip O'Toole 7b1a4e6700 Control whether each query should be logged
Fixes issue #4138
2015-09-16 19:26:23 -07:00
Philip O'Toole e4fde993f1 Make engine configurable 2015-09-16 19:09:25 -07:00
Philip O'Toole 3cb29d9241 By default write stats to default retention policy
This reverts to a previous design for storing stats, whereby if a
non-default retention policy is configured as the destination retention
policy, it is up the user to explicitly create it, with the desired
replication factor and duration.
2015-09-10 15:08:09 -07:00
Philip O'Toole 70607836e1 Set default monitor store interval to 10 seconds 2015-09-08 20:37:15 -07:00
Philip O'Toole 24aca5611a Add batch-pending control to openTSDB input 2015-09-08 19:35:42 -07:00
Philip O'Toole 5373f263a3 Add pending control to batcher
With this change, the generic batcher used by many inputs can now be
buffered. Testing shows that this performance of the Graphite input by
10-100%, with the biggest improvements at lower numbers of connections.
2015-09-08 19:32:00 -07:00
Philip O'Toole 349ba8b307 Add batching and stats to openTSDB input 2015-09-08 16:19:50 -07:00
Alexandre Viau f0c57066c5 removed trailing spaces 2015-09-06 22:16:00 -04:00
Philip O'Toole 1fdf361f00 Merge pull request #4015 from influxdb/configurable_internal_rp
Monitor retention policy is configurable
2015-09-05 08:53:43 -07:00
Philip O'Toole 406480f4b2 Retention enforcement period to 30 minutes
This was previously set in the code.

[ci skip]
2015-09-04 23:30:13 -07:00
Philip O'Toole 214cfea53c Monitor retention policy is configurable 2015-09-04 22:53:04 -07:00
Philip O'Toole c0d61740a4 Ensure monitor database exists
This requires a leader in the cluster, so wait for that before
attempting the database creation.
2015-09-02 16:26:16 -07:00
Philip O'Toole 53f8cb9714 Disable monitor store in config as well as code
[ci skip]
2015-09-02 08:09:17 -07:00
Philip O'Toole aeee50582b Add port to default store-address
[ci skip]
2015-09-02 07:47:19 -07:00
Philip O'Toole 366c0115f9 Serve expvar information from HTTP package 2015-09-01 15:22:37 -07:00
Philip O'Toole f05dc20b58 Hook new monitor service to server
u
2015-09-01 15:03:52 -07:00
Philip O'Toole d87e668c78 Remove obsolete monitoring code 2015-09-01 15:03:52 -07:00
Philip O'Toole 6193226ce8 Revert "Merge pull request #3771 from influxdb/tcp_graphite_timeout"
This reverts commit d7f646f7a4, reversing
changes made to d6f9903f10.

Conflicts:
	CHANGELOG.md

Fixes issue #3809
2015-08-24 10:53:14 -07:00
Philip 4930a6d8bb Start adding timeouts to TCP Graphite input 2015-08-20 15:10:22 -07:00
Paul Dix 9df3b7d828 Add WAL configuration options 2015-08-18 16:59:54 -04:00
Philip O'Toole 8dbcff833b Revert "Revert "Merge pull request #3599 from tpitale/multiple-udp-servers""
This reverts commit 5f83f038e1.
2015-08-10 16:21:27 -07:00
Philip O'Toole 5f83f038e1 Revert "Merge pull request #3599 from tpitale/multiple-udp-servers"
This reverts commit 7f35d65412, reversing
changes made to f828781544.
2015-08-10 14:44:14 -07:00
Tony Pitale e943afacdc Change (previously unused) single udp config to support multiple UDP listeners
do not use NewConfig for UDP

appendUDPService must return a value

udp service does not need to handle error

fix missing case of c.UDP in tests
2015-08-09 11:28:09 -04:00
Paul Dix fb76c34a79 Merge pull request #3426 from jhorwit2/jah/continuous-logging
Added additional logging to continuous queries
2015-07-27 17:43:55 -04:00
Todd Persen 381c300ac5 Merge pull request #3424 from influxdb/pd-update-sample-config
Update sample config with information on batching for UDP, Graphite, …
2015-07-23 17:09:28 -07:00
Josh Horwitz e722b4b4ad Added additional logging to continuous queries 2015-07-23 19:09:42 -04:00
Gunnar d9f16987fc Merge pull request #3439 from influxdb/ga-admin-https
Add HTTPS option and logger to admin service
2015-07-23 15:09:56 -07:00
gunnaraasen 54c4066a5f Remove cert.pem file 2015-07-23 14:55:56 -07:00
gunnaraasen e5ead383e5 Add HTTPS option and logger to admin service 2015-07-22 16:49:12 -07:00
Paul Dix 205a10dbe3 Update sample config with information on batching for UDP, Graphite, and CollectD 2015-07-21 17:48:52 -07:00
Todd Persen 47d5c2d65f First pass at re-enabling HTTPS. 2015-07-17 16:57:31 -07:00
Josh Horwitz 4529af1afd Fixed flush interval & flush delay parameters 2015-07-15 16:59:07 -04:00
Josh Horwitz 307154573c Updated wal & flush parameters
As you can see [here](b2b69c63fe/tsdb/config.go (L23)), it appears the configuration parameters were updated in code, but not the default configuration.
2015-07-11 12:36:00 -04:00
Philip O'Toole d09b0867f7 Add explanations of PointWriter configs 2015-07-02 12:50:15 -04:00
Philip O'Toole a0a891f0b1 Add explanatory note on WAL configuration 2015-07-02 10:40:29 -04:00
Can ZHANG c130efb5e2 Add fields to config metric name schema of graphite 2015-06-24 23:09:06 -06:00
Philip O'Toole d159239714 Update sample config to describe reporting 2015-06-11 00:21:15 -07:00
Philip O'Toole e84f661f7e Use defaults for Graphite input where necessary 2015-06-10 20:38:17 -07:00
Todd Persen f4c07d9d92 Add some section-level comments to the config. 2015-06-09 10:27:27 -07:00
Todd Persen f9188687de Clean up intervals and add graphite section. 2015-06-09 03:38:07 -07:00
Todd Persen f44f433c90 Create a valid default config for v0.9.0 2015-06-08 14:44:52 -07:00
Ben Johnson b925e1c1af Multi-node clustering.
This commit adds the ability to cluster multiple nodes together to share
the same metadata through raft consensus.
2015-06-05 14:41:19 -06:00
Renan Strauss 3b09a59540 Add UDP service back 2015-06-04 10:24:48 +02:00
Philip O'Toole 0c26fd67a6 Correct comments for batcher timeouts 2015-05-29 09:29:08 -07:00
Philip O'Toole eae313c4e2 Integrate batching with collectd 2015-05-28 15:22:36 -07:00
Philip O'Toole d231fc1290 Add Graphite batching params to example config 2015-05-28 12:17:56 -07:00
Chris Laws 6bb0dfdd21 Fixes typos in sample config file 2015-05-24 09:25:07 +09:30
Philip O'Toole f063ebfad2 Default Raft election timeout to 5 seconds 2015-05-12 13:57:28 -07:00
Philip O'Toole 8ed9e6895f Reduce maximum topic size to 50MB
1GB per topic seems way to large. Instead make it 50MB. Topic data will
never be deleted until at least 1 data node has replicated the data.
2015-04-30 17:14:36 -07:00
Philip O'Toole 6f326bcd9a Add details on http-access 2015-04-24 16:20:59 -07:00
Philip O'Toole 86db6df16c 5-second Raft election timeout during CI testing
CI testing may suffer from lack of CPU resources, meaning leader
elections may continually occur. This gives leader nodes more time to
send out heartbeats.
2015-04-23 15:59:36 -07:00
Philip O'Toole f2783353d9 Allow Raft election timeout to be configured 2015-04-23 15:05:40 -07:00
Philip O'Toole dab100a3b1 Update sample config with topic truncation 2015-04-14 16:35:44 -07:00
Jason Wilder 32bc13de7f Remove snapshot port/bind-address from sample config
No longer used
2015-04-13 17:19:21 -06:00
Jason Wilder 423ce6ab2b Update sample toml to include join-urls
Fixes #2221
2015-04-09 12:38:41 -06:00
Jason Wilder ba61643a91 Update config.toml.sample
Removed unused items and add new ones
2015-04-06 16:38:01 -06:00
Tristan Colgate-McFarlane 32d6433c04 OpenTSDB server interface
Add an input collector for the OpenTSDB telnet protcol
2015-04-05 10:29:49 +01:00
Philip O'Toole a540780543 Remove leading whitespace in example config 2015-04-03 16:48:23 -07:00
Philip O'Toole 84d590ce44 Monitoring database should not be configurable 2015-04-03 14:40:36 -07:00
Philip O'Toole 5df05d1256 It's for stats and diags, not just diags 2015-04-03 14:26:17 -07:00
Philip O'Toole 9b4b5dd40a Fix up paths for run and data 2015-04-03 12:52:37 -07:00
Philip O'Toole 5e08351a27 Merge pull request #2087 from influxdb/_internal_not_internal
Use _internal as default self-monitoring database
2015-03-26 17:13:44 -07:00
Philip O'Toole f829355e3e Allow snapshot endpoint to be disabled
Fix isse #2086
2015-03-26 16:13:23 -07:00
Philip O'Toole 7a5f66c75a Use _internal as default self-monitoring database 2015-03-26 14:12:14 -07:00
Philip O'Toole 9b357291e4 Add details on snapshot configuration 2015-03-26 13:56:38 -07:00
Philip O'Toole c461c7e7b4 Remove logging to specific file 2015-03-25 17:41:39 -07:00
Philip O'Toole 2fe974f1d6 Remove obsolete PEM file 2015-03-25 15:45:21 -07:00