Commit Graph

139 Commits (82b3108f6de82edf793d9adcc9498efcc13c7bd8)

Author SHA1 Message Date
Jason Wilder 82b3108f6d Refactor execRun to RunCommand 2015-04-06 16:37:59 -06:00
Philip O'Toole dbb7d2a319 Tweak openTSDB changes and update CHANGELOG 2015-04-06 11:10:50 -07:00
Tristan Colgate-McFarlane 32d6433c04 OpenTSDB server interface
Add an input collector for the OpenTSDB telnet protcol
2015-04-05 10:29:49 +01:00
Jason Wilder 9ee0f6445e Fix broker connect race at startup
When a data node starts up, the broker URLs were not set before
they were actually being used.  The call to client.Open() in
turn triggers the raft streamer and heartbeat which try to connect
to the broker.   If those started before the subsequent client.SetURLs()
call, you would see the following error in the logs at startup:

[messaging] 2015/04/01 11:59:22 reconnecting to broker: url={  <nil>  /messaging/messages index=2&streaming=true&topicID=0 }, err=Get /messaging/messages?index=2&streaming=true&topicID=0: unsupported protocol scheme ""

Fixing this race uncovered another bug where the join urls would be
cleared the first time the broker was started.  In this case, the
join urls should be left alone since they were set properly w/ SetURLs.

Fixes #2152
2015-04-03 21:04:42 -06:00
Jason Wilder 6d4c7e9cd5 Handle broker and data node endpoints regardless of role
This is a pre-requisite for #1934.  When running separate
broker and data nodes, you currently need to know what role
a host is performing.  This complicates cluster setup in
that you must configure separate broker URLs and data node
URLs.

This change allows a broker only node to redirect data nodes endpoints
to a valid data node and a data only node to redirect broker
endpoints to a valid broker.
2015-04-03 21:00:43 -06:00
Philip O'Toole 84d590ce44 Monitoring database should not be configurable 2015-04-03 14:40:36 -07:00
Philip O'Toole 5df05d1256 It's for stats and diags, not just diags 2015-04-03 14:26:17 -07:00
Jason Wilder 91fb7e3756 Track data node urls on brokers
This sends data node urls via the broker heartbeat from each data
node.  The urls are tracked on the broker to support simpler
cluster setup as well as distributed queries.
2015-04-02 11:27:53 -06:00
Philip O'Toole f829355e3e Allow snapshot endpoint to be disabled
Fix isse #2086
2015-03-26 16:13:23 -07:00
Philip O'Toole c461c7e7b4 Remove logging to specific file 2015-03-25 17:41:39 -07:00
Ben Johnson 21782c0a67 Merge branch 'master' of https://github.com/influxdb/influxdb into backup-restore 2015-03-24 16:05:49 -06:00
Philip O'Toole fba41df82b Push version and commit hash onto Server 2015-03-23 23:45:57 -07:00
Ben Johnson 3befa12fa3 Merge branch 'master' of https://github.com/influxdb/influxdb into backup-restore
Conflicts:
	cmd/influxd/main.go
	cmd/influxd/run.go
2015-03-22 15:38:41 -06:00
Ben Johnson 11c808f55f Add restore and bootstrap.
This commit adds the "influxd restore" command to the CLI. This allows
a snapshot that has been produced by "influxd backup" to be restored
to a config location and the broker and raft directories will be
bootstrapped based on the state of the snapshot.
2015-03-22 15:31:49 -06:00
Ben Johnson 963d277a75 Add "influxd backup" command.
This commit adds the backup command to the influxd binary as well as
implements a SnapshotWriter in the influxdb package.

By default the snapshot handler binds to 127.0.0.1 so it cannot be
accessed outside of the local machine.
2015-03-22 10:54:14 -06:00
Philip O'Toole ee29214898 Make it clear where influxd storage is 2015-03-20 15:19:30 -07:00
Philip O'Toole 45ac8ff2d9 Explicitly check for errors getting current user 2015-03-20 15:18:29 -07:00
Philip O'Toole f6f74a11bd Don't check 'configExists' at Run() level
*config was always non-null, since code at a higher level ensures that a
default config is passed down if no config is specified. So this logic
was pointless.
2015-03-20 14:10:50 -07:00
Grégory Starck 0c7e062a18 Also print the broker path.
So to know/see where it's actually located.
2015-03-18 11:58:56 -04:00
Cory LaNou 961e2ee944 Print config 2015-03-16 16:24:44 -06:00
Philip O'Toole 50d2470041 Write totals, not diff, of internal stats 2015-03-15 14:32:46 -07:00
Philip O'Toole d627634991 Ensure internal retention policy exists 2015-03-15 14:32:46 -07:00
Philip O'Toole f4b3e3da9f Fix final 'go vet' errors 2015-03-15 14:32:46 -07:00
Philip O'Toole ae3b3d5252 Rename "metrics" to "stats" 2015-03-15 14:32:46 -07:00
Philip O'Toole ea7b7be534 Fix 'go vet' errors 2015-03-15 14:32:11 -07:00
Philip O'Toole 5240151517 Actually start self-monitoring if requested 2015-03-15 14:32:11 -07:00
Philip O'Toole f730257ee4 Implement self-monitoring 2015-03-15 14:31:16 -07:00
Ben Johnson 53dbec8232 Add config notifications and increased test coverage. 2015-03-14 13:36:06 -06:00
Ben Johnson 4b9a93d924 Merge branch 'master' of https://github.com/influxdb/influxdb into stateless-broker 2015-03-12 15:46:04 -06:00
Philip O'Toole d82d040e59 Create databases for Graphite at higher level
By doing this the SeriesWriter interface stays focused and just has
methods for writing data. Its name then remains coherent.
2015-03-12 13:33:25 -07:00
Philip O'Toole 7717b11e6b Factor common code into Graphite package 2015-03-12 12:21:27 -07:00
Ben Johnson 7ab19b9f91 Merge branch 'master' of https://github.com/influxdb/influxdb into stateless-broker 2015-03-12 11:59:55 -06:00
Cory LaNou 58dac30fd5 auto create database for graphite if not specified 2015-03-12 10:20:49 -06:00
Cory LaNou 174a3007bb clarify broker failed start messages 2015-03-11 14:05:02 -06:00
Cory LaNou c7068b77e9 better error for starting server so we can find what line it was 2015-03-11 14:05:01 -06:00
Ben Johnson 5f6bcf523f Fix broker integration bugs. 2015-03-11 12:00:45 -06:00
Richard Arends 2948d6f464 typo: prototcol should be protocol 2015-03-11 13:05:14 +01:00
Ben Johnson 66115f95ca Merge branch 'master' of https://github.com/influxdb/influxdb into stateless-broker
Conflicts:
	cmd/influxd/run.go
	messaging/broker.go
	messaging/client.go
	messaging/client_test.go
	messaging/intg_test.go
	server.go
	tx_test.go
2015-03-10 16:27:37 -06:00
Ben Johnson 27e9132796 Integrate stateless broker into remaining packages. 2015-03-10 14:53:45 -06:00
Cory LaNou 67f03ef26b Pre-create shard groups
1) Pre create shard groups

2) Calculate and save the ShardGroupDuration for Retention Policies. This should never change even if they alter a retention policy in the future
2015-03-09 17:30:17 -06:00
Philip O'Toole f72313edd9 Support retention policy auto-creation 2015-03-09 16:24:03 -07:00
Philip O'Toole d802829946 Review feedback 2015-03-07 22:55:23 -08:00
Philip O'Toole fb618cb385 Support control of Raft debug logging 2015-03-06 15:13:33 -08:00
Joseph Rothrock 9b63eed767 Merge branch 'master' of github.com:influxdb/influxdb into 1753
Conflicts:
	CHANGELOG.md
2015-03-06 12:37:15 -08:00
Joseph Rothrock 771ef1cec3 Don't Panic on Missing Dirs
Issue: 1753
Figure out what's missing, create it, and keep going.
2015-03-06 12:11:02 -08:00
Philip O'Toole 2402467e63 Add trace-level logging of write to handler 2015-03-05 17:38:03 -08:00
Philip O'Toole 76c255a3c8 Add trace-level logging to server write path 2015-03-05 17:35:57 -08:00
Joseph Rothrock 2e3ed5a089 Merge branch 'master' of github.com:influxdb/influxdb into 1755 2015-03-04 15:37:37 -08:00
Joseph Rothrock 6bb2ad6b95 JSON via UDP
Issue: 1755

Bind the server to a UDP listener.
2015-03-04 13:36:21 -08:00
Joseph Rothrock c96fda2287 Add a flag to config that disables CQs 2015-02-24 17:18:35 -08:00