Commit Graph

42 Commits (v0.8.8)

Author SHA1 Message Date
Todd Persen 59fdf22d96 Fix #1087. Make sure we're checking for missing cluster admins. 2014-12-02 16:53:47 -05:00
Kimo Rosenbaum 3c78fed1b8 [#issue 1086] Add a test with multi-dataset packet 2014-11-25 21:20:24 -05:00
Kimo Rosenbaum 86f234afdd Modify existing testt to check ds name and value 2014-11-25 21:20:24 -05:00
Kimo Rosenbaum 97e07678cc [issue #1086] grab the correct dataset information 2014-11-25 21:20:24 -05:00
John Shahid 60c98e519e Remove some nonsense 2014-10-30 14:16:46 -04:00
David Norton a428042899 Fix the timestamps set by the collectd plugin
Timestamps should be in microseconds instead of milliseconds.

Fix #1075. Close #1076
2014-10-29 18:30:17 -04:00
David Norton 9786d31db3 Add func to get str desc of Processor chain
Close #1068
2014-10-29 16:39:04 -04:00
Kimo R b142ebe091 gollectd's TypeDB method has been renamed
Close #1060
2014-10-27 17:40:38 -04:00
Philip O'Toole ffd9a4bc7d Allow graphite and collectd bind address to be set
Fix #1055. Close #1056
2014-10-27 17:05:14 -04:00
David Norton e27d3bbb21 Fix the timestamps of the points written by the collectd plugin
Try to use high resolution timestamp but if it's 0, fall back to
unix timestamp.

Collectd timestamps are uint64 and influxdb uses int64.  Change
to use type conversion instead of converting to string and then
parsing the string back to int64.  Also, test if the collectd
timestamp is too large for influxdb.  If it is, wrap around and
log an error message the first time but don't fill the log with
messages for every entry thereafter.

Move packet parsing code into its own function so it can be unit
tested.

Add unit tests to for packets using high resolution and unix
timestamps.

Fix #1051. Close #1054
2014-10-27 17:05:14 -04:00
Todd Persen 7df37811b5 Move admin assets into the compiled binary.
Fix #1032
2014-10-20 17:43:42 -04:00
Kimo Rosenbaum 3c84264b8d Add an input plugin for collectd
Close #992
2014-10-20 12:48:10 -04:00
John Shahid 6bc370e3ec fixup! Return the right content in the response when it's compressed
Fix #1007
2014-10-07 13:48:26 -04:00
John Shahid b2b90089d2 Return the right content in the response when it's compressed
Fix #1007
2014-10-06 17:35:50 -04:00
Philip O'Toole 78592ac634 Prevent invalid database names
Close #843
2014-09-08 15:08:59 -04:00
John Shahid b9571f4ff3 Fix a merge conflict introduced earlier 2014-09-08 14:40:50 -04:00
Paul Dix 39091fc8fd Move cluster config from raft to API.
Fixes #853. Close #854. Previously, there was an unprotected endpoint in
raft to return the cluster config that would include user hashes. This
endpoint is useful for debugging purposes so I restructured it and moved
it to the API. It ensures the requesting user is a cluster admin.

Cluster config will now return all of the cluster state including
servers, CQs, shards, etc.
2014-09-08 14:31:56 -04:00
Paul Dix 6ddfba6e32 Add ability to update existing shard spaces.
This will help users recover from #886. It's dangerous functionality because it only changes the metadata. Will document and tell people to use with caution.
2014-09-08 14:18:32 -04:00
John Shahid 4e3361ad58 Add profiling endpoints to the http api 2014-09-03 15:10:43 -04:00
John Shahid 4383375fe8 Split the different engines in their own types 2014-09-03 15:10:43 -04:00
John Shahid ff11c5b55e Use GetQueryString() instead of accessing the internal field 2014-09-03 15:10:42 -04:00
John Shahid 483e254c29 Api should have it's own coordinator interface 2014-09-03 15:10:42 -04:00
John Shahid 9c811a1761 Some cleanup 2014-09-03 15:10:42 -04:00
John Shahid b66eab4f25 Remove some api endpoints that are redundant 2014-09-03 15:10:42 -04:00
John Shahid aeea03e362 Get rid of migration 2014-09-03 15:10:42 -04:00
John Shahid 1df438a732 Merge pull request #857 from oliveagle/more_informative_api_get_servers
GetLeaderRaftConnectString returns consistent result
2014-08-29 13:19:08 -04:00
Todd Persen fb9d03e28d Merge pull request #863 from influxdb/862-slow-data-migrator
Add optional pausing to data migration.
2014-08-21 17:27:53 -04:00
Todd Persen 73de8f18a6 Merge pull request #861 from influxdb/860-validte-shards
Update database configuration to validate shard spaces before making db
2014-08-21 17:27:41 -04:00
Paul Dix 439e4c9914 Add optional pausing to data migration. 2014-08-21 17:15:55 -04:00
Paul Dix 72274002fc Update database configuration to validate shard spaces before creating anything.
Fixes #860. Update the validate method on shard spaces to optionally check if the database exists.
2014-08-21 16:59:27 -04:00
oliveagle 9117ae789b GetLeaderRaftConnectString returns consistent result 2014-08-22 01:30:48 +08:00
oliveagle 8fdd988226 makes listServers api more informative 2014-08-19 17:09:23 +08:00
John Shahid d9f14cbb72 Merge pull request #832 from influxdb/831-create-shard-space
Make create shard space endpoint database specific.
2014-08-15 14:10:32 -04:00
John Shahid 45d1b793a7 Fix a compilation error in the test 2014-08-15 13:53:23 -04:00
Paul Dix 632dba81dc Make create shard space endpoint database specific.
Fixes #831. Shard spaces now belong to a database so the endpoint should reflect that.
2014-08-15 13:23:21 -04:00
Paul Dix 5403baffd3 Add data migration 0.7 -> 0.8
Close #809. Fix #746
2014-08-15 13:20:49 -04:00
John Shahid dd116bdca7 Don't read the entire body in memory 2014-08-01 16:09:09 -04:00
Paul Dix 97508402ee Move load database config to API
Fix #791 - Removed load database config options from the daemon. Created an API endpoint and updated test.
Fix #745 - Added definition of continuous queries to load database config.
Close #792
2014-08-01 16:09:00 -04:00
Dieter Plaetinck 856a94cc78 graphite ingest write data in batches to coordinator
Close #644

This commit also include lots of cleanup related to start up and
shutting down as well as logging. Below is an explanation of how the api
starts up and shuts down. It also covers the error conditions and how
they are handled.

networking/goroutine fixes

* break from TCP Accept() loop when connection closed, which was preventing shutdown to proceed
* make sure that UDP functionality doesn't write to writeSeries channel after it has been closed.
* clearer, more specific shutdown message

in particular:

 * self.writers allows us to make sure things writing to writeSeries are done
   (they do blocking calls to handleMessage()) whether udp or tcp
 * self.connClosed lets us break from the Accept() loop,
   see http://zhen.org/blog/graceful-shutdown-of-go-net-dot-listeners/ (quit channel)
 * shutdown channel is now allCommitted

things can get a little complicated, so here's a little schematic of how the functions and
their logic relate:
indent for a call out or important code within. everything shown as one nested tree

  server.go
      go ListenAndServe
          go committer
              reads from self.writeSeries until closed, then writes to self.allCommitted
          Serve
              for {
                  Accept, breaks if err + connClosed
                  self.writers.Add()
                  go handleClient
                      for {
                          handleMessage
                              reads until err and writes to self.writeSeries until read failed
                          reads until EOF, ignores other handleMessage errors
                      }
                      conn.Close()
                      self.writers.Done()
              }
              self.writers.Wait()
              close(self.writeSeries)
      Close()
          close(self.connClosed)
          self.conn.Close()
          wants confirmation on allCommitted channel; [timeout] returns within 5s
2014-07-28 14:40:21 -04:00
Shugo Maeda d74e71ca83 When a server is removed, its ID should be removed from shards. 2014-07-17 18:28:06 +09:00
John Shahid 39ea797dcd Fix #690. Use idiomatic go project structure
Conflicts:
	cluster/cluster_configuration.go
	cluster/shard.go
	coordinator/command.go
	coordinator/coordinator_test.go
	coordinator/raft_server.go
	daemon/influxd.go
	datastore/shard.go
	integration/single_server_test.go
	parser/query_spec.go
	server/server.go
2014-07-14 18:47:37 -04:00
John Shahid e5276112c1 Restructure the codebase to be more idiomatic 2014-06-30 11:31:08 -04:00