Commit Graph

67 Commits (274647b5b2c816c7de50f5acb7c82a1f2a9ef3ef)

Author SHA1 Message Date
Jason Wilder a89a4d6b40 Add PointsWriter write timeout back
Was ignored for some reason.
2016-05-11 12:59:51 -06:00
Jason Wilder db7d58c867 Remove old cluster config options 2016-05-11 12:59:30 -06:00
Jason Wilder 6cc1a34704 Rename cluster package to coordinator 2016-05-11 11:41:05 -06:00
Ben Johnson f52c85a8a1 Query engine and parser integration into root pkg. 2014-11-09 19:55:53 -07:00
Ben Johnson b78d4f1329 Add basic query code into the database. 2014-11-06 20:18:36 -05:00
Ben Johnson 9d1464813a Merge branch 'master' of https://github.com/influxdb/influxdb into streaming-raft
Conflicts:
	Makefile.in
	_vendor/raft/server.go
	_vendor/raft/snapshot.go
	_vendor/raft/snapshot_test.go
	admin/http_server.go
	admin/http_server_test.go
	api/graphite/api.go
	api/http/series_writer.go
	cluster/cluster_configuration.go
	cluster/cluster_server.go
	cluster/nil_processor.go
	cluster/shard_space.go
	cmd/influxd/main.go
	common/helpers.go
	configuration/configuration.go
	configuration/configuration_test.go
	coordinator/protobuf_server.go
	coordinator/raft_server.go
	datastore/point_iterator.go
	datastore/shard.go
	datastore/storage_key.go
	engine/aggregator_engine.go
	engine/arithmetic_operators.go
	parser/group_by.go
	parser/query_api.go
	response_channel.go
	server/server.go
2014-11-06 01:20:36 -05:00
John Shahid 1f3570536f Don't try to close the protobuf server if it's not open
Fix #584
2014-11-05 16:46:54 -05:00
John Shahid 1f5f5cb789 Don't write points if they are too old
Background of the bug: Prior to this patch we actually tried writing
points that were older than the retention period of the shard. This
caused race condition when it came to writing points to a shard that's
being dropped, which will happen frequently if the user is loading old
data (by accident). This is demonstrated in the test in this commit.This
bug was previously addressed in #985. It turns the fix for #985 wasn't
enough. A user reported in #1078 that some shards are left behind and
not deleted.

It turns out that while the shard is being dropped more write
requests could come in and end up on line `cluster/shard.go:195` which
will cause the datastore to create a shard on disk that isn't tracked
anywhere in the metadata. This shard will live forever and never get
deleted. This fix address this issue by not writing old points in, but
there are still some edge cases with the current implementation, at
least not as bad as current master.

Close #1078
2014-11-03 17:28:47 -05:00
Ben Johnson 31f981e804 Refactoring common, cluster, and protobuf. 2014-10-31 19:31:19 -06:00
John Shahid 3a857296f4 Support joining multiple series using regex or list 2014-10-31 14:49:48 -04:00
David Norton 4b59ddd113 Don't try to take 2 snapshots at a time
Fix #943. Close #1081
2014-10-31 14:00:56 -04:00
John Shahid bdcaef1ded Set the node's connection string when creating a new raft server 2014-10-31 13:54:20 -04:00
John Shahid f9b3a27345 Make the raft logging configurable 2014-10-30 16:03:13 -04:00
David Norton 9786d31db3 Add func to get str desc of Processor chain
Close #1068
2014-10-29 16:39:04 -04:00
Ben Johnson ec0835c256 Refactor user commands. 2014-10-28 20:30:21 -06:00
Ben Johnson 3a0e1b817c Add database listing. 2014-10-27 18:16:03 -06:00
Ben Johnson 2722e89299 Add user listing. 2014-10-27 17:31:45 -06:00
Ben Johnson 4b276bada3 Refactor messaging error handling. 2014-10-24 17:45:02 -06:00
John Shahid 6802eda768 Rename MergeFun to MergeRegex 2014-10-22 17:58:04 -04:00
John Shahid cace54d8c8 Make sure the query string has valid regex and add a test 2014-10-22 16:41:08 -04:00
John Shahid 78b99f60c6 Merge points at the shard level 2014-10-21 17:57:13 -04:00
John Shahid 465614c173 Modify merge to work with regex 2014-10-21 17:57:13 -04:00
David Norton ef50442d9d Fix #1040: fix panic when snapshot dir doesn't exist 2014-10-20 20:17:02 -04:00
David Norton 5e9750f7a6 Revert to older snapshots if the latest raft snapshot is corrupted
Fix #1040
2014-10-20 18:37:39 -04:00
Todd Persen 9f89aaeb26 Aggregating by time should respect the natural boundaries of the argument.
Fix #387
2014-10-20 15:24:39 -04:00
Ben Johnson 2e01f603e9 Merge branch 'master' of https://github.com/influxdb/influxdb into streaming-raft 2014-10-16 13:33:02 -06:00
John Shahid 4c655ddc3d fixup! Querying for data outside of existing shards should return an empty response. 2014-10-15 12:27:15 -04:00
Todd Persen f16f4b6639 Querying for data outside of existing shards should return an empty response.
Fix #1004. Close #1023
2014-10-14 12:59:47 -04:00
Ben Johnson 4dd03b6e06 Add influx log. 2014-10-01 20:49:21 -06:00
John Shahid 706282faf6 fix a merge conflict that wasn't caught in 0ca44c9 2014-09-24 19:04:11 -04:00
John Shahid 0ca44c906d Merge branch '0.8'
Conflicts:
	api/http/api.go
	cluster/cluster_configuration.go
	cluster/cluster_configuration_test.go
	coordinator/coordinator.go
	engine/aggregator_operators.go
	engine/common_merge_engine.go
	integration/data_test.go
	parser/parser.go
2014-09-24 18:55:19 -04:00
Paul Dix 7f8c4778f6 Move cluster config from raft to API.
Fixes #853. Close #854. Previously, there was an unprotected endpoint in
raft to return the cluster config that would include user hashes. This
endpoint is useful for debugging purposes so I restructured it and moved
it to the API. It ensures the requesting user is a cluster admin.

Cluster config will now return all of the cluster state including
servers, CQs, shards, etc.

Conflicts:
	integration/single_server_test.go
2014-09-24 17:40:29 -04:00
John Shahid 9b9ac93652 Fix parsing of multiple queries
Fix #885
2014-09-24 17:25:19 -04:00
Paul Dix f0c0abdb10 Add option to include space to series mappings in list series query.
Fixes #867. Close #927. Updated lexer and parser to work, added code to
coordinator to insert spaces if requested. Now the user can request the
shard spaces. `list series include spaces`
2014-09-11 11:28:18 -04:00
Paul Dix 39091fc8fd Move cluster config from raft to API.
Fixes #853. Close #854. Previously, there was an unprotected endpoint in
raft to return the cluster config that would include user hashes. This
endpoint is useful for debugging purposes so I restructured it and moved
it to the API. It ensures the requesting user is a cluster admin.

Cluster config will now return all of the cluster state including
servers, CQs, shards, etc.
2014-09-08 14:31:56 -04:00
Paul Dix 6ddfba6e32 Add ability to update existing shard spaces.
This will help users recover from #886. It's dangerous functionality because it only changes the metadata. Will document and tell people to use with caution.
2014-09-08 14:18:32 -04:00
Paul Dix a62e8c8b4c Add ability to update existing shard spaces.
This will help users recover from #886. It's dangerous functionality because it only changes the metadata. Will document and tell people to use with caution.
2014-09-05 16:24:00 -04:00
John Shahid c45960aa1f use gocheck in the coordinator benchmark 2014-09-04 15:24:57 -04:00
John Shahid e42bb3de3c Add some documentation 2014-09-03 15:10:43 -04:00
John Shahid 0a0b14ba23 Remove more constants 2014-09-03 15:10:43 -04:00
John Shahid 18dde750ab Cleanup the creation of engine processors 2014-09-03 15:10:43 -04:00
John Shahid 2a997d2648 Clean up 2014-09-03 15:10:43 -04:00
John Shahid 843c16e196 Write to the buffer instead of using append 2014-09-03 15:10:43 -04:00
John Shahid 500eccc503 No need for a function variable 2014-09-03 15:10:43 -04:00
John Shahid c2d01e1f2d Simplify the response types 2014-09-03 15:10:43 -04:00
John Shahid 93e75e4c13 Add some logging 2014-09-03 15:10:43 -04:00
John Shahid 4383375fe8 Split the different engines in their own types 2014-09-03 15:10:43 -04:00
John Shahid d68a798454 Move permission checking to permissions 2014-09-03 15:10:43 -04:00
John Shahid f44b83f3ae Use separate file 2014-09-03 15:10:43 -04:00
John Shahid d696e5493c Remove some cruft 2014-09-03 15:10:43 -04:00