David Norton
5d26cfa4d7
return interface{} from nextChunk* functions
2015-08-22 10:59:29 -04:00
David Norton
c8f88f9a61
refactor remote mapping
2015-08-22 10:16:41 -04:00
Jason Wilder
a7cb0df4af
Fix typos/spacing
2015-08-13 10:02:05 -06:00
Jason Wilder
668181d275
Make log statements more consistent
...
* Capitalize first letter of message
* Log all services staring consistently
* Remove some extraneous log statements in meta.Store
* Log data dirs for meta, data and hinted handoff
2015-08-13 10:01:42 -06:00
David Norton
d661bf1a06
fix #3414 : shard mappers perform query re-writing
2015-08-04 09:49:50 -04:00
Philip O'Toole
10eecb441d
Allow remote mapping to be forced
...
This is useful primarily for testing.
2015-07-20 10:44:45 -07:00
Philip O'Toole
425a65fca1
RemoteShard mapping now performed over TCP
...
With this change remote mapping no longer uses HTTP, as the HTTP ports
exposed by nodes on the cluster are not known cluster wide. The TCP
ports exposed by the cluster service are, so this change uses that
functionality. Each RemoteMapper has its own dedicated connection pool
for each node, and remote mapping TCP connections are in no way coupled
with query TCP connections.
2015-07-20 10:44:38 -07:00
Philip O'Toole
a19cea36bd
Rename cluster unit test function
...
Makes future tests, related to shard mapping, clearer.
2015-07-17 13:05:15 -07:00
Philip O'Toole
2dc8bb947e
Correctly hook up RemoteMapper's MetaStore
2015-07-16 14:00:10 -07:00
Philip O'Toole
284a9ac0ff
Add RemoteMapper implementation
2015-07-15 21:57:23 -07:00
Philip O'Toole
e254245f2f
Implement simple remote node choice policy
2015-07-15 19:53:10 -07:00
Philip O'Toole
f41d2bab5d
Start move to unified query executor
2015-07-15 19:31:13 -07:00
Philip O'Toole
74cb96646c
Refactor query engine for distributed query support
...
With this change, the query engine code gathers information about
shards and tagsets by working with individual shards, collating the
information, and returning that to the client. It does not assume that any
particular shard is local, and accesses all shards through abstracted
Mappers, of which there are two types -- a Mapper type for Raw queries
and a second type for Aggregate queries. There are corresponding
Executors for each type of Mapper, but both types of Executors share the
same interface.
2015-07-15 12:54:55 -07:00
Philip O'Toole
a84c48bff6
Allow the PointWriter timeout to be configurable
2015-07-02 12:50:12 -04:00
Joseph Crail
5fccee3d16
Fix spelling errors in comments and strings.
2015-06-28 02:54:34 -04:00
David Norton
7c39ede6ba
fix #2920 : create collectd database on startup
2015-06-11 09:40:42 -04:00
Jason Wilder
67d4ef0e28
Don't queue write failures that due to type conflicts
...
These will never succeed and will stay in the queue indefinitely.
2015-06-10 14:52:59 -06:00
Jason Wilder
999f4a4c41
Return field type errors as client write errors
...
Fixes #2849
2015-06-10 14:52:26 -06:00
Philip O'Toole
952fb49368
Move parsing consistency levels to cluster package
...
Errors parsing the consistency level are indicated by returning a nil
Graphite input.
2015-06-09 14:21:12 -07:00
Philip O'Toole
fd0de2fb1b
Add function to parser consistency levels
2015-06-09 14:21:12 -07:00
Jason Wilder
eb1cd44b8d
Log write errors
...
Since the client only receives a "write failed" or "partial write" error
message, log more context in the logs.
2015-06-09 14:49:22 -06:00
Jason Wilder
5e515fbeda
Don't log EOF as an error
...
It's expected when a client disconnects
2015-06-08 16:39:39 -06:00
Jason Wilder
8323d6aa9e
Log when TCP clients connect/disconnect
2015-06-08 16:39:02 -06:00
Jason Wilder
8cbda9694e
Ensure unusable connections get closed
...
Fixes a bug where a connection that was marked as unusable didn't
prevent it from getting checked backed into the pool.
2015-06-08 11:26:56 -06:00
Jason Wilder
0c6ea32540
Use read locks instead of write lock for connection pools checkout
2015-06-08 11:21:07 -06:00
Ben Johnson
6e40f869fe
Fix formatting directive.
2015-06-05 23:06:52 -06:00
Ben Johnson
617e214a49
Add remote write logging.
2015-06-05 22:49:03 -06:00
Ben Johnson
607c352412
Add remote write logging.
2015-06-05 22:34:30 -06:00
Jason Wilder
1024965db7
Create shard received from cluster writer
2015-06-05 22:16:51 -06:00
Jason Wilder
1638ff8b6c
Handle nil node returned from meta store in shard writer
2015-06-05 22:16:51 -06:00
Jason Wilder
75b72c60fe
Add hinted handoff service
...
The hinted handoff service will queue a write to a remote node if
that write fails and periodically retry the write.
2015-06-05 22:16:51 -06:00
Ben Johnson
fb06549552
remove bind address from cluster config
2015-06-05 17:07:54 -06:00
Ben Johnson
abbcf15bb2
integrate mux into influxd cluster service
2015-06-05 17:02:32 -06:00
Ben Johnson
5a5c077790
refactor cluster to use mux
2015-06-05 16:54:12 -06:00
Ben Johnson
b925e1c1af
Multi-node clustering.
...
This commit adds the ability to cluster multiple nodes together to share
the same metadata through raft consensus.
2015-06-05 14:41:19 -06:00
Cory LaNou
21af1ded6b
messages over 1gb are probably not valid
2015-06-04 19:40:48 -06:00
Cory LaNou
5c52c4cda1
add ability to set logger for testing
2015-06-03 09:58:39 -06:00
Jason Wilder
156e7df346
Rename PointsWrite.Store to TSDBStore
...
Matches MetaStore naming convention better.
2015-06-02 14:47:59 -06:00
Jason Wilder
3957e096f8
Remove ownerID from protobufs
...
Not needed since the node that processes the request is the owner.
2015-06-02 14:45:52 -06:00
Jason Wilder
e400e8f2d6
Use default retention policy if not specified during writes
2015-06-01 17:16:44 -06:00
Jason Wilder
497cd506f9
Remove temporary INFLUXDB_ALPHA write path enable flag
...
Real thing exists now.
2015-06-01 16:45:08 -06:00
Cory LaNou
17bdf1c114
get both json/line protocol endpoints working
2015-06-01 12:35:57 -06:00
Cory LaNou
3597565955
reading and writing yo!
2015-06-01 11:59:58 -06:00
Ben Johnson
bf823d9887
Integrating cmd/influxd/run.
2015-05-30 14:06:36 -06:00
Ben Johnson
e1fc0958e7
Rename cluster.Coordinator to cluster.PointsWriter.
2015-05-30 14:05:27 -06:00
Ben Johnson
c916256ac9
Rename cluster.Writer to cluster.ShardWriter.
2015-05-30 14:05:27 -06:00
Ben Johnson
8c8a55a737
Removed 'failed' from test suite.
2015-05-30 08:59:27 -06:00
Ben Johnson
cdc5a47efa
Clean up influxdb.
2015-05-30 08:14:10 -06:00
Ben Johnson
9d4527071e
Refactor run command.
2015-05-29 14:59:57 -06:00
Ben Johnson
df1aeee70a
WIP
2015-05-29 14:56:30 -06:00