7ace10f7e6
Load shards from filesystem when tsdb.Store is opened
2015-05-26 15:43:46 -06:00
cb23a7a297
Fix breakage from rename of data to cluster package
2015-05-26 15:42:44 -06:00
99c0b58473
Merge pull request #2658 from influxdb/jw-write-path
...
Wire up new write path
2015-05-26 15:57:14 -04:00
01618dc143
Move data.Node to tsdb.Store. Move data to cluster.
2015-05-26 15:56:54 -04:00
21bfb150a1
Wire up new write path
...
This allows the new write path to be hooked up if you start the
server with `INFLUXDB_ALPHA1=1`. When set, writes will go though
the coordinator and be stubbed out to write to a single local data
node with one shards. The write will be logged and written to
disk .
The env var is used so that the current write path is not completely
broken which would break many of the tests that depend on writes.
Note that queries are not currently working w/ the this change.
2015-05-26 12:07:56 -06:00
79ce57ce30
Merge pull request #2654 from influxdb/meta
...
Implement meta.Store and meta.Data.
2015-05-25 16:32:15 -06:00
7258a9be3c
Implement meta.Store and meta.Data.
2015-05-25 16:28:58 -06:00
f861159e8e
Merge pull request #2646 from influxdb/shared-shard-index
...
Shared metadata index
2015-05-24 07:40:07 -04:00
6c80108f63
Change Database to DatabaseIndex, remove leftover warn statement
2015-05-24 07:39:45 -04:00
c3ab88a715
Make the metadata index shared across shards while keeping field types and encoding local to each shard.
2015-05-23 18:06:07 -04:00
e30e7f3c16
Fix broken merge
...
tcp client/server was added while Point was moved and converted
to an interface in two other PRs.
2015-05-22 22:23:01 -06:00
2a727dc8ce
Merge pull request #2641 from influxdb/jw-points
...
Convert Points to interface
2015-05-22 22:08:32 -06:00
7a645698e2
Merge pull request #2632 from influxdb/tcp-client-server
...
first pass at tcp client/server with proto buffs
2015-05-22 16:21:32 -06:00
54bcc0d331
WriteShardRequest -> WriteShard
2015-05-22 16:19:29 -06:00
1076153a00
Convert Point to interface
...
Should be possible to replace the implementation with a more
optimized version now.
2015-05-22 15:39:55 -06:00
afbb6e28bb
test ErrBindAddressRequired
2015-05-22 15:33:37 -06:00
1098a8aea1
more refactoring
2015-05-22 15:28:22 -06:00
528f47e093
Convert Point.Fields to Point.Fields()
2015-05-22 15:22:03 -06:00
f8d599cda9
Convert Point.Tags to Point.Tags()
2015-05-22 15:12:34 -06:00
742b9de3c2
refactor writeShardRequest
2015-05-22 15:12:07 -06:00
cf02c342d9
make some methods private
2015-05-22 15:08:28 -06:00
888b2cbecb
clarify error comment
2015-05-22 15:01:27 -06:00
5dcab443dc
Move data.Point to tsdb.Point
2015-05-22 15:00:51 -06:00
e0f13cb44c
removing unused error
2015-05-22 14:58:34 -06:00
0b6f83871c
acking with proper success/error messages
2015-05-22 14:53:42 -06:00
d633d7683f
Convert Point.Name to Point.Name()
...
Hiding state behind interface.
2015-05-22 14:39:33 -06:00
997020963a
Convert Point.Time to Point.Time()
...
Make public state private so that Point can be converted to an
interface.
2015-05-22 14:39:15 -06:00
8ea9da2703
Merge pull request #2638 from influxdb/metadata-in-shard
...
Metadata in shard
2015-05-22 16:34:44 -04:00
ae56dbb77a
Fix rebase issues.
2015-05-22 16:15:36 -04:00
8f937cae87
Initial implementation for writing data to a shard.
2015-05-22 16:11:18 -04:00
a6ae533572
Allow coordinator to map points to multiple shards
...
Given a WritePointsRequest, MapShards will return a map
of shard ID to points. This map can then be used to write
each point to the respective shard owners.
2015-05-22 16:11:18 -04:00
7ae8c76ff4
unskip tests
2015-05-21 16:38:58 -06:00
02cbf09afd
first pass at tcp client/server with proto buffs
2015-05-21 16:26:20 -06:00
2bc299d808
Merge pull request #2628 from influxdb/jw-binary-write
...
Shard write protobufs
2015-05-21 11:44:11 -06:00
da74f03104
Update CONTRIBUTING.md with protobuf setup
2015-05-21 11:29:34 -06:00
b7b909798b
Use go generate to build protobufs
2015-05-21 11:12:58 -06:00
b655fd87fa
Fix doc comment
2015-05-21 10:35:58 -06:00
f2d77158e2
Use inline interface for coordinator metastore references
...
meta.Store was changed to a struct so can't test the coordinator
very easily. Since the interface that the coordinator needs is
very specific to the coordinator, make inline it to make that
distinction more clear.
2015-05-21 10:31:25 -06:00
1e6c789abc
Add WriteShardRequest/Response types with protobuf serialization
...
These are the requests that will be sent to remote data nodes
when a write request is received. They are small wrappers around
the generated protobuf structs that will be easier to work with
and also minimize duplicated data storage in memory.
2015-05-21 10:24:06 -06:00
01d7bfb398
Move coordinator to data package
2015-05-21 10:16:54 -06:00
ed2d6e41f9
Merge pull request #2623 from influxdb/meta
...
Add single-node raft back metastore.
2015-05-21 09:16:00 -06:00
12e4253e15
Add single-node raft back metastore.
...
This commit adds the meta.RaftStore which can start a single node
cluster and create nodes on the meta.Data internal structure.
Conflicts:
meta/meta.go
2015-05-20 16:49:03 -06:00
9bd1339e37
Merge pull request #2614 from influxdb/coordinator
...
Initial coordinator implementation
2015-05-20 10:13:38 -06:00
0361d2d61a
Move point/shard calculation to ShardGroupInfo
2015-05-20 10:01:29 -06:00
10caf43c29
Remove shard Read/Write interface funcs
...
Not used.
2015-05-20 10:01:29 -06:00
c2e3d19cb7
Rename Point.SeriesID() to HashID()
...
More explicity that it's not a globally unique value
2015-05-20 10:01:29 -06:00
580bbeaba0
Add tests for partial writes with errors
2015-05-20 10:01:29 -06:00
6e5da3a77d
Remove duplicate test
...
TestCooridinatorWriteOne was replaced by TestCoordinatorWrite table
test.
2015-05-20 10:01:29 -06:00
f978fa6d4c
Fix data race in coordinator test
2015-05-20 10:01:29 -06:00
acd836fcf1
Clarify comments
2015-05-20 10:01:29 -06:00
Jason Wilder
Paul Dix
Ben Johnson
Cory LaNou