9ec7a710c9
some misc refactoring on influxd startup
2016-01-21 15:28:32 -05:00
8d878fff91
buildable meta -> services/meta
2016-01-21 15:28:32 -05:00
718fb92cf5
Remove registration, add 'usage-client'
...
Server registration and stats reporting has been removed from what was
once http://enterprise.influxdata.com . The app that lived there, now
runs at http://usage.influxdata.com , so that the subdomain can
eventually be repurposed. Because we also want to repurpose the
`enterprise-client` repo, we have also renamed that to `usage-client`.
InfluxDB no longer needs the `registration` service now, since all of
the endpoints it communicates with simply discard the data provided to
them.
2015-12-10 15:58:34 -05:00
76d291e88e
beginning of cluster test harness
2015-12-03 08:04:09 -06:00
98632778dd
%s will convert a float to a less than useful string. %v is better.
2015-11-20 15:43:35 -05:00
c71e323d63
ServerID and ClusterID need to be strings when being sent to Enterprise.
2015-11-20 15:22:27 -05:00
b908cbb866
fix lint errors for cmd/...
...
corrects the initialize package comment for lint
brings c.ServerVersion back
2015-11-10 23:13:01 -08:00
8ac958f8a0
Merge pull request #4683 from influxdb/enterprise-client
...
Updated to use the new Enterprise Client
2015-11-06 13:13:15 -05:00
d46bf535b2
Report anonymous stats to Enterprise
2015-11-06 10:30:57 -05:00
1719a6107c
PointsWriter will drop writes to subscriber service for any in-flight writes
2015-11-05 16:25:00 -07:00
f703f58d22
Add HH diagnostics
2015-10-26 18:59:58 -07:00
878663e1e3
Periodic upload of stats to Enterprise
2015-10-19 15:25:07 -07:00
667ad3342a
Refactor registration as a service
...
Registration also involves statistics and diagnostics upload, for the
purposes of remote management. This means there will be long-running
goroutines in effect. Therefore move the code to a service model.
2015-10-19 15:01:14 -07:00
8f16a85cd2
Fixed issue sending JSON numbers to Enterprise when it wants strings
2015-10-15 16:51:48 -04:00
0f001a6d9a
Handle registration errors from Enterprise server
2015-10-15 13:48:23 -07:00
07db774423
Register with Enterprise if token available
2015-10-15 13:13:34 -07:00
8b31007aa7
Adds subscriber service for creating/dropping subscriptions to the
...
InfluxDB data stream.
2015-10-14 15:23:45 -06:00
f298e88b39
Auto-create UDP service database
...
All other services operate like this, so make UDP service consistent.
2015-10-14 08:30:09 -07:00
48223a90f9
Fix spelling nit.
...
Make it obvious that INTO is a keyword and not part of the sentence
2015-10-14 15:16:27 +01:00
822af73f88
implement continuous queries as regular execs of into queries.
...
Now that we have into queries, we can implement them as regular
queries that are just run on a timer.
2015-10-13 15:51:19 +00:00
62dff895e2
wire up INTO queries.
...
Since INTO queries need to have absolute information about the database
to work, we need to create a loopback interface back to the cluster
in order to perform them.
2015-10-13 15:00:36 +00:00
5b0a8ed306
HH should not process dropped nodes
2015-10-08 18:23:12 -07:00
d74e0690c7
Revert "Merge pull request #4233 from influxdb/drop-server"
...
This reverts commit 0bdb36f6dc3085fbc138
2015-10-02 08:39:57 -07:00
99da67007d
no more shutdown
2015-10-01 15:39:15 -05:00
73372ed907
[Ee]xecuteShutdown -> [Mm]onitorShutdown
2015-10-01 15:39:15 -05:00
34bfb6b330
be sure to exit the go routine if we terminate normally
2015-10-01 15:39:15 -05:00
7a3e1f6b27
removing peer wip
2015-10-01 15:39:15 -05:00
7cb8c2d2ec
Add build timestamp to version data
2015-09-24 23:40:53 -07:00
f73bc6ff19
Merge pull request #4140 from influxdb/engine_config
...
Make engine configurable
2015-09-16 21:17:43 -07:00
7b1a4e6700
Control whether each query should be logged
...
Fixes issue #4138
2015-09-16 19:26:23 -07:00
e4fde993f1
Make engine configurable
2015-09-16 19:09:25 -07:00
0ea0a3a71b
Add build info to diagnostics
2015-09-09 12:43:51 -07:00
402576bd93
Pass richer build information to Server
2015-09-09 12:36:32 -07:00
77d310337c
Clarify comment
2015-09-08 11:05:39 -06:00
dabb01691e
Close server is reverse order that it was started
...
The server was closing by stopping the most depended on services first
which causes various panics while higher level services are still processing
task when the server closes.
Fixes #3881
2015-09-08 11:04:00 -06:00
b8da247b08
Open monitor server after metastore is ready
2015-09-05 09:06:51 -06:00
deff06f850
add copier service
...
This commit adds the copier service which allows one server to
copy shards from another server. This will be used for moving
shards in the cluster.
2015-09-03 13:07:35 -06:00
d820fa7649
Add PointsWriter to monitor
...
This will allow the monitor to persistently store statistics
2015-09-02 15:45:11 -07:00
9165a0cf4c
Create statement_executor for monitor
2015-09-02 15:44:56 -07:00
4e2ee1ea70
Rename MonitorService to just Monitor
...
monitor is not a service, it has more in common with meta, since it
provides functionality to the query layer. This names makes this
clearer.
2015-09-02 15:07:30 -07:00
9df17409d3
Use monitor service with Graphite
2015-09-01 15:21:36 -07:00
f05dc20b58
Hook new monitor service to server
...
u
2015-09-01 15:03:52 -07:00
9df3b7d828
Add WAL configuration options
2015-08-18 16:59:54 -04:00
f07b8d4016
Make sure port is optional when passing hostanme flag
2015-08-12 10:41:43 -06:00
8dbcff833b
Revert "Revert "Merge pull request #3599 from tpitale/multiple-udp-servers""
...
This reverts commit 5f83f038e1
2015-08-10 16:21:27 -07:00
5f83f038e1
Revert "Merge pull request #3599 from tpitale/multiple-udp-servers"
...
This reverts commit 7f35d65412f828781544
2015-08-10 14:44:14 -07:00
7f35d65412
Merge pull request #3599 from tpitale/multiple-udp-servers
...
Change single udp config to support multiple UDP listeners
2015-08-10 14:22:27 -07:00
e943afacdc
Change (previously unused) single udp config to support multiple UDP listeners
...
do not use NewConfig for UDP
appendUDPService must return a value
udp service does not need to handle error
fix missing case of c.UDP in tests
2015-08-09 11:28:09 -04:00
87376a1c35
Allow -hostname to also override remote addr port
...
When starting a influxd in a docker container, the processess needs to know
the hosts address and port in order to create its NodeInfo correctly. -hostname
previously only allowed us to change the hostname and the port would always be 8088
which may not be correctly if running multiple containers on the same host.
2015-08-07 14:03:08 -06:00
2b76dac479
Don't resolve hostname when creating node
...
Hostnames were always being resolved to an IP address and the IP
address was used as the host address and raft peer address. There
was no way to use an actual hostname instead of an IP address.
2015-08-05 14:17:26 -06:00
b6c95925fb
Add retry delay for report service loop when error occurs
...
There is a race when stopping servers where the meta.Store is closing
but the server has not signaled it is closing so the reporting goroutine
repeeatedly errors out in fast loop during this time. It creates a lot
of noise in the logs.
2015-07-28 09:40:26 -06:00
514f36cf54
Exit report goroutine if server is closing
2015-07-28 09:40:25 -06:00
abfd438a11
Implement remote meta data fetch
...
This adds some basic plumbing to make remote procedure calls to other cluster
members. This first implementation allows a node to contact the raft leader
and fetch a copy of the meta data. This will be used by non-raft members to
pull down the latest metadata.
2015-07-23 10:21:22 -06:00
a7f50ae03c
refactor storage to engine
2015-07-22 11:08:10 -06:00
10eecb441d
Allow remote mapping to be forced
...
This is useful primarily for testing.
2015-07-20 10:44:45 -07:00
425a65fca1
RemoteShard mapping now performed over TCP
...
With this change remote mapping no longer uses HTTP, as the HTTP ports
exposed by nodes on the cluster are not known cluster wide. The TCP
ports exposed by the cluster service are, so this change uses that
functionality. Each RemoteMapper has its own dedicated connection pool
for each node, and remote mapping TCP connections are in no way coupled
with query TCP connections.
2015-07-20 10:44:38 -07:00
bd2f475b5d
Merge pull request #3334 from mcastilho/master
...
Clean shutdown of influxd server
2015-07-16 13:00:13 -07:00
f41d2bab5d
Start move to unified query executor
2015-07-15 19:31:13 -07:00
74cb96646c
Refactor query engine for distributed query support
...
With this change, the query engine code gathers information about
shards and tagsets by working with individual shards, collating the
information, and returning that to the client. It does not assume that any
particular shard is local, and accesses all shards through abstracted
Mappers, of which there are two types -- a Mapper type for Raw queries
and a second type for Aggregate queries. There are corresponding
Executors for each type of Mapper, but both types of Executors share the
same interface.
2015-07-15 12:54:55 -07:00
e560eb19ee
Clean shutdown of influxd server
2015-07-15 13:14:11 -04:00
a84c48bff6
Allow the PointWriter timeout to be configurable
2015-07-02 12:50:12 -04:00
ca86fa2633
Allow WAL inter-flush time to be configurable
2015-07-02 10:40:26 -04:00
b574e2f755
Add write ahead log
...
This commit adds a write ahead log to the shard. Entries are cached
in memory and periodically flushed back into the index. The WAL and
the cache are both partitioned into buckets so that flushing doesn't
stop the world as long.
2015-06-25 15:47:13 -06:00
d5fda01c2a
Server now requires build information
...
Version is worth special-casing here, since the build information is
pretty important, and make components need it.
Fixes issue #2958 .
2015-06-12 11:41:25 -07:00
23a7896182
Server does not need Commit info, remove it
2015-06-12 11:28:32 -07:00
b0b8d25752
fix #2935 : remove delay on memprofile
2015-06-12 12:07:01 -04:00
fd2f1bb223
cr #2935 : make code review changes
2015-06-12 11:47:59 -04:00
f717019d88
fix #2935 : hook CPU and memory profiling back up
2015-06-12 11:47:59 -04:00
5e7ddc6a60
Merge pull request #2928 from neonstalwart/version-header
...
pass along version to httpd/handler
2015-06-12 09:46:33 -04:00
4dff5f48aa
Export WaitForLeader on MetaStore
...
This exported function can then be used by Services and
server-reporting, so those components don't make progress until the
cluster is ready.
2015-06-11 11:10:07 -07:00
ce84047b44
pass along version to httpd/handler
2015-06-11 11:22:37 -05:00
de17fcd6f6
missing parens to call func
2015-06-11 10:51:48 -05:00
a325071103
fix #2920 : set MetaStore in collectd service
2015-06-11 09:53:16 -04:00
431034c8f4
Wait for Raft leader even when cluster exists
2015-06-11 01:23:30 -07:00
b15a0df6d4
Wait for leader before reporting
2015-06-11 00:21:15 -07:00
406509e93e
Remove rogue ID field from reporting
2015-06-11 00:21:15 -07:00
68fa173839
Report in goroutine so it outlasts return
2015-06-11 00:21:15 -07:00
64af1b6241
Report number of measurements and series per node
2015-06-11 00:21:15 -07:00
bc31783a00
Refactor backup and restore
...
This commit updates the snapshot code as well as the "backup" and
"restore" command to work with the new architecture.
2015-06-10 22:07:01 -06:00
223bf672cf
Update CHANGELOG
2015-06-10 20:05:59 -07:00
57ce67b97b
Ensure target Graphite database exists
2015-06-10 18:03:06 -07:00
f679c81136
Simply use "precreator" for shard precreation
2015-06-10 15:27:38 -07:00
1ddab4627f
Start the shard-precreation service
2015-06-10 15:27:38 -07:00
cbaf3cb0ed
Support setting openTSDB consistency level
2015-06-09 15:39:31 -07:00
8eea2b3092
Allow Server creation to return errors
2015-06-09 14:21:12 -07:00
d5f52333a1
fix #2814 : hook collectd service back up
2015-06-09 00:34:46 -04:00
b0d76913b0
Add new Service-style Graphite input support
2015-06-08 20:39:39 -07:00
b688eccb77
Refactor OpenTSDB to a service
...
This commit converts the OpenTSDB endpoint into a service.
2015-06-08 15:12:16 -06:00
b44f6efdc2
Fix UDP service, broken by 092bc3f and uncorrectly fixed in cc78fe4
2015-06-08 10:49:07 +02:00
3a19798968
Set metastore on cluster service
2015-06-05 22:29:52 -06:00
809b9b8a83
Add basic hinted handoff support
...
If a remote write fails, it will be queued to a per-node, local disk
queue and retried later.
2015-06-05 22:16:51 -06:00
75b72c60fe
Add hinted handoff service
...
The hinted handoff service will queue a write to a remote node if
that write fails and periodically retry the write.
2015-06-05 22:16:51 -06:00
413da5cdc4
add mux.Serve()
2015-06-05 22:13:49 -06:00
4bf024109f
Merge pull request #2779 from influxdb/hook-CQs-back-2733
...
fix #2733 : hook CQs back in
2015-06-05 20:40:31 -07:00
9ec6e4ff7e
Merge pull request #2794 from benbjohnson/mux
...
Influxd mux integration
2015-06-05 21:15:18 -06:00
cc78fe4678
fix #2733 : fix rebase issue...grrr
2015-06-05 20:05:31 -04:00
fb514f2302
fix #2733 : add endpoint to trigger CQ(s)
2015-06-05 19:56:28 -04:00
077159a126
fix #2733 : check config before enabling CQ service
2015-06-05 19:54:23 -04:00
092bc3fd2d
fix #2733 : hook CQs back in
2015-06-05 19:54:23 -04:00
041b31d6b3
Merge pull request #2783 from renan-/udp-refresh
...
Make UDP service code simpler
2015-06-05 16:23:16 -07:00
Cory LaNou
Tim Raymond
David Norton
Mark Bates
Pablo Miranda
Nathaniel Cook
Philip O'Toole
Daniel Morsing
Daniel Morsing
Philip O'Toole
Jason Wilder
Ben Johnson
Paul Dix
Tony Pitale
Marcio Castilho
ben hockey
Renan Strauss
Todd Persen