b171ab6655
add many non GROUP BY * test scenarios. clean up comments for fixed tests
2015-08-14 15:05:27 -05:00
d083ca463e
add non group by host tests
2015-08-14 15:05:27 -05:00
d58851a679
silence reporting in integration tests
2015-08-14 15:05:26 -05:00
f507059ab4
more wildcard expansion tests
2015-08-14 15:05:26 -05:00
7fdb682966
first pass at raw queries with tags
2015-08-14 15:05:26 -05:00
dc83c57d7e
more wip
2015-08-14 15:05:26 -05:00
8ea3c47747
wip
2015-08-14 15:05:26 -05:00
7b4879f0ce
Fully remove a series when dropped
...
Fix issue #3226 .
2015-08-14 10:50:35 -07:00
f544113e8c
Add test for CQ deadlock
...
Test script from #3517 that reproduces a CQ deadlock. This is related
to #3522 as well.
2015-08-14 10:46:25 -06:00
765eee74b1
turn on block profiling
...
This should help us figure out where exactly a database is hung when
it happens.
2015-08-13 15:28:53 -07:00
c81a0afb8f
Merge pull request #3635 from influxdb/add_branch_to_version
...
Add build branch to version information
2015-08-13 14:41:14 -07:00
717bce6899
Add build branch to version information
2015-08-13 13:40:51 -07:00
f74248c4e4
Add new server-level unit test
...
Added this as part of working on issue #3603 .
2015-08-13 13:08:40 -07:00
668181d275
Make log statements more consistent
...
* Capitalize first letter of message
* Log all services staring consistently
* Remove some extraneous log statements in meta.Store
* Log data dirs for meta, data and hinted handoff
2015-08-13 10:01:42 -06:00
5dfd25269f
Fix panic: reflect: call of reflect.Value.NumField on string Value
...
The env var overrides panic if we if peers was set in the config.
The type of that value is a []string and NumFields is not a valid
for that type. We don't currently support this slice fields via
the env variable settings. This particular one can be set with the
-join flag already so we just skip these fields for now.
2015-08-12 11:27:04 -06:00
f07b8d4016
Make sure port is optional when passing hostanme flag
2015-08-12 10:41:43 -06:00
be792b926a
Re-enable regex test
...
Test now passes after recent changes.
2015-08-10 17:17:17 -07:00
5b39b96b9d
Re-enable RP test
...
Test passes after latest changes.
2015-08-10 17:15:46 -07:00
f5c8280525
Fix multi UDP tests
2015-08-10 16:23:04 -07:00
8dbcff833b
Revert "Revert "Merge pull request #3599 from tpitale/multiple-udp-servers""
...
This reverts commit 5f83f038e1
2015-08-10 16:21:27 -07:00
5f83f038e1
Revert "Merge pull request #3599 from tpitale/multiple-udp-servers"
...
This reverts commit 7f35d65412f828781544
2015-08-10 14:44:14 -07:00
7f35d65412
Merge pull request #3599 from tpitale/multiple-udp-servers
...
Change single udp config to support multiple UDP listeners
2015-08-10 14:22:27 -07:00
84af826a0f
Re-enable test "TestServer_Query_Now"
...
Recent changes must have fixed issue #2874 .
2015-08-10 14:10:20 -07:00
a122e709ea
Add system-level test for math
2015-08-10 13:13:04 -07:00
11f4ba82aa
Add env override config test
2015-08-09 16:14:10 -06:00
775dadadf5
Use INFLUXDB as env var prefix
2015-08-09 16:06:38 -06:00
e943afacdc
Change (previously unused) single udp config to support multiple UDP listeners
...
do not use NewConfig for UDP
appendUDPService must return a value
udp service does not need to handle error
fix missing case of c.UDP in tests
2015-08-09 11:28:09 -04:00
6f9c18fe95
Allow overriding of configuration parameters using environment variables
...
This allows all config variable to be set via environment variables using
a similar naming convention for the toml config. For example, to change the
HTTP API port using the config, you would set:
[http]
bind-address = ":8086"
To change it with an environment variable, you would use:
HTTP_BIND_ADDRESS=":8086" influxd
The section name is used as the env variable prefix and the config key
name is the suffix. The only change to the config name is that "-" should
be replaced with "_" to avoid shell interpretation issues.
This makes it much easier to configure docker instances within a docker container
or adhoc instances at the command-line.
For slice config sections like graphite, you can currently only override the first
entry since the default config only has 1 entry. To do that use, GRAPHITE_0 as the
prefix. You cannot currently add new entries like GRAPHITE_1. A future PR might
address this issue.
The environment variable values should be the same as the config values.
The order that configuration values are applied is as follows:
* Default config
* Config file
* Environment variables
* Command-line arguments
Fixes #3246
2015-08-07 14:27:38 -06:00
87376a1c35
Allow -hostname to also override remote addr port
...
When starting a influxd in a docker container, the processess needs to know
the hosts address and port in order to create its NodeInfo correctly. -hostname
previously only allowed us to change the hostname and the port would always be 8088
which may not be correctly if running multiple containers on the same host.
2015-08-07 14:03:08 -06:00
c90ffff855
Fallback to HOME env var to determine home dir
...
When building a static binary without cgo, user.Current() uses cgo
and always fails. Fallback to to HOME env variable if it exists.
2015-08-07 14:03:08 -06:00
2d26c2c9fe
Additional test coverage for non-existent fields
2015-08-06 15:01:34 -05:00
fdaa809f9a
fix some tests, add some tests, fix some test comments
2015-08-06 14:01:29 -05:00
b19a8f3968
Fix alias, maintain column sort order
2015-08-06 14:01:03 -05:00
2b76dac479
Don't resolve hostname when creating node
...
Hostnames were always being resolved to an IP address and the IP
address was used as the host address and raft peer address. There
was no way to use an actual hostname instead of an IP address.
2015-08-05 14:17:26 -06:00
38b70b2cfd
add test for evil identifiers that stress the parser
2015-08-05 19:41:00 +01:00
d661bf1a06
fix #3414 : shard mappers perform query re-writing
2015-08-04 09:49:50 -04:00
0b248e225c
Fix aggregate queries and time precision on where clauses.
2015-07-29 15:54:55 -04:00
4bc7e11adb
Continuous Query Tests
2015-07-28 14:58:44 -05:00
b6c95925fb
Add retry delay for report service loop when error occurs
...
There is a race when stopping servers where the meta.Store is closing
but the server has not signaled it is closing so the reporting goroutine
repeeatedly errors out in fast loop during this time. It creates a lot
of noise in the logs.
2015-07-28 09:40:26 -06:00
514f36cf54
Exit report goroutine if server is closing
2015-07-28 09:40:25 -06:00
06d8ff7c13
Use config.Peers when passing -join flag
...
Removes the two separate variables in the meta.Config. -join will
now override the Peers var.
2015-07-28 09:40:25 -06:00
47b8de7ce8
Hide Meta.Join from config command using toml skip annotation
2015-07-23 10:21:25 -06:00
84a8d7d24b
Add cluster-tracing option to meta config
...
Useful for troubleshooting but too verbose for regular use.
2015-07-23 10:21:24 -06:00
c1fc83e3d5
Make join private so it does not show up in config command
2015-07-23 10:21:24 -06:00
e06f6f421b
Add ability to join an existing cluster
...
This adds some basic ability to join a node to an existing cluster. It
uses a rpc layer to initiate a join request to an existing memeber. The
response indicates whether the joining node should take part in the raft
cluster and who it's peers should be. If raft should not be started, the
peers are the addresses of the current raft members that it should delegate
consensus operations.
To keep the meta store implementation agnostic of whether it's running
a local raft or not, a consensusStrategy type was also added.
2015-07-23 10:21:22 -06:00
abfd438a11
Implement remote meta data fetch
...
This adds some basic plumbing to make remote procedure calls to other cluster
members. This first implementation allows a node to contact the raft leader
and fetch a copy of the meta data. This will be used by non-raft members to
pull down the latest metadata.
2015-07-23 10:21:22 -06:00
a7f50ae03c
refactor storage to engine
2015-07-22 11:08:10 -06:00
112da5205b
Add 2 passing test cases around multi-shard select
2015-07-21 07:28:20 -07:00
29570ba563
Merge pull request #3406 from influxdb/math_tests
...
Basic mult and divide tests on aggregates
2015-07-20 19:09:29 -07:00
178856e97e
Basic mult and divide tests on aggregates
2015-07-20 19:02:03 -07:00
7e0fa132c8
Raw query with no valid SELECT fields is not data
2015-07-20 15:59:52 -07:00
10eecb441d
Allow remote mapping to be forced
...
This is useful primarily for testing.
2015-07-20 10:44:45 -07:00
425a65fca1
RemoteShard mapping now performed over TCP
...
With this change remote mapping no longer uses HTTP, as the HTTP ports
exposed by nodes on the cluster are not known cluster wide. The TCP
ports exposed by the cluster service are, so this change uses that
functionality. Each RemoteMapper has its own dedicated connection pool
for each node, and remote mapping TCP connections are in no way coupled
with query TCP connections.
2015-07-20 10:44:38 -07:00
3e1b0fed78
Merge pull request #3345 from influxdb/ga-show-rp-syntax
...
Make `SHOW RETENTION POLICIES` consistent by requiring `ON`
2015-07-17 10:46:24 -07:00
0d6c6bbe6f
Correctly check if raw derivative is required
...
The multiple checks for Mapper and Executor type -- the lack of DRYness
in this code -- meant the same checks would need to be copied. Therefore
this change, as well as fixing the bug, improves the situation a little
bit by *asking* the Mappers what type of Executor is required. This code
is still not ideal.
Fixes #3355 .
2015-07-16 23:28:38 -07:00
ee8ba11c4f
Add ON token to SHOW RETENTION POLICIES parser with tests
2015-07-16 13:45:50 -07:00
bd2f475b5d
Merge pull request #3334 from mcastilho/master
...
Clean shutdown of influxd server
2015-07-16 13:00:13 -07:00
d8c31f0b3c
Merge pull request #3320 from influxdb/streaming_dq
...
Support Distributed Queries
2015-07-16 12:33:21 -07:00
f41d2bab5d
Start move to unified query executor
2015-07-15 19:31:13 -07:00
74cb96646c
Refactor query engine for distributed query support
...
With this change, the query engine code gathers information about
shards and tagsets by working with individual shards, collating the
information, and returning that to the client. It does not assume that any
particular shard is local, and accesses all shards through abstracted
Mappers, of which there are two types -- a Mapper type for Raw queries
and a second type for Aggregate queries. There are corresponding
Executors for each type of Mapper, but both types of Executors share the
same interface.
2015-07-15 12:54:55 -07:00
21ea87432c
Test that DROP DATABASE is isolated
2015-07-15 11:20:25 -07:00
e560eb19ee
Clean shutdown of influxd server
2015-07-15 13:14:11 -04:00
a84c48bff6
Allow the PointWriter timeout to be configurable
2015-07-02 12:50:12 -04:00
ca86fa2633
Allow WAL inter-flush time to be configurable
2015-07-02 10:40:26 -04:00
c4a75ffef7
Merge pull request #3180 from influxdb/log_commit
...
Log GOMAXPROCS, version, and commit on start
2015-06-29 14:01:57 -04:00
e554115178
Log GOMAXPROCS, version, and commit on start
2015-06-29 13:52:03 -04:00
5fccee3d16
Fix spelling errors in comments and strings.
2015-06-28 02:54:34 -04:00
b574e2f755
Add write ahead log
...
This commit adds a write ahead log to the shard. Entries are cached
in memory and periodically flushed back into the index. The WAL and
the cache are both partitioned into buckets so that flushing doesn't
stop the world as long.
2015-06-25 15:47:13 -06:00
ea348ddc2c
Add sample graphite config to default config
2015-06-24 23:09:07 -06:00
fed8d67946
Add validation for graphite config templates and tags
2015-06-24 23:09:07 -06:00
e010daf74c
Test GROUP BY when different tags have same value
2015-06-22 16:04:13 -07:00
841a8d35ee
Test queries after drop-and-create database with data
2015-06-22 11:55:44 -07:00
8bff4c1c51
Unit test minimum retention policy duration
2015-06-17 11:02:38 -07:00
60d338282e
Unit test measurement recreation after DROP
2015-06-16 12:14:36 -07:00
05bd0fc53d
Check database existence during normalization
...
Statements were only being normalized if a default database was included
in the query (usually via the query param 'db'). However if no default
database was included, and none was an explicit part of the measurement
name, no database-existence check was run. This result in a later panic
with wildcard expansion.
2015-06-15 11:51:32 -07:00
b440c593a4
Merge pull request #2987 from neonstalwart/server_test-fix
...
fix version assertion in server_test
2015-06-15 10:26:11 -07:00
a9d2e81772
More integration tests for retention policy
2015-06-15 11:00:41 -05:00
e52acd3057
show tag field integration tests
2015-06-15 10:34:11 -05:00
90ea63baad
fix version assertion in server_test
2015-06-15 09:44:49 -05:00
85bb693119
Unit test version in HTTP response
2015-06-12 12:31:31 -07:00
d5fda01c2a
Server now requires build information
...
Version is worth special-casing here, since the build information is
pretty important, and make components need it.
Fixes issue #2958 .
2015-06-12 11:41:25 -07:00
23a7896182
Server does not need Commit info, remove it
2015-06-12 11:28:32 -07:00
6cc9a2ee20
SHOW TAGS integration tests
2015-06-12 12:16:27 -05:00
0318b4562e
Merge pull request #2936 from influxdb/fix-2935
...
fix #2935 : hook CPU and memory profiling back up
2015-06-12 12:10:27 -04:00
b0b8d25752
fix #2935 : remove delay on memprofile
2015-06-12 12:07:01 -04:00
69a20970ff
SHOW MEASUREMENTS integration tests
2015-06-12 10:49:28 -05:00
fd2f1bb223
cr #2935 : make code review changes
2015-06-12 11:47:59 -04:00
f717019d88
fix #2935 : hook CPU and memory profiling back up
2015-06-12 11:47:59 -04:00
3686f2c496
Show series integration tests
2015-06-12 10:38:24 -05:00
5e7ddc6a60
Merge pull request #2928 from neonstalwart/version-header
...
pass along version to httpd/handler
2015-06-12 09:46:33 -04:00
aef4ba2e20
fix typos in server_test.md
2015-06-11 15:43:43 -05:00
e89d2d85a6
Merge pull request #2931 from influxdb/wait_for_leader
...
Export WaitForLeader on MetaStore
2015-06-11 13:26:00 -07:00
2373d9a68f
Integration tests for drop measurement
2015-06-11 15:04:23 -05:00
224c6bb698
docs on integration testing
2015-06-11 14:17:07 -05:00
4dff5f48aa
Export WaitForLeader on MetaStore
...
This exported function can then be used by Services and
server-reporting, so those components don't make progress until the
cluster is ready.
2015-06-11 11:10:07 -07:00
ce84047b44
pass along version to httpd/handler
2015-06-11 11:22:37 -05:00
2ecc2162cb
add fill tests
2015-06-11 10:52:32 -05:00
de17fcd6f6
missing parens to call func
2015-06-11 10:51:48 -05:00
a325071103
fix #2920 : set MetaStore in collectd service
2015-06-11 09:53:16 -04:00
431034c8f4
Wait for Raft leader even when cluster exists
2015-06-11 01:23:30 -07:00
b15a0df6d4
Wait for leader before reporting
2015-06-11 00:21:15 -07:00
406509e93e
Remove rogue ID field from reporting
2015-06-11 00:21:15 -07:00
68fa173839
Report in goroutine so it outlasts return
2015-06-11 00:21:15 -07:00
64af1b6241
Report number of measurements and series per node
2015-06-11 00:21:15 -07:00
bc31783a00
Refactor backup and restore
...
This commit updates the snapshot code as well as the "backup" and
"restore" command to work with the new architecture.
2015-06-10 22:07:01 -06:00
223bf672cf
Update CHANGELOG
2015-06-10 20:05:59 -07:00
57ce67b97b
Ensure target Graphite database exists
2015-06-10 18:03:06 -07:00
f679c81136
Simply use "precreator" for shard precreation
2015-06-10 15:27:38 -07:00
1ddab4627f
Start the shard-precreation service
2015-06-10 15:27:38 -07:00
f60f833123
more testing!
2015-06-10 15:50:33 -05:00
99a404eec9
more aggregation tests for ints, update skipped tests with issue numbers
2015-06-10 14:34:41 -05:00
cbaf3cb0ed
Support setting openTSDB consistency level
2015-06-09 15:39:31 -07:00
8eea2b3092
Allow Server creation to return errors
2015-06-09 14:21:12 -07:00
709a7ffd06
add where clause integration tests, add support for int64 comparisons
2015-06-09 15:45:00 -05:00
a43054adce
add test for querying across shards and fields
2015-06-09 12:51:59 -05:00
d5f52333a1
fix #2814 : hook collectd service back up
2015-06-09 00:34:46 -04:00
b0d76913b0
Add new Service-style Graphite input support
2015-06-08 20:39:39 -07:00
4b94a00644
Set auto-created retetion period to infinity
...
Fix issue #2817
2015-06-08 19:47:37 -07:00
a9657289c4
Merge pull request #2823 from benbjohnson/opentsdb
...
Convert OpenTSDB to service
2015-06-08 17:32:55 -06:00
b688eccb77
Refactor OpenTSDB to a service
...
This commit converts the OpenTSDB endpoint into a service.
2015-06-08 15:12:16 -06:00
393493fa98
more query tag tests
2015-06-08 14:58:55 -05:00
64b921580f
enable database drop tests
2015-06-08 13:58:03 -05:00
7fbc28963c
Merge pull request #2816 from renan-/fix-udp
...
Fix UDP service, broken by 092bc3fcc78fe4
2015-06-08 11:05:48 -07:00
8f712eaf85
Ignore shards that don't have the selected measurement in them.
...
Fixes #2815 and fixes #2818 .
2015-06-08 17:14:42 +02:00
eaec3e42e4
add test for multiple measurements
2015-06-08 10:07:29 -05:00
b44f6efdc2
Fix UDP service, broken by 092bc3f and uncorrectly fixed in cc78fe4
2015-06-08 10:49:07 +02:00
b19828fea7
Add test case for retention auto-create
2015-06-06 17:22:37 -07:00
3a19798968
Set metastore on cluster service
2015-06-05 22:29:52 -06:00
809b9b8a83
Add basic hinted handoff support
...
If a remote write fails, it will be queued to a per-node, local disk
queue and retried later.
2015-06-05 22:16:51 -06:00
75b72c60fe
Add hinted handoff service
...
The hinted handoff service will queue a write to a remote node if
that write fails and periodically retry the write.
2015-06-05 22:16:51 -06:00
413da5cdc4
add mux.Serve()
2015-06-05 22:13:49 -06:00
4bf024109f
Merge pull request #2779 from influxdb/hook-CQs-back-2733
...
fix #2733 : hook CQs back in
2015-06-05 20:40:31 -07:00
9ec6e4ff7e
Merge pull request #2794 from benbjohnson/mux
...
Influxd mux integration
2015-06-05 21:15:18 -06:00
cc78fe4678
fix #2733 : fix rebase issue...grrr
2015-06-05 20:05:31 -04:00
fb514f2302
fix #2733 : add endpoint to trigger CQ(s)
2015-06-05 19:56:28 -04:00
077159a126
fix #2733 : check config before enabling CQ service
2015-06-05 19:54:23 -04:00
092bc3fd2d
fix #2733 : hook CQs back in
2015-06-05 19:54:23 -04:00
041b31d6b3
Merge pull request #2783 from renan-/udp-refresh
...
Make UDP service code simpler
2015-06-05 16:23:16 -07:00
fb06549552
remove bind address from cluster config
2015-06-05 17:07:54 -06:00
abbcf15bb2
integrate mux into influxd cluster service
2015-06-05 17:02:32 -06:00
6cf78206f0
refactor run.Server to use tcp.Mux
2015-06-05 16:31:58 -06:00
b925e1c1af
Multi-node clustering.
...
This commit adds the ability to cluster multiple nodes together to share
the same metadata through raft consensus.
2015-06-05 14:41:19 -06:00
a4a05241ba
Set retention enforcement default config
2015-06-05 11:27:30 -07:00
e8ab17dbc5
[services/udp] Clean-up the code
2015-06-05 10:55:10 +02:00
ae3e8c727a
Don't append retention service if not enabled
2015-06-04 21:47:06 -07:00
fab9adb361
Hook in actual retention service
2015-06-04 17:02:22 -07:00
8d3f54172c
wildcard and precision write integration tests
2015-06-04 12:58:03 -06:00
3f7cf15a8d
not needed
2015-06-04 09:24:26 -06:00
08bec931c6
observe enabled flag when appending services
2015-06-04 09:24:08 -06:00
3b09a59540
Add UDP service back
2015-06-04 10:24:48 +02:00
90d8f37a08
some refactoring, mostly aggregation tests
2015-06-03 16:07:40 -06:00
212bbd067f
move helpers to their own file
2015-06-03 13:44:10 -06:00
2dac41a619
fix one test that now works
2015-06-03 11:54:45 -06:00
e6f0a2f3ab
do not use the word `fail` in test messages
2015-06-03 11:22:59 -06:00
621e2dc2f3
more test coverage, minor test refactorings
2015-06-03 11:15:20 -06:00
5c52c4cda1
add ability to set logger for testing
2015-06-03 09:58:39 -06:00
1ab8d58bb2
and then there were table tests!
2015-06-02 20:24:53 -06:00
ec749c836f
Merge pull request #2742 from influxdb/integration-tests
...
Integration tests
2015-06-02 16:42:16 -06:00
ab8701721a
more integration testing
2015-06-02 16:03:13 -06:00
156e7df346
Rename PointsWrite.Store to TSDBStore
...
Matches MetaStore naming convention better.
2015-06-02 14:47:59 -06:00
3957e096f8
Remove ownerID from protobufs
...
Not needed since the node that processes the request is the owner.
2015-06-02 14:45:52 -06:00
44d38cb430
Merge branch 'master' into alpha1
2015-06-02 10:40:52 -06:00
d962283ae6
adding some integration tests
2015-06-01 16:04:20 -06:00
3597565955
reading and writing yo!
2015-06-01 11:59:58 -06:00
bf823d9887
Integrating cmd/influxd/run.
2015-05-30 14:06:36 -06:00
c916256ac9
Rename cluster.Writer to cluster.ShardWriter.
2015-05-30 14:05:27 -06:00
8c8a55a737
Removed 'failed' from test suite.
2015-05-30 08:59:27 -06:00
233c63029b
Refactor influxd.Main.
2015-05-30 08:49:49 -06:00
4872e6db7c
Move services to subpackage.
2015-05-30 08:20:12 -06:00
6677ea074f
more services, more test fixes, getting closer...
2015-05-29 14:59:57 -06:00
9d4527071e
Refactor run command.
2015-05-29 14:59:57 -06:00
1f294ce8de
Add httpd.Handler.serveQuery() tests.
2015-05-29 14:59:57 -06:00
df1aeee70a
WIP
2015-05-29 14:56:30 -06:00
Cory LaNou
Philip O'Toole
Jason Wilder
Daniel Morsing
Philip O'Toole
Tony Pitale
Cory LaNou
David Norton
Ben Johnson
gunnaraasen
Marcio Castilho
Joseph Crail
ben hockey
Paul Dix
Renan Strauss
Todd Persen