2465dbc788
Add high performance stress test example
...
First round at adding query load
Working draft:
Not happy with things, but it works
2015-09-30 15:55:07 -07:00
22a6f79a3c
Add support for `tag_count` config option
...
It is now possible to configure arbitrarily many tags in a generic
format. That is specifying the config option `tag_count=10` will add 10
tags to a series that are of the form `tag-key-n=tag-value` where n
ranges from 0 to 9.
Save current state
2015-09-30 15:55:06 -07:00
03f291d78c
Add comments and shuffle var declarations
2015-09-30 15:55:06 -07:00
fdfb039a44
Allow configuration via config file or flags
...
Note that config file takes precedence to flags
2015-09-30 15:55:06 -07:00
4e587b4622
Add comment to example toml file
2015-09-30 15:55:06 -07:00
48dde6b16c
Add support for config file
2015-09-30 15:55:06 -07:00
911623f5f6
Add quick notes
2015-09-30 15:55:06 -07:00
e608e9b79b
Add stress
...
First pass at running stress test from a toml
2015-09-30 15:55:06 -07:00
e43b60b8e1
Add example config for stress test
2015-09-30 15:55:06 -07:00
343dd23ee7
refactor map functions to use list of values
...
This commit changes `tsdb.mapFunc` to use `tsdb.MapInput` instead
of an iterator. This will make it easier and faster to pass blocks
of values from the new storage engine into the engine.
2015-09-29 14:00:33 -06:00
7cb8c2d2ec
Add build timestamp to version data
2015-09-24 23:40:53 -07:00
b1becfbcfc
more tests, simplify mapFunc signatures
2015-09-23 09:27:19 -05:00
78bc740434
full support for min/max/first/last
2015-09-23 09:03:57 -05:00
8e27cf1fd8
Merge remote-tracking branch 'upstream/master' into refactor-select-mapper
...
Conflicts:
tsdb/store.go
2015-09-22 13:58:24 -06:00
96715d7d90
rename Cursor.Seek() to Cursor.SeekTo()
2015-09-22 13:23:16 -06:00
56cb2fae5d
fix integration tests
2015-09-22 13:10:13 -06:00
649663ca15
fix tests
2015-09-22 13:10:13 -06:00
a5269e9cc7
rename direction to ascending.
2015-09-22 13:09:26 -06:00
8bd2408320
convert SHOW TAG KEYS to distributed query
2015-09-21 11:30:51 -04:00
72f6f7d268
Merge pull request #4134 from influxdb/issue-3447
...
Refactor Points and Rows to dedicated packages
2015-09-17 15:27:48 -05:00
f73bc6ff19
Merge pull request #4140 from influxdb/engine_config
...
Make engine configurable
2015-09-16 21:17:43 -07:00
7b1a4e6700
Control whether each query should be logged
...
Fixes issue #4138
2015-09-16 19:26:23 -07:00
e4fde993f1
Make engine configurable
2015-09-16 19:09:25 -07:00
d19a510ad2
refactor Points and Rows to dedicated packages
2015-09-16 15:33:08 -05:00
bf955c7c11
Merge pull request #4112 from influxdb/issue-3457
...
Period in field name that matches measurement fails. Fixes #3457
2015-09-16 09:55:43 -05:00
afe5cc67f4
Repeat the identical time aggregate test more;
2015-09-15 16:22:25 -07:00
f02d8eef4f
unskip test
2015-09-15 16:36:11 -05:00
5395ac7634
Period in field name that matches measurement fails. Fixes #3457
2015-09-15 16:26:39 -05:00
c70b503f00
go fmt
2015-09-15 16:09:58 -05:00
69c9f28e2d
Fix compilation error in test code
2015-09-15 11:42:58 -07:00
76e3552a95
Increase write-timeout to 30s during testing
...
This should hopefully reduce the rate of CI failures during testing.
2015-09-15 11:35:21 -07:00
05b2e4985f
Merge pull request #4065 from sbouchex/cmd_add_precision
...
Added precision support in cmd client
2015-09-14 16:44:23 -07:00
f623701e79
Merge branch 'master' into md-stress-runner
2015-09-11 15:45:11 -07:00
d85c4f7699
Cherry pick failed requests from 2d67a9e
...
Commit 2d67a9ea22
2015-09-11 15:10:15 -07:00
5656ba167f
Added precision support in cmd client
2015-09-11 10:04:18 +02:00
9831ab2cc8
Added precision support in cmd client
2015-09-11 09:20:02 +02:00
101a4d2a55
Merge pull request #4066 from influxdb/pd-fail-writes-on-memory-pressure
...
Update WAL to fail writes if pressure too high.
2015-09-10 11:27:32 -07:00
ed917aa7f8
Log each query before execution
...
If a query causes a server to panic, the query is nowhere in the logs,
which makes debug very difficult.
2015-09-10 10:52:51 -07:00
ef17dbb492
more tests
2015-09-10 11:32:30 -05:00
2d67a9ea22
Update WAL to fail writes if pressure too high.
...
If the memory gets 5x above the partition size threshold, the WAL will start returning write failures to the clients. This will allow them to backoff their write volume.
Also updated the stress script to track failed requests and output messages on failure and when it returns to success.
2015-09-09 22:41:32 -07:00
f8a827d9d2
Added precision support in cmd client
2015-09-09 22:54:57 +02:00
fa04b0ab20
add server integration tests
2015-09-09 15:46:21 -05:00
23a606bafc
Added precision support in cmd client
2015-09-09 22:17:48 +02:00
0ea0a3a71b
Add build info to diagnostics
2015-09-09 12:43:51 -07:00
402576bd93
Pass richer build information to Server
2015-09-09 12:36:32 -07:00
70c816e236
Add optional precision setting
2015-09-09 11:21:17 -07:00
551e51a643
Move `cmd/influx_stress/runner` pkg to `stress`
2015-09-09 11:21:17 -07:00
c773df00ef
Add throttling of requests
2015-09-09 11:21:17 -07:00
2b0b66d7d6
Add a configurable `Measurements` type
...
Previously the measurement that was getting written into InfluxDB was
hard coded in the `Run` method as `cpu`. Now you can specify a
measurements by passing an `-m` flag to `influx_stress`.
The `-m` flag accepts a comma separated list of measurements. (e.g.
`influx_stress -m cpu,mem,disk`)
2015-09-09 11:21:17 -07:00
d63ac6a842
Add tests for runner.go
2015-09-09 11:21:17 -07:00
35a0477f05
Add the an error to the NewCleint
...
Additionally the Config definition of the Config type was moved to just
above the definition of the NewClient Method.
2015-09-09 11:21:17 -07:00
dd8413d9ac
Missed one last thing for the timer
2015-09-09 11:21:17 -07:00
e29b159079
Change Timer method names to be more semantic.
...
Additionally, getter and setter method were added to the Timer type.
2015-09-09 11:21:17 -07:00
1a3d6cb74a
Rename newResponseTime to NewResponseTime
2015-09-09 11:21:16 -07:00
4413b302be
Fix sorting for the ResponseTimes type
...
The `sort` methods were failing as responseTimes couldn't be cast to an
[]int. To fix this `ResponseTimes` now implements the `sort.Interface`
interface.
2015-09-09 11:21:16 -07:00
d54e439385
Change responseTimes to its own type
...
`responesTimes` was an []int and is now it own type
2015-09-09 11:21:16 -07:00
3ae5183592
Add comments where needed
2015-09-09 11:21:16 -07:00
a19e2d9f50
Rename `Runner` to `Run`
2015-09-09 11:21:16 -07:00
71d8047ad3
Pull the body of influx_stress main out
...
This commit abstracts out the body of `main()` and moves it into a separate
function `Runner` in `runner/runner.go`. Additonally two new types,
`Timer` and `Config` were introduced.
`Runner` takes in a `*Config` and returns the total number of points
written `totalPoints`, an slice of response times `responseTimes`, and a
timer with the starting and ending times of the test `*Timer`.
2015-09-09 11:21:16 -07:00
d57771dc17
Add Timer type that keeps track of start & end
2015-09-09 11:21:16 -07:00
8b89332029
Add new file `runner.go`
2015-09-09 11:21:16 -07:00
ca07b86254
Prohibit dropping the default retention policy
...
This is to prevents users from putting their system into an awkward
state. It is a policy that all databases must have at least a default
retention policy.
Fixes issue #3699 .
2015-09-08 23:00:19 -07:00
62e9c24b25
fixes #3926
2015-09-08 14:15:48 -05:00
77d310337c
Clarify comment
2015-09-08 11:05:39 -06:00
dabb01691e
Close server is reverse order that it was started
...
The server was closing by stopping the most depended on services first
which causes various panics while higher level services are still processing
task when the server closes.
Fixes #3881
2015-09-08 11:04:00 -06:00
bbc103305b
Support multiple Graphite inputs
...
Fixes issue #3636
2015-09-06 21:33:46 -07:00
b8da247b08
Open monitor server after metastore is ready
2015-09-05 09:06:51 -06:00
13dbc8f0ba
Merge pull request #3841 from influxdb/jw-file-utils
...
Add inspect tool
2015-09-04 14:12:05 -06:00
267f8e6c11
Skipping race test
...
Issue #3997
2015-09-04 11:59:28 -07:00
3867fed0ff
one additional test for top
2015-09-04 13:30:42 -05:00
9703467171
refactor validateAggregates
2015-09-04 13:30:41 -05:00
347ffc70b4
wire up advanced top sorting/slicing
2015-09-04 13:30:41 -05:00
8c4595b345
top is coming together. filling out fields properly
2015-09-04 13:30:41 -05:00
ba79007960
wip
2015-09-04 13:30:41 -05:00
f3e557d943
more top test scenarios
2015-09-04 13:30:41 -05:00
5a66725054
refactoring/adding top integration testing
2015-09-04 13:30:40 -05:00
35b9215aa9
refactor processTopBottom - wip
2015-09-04 13:30:40 -05:00
046282249a
wip remapping top output
2015-09-04 13:30:40 -05:00
72fd115dc2
exposing tags on cursors, top/bottom are valid funcs now
2015-09-04 13:30:39 -05:00
a3def8d3a7
Merge pull request #3993 from influxdb/dgn-fix-cq-test
...
fix CQ test
2015-09-04 13:12:29 -04:00
4a0d31d284
Fix broken rebase
2015-09-04 10:50:11 -06:00
23d4ce2efa
Fix panic if a series does not exists in a shard
2015-09-04 10:38:59 -06:00
6b4926257a
Add inspect tool
...
Start of a lower-level file inspection tool. This currently dumps
summary statistics for the shards, index and WAL that can be used to
understand the shape of the data is in the local shards. This util
operates on the shards itself and not through the server and is intended
more for debugging/troubleshooting.
2015-09-04 10:38:59 -06:00
0d43fdb94c
fix CQ test
2015-09-04 12:35:41 -04:00
df70a1c8ce
Update tests to use Direction enum
2015-09-04 09:00:11 -06:00
b7c0d47008
Add aggregate order by desc test
2015-09-03 22:31:58 -06:00
266bdc1c2b
Support sort by time DESC in wal and bz1 engines
2015-09-03 22:28:36 -06:00
6592dcc699
EnableLogging -> LoggingEnabled
2015-09-03 16:56:07 -05:00
473c04dc0d
silence wal logging during testing
2015-09-03 15:17:03 -05:00
deff06f850
add copier service
...
This commit adds the copier service which allows one server to
copy shards from another server. This will be used for moving
shards in the cluster.
2015-09-03 13:07:35 -06:00
4187fb4257
skip test instead of commenting out
2015-09-03 09:40:45 -04:00
2739f5e688
temporarily disable a CQ test
2015-09-03 07:12:15 -04:00
66001cfbb5
fix #2555 : add integration tests for CQs
2015-09-03 07:12:15 -04:00
c0d61740a4
Ensure monitor database exists
...
This requires a leader in the cluster, so wait for that before
attempting the database creation.
2015-09-02 16:26:16 -07:00
d820fa7649
Add PointsWriter to monitor
...
This will allow the monitor to persistently store statistics
2015-09-02 15:45:11 -07:00
9165a0cf4c
Create statement_executor for monitor
2015-09-02 15:44:56 -07:00
4e2ee1ea70
Rename MonitorService to just Monitor
...
monitor is not a service, it has more in common with meta, since it
provides functionality to the query layer. This names makes this
clearer.
2015-09-02 15:07:30 -07:00
1d4ee6c3fa
Add tests for influx consistency level parsing
2015-09-02 09:22:15 -06:00
557f796566
Add an option to cmd/influx to set write consistency level
...
This patch introduces an option in influx allowing users to
select write consistency level, which has been implicitly
set to 'any' by default so far.
2015-09-02 11:00:06 +09:00
9df17409d3
Use monitor service with Graphite
2015-09-01 15:21:36 -07:00
f05dc20b58
Hook new monitor service to server
...
u
2015-09-01 15:03:52 -07:00
d87e668c78
Remove obsolete monitoring code
2015-09-01 15:03:52 -07:00
1a55951f36
Backend support for database IF NOT EXISTS
2015-08-28 19:04:54 -07:00
e0066760ba
Make the startup log message actually first
2015-08-28 15:14:20 -07:00
191163c7c7
Move to Go 1.5
2015-08-27 09:58:15 -07:00
94484067f3
Log Go runtime version
2015-08-26 14:47:59 -07:00
10779c9634
Unit-test predictable first/last point ordering
2015-08-25 22:26:04 -07:00
ca52a3ffd7
Allow queries to be looped
...
Some queries may be subject to race conditions. This variable allows the
test to request that a query is executed multiple times, increasing the
chance that any race will be exposed.
2015-08-25 15:16:13 -07:00
ace4737228
throttle import
2015-08-21 15:07:01 -05:00
20e5d5f3a9
Test explicitly SELECTing time as a field
2015-08-21 12:14:53 -07:00
2752e894e1
Merge pull request #3762 from influxdb/pd-update-stress
...
Update stress to work with fewer than 10k series.
2015-08-21 11:24:27 -04:00
cd0ce4ac55
Re-enable chunking test post WAL updates
...
Fixes issue #3725 .
2015-08-20 12:54:48 -07:00
375afc3fcc
Update stress to work with fewer than 10k series.
2015-08-20 09:36:06 -04:00
cd3ef17fc6
Merge pull request #3743 from influxdb/jw-env-config
...
Apply env overrideds for config command
2015-08-19 15:20:03 -06:00
0b2aa62172
Merge pull request #3737 from influxdb/jw-wal-dir
...
Ensure wal-dir has a default value
2015-08-19 13:53:37 -06:00
67c54ddc47
Apply env overrideds for config command
...
Matches the behavior of the run command and lets you test env
vars override config values more easily.
2015-08-19 13:52:28 -06:00
6bd9561de0
Ensure wal-dir has a default value
2015-08-19 13:39:22 -06:00
de95a42d4e
Skip failing chunking test
...
Until https://github.com/influxdb/influxdb/issues/3725 is fixed.
2015-08-19 11:40:02 -07:00
c31b88de60
Merge pull request #3569 from influxdb/pd-wal
...
Add initial WAL implementation and tests
2015-08-18 20:45:32 -04:00
9df3b7d828
Add WAL configuration options
2015-08-18 16:59:54 -04:00
28a6b1f3fd
Merge pull request #3697 from influxdb/chunking_10k
...
Merge same-series data if not chunking
2015-08-18 13:23:10 -07:00
0eb93d675d
Add some unit tests related to partner testing
2015-08-17 14:36:13 -07:00
487c336571
Correctly merge rows for identical series
...
If no chunking was requested by the user, the co-ordinating node buffers all
results in RAM before emitting a single result. However buffering was not
merging results for rows which had data for the same series. This change fixes this.
Fixes issue #3242 .
2015-08-17 13:43:17 -07:00
29de960638
adjust granularity of block profile
...
32bit int platforms can't handle a constant this high, so cap it at
1 second instead.
2015-08-17 09:55:38 -07:00
9a53406e55
remove extraneous debug stuff
2015-08-16 12:46:50 -04:00
6776014047
Fix bug in stress script, remove extraneous printlns
2015-08-16 12:46:50 -04:00
48ede78d98
mend
2015-08-16 12:46:50 -04:00
014812d967
Merge pull request #3628 from influxdb/wildcard-expansion
...
Wildcard expansion
2015-08-14 15:29:14 -05:00
72f51b0923
Merge pull request #3652 from influxdb/blockprof
...
turn on block profiling
2015-08-14 13:24:51 -07:00
4e04c069f9
error out if only tags are in the select clause
2015-08-14 15:24:37 -05:00
b171ab6655
add many non GROUP BY * test scenarios. clean up comments for fixed tests
2015-08-14 15:05:27 -05:00
d083ca463e
add non group by host tests
2015-08-14 15:05:27 -05:00
d58851a679
silence reporting in integration tests
2015-08-14 15:05:26 -05:00
f507059ab4
more wildcard expansion tests
2015-08-14 15:05:26 -05:00
7fdb682966
first pass at raw queries with tags
2015-08-14 15:05:26 -05:00
dc83c57d7e
more wip
2015-08-14 15:05:26 -05:00
8ea3c47747
wip
2015-08-14 15:05:26 -05:00
7b4879f0ce
Fully remove a series when dropped
...
Fix issue #3226 .
2015-08-14 10:50:35 -07:00
f544113e8c
Add test for CQ deadlock
...
Test script from #3517 that reproduces a CQ deadlock. This is related
to #3522 as well.
2015-08-14 10:46:25 -06:00
765eee74b1
turn on block profiling
...
This should help us figure out where exactly a database is hung when
it happens.
2015-08-13 15:28:53 -07:00
c81a0afb8f
Merge pull request #3635 from influxdb/add_branch_to_version
...
Add build branch to version information
2015-08-13 14:41:14 -07:00
717bce6899
Add build branch to version information
2015-08-13 13:40:51 -07:00
f74248c4e4
Add new server-level unit test
...
Added this as part of working on issue #3603 .
2015-08-13 13:08:40 -07:00
668181d275
Make log statements more consistent
...
* Capitalize first letter of message
* Log all services staring consistently
* Remove some extraneous log statements in meta.Store
* Log data dirs for meta, data and hinted handoff
2015-08-13 10:01:42 -06:00
5dfd25269f
Fix panic: reflect: call of reflect.Value.NumField on string Value
...
The env var overrides panic if we if peers was set in the config.
The type of that value is a []string and NumFields is not a valid
for that type. We don't currently support this slice fields via
the env variable settings. This particular one can be set with the
-join flag already so we just skip these fields for now.
2015-08-12 11:27:04 -06:00
f07b8d4016
Make sure port is optional when passing hostanme flag
2015-08-12 10:41:43 -06:00
be792b926a
Re-enable regex test
...
Test now passes after recent changes.
2015-08-10 17:17:17 -07:00
5b39b96b9d
Re-enable RP test
...
Test passes after latest changes.
2015-08-10 17:15:46 -07:00
f5c8280525
Fix multi UDP tests
2015-08-10 16:23:04 -07:00
8dbcff833b
Revert "Revert "Merge pull request #3599 from tpitale/multiple-udp-servers""
...
This reverts commit 5f83f038e1
2015-08-10 16:21:27 -07:00
Michael Desa
Ben Johnson
Philip O'Toole
Cory LaNou
David Norton
Philip O'Toole
Sébastien Bouchex Bellomié
Paul Dix
Jason Wilder
Takayuki Usui
Daniel Morsing