Commit Graph

1263 Commits (627cd9d486b98af01f02f0915319185a81b46c87)

Author SHA1 Message Date
Jason Wilder efea0edb82 Merge pull request #4504 from influxdb/jw-4444
Fix panic: runtime error: index out of range - Values.MinTime
2015-10-19 13:44:28 -06:00
David Norton a268ba6bb4 feat #3523: add unit test for no matches 2015-10-19 14:40:06 -04:00
Jason Wilder 1bcd8dd5de Handle reading partially written tsm files better
If a tsm file was partially written, we were not able to read the
raw block data because we panic/exited when reading the corrupted
index.  This allows us to read the raw blocks if we can.
2015-10-19 12:03:12 -06:00
David Norton 401447cbed feat #3523: filter SHOW MEASUREMENTS by WITH 2015-10-19 14:00:53 -04:00
Daniel Morsing e73c37088f Merge pull request #4454 from influxdb/intofixes
Intofixes
2015-10-19 18:58:42 +01:00
Charles Chan 456a9a8ab7 Fix typos.
* meaining --> meaning
* communcation --> communication
* deterimine --> determine
* mistmatch --> mistmatch
2015-10-17 07:50:45 -07:00
David Norton 026611aea9 fix #4475: update unit test for new error message 2015-10-16 10:50:35 -04:00
Cory LaNou a2102e19ba always return time, never strings. fixes #4415 2015-10-15 20:19:58 -05:00
Philip O'Toole 64bf96e007 100B_STD should actually write 100B points
[ci skip]
2015-10-15 16:54:29 -07:00
Philip O'Toole 81390db622 Actually check connection errors
Fix issue #4463
2015-10-15 15:07:18 -07:00
Philip O'Toole 42995ea326 Merge pull request #4459 from influxdb/add_token
Register with Enterprise server
2015-10-15 14:01:08 -07:00
Mark Bates 8f16a85cd2 Fixed issue sending JSON numbers to Enterprise when it wants strings 2015-10-15 16:51:48 -04:00
Philip O'Toole 0f001a6d9a Handle registration errors from Enterprise server 2015-10-15 13:48:23 -07:00
Philip O'Toole 07db774423 Register with Enterprise if token available 2015-10-15 13:13:34 -07:00
Philip O'Toole a7e841f447 Add config support for Enterprise token 2015-10-15 13:02:16 -07:00
Jason Wilder ae925625ce Merge pull request #4451 from influxdb/jw-int64
Int64 encoding enhancements
2015-10-15 13:44:55 -06:00
Jason Wilder b19fbec093 Merge pull request #4445 from influxdb/jw-tsm
Add influx_inspect filtering support
2015-10-15 11:16:33 -06:00
Nathaniel Cook cb1aaa8e42 Merge pull request #4375 from influxdb/subscriptions
Feature add subscriber service for creating/dropping subscriptions
2015-10-15 09:17:26 -06:00
Daniel Morsing d990b5f28d fix into queries when encountering nil values.
For aggregate queries, having a null result means that you haven't
got any data for that time period. CQs used this as a signal that
the measurement was not created and dropped the entire write.

INTO queries can have any structure, including wildcards, so dropping
the entire query isn't going to work. Instead, just drop the nulls
returned.
2015-10-15 12:12:40 +00:00
Jason Wilder 30364aa2b0 Remove dead code 2015-10-14 19:26:46 -06:00
Jason Wilder d3691425e0 Update influx_inspect to show RLE for int64 blocks 2015-10-14 19:24:04 -06:00
Michael Desa 7870b84f20 Merge pull request #4450 from influxdb/md-flags-override
Flags overwriting config file
2015-10-14 16:19:46 -07:00
Michael Desa 359f50ff85 Add support for flags overwriting config file
Previously the test file would over write any flags passed to
influx_stress, now flags overwrite config file options

Ammended with nit fixes
2015-10-14 16:14:20 -07:00
Sean Beckett 82f104a8b1 Merge pull request #4436 from influxdb/tag-names-to-keys
WIP tag name --> tag key, field name --> field key
2015-10-14 16:02:46 -07:00
Nathaniel Cook 8b31007aa7 Adds subscriber service for creating/dropping subscriptions to the
InfluxDB data stream.
2015-10-14 15:23:45 -06:00
Philip O'Toole f298e88b39 Auto-create UDP service database
All other services operate like this, so make UDP service consistent.
2015-10-14 08:30:09 -07:00
Jason Wilder 214e451af5 Move info command to separate file 2015-10-14 09:27:24 -06:00
Jason Wilder 4e9e3a4763 Shorten dumptsm flags 2015-10-14 09:24:54 -06:00
Daniel Morsing 6d188d9703 Merge pull request #4409 from influxdb/intoq
wire up INTO queries.
2015-10-14 15:29:54 +01:00
Daniel Morsing 48223a90f9 Fix spelling nit.
Make it obvious that INTO is a keyword and not part of the sentence
2015-10-14 15:16:27 +01:00
Jason Wilder bbe0eb49bc Add ability to filter index and block by key string match 2015-10-13 18:16:16 -06:00
Sean Beckett 8e65f0c84f Update server_test.go 2015-10-13 16:53:10 -07:00
Sean Beckett 9a9e04084f Update config.go 2015-10-13 16:49:09 -07:00
Jason Wilder 467ada073a Add flags for dumping only index, block or all data 2015-10-13 17:47:37 -06:00
Jason Wilder 1a3f8c403e Re-work influx_inspect command-line options to use sub-commands
Should make adding new functionality easier.
2015-10-13 17:26:23 -06:00
Jason Wilder ad35dcea38 Handle case where IDs file is out of sync with tsm1 file or missing
Avoids a panic if a series ID exists in the tsm file but not in the IDs file.
Also handles the case were we don't have an ids file and just a tsm file.
2015-10-13 17:19:59 -06:00
Daniel Morsing 822af73f88 implement continuous queries as regular execs of into queries.
Now that we have into queries, we can implement them as regular
queries that are just run on a timer.
2015-10-13 15:51:19 +00:00
Daniel Morsing 62dff895e2 wire up INTO queries.
Since INTO queries need to have absolute information about the database
to work, we need to create a loopback interface back to the cluster
in order to perform them.
2015-10-13 15:00:36 +00:00
Cory LaNou 6787525912 fixes multiple selectors overwriting each other. fixes #4360 2015-10-12 21:40:57 -05:00
Jason Wilder 16b3084ca9 Merge pull request #4397 from influxdb/jw-tsmdump
tsm1 file dump
2015-10-12 08:12:23 -06:00
Jason Wilder f58c283d8a Add some comments 2015-10-09 22:53:58 -06:00
Jason Wilder bc6d677b06 Add tsm file dump support to influx_inspect
This will read a tsm file and dump index, block and compression level info from the file.
It reads the file directly as opposed to reading it through the tsm engine which should
help with debugging and troubleshooting data file issues.

The implementation is not pretty but the output is very useful.  In the future, we can
add data extraction, recovery and verification functionality if needed.
2015-10-09 22:32:11 -06:00
David Norton 512d6ac050 fix #4280: only drop points matching WHERE clause 2015-10-09 18:34:32 -04:00
Philip O'Toole 455191d784 Merge pull request #4386 from influxdb/rename_inspect
Rename 'inspect' to 'influx_inspect'
2015-10-09 11:10:53 -07:00
Philip O'Toole 1e7a86aa61 Rename 'inspect' to 'influx_inspect' 2015-10-09 11:03:39 -07:00
linearb 60d298936e return error when database rename conflicts with continuous queries 2015-10-09 13:57:02 -04:00
linearb 668b5b9bfb change syntax to ALTER DATABASE ... RENAME TO ... 2015-10-09 13:56:23 -04:00
linearb d2afd881e6 add integration test for RENAME DATABASE 2015-10-09 13:55:38 -04:00
linearb 7212bfce83 add RENAME DATABASE 2015-10-09 13:55:38 -04:00
Philip O'Toole 5b0a8ed306 HH should not process dropped nodes 2015-10-08 18:23:12 -07:00
Nick Dawbarn 26f6d00668 Bugfix for #3429 String representations of RegexLiterals generated in influxql/ast.go add the / char as a start and end delimiter, but does not escape any / characters that may exist with the regex 2015-10-08 19:41:36 +10:00
Michael Desa 897a5effff Merge pull request #4329 from influxdb/md-stress-timestamps
Add support for evenly spaced timestamps
2015-10-06 16:26:08 -07:00
David Norton 4375545064 fix #4276: walk DropSeriesStatement 2015-10-05 19:56:30 -04:00
Michael Desa 02349a63d5 Change precison on example 2015-10-05 12:29:58 -07:00
Michael Desa 70c7d1c4d8 Change file names to be more semantic 2015-10-05 12:29:11 -07:00
Michael Desa 2ca11072e8 Change `jitter` to false in examples 2015-10-05 12:19:59 -07:00
Michael Desa 52b7e557c1 Add support for timestamp jitter 2015-10-05 12:09:08 -07:00
Michael Desa 68c1d05ad4 First pass at adding timestamps 2015-10-02 16:05:06 -07:00
Philip O'Toole d74e0690c7 Revert "Merge pull request #4233 from influxdb/drop-server"
This reverts commit 0bdb36f6dc, reversing
changes made to 3085fbc138.
2015-10-02 08:39:57 -07:00
Cory LaNou 99da67007d no more shutdown 2015-10-01 15:39:15 -05:00
Cory LaNou 73372ed907 [Ee]xecuteShutdown -> [Mm]onitorShutdown 2015-10-01 15:39:15 -05:00
Cory LaNou 34bfb6b330 be sure to exit the go routine if we terminate normally 2015-10-01 15:39:15 -05:00
Cory LaNou 7a3e1f6b27 removing peer wip 2015-10-01 15:39:15 -05:00
Michael Desa 027da3dbb4 Add examples folder 2015-09-30 15:55:09 -07:00
Michael Desa f056753afe Add moderate burn test
First pass at constructing points myself
2015-09-30 15:55:07 -07:00
Michael Desa d6027071d2 Add optional jitter to timestamps 2015-09-30 15:55:07 -07:00
Michael Desa 293fad1e20 Add note about buffer time and change example_2 2015-09-30 15:55:07 -07:00
Michael Desa 8a76e7db78 Add comments and tests 2015-09-30 15:55:07 -07:00
Michael Desa ee9c78735e Add configurable channel buffer size 2015-09-30 15:55:07 -07:00
Michael Desa ecb9bd9592 Add support for stress test under query load 2015-09-30 15:55:07 -07:00
Michael Desa 2465dbc788 Add high performance stress test example
First round at adding query load

Working draft:

Not happy with things, but it works
2015-09-30 15:55:07 -07:00
Michael Desa 22a6f79a3c Add support for `tag_count` config option
It is now possible to configure arbitrarily many tags in a generic
format. That is specifying the config option `tag_count=10` will add 10
tags to a series that are of the form `tag-key-n=tag-value` where n
ranges from 0 to 9.

Save current state
2015-09-30 15:55:06 -07:00
Michael Desa 03f291d78c Add comments and shuffle var declarations 2015-09-30 15:55:06 -07:00
Michael Desa fdfb039a44 Allow configuration via config file or flags
Note that config file takes precedence to flags
2015-09-30 15:55:06 -07:00
Michael Desa 4e587b4622 Add comment to example toml file 2015-09-30 15:55:06 -07:00
Michael Desa 48dde6b16c Add support for config file 2015-09-30 15:55:06 -07:00
Michael Desa 911623f5f6 Add quick notes 2015-09-30 15:55:06 -07:00
Michael Desa e608e9b79b Add stress
First pass at running stress test from a toml
2015-09-30 15:55:06 -07:00
Michael Desa e43b60b8e1 Add example config for stress test 2015-09-30 15:55:06 -07:00
Ben Johnson 343dd23ee7 refactor map functions to use list of values
This commit changes `tsdb.mapFunc` to use `tsdb.MapInput` instead
of an iterator. This will make it easier and faster to pass blocks
of values from the new storage engine into the engine.
2015-09-29 14:00:33 -06:00
Philip O'Toole 7cb8c2d2ec Add build timestamp to version data 2015-09-24 23:40:53 -07:00
Cory LaNou b1becfbcfc more tests, simplify mapFunc signatures 2015-09-23 09:27:19 -05:00
Cory LaNou 78bc740434 full support for min/max/first/last 2015-09-23 09:03:57 -05:00
Ben Johnson 8e27cf1fd8 Merge remote-tracking branch 'upstream/master' into refactor-select-mapper
Conflicts:
	tsdb/store.go
2015-09-22 13:58:24 -06:00
Ben Johnson 96715d7d90 rename Cursor.Seek() to Cursor.SeekTo() 2015-09-22 13:23:16 -06:00
Ben Johnson 56cb2fae5d fix integration tests 2015-09-22 13:10:13 -06:00
Ben Johnson 649663ca15 fix tests 2015-09-22 13:10:13 -06:00
Ben Johnson a5269e9cc7 rename direction to ascending. 2015-09-22 13:09:26 -06:00
David Norton 8bd2408320 convert SHOW TAG KEYS to distributed query 2015-09-21 11:30:51 -04:00
Cory LaNou 72f6f7d268 Merge pull request #4134 from influxdb/issue-3447
Refactor Points and Rows to dedicated packages
2015-09-17 15:27:48 -05:00
Philip O'Toole f73bc6ff19 Merge pull request #4140 from influxdb/engine_config
Make engine configurable
2015-09-16 21:17:43 -07:00
Philip O'Toole 7b1a4e6700 Control whether each query should be logged
Fixes issue #4138
2015-09-16 19:26:23 -07:00
Philip O'Toole e4fde993f1 Make engine configurable 2015-09-16 19:09:25 -07:00
Cory LaNou d19a510ad2 refactor Points and Rows to dedicated packages 2015-09-16 15:33:08 -05:00
Cory LaNou bf955c7c11 Merge pull request #4112 from influxdb/issue-3457
Period in field name that matches measurement fails.  Fixes #3457
2015-09-16 09:55:43 -05:00
Philip O'Toole afe5cc67f4 Repeat the identical time aggregate test more; 2015-09-15 16:22:25 -07:00
Cory LaNou f02d8eef4f unskip test 2015-09-15 16:36:11 -05:00
Cory LaNou 5395ac7634 Period in field name that matches measurement fails. Fixes #3457 2015-09-15 16:26:39 -05:00
Cory LaNou c70b503f00 go fmt 2015-09-15 16:09:58 -05:00
Philip O'Toole 69c9f28e2d Fix compilation error in test code 2015-09-15 11:42:58 -07:00
Philip O'Toole 76e3552a95 Increase write-timeout to 30s during testing
This should hopefully reduce the rate of CI failures during testing.
2015-09-15 11:35:21 -07:00
Philip O'Toole 05b2e4985f Merge pull request #4065 from sbouchex/cmd_add_precision
Added precision support in cmd client
2015-09-14 16:44:23 -07:00
Michael Desa f623701e79 Merge branch 'master' into md-stress-runner 2015-09-11 15:45:11 -07:00
Michael Desa d85c4f7699 Cherry pick failed requests from 2d67a9e
Commit 2d67a9ea22
started tracking failed request. This commit cherry picks the
functionality introduced there.
2015-09-11 15:10:15 -07:00
Sébastien Bouchex Bellomié 5656ba167f Added precision support in cmd client 2015-09-11 10:04:18 +02:00
Sébastien Bouchex Bellomié 9831ab2cc8 Added precision support in cmd client 2015-09-11 09:20:02 +02:00
Philip O'Toole 101a4d2a55 Merge pull request #4066 from influxdb/pd-fail-writes-on-memory-pressure
Update WAL to fail writes if pressure too high.
2015-09-10 11:27:32 -07:00
Philip O'Toole ed917aa7f8 Log each query before execution
If a query causes a server to panic, the query is nowhere in the logs,
which makes debug very difficult.
2015-09-10 10:52:51 -07:00
Cory LaNou ef17dbb492 more tests 2015-09-10 11:32:30 -05:00
Paul Dix 2d67a9ea22 Update WAL to fail writes if pressure too high.
If the memory gets 5x above the partition size threshold, the WAL will start returning write failures to the clients. This will allow them to backoff their write volume.

Also updated the stress script to track failed requests and output messages on failure and when it returns to success.
2015-09-09 22:41:32 -07:00
Sébastien Bouchex Bellomié f8a827d9d2 Added precision support in cmd client 2015-09-09 22:54:57 +02:00
Cory LaNou fa04b0ab20 add server integration tests 2015-09-09 15:46:21 -05:00
Sébastien Bouchex Bellomié 23a606bafc Added precision support in cmd client 2015-09-09 22:17:48 +02:00
Philip O'Toole 0ea0a3a71b Add build info to diagnostics 2015-09-09 12:43:51 -07:00
Philip O'Toole 402576bd93 Pass richer build information to Server 2015-09-09 12:36:32 -07:00
Michael Desa 70c816e236 Add optional precision setting 2015-09-09 11:21:17 -07:00
Michael Desa 551e51a643 Move `cmd/influx_stress/runner` pkg to `stress` 2015-09-09 11:21:17 -07:00
Michael Desa c773df00ef Add throttling of requests 2015-09-09 11:21:17 -07:00
Michael Desa 2b0b66d7d6 Add a configurable `Measurements` type
Previously the measurement that was getting written into InfluxDB was
hard coded in the `Run` method as `cpu`. Now you can specify a
measurements by passing an `-m` flag to `influx_stress`.

The `-m` flag accepts a comma separated list of measurements. (e.g.
`influx_stress -m cpu,mem,disk`)
2015-09-09 11:21:17 -07:00
Michael Desa d63ac6a842 Add tests for runner.go 2015-09-09 11:21:17 -07:00
Michael Desa 35a0477f05 Add the an error to the NewCleint
Additionally the Config definition of the Config type was moved to just
above the definition of the NewClient Method.
2015-09-09 11:21:17 -07:00
Michael Desa dd8413d9ac Missed one last thing for the timer 2015-09-09 11:21:17 -07:00
Michael Desa e29b159079 Change Timer method names to be more semantic.
Additionally, getter and setter method were added to the Timer type.
2015-09-09 11:21:17 -07:00
Michael Desa 1a3d6cb74a Rename newResponseTime to NewResponseTime 2015-09-09 11:21:16 -07:00
Michael Desa 4413b302be Fix sorting for the ResponseTimes type
The `sort` methods were failing as responseTimes couldn't be cast to an
[]int. To fix this `ResponseTimes` now implements the `sort.Interface`
interface.
2015-09-09 11:21:16 -07:00
Michael Desa d54e439385 Change responseTimes to its own type
`responesTimes` was an []int and is now it own type
2015-09-09 11:21:16 -07:00
Michael Desa 3ae5183592 Add comments where needed 2015-09-09 11:21:16 -07:00
Michael Desa a19e2d9f50 Rename `Runner` to `Run` 2015-09-09 11:21:16 -07:00
Michael Desa 71d8047ad3 Pull the body of influx_stress main out
This commit abstracts out the body of `main()` and moves it into a separate
function `Runner` in `runner/runner.go`. Additonally two new types,
`Timer` and `Config` were introduced.

`Runner` takes in a `*Config` and returns the total number of points
written `totalPoints`, an slice of response times `responseTimes`, and a
timer with the starting and ending times of the test `*Timer`.
2015-09-09 11:21:16 -07:00
Michael Desa d57771dc17 Add Timer type that keeps track of start & end 2015-09-09 11:21:16 -07:00
Michael Desa 8b89332029 Add new file `runner.go` 2015-09-09 11:21:16 -07:00
Philip O'Toole ca07b86254 Prohibit dropping the default retention policy
This is to prevents users from putting their system into an awkward
state. It is a policy that all databases must have at least a default
retention policy.

Fixes issue #3699.
2015-09-08 23:00:19 -07:00
Cory LaNou 62e9c24b25 fixes #3926 2015-09-08 14:15:48 -05:00
Jason Wilder 77d310337c Clarify comment 2015-09-08 11:05:39 -06:00
Jason Wilder dabb01691e Close server is reverse order that it was started
The server was closing by stopping the most depended on services first
which causes various panics while higher level services are still processing
task when the server closes.

Fixes #3881
2015-09-08 11:04:00 -06:00
Philip O'Toole bbc103305b Support multiple Graphite inputs
Fixes issue #3636
2015-09-06 21:33:46 -07:00
Jason Wilder b8da247b08 Open monitor server after metastore is ready 2015-09-05 09:06:51 -06:00
Jason Wilder 13dbc8f0ba Merge pull request #3841 from influxdb/jw-file-utils
Add inspect tool
2015-09-04 14:12:05 -06:00
Philip O'Toole 267f8e6c11 Skipping race test
Issue #3997
2015-09-04 11:59:28 -07:00
Cory LaNou 3867fed0ff one additional test for top 2015-09-04 13:30:42 -05:00
Cory LaNou 9703467171 refactor validateAggregates 2015-09-04 13:30:41 -05:00
Cory LaNou 347ffc70b4 wire up advanced top sorting/slicing 2015-09-04 13:30:41 -05:00
Cory LaNou 8c4595b345 top is coming together. filling out fields properly 2015-09-04 13:30:41 -05:00
Cory LaNou ba79007960 wip 2015-09-04 13:30:41 -05:00
Cory LaNou f3e557d943 more top test scenarios 2015-09-04 13:30:41 -05:00
Cory LaNou 5a66725054 refactoring/adding top integration testing 2015-09-04 13:30:40 -05:00
Cory LaNou 35b9215aa9 refactor processTopBottom - wip 2015-09-04 13:30:40 -05:00
Cory LaNou 046282249a wip remapping top output 2015-09-04 13:30:40 -05:00
Cory LaNou 72fd115dc2 exposing tags on cursors, top/bottom are valid funcs now 2015-09-04 13:30:39 -05:00
dgnorton a3def8d3a7 Merge pull request #3993 from influxdb/dgn-fix-cq-test
fix CQ test
2015-09-04 13:12:29 -04:00
Jason Wilder 4a0d31d284 Fix broken rebase 2015-09-04 10:50:11 -06:00
Jason Wilder 23d4ce2efa Fix panic if a series does not exists in a shard 2015-09-04 10:38:59 -06:00
Jason Wilder 6b4926257a Add inspect tool
Start of a lower-level file inspection tool.  This currently dumps
summary statistics for the shards, index and WAL that can be used to
understand the shape of the data is in the local shards.  This util
operates on the shards itself and not through the server and is intended
more for debugging/troubleshooting.
2015-09-04 10:38:59 -06:00
David Norton 0d43fdb94c fix CQ test 2015-09-04 12:35:41 -04:00
Jason Wilder df70a1c8ce Update tests to use Direction enum 2015-09-04 09:00:11 -06:00
Jason Wilder b7c0d47008 Add aggregate order by desc test 2015-09-03 22:31:58 -06:00
Jason Wilder 266bdc1c2b Support sort by time DESC in wal and bz1 engines 2015-09-03 22:28:36 -06:00
Cory LaNou 6592dcc699 EnableLogging -> LoggingEnabled 2015-09-03 16:56:07 -05:00
Cory LaNou 473c04dc0d silence wal logging during testing 2015-09-03 15:17:03 -05:00
Ben Johnson deff06f850 add copier service
This commit adds the copier service which allows one server to
copy shards from another server. This will be used for moving
shards in the cluster.
2015-09-03 13:07:35 -06:00
David Norton 4187fb4257 skip test instead of commenting out 2015-09-03 09:40:45 -04:00
David Norton 2739f5e688 temporarily disable a CQ test 2015-09-03 07:12:15 -04:00
David Norton 66001cfbb5 fix #2555: add integration tests for CQs 2015-09-03 07:12:15 -04:00
Philip O'Toole c0d61740a4 Ensure monitor database exists
This requires a leader in the cluster, so wait for that before
attempting the database creation.
2015-09-02 16:26:16 -07:00
Philip O'Toole d820fa7649 Add PointsWriter to monitor
This will allow the monitor to persistently store statistics
2015-09-02 15:45:11 -07:00
Philip O'Toole 9165a0cf4c Create statement_executor for monitor 2015-09-02 15:44:56 -07:00
Philip O'Toole 4e2ee1ea70 Rename MonitorService to just Monitor
monitor is not a service, it has more in common with meta, since it
provides functionality to the query layer. This names makes this
clearer.
2015-09-02 15:07:30 -07:00
Jason Wilder 1d4ee6c3fa Add tests for influx consistency level parsing 2015-09-02 09:22:15 -06:00
Takayuki Usui 557f796566 Add an option to cmd/influx to set write consistency level
This patch introduces an option in influx allowing users to
select write consistency level, which has been implicitly
set to 'any' by default so far.
2015-09-02 11:00:06 +09:00
Philip O'Toole 9df17409d3 Use monitor service with Graphite 2015-09-01 15:21:36 -07:00
Philip O'Toole f05dc20b58 Hook new monitor service to server
u
2015-09-01 15:03:52 -07:00
Philip O'Toole d87e668c78 Remove obsolete monitoring code 2015-09-01 15:03:52 -07:00
Philip O'Toole 1a55951f36 Backend support for database IF NOT EXISTS 2015-08-28 19:04:54 -07:00
Philip O'Toole e0066760ba Make the startup log message actually first 2015-08-28 15:14:20 -07:00
Philip O'Toole 191163c7c7 Move to Go 1.5 2015-08-27 09:58:15 -07:00
Philip O'Toole 94484067f3 Log Go runtime version 2015-08-26 14:47:59 -07:00
Philip O'Toole 10779c9634 Unit-test predictable first/last point ordering 2015-08-25 22:26:04 -07:00
Philip O'Toole ca52a3ffd7 Allow queries to be looped
Some queries may be subject to race conditions. This variable allows the
test to request that a query is executed multiple times, increasing the
chance that any race will be exposed.
2015-08-25 15:16:13 -07:00
Cory LaNou ace4737228 throttle import 2015-08-21 15:07:01 -05:00
Philip O'Toole 20e5d5f3a9 Test explicitly SELECTing time as a field 2015-08-21 12:14:53 -07:00
Paul Dix 2752e894e1 Merge pull request #3762 from influxdb/pd-update-stress
Update stress to work with fewer than 10k series.
2015-08-21 11:24:27 -04:00
Philip O'Toole cd0ce4ac55 Re-enable chunking test post WAL updates
Fixes issue #3725.
2015-08-20 12:54:48 -07:00
Paul Dix 375afc3fcc Update stress to work with fewer than 10k series. 2015-08-20 09:36:06 -04:00
Jason Wilder cd3ef17fc6 Merge pull request #3743 from influxdb/jw-env-config
Apply env overrideds for config command
2015-08-19 15:20:03 -06:00
Jason Wilder 0b2aa62172 Merge pull request #3737 from influxdb/jw-wal-dir
Ensure wal-dir has a default value
2015-08-19 13:53:37 -06:00
Jason Wilder 67c54ddc47 Apply env overrideds for config command
Matches the behavior of the run command and lets you test env
vars override config values more easily.
2015-08-19 13:52:28 -06:00
Jason Wilder 6bd9561de0 Ensure wal-dir has a default value 2015-08-19 13:39:22 -06:00
Philip O'Toole de95a42d4e Skip failing chunking test
Until https://github.com/influxdb/influxdb/issues/3725 is fixed.
2015-08-19 11:40:02 -07:00
Paul Dix c31b88de60 Merge pull request #3569 from influxdb/pd-wal
Add initial WAL implementation and tests
2015-08-18 20:45:32 -04:00
Paul Dix 9df3b7d828 Add WAL configuration options 2015-08-18 16:59:54 -04:00
Philip O'Toole 28a6b1f3fd Merge pull request #3697 from influxdb/chunking_10k
Merge same-series data if not chunking
2015-08-18 13:23:10 -07:00
Philip O'Toole 0eb93d675d Add some unit tests related to partner testing 2015-08-17 14:36:13 -07:00
Philip O'Toole 487c336571 Correctly merge rows for identical series
If no chunking was requested by the user, the co-ordinating node buffers all
results in RAM before emitting a single result. However buffering was not
merging results for rows which had data for the same series. This change fixes this.

Fixes issue #3242.
2015-08-17 13:43:17 -07:00
Daniel Morsing 29de960638 adjust granularity of block profile
32bit int platforms can't handle a constant this high, so cap it at
1 second instead.
2015-08-17 09:55:38 -07:00
Paul Dix 9a53406e55 remove extraneous debug stuff 2015-08-16 12:46:50 -04:00
Paul Dix 6776014047 Fix bug in stress script, remove extraneous printlns 2015-08-16 12:46:50 -04:00
Paul Dix 48ede78d98 mend 2015-08-16 12:46:50 -04:00
Cory LaNou 014812d967 Merge pull request #3628 from influxdb/wildcard-expansion
Wildcard expansion
2015-08-14 15:29:14 -05:00
Daniel Morsing 72f51b0923 Merge pull request #3652 from influxdb/blockprof
turn on block profiling
2015-08-14 13:24:51 -07:00
Cory LaNou 4e04c069f9 error out if only tags are in the select clause 2015-08-14 15:24:37 -05:00
Cory LaNou b171ab6655 add many non GROUP BY * test scenarios. clean up comments for fixed tests 2015-08-14 15:05:27 -05:00
Cory LaNou d083ca463e add non group by host tests 2015-08-14 15:05:27 -05:00
Cory LaNou d58851a679 silence reporting in integration tests 2015-08-14 15:05:26 -05:00
Cory LaNou f507059ab4 more wildcard expansion tests 2015-08-14 15:05:26 -05:00
Cory LaNou 7fdb682966 first pass at raw queries with tags 2015-08-14 15:05:26 -05:00
Cory LaNou dc83c57d7e more wip 2015-08-14 15:05:26 -05:00
Cory LaNou 8ea3c47747 wip 2015-08-14 15:05:26 -05:00
Philip O'Toole 7b4879f0ce Fully remove a series when dropped
Fix issue #3226.
2015-08-14 10:50:35 -07:00
Jason Wilder f544113e8c Add test for CQ deadlock
Test script from #3517 that reproduces a CQ deadlock.  This is related
to #3522 as well.
2015-08-14 10:46:25 -06:00
Daniel Morsing 765eee74b1 turn on block profiling
This should help us figure out where exactly a database is hung when
it happens.
2015-08-13 15:28:53 -07:00
Philip O'Toole c81a0afb8f Merge pull request #3635 from influxdb/add_branch_to_version
Add build branch to version information
2015-08-13 14:41:14 -07:00
Philip O'Toole 717bce6899 Add build branch to version information 2015-08-13 13:40:51 -07:00
Philip O'Toole f74248c4e4 Add new server-level unit test
Added this as part of working on issue #3603.
2015-08-13 13:08:40 -07:00
Jason Wilder 668181d275 Make log statements more consistent
* Capitalize first letter of message
* Log all services staring consistently
* Remove some extraneous log statements in meta.Store
* Log data dirs for meta, data and hinted handoff
2015-08-13 10:01:42 -06:00
Jason Wilder 5dfd25269f Fix panic: reflect: call of reflect.Value.NumField on string Value
The env var overrides panic if we if peers was set in the config.
The type of that value is a []string and NumFields is not a valid
for that type.  We don't currently support this slice fields via
the env variable settings.  This particular one can be set with the
-join flag already so we just skip these fields for now.
2015-08-12 11:27:04 -06:00
Jason Wilder f07b8d4016 Make sure port is optional when passing hostanme flag 2015-08-12 10:41:43 -06:00
Philip O'Toole be792b926a Re-enable regex test
Test now passes after recent changes.
2015-08-10 17:17:17 -07:00
Philip O'Toole 5b39b96b9d Re-enable RP test
Test passes after latest changes.
2015-08-10 17:15:46 -07:00
Philip O'Toole f5c8280525 Fix multi UDP tests 2015-08-10 16:23:04 -07:00
Philip O'Toole 8dbcff833b Revert "Revert "Merge pull request #3599 from tpitale/multiple-udp-servers""
This reverts commit 5f83f038e1.
2015-08-10 16:21:27 -07:00
Philip O'Toole 5f83f038e1 Revert "Merge pull request #3599 from tpitale/multiple-udp-servers"
This reverts commit 7f35d65412, reversing
changes made to f828781544.
2015-08-10 14:44:14 -07:00
Philip O'Toole 7f35d65412 Merge pull request #3599 from tpitale/multiple-udp-servers
Change single udp config to support multiple UDP listeners
2015-08-10 14:22:27 -07:00
Philip O'Toole 84af826a0f Re-enable test "TestServer_Query_Now"
Recent changes must have fixed issue #2874.
2015-08-10 14:10:20 -07:00
Philip O'Toole a122e709ea Add system-level test for math 2015-08-10 13:13:04 -07:00
Jason Wilder 11f4ba82aa Add env override config test 2015-08-09 16:14:10 -06:00
Jason Wilder 775dadadf5 Use INFLUXDB as env var prefix 2015-08-09 16:06:38 -06:00
Tony Pitale e943afacdc Change (previously unused) single udp config to support multiple UDP listeners
do not use NewConfig for UDP

appendUDPService must return a value

udp service does not need to handle error

fix missing case of c.UDP in tests
2015-08-09 11:28:09 -04:00
Jason Wilder 6f9c18fe95 Allow overriding of configuration parameters using environment variables
This allows all config variable to be set via environment variables using
a similar naming convention for the toml config.  For example, to change the
HTTP API port using the config, you would set:

[http]
  bind-address = ":8086"

To change it with an environment variable, you would use:

  HTTP_BIND_ADDRESS=":8086" influxd

The section name is used as the env variable prefix and the config key
name is the suffix.  The only change to the config name is that "-" should
be replaced with "_" to avoid shell interpretation issues.

This makes it much easier to configure docker instances within a docker container
or adhoc instances at the command-line.

For slice config sections like graphite, you can currently only override the first
entry since the default config only has 1 entry.  To do that use, GRAPHITE_0 as the
prefix.  You cannot currently add new entries like GRAPHITE_1.  A future PR might
address this issue.

The environment variable values should be the same as the config values.

The order that configuration values are applied is as follows:
* Default config
* Config file
* Environment variables
* Command-line arguments

Fixes #3246
2015-08-07 14:27:38 -06:00
Jason Wilder 87376a1c35 Allow -hostname to also override remote addr port
When starting a influxd in a docker container, the processess needs to know
the hosts address and port in order to create its NodeInfo correctly.  -hostname
previously only allowed us to change the hostname and the port would always be 8088
which may not be correctly if running multiple containers on the same host.
2015-08-07 14:03:08 -06:00
Jason Wilder c90ffff855 Fallback to HOME env var to determine home dir
When building a static binary without cgo, user.Current() uses cgo
and always fails.  Fallback to to HOME env variable if it exists.
2015-08-07 14:03:08 -06:00
Cory LaNou 2d26c2c9fe Additional test coverage for non-existent fields 2015-08-06 15:01:34 -05:00
Cory LaNou fdaa809f9a fix some tests, add some tests, fix some test comments 2015-08-06 14:01:29 -05:00
Cory LaNou b19a8f3968 Fix alias, maintain column sort order 2015-08-06 14:01:03 -05:00
Cory LaNou 765509bd68 revert breaking change to `client.NewClient` function 2015-08-06 11:46:25 -05:00
Cory LaNou 05fde32c2f silence output when connecting 2015-08-06 10:24:00 -05:00
Cory LaNou b29f9a4118 minor fix to help for influx 2015-08-06 09:19:56 -05:00
Cory LaNou 296f16d634 NewConfig should return a default config without needing params passed to it 2015-08-06 09:19:56 -05:00
Cory LaNou 76367d5161 refactoring based on feedback 2015-08-06 09:19:56 -05:00
Cory LaNou b0b229b1bd add godoc comments for v8 importer 2015-08-06 09:19:34 -05:00
Cory LaNou 05a8c106e8 add database/retention policy context switching. log failed imports 2015-08-06 09:19:34 -05:00
Cory LaNou 30a0ca0130 start of a v8 data importer via the cli 2015-08-06 09:19:34 -05:00
Jason Wilder 2b76dac479 Don't resolve hostname when creating node
Hostnames were always being resolved to an IP address and the IP
address was used as the host address and raft peer address.  There
was no way to use an actual hostname instead of an IP address.
2015-08-05 14:17:26 -06:00
Daniel Morsing 38b70b2cfd add test for evil identifiers that stress the parser 2015-08-05 19:41:00 +01:00
David Norton d661bf1a06 fix #3414: shard mappers perform query re-writing 2015-08-04 09:49:50 -04:00
David Norton 0b248e225c Fix aggregate queries and time precision on where clauses. 2015-07-29 15:54:55 -04:00
Cory LaNou 4bc7e11adb Continuous Query Tests 2015-07-28 14:58:44 -05:00
Jason Wilder b6c95925fb Add retry delay for report service loop when error occurs
There is a race when stopping servers where the meta.Store is closing
but the server has not signaled it is closing so the reporting goroutine
repeeatedly errors out in fast loop during this time.  It creates a lot
of noise in the logs.
2015-07-28 09:40:26 -06:00
Jason Wilder 514f36cf54 Exit report goroutine if server is closing 2015-07-28 09:40:25 -06:00
Jason Wilder 06d8ff7c13 Use config.Peers when passing -join flag
Removes the two separate variables in the meta.Config.  -join will
now override the Peers var.
2015-07-28 09:40:25 -06:00
gunnaraasen 32d3d70da9 Remove all dump code from CLI 2015-07-23 17:21:01 -07:00