Commit Graph

1263 Commits (627cd9d486b98af01f02f0915319185a81b46c87)

Author SHA1 Message Date
nick.grange 33de878956 Fixed #5078 to support Inserts in non-interactive mode.
Changed non-interactive mode to send everything through the CLI's parser the same way the interactive mode works.
Added multiline support for -execute flag.
2015-12-17 23:42:30 +11:00
Michael Desa ff12e83e7f Merge pull request #5148 from influxdb/jz-influx-stress-documentation
Add README.md for influx_stress
2015-12-16 17:16:22 -08:00
Jack Zampolin a507a8dd8e Add README.md for influx_stress 2015-12-16 16:20:37 -08:00
Jason Wilder 93d93797da Fix snappy decode error w/ influx_inspect 2015-12-16 11:28:13 -07:00
dgnorton d89e233567 Merge pull request #5100 from influxdb/dgn-fix-4303
fix #4303: don't drop from multiple databases
2015-12-15 07:27:05 -05:00
Jack Zampolin 7d0d9b75d9 Add backoff to retry function
Set backoff constant

Wait to parse flags

Remove unnecessary logging

Fix retry logic
2015-12-14 13:46:40 -08:00
David Norton 69f22803d2 fix #4303: duplicate url.Values 2015-12-14 12:28:01 -05:00
David Norton 3014fb90e4 fix #4303: don't drop from multiple databases 2015-12-12 13:54:23 -05:00
Tim Raymond 718fb92cf5 Remove registration, add 'usage-client'
Server registration and stats reporting has been removed from what was
once http://enterprise.influxdata.com. The app that lived there, now
runs at http://usage.influxdata.com, so that the subdomain can
eventually be repurposed. Because we also want to repurpose the
`enterprise-client` repo, we have also renamed that to `usage-client`.
InfluxDB no longer needs the `registration` service now, since all of
the endpoints it communicates with simply discard the data provided to
them.
2015-12-10 15:58:34 -05:00
Philip O'Toole def5e06150 Merge pull request #5064 from mengjinglei/fix-parens-math
fix issue #5054
2015-12-10 08:44:48 -08:00
mengjingleli 149b93fd4b add a test case 2015-12-10 13:51:43 +08:00
Nathaniel Cook b7000c80dd count with fill(none) will drop 0 valued intervals 2015-12-09 15:20:47 -07:00
mengjingleli 3a901abbd8 fix issue #5054 2015-12-09 15:27:33 +08:00
Michael Desa 59169dcdc4 Implement WriteHTTPHandler 2015-12-08 16:09:12 -08:00
Michael Desa 364a699416 Add broadcast channel for stress 2015-12-08 14:29:22 -08:00
Paul Dix 40e606cb14 Merge pull request #5003 from influxdb/jw-compaction
Update compaction planning
2015-12-05 16:49:54 -05:00
Jason Wilder 41b24995a7 Compcation fixes 2015-12-05 12:19:28 -07:00
Michael Desa 14b5ed3001 Merge pull request #4961 from influxdb/md-stress-cluster
Add cluster support to stress test
2015-12-04 15:20:31 -08:00
Philip O'Toole 4f69936564 Add more math unit tests to server-level tests 2015-12-04 11:23:35 -08:00
Jason Wilder c54a3da0ca Implement delete series/measurement 2015-12-04 09:10:26 -07:00
Cory LaNou 477110f0b7 add option to disable logging for meta service. useful for testing 2015-12-03 11:11:36 -06:00
Cory LaNou 0c2588ed43 cluster retention auto create test 2015-12-03 08:08:57 -06:00
Cory LaNou 52da1c76d6 cluster retention policy tests 2015-12-03 08:08:56 -06:00
Cory LaNou 96c230d968 allow for configurable cluster creation 2015-12-03 08:08:56 -06:00
Cory LaNou ab57bde115 more tests, some refactoring 2015-12-03 08:08:56 -06:00
Cory LaNou 91da96eb34 fix race in test harness 2015-12-03 08:08:56 -06:00
Cory LaNou 6e845839c8 fix flakey test harness 2015-12-03 08:08:56 -06:00
Cory LaNou 967a53cabd start sharing integration tests for cluster tests 2015-12-03 08:08:56 -06:00
David Norton 3208564192 fix RP not found error messages 2015-12-03 08:04:09 -06:00
David Norton 343f00d1f2 fix go vet errors 2015-12-03 08:04:09 -06:00
David Norton 76d291e88e beginning of cluster test harness 2015-12-03 08:04:09 -06:00
Michael Desa f9fa366861 Add querying across cluster
Add support for precision
2015-12-02 14:49:23 -08:00
Michael Desa b0f27beb12 Add support for writing to a cluster 2015-11-30 10:22:12 -08:00
Paulo Pires 8e2868ed60 Added support for setting retention policy on database creation.
Fixes #2676
2015-11-27 20:02:55 +00:00
Jason Wilder a6541937f8 Add dumptsmdev to influx_inspect
Allow inspecting the updated TSM format.
2015-11-24 08:50:13 -07:00
Mark Bates 98632778dd %s will convert a float to a less than useful string. %v is better. 2015-11-20 15:43:35 -05:00
Mark Bates c71e323d63 ServerID and ClusterID need to be strings when being sent to Enterprise. 2015-11-20 15:22:27 -05:00
Philip O'Toole 1e9e7c2d94 Merge pull request #4807 from flisky/master
FIX #4279 CLI support multiline
2015-11-18 19:03:34 -08:00
Jason Wilder c4a6490d32 Update influx_inspect to use new DecodeBlock interface 2015-11-17 23:24:09 -07:00
Michael Desa 9a5120b2a3 Merge pull request #4742 from influxdb/md-new-stress
WIP: Refactor Stress tool
2015-11-17 14:42:51 -08:00
Michael Desa eb0e760763 Update stress config examples 2015-11-17 14:36:10 -08:00
Michael Desa b86c0d31d7 Refactor stress tool
Add StressTest type and auxillary interfaces

Add config structs

Move generator to config

Add utility methods used in stress

Add basic components for a stress test

Add touches

Add configuration options

Add unified results handlers

Add final print out of results

Add Success function to response type

Add query support

Send query results

Add comments to run.go

Change Basic to BasicWriter

Add basic query

Add incomplete README

Abstract out response handling

Change plugin to basic

Add responseHandler type

Add additional parameter to Query function

Add todo comments and cleanup main

Lower hard coded value

Add flag for profiling

Fix race condition

Wait at the right place

Chane point from struct to interface

Improve generic write throughput

Reorganize

Fastest State

Add toml config

Add test server

Add basic working version of config file

Move config file logic into its own file

Fix broken config file

Add query count to stress config

Add support for concurrency and batch interval

Reorder config option

Remove unneeded init

Remove old stress package

Move new stress code into stress directory

Rework influx_stress tool

Do something reasonable if no config is given

Remove unneeded comments

Add tests for stress package

Add comments and reorganize code

Add more comments

Count lines posted correctly

Add NewConfig method

Fix style issues

Add backticks to flag description

Fix grammar

Remove `StartTimer` calls where appropriate

Fix comment language

Change Reader to Querier

Reorder defer

Fix issues bought up by golint

Add more comments

Add more detailed Readme

Increase counter appropriately

Add return errors where appropriate

Add test coverage

Move `now()` from QueryClient to QueryGenerator
2015-11-17 12:16:31 -08:00
Cory LaNou 6309ec9a68 fix time inclusive comparison 2015-11-17 10:43:27 -06:00
Cory LaNou 824d7a1d9b Add interface for heap to support Reverse for `order by desc` 2015-11-16 15:10:55 -06:00
Yin Jifeng 2f3fc70514 FIX #4279 CLI support multiline 2015-11-16 22:59:21 +08:00
Cory LaNou bb00645a84 Merge pull request #4768 from pires/4719-cli_history_refactor
CLI history skips blank lines.
2015-11-14 07:25:58 -06:00
Paulo Pires a8fa170f29 Removed bogus comment. 2015-11-14 11:12:31 +00:00
Philip O'Toole 912684b8d6 WHERE fields must be decoded during aggregates
This change ensures that if there are any fields in the WHERE clause of
an aggregate that are different from the fields in the SELECT clause,
that the cursors also decode those fields. Otherwise WHERE clauses of
the form 'SELECT f(w) FROM x WHERE y=z' will return incorrect results

Fixes issue #4701.
2015-11-13 15:18:54 -08:00
Philip O'Toole 172cc43732 Merge pull request #4766 from aneshas/cli-help-contrib
Changed help command output from inside the cli
2015-11-13 11:17:18 -08:00
Paulo Pires aa6ec0cc6f Added more tests to increase coverage. Refs #2313 2015-11-13 11:38:35 +00:00
Anes Hasicic 95ced0bcc1 Changed help command output from inside the cli to
match the info provided by the influx --help output,
and added history command

Reverted description for pretty command

+ minor edits

Removed duplication of command names

Signed-off-by: Anes Hasicic <anes.hasicic@gmail.com>
2015-11-13 09:41:51 +01:00
Philip O'Toole eebf157171 Remove incorrect count() tests 2015-11-12 19:08:44 -08:00
Philip O'Toole f889ac1140 If no points to count, count is 0
Fix issue #4701.
2015-11-12 18:52:58 -08:00
Paulo Pires 81658de1be Exit gracefully on forced CLI termination. 2015-11-12 23:14:36 +00:00
Philip O'Toole dc609b06fd Set GOMAXPROCS before log message
Previously the impression was being given that GOMAXPROCS was not being
set correctly.
2015-11-12 13:28:35 -08:00
Paulo Pires c812aaa36b Refactored command parsing tokenization. 2015-11-12 20:52:41 +00:00
Paulo Pires 194b2c4965 CLI history skips blank lines.
Fixes #4719
2015-11-12 20:50:23 +00:00
Philip O'Toole 3cab8fac02 Revert to Go 1.4.2
This is not passing 'go vet' under 1.4.2.
2015-11-11 15:48:37 -08:00
Philip O'Toole bc1091ec31 Revert "Merge pull request #4684 from nkatsaros/default-config"
This reverts commit 87441584f3, reversing
changes made to a14829bc1d.
2015-11-11 09:29:06 -08:00
Pablo Miranda b908cbb866 fix lint errors for cmd/...
corrects the initialize package comment for lint

brings c.ServerVersion back
2015-11-10 23:13:01 -08:00
Cory LaNou 6ecb62e4d2 Merge pull request #4737 from ch33hau/4283-hh-throws-error-even-if-disabled
Disable HintedHandoff if configuration is not set. #4283
2015-11-10 19:07:27 -06:00
ch33hau 8bfdfbda0b Disable HintedHandoff if configuration is not set. #4283 2015-11-11 01:12:34 +08:00
Paulo Pires aa6f807dfe Move CLI stuff out of main package for increased testability. Refs #2313 2015-11-10 16:27:13 +00:00
Paulo Pires 4a1dff865c Added tests related to #4704 2015-11-09 23:58:13 +00:00
Paulo Pires 39f9e516c6 Improve CLI command parsing. Fixes #4544 2015-11-09 23:56:30 +00:00
Philip O'Toole 21ddb07b5f Merge pull request #4715 from oiooj/master
raft.raftLayer already closed in raft.NetworkTransport.Close()
2015-11-09 15:43:01 -08:00
Philip O'Toole fbfa175098 Merge pull request #4702 from pires/4628-cli_history
Implement CLI history command
2015-11-09 14:36:04 -08:00
oiooj 6e9b210e63 raft.raftLayer already closed in raft.NetworkTransport.Close() 2015-11-10 00:09:19 +08:00
Paulo Pires b41131643d Implement CLI history command. Fixes #4628 2015-11-06 22:20:28 -05:00
ch33hau 2235dcec6b Added IF EXISTS for DROP DATABASE command, #4659 2015-11-07 10:57:49 +08:00
Mark Bates 8ac958f8a0 Merge pull request #4683 from influxdb/enterprise-client
Updated to use the new Enterprise Client
2015-11-06 13:13:15 -05:00
Mark Bates d46bf535b2 Report anonymous stats to Enterprise 2015-11-06 10:30:57 -05:00
Philip O'Toole a9e22dad5c Merge pull request #4674 from simcap/master
Fix restore panic issue #4671
2015-11-06 00:19:51 -08:00
Philip O'Toole 87441584f3 Merge pull request #4684 from nkatsaros/default-config
Add graphite and udp services to the default config generator
2015-11-05 17:53:15 -08:00
Nathaniel Cook 1719a6107c PointsWriter will drop writes to subscriber service for any in-flight writes 2015-11-05 16:25:00 -07:00
Nicholas Katsaros 4f8b0aca9a Add graphite and udp services to the default config generator 2015-11-05 16:42:21 -05:00
simcap c9c68e8cd3 Fix restore panics #4671
When unpacking the meta, the Store `Addr` is built
against the hostname and the `bind-address` port.
We can use this resolved address for the `RemoteAddr`
as well since according to the clustering docs the
`hostname must be resolved by all members in the cluster`
2015-11-05 18:31:04 +01:00
Philip O'Toole ae8b458d9e Merge pull request #4644 from influxdb/cli_auth_panic
Check for errors in response during token check
2015-11-03 08:08:23 -08:00
Philip O'Toole e6dffd12c7 Check for errors in response during token check
Fixes issue #4641.
2015-11-03 07:59:37 -08:00
oiooj dafc6fff42 Fix restore functionality panics 2015-11-03 19:25:33 +08:00
Jason Wilder 7508a2a252 Merge pull request #4587 from influxdb/jw-nan
Prevent NaN float values from being stored
2015-10-28 09:28:04 -06:00
Philip O'Toole d8e4655e0f Merge pull request #4586 from influxdb/engine_fail_msg
Exit when invalid engine is selected
2015-10-27 21:50:01 -07:00
Philip O'Toole 00b2454c53 Exit if invalid engine is selected
Fix #4584, related to #4583
2015-10-27 17:29:18 -07:00
Philip O'Toole a727a8dd3f Only display Enterprise hint on CLI mode
This change moves the logic to detect and display the Enterprise
registration hint into the same logic check as that which decides if the
successful-connection message should be displayed.

Fixes #4514.
2015-10-27 17:18:18 -07:00
Jason Wilder 7d6d23e661 Write as many points as we can parse via line protocol
This changes the HTTP line protocol handler to behave similar to the other
handler in that they will write as many points as possible.  Previously, we
would fail the entire batch if one point failed.  This can happen more frequently
now with NaN being more explicitly unsupported.  Now it will write as many points
that parse successfully and return a "partial write" error to the client with the
lines that failed to parse.
2015-10-27 17:12:57 -06:00
Philip O'Toole f703f58d22 Add HH diagnostics 2015-10-26 18:59:58 -07:00
Cory LaNou ff4209436f close raftState before waiting 2015-10-23 14:48:32 -06:00
Cory LaNou 90beaee803 silence subscriber service logging during testing 2015-10-23 14:48:32 -06:00
Ben Johnson e9d303531e reuse tsm1 decode buffer
This commit changes `tsm1.DecodeBlock()` to reuse the same
slice of `[]tsm1.Value` instead of reallocating a new one each time.
2015-10-23 12:51:55 -06:00
Michael Desa f47634ec30 Merge pull request #4540 from influxdb/md-cleanup
Remove unneeded lines
2015-10-23 10:12:00 -07:00
Ben Johnson 28b585e639 refactor tsdb query engine
This commit refactors the tsdb query engine to use separate aggregate
and raw execution paths, encapsulates cursor functionality, and removes
the TagSetCursor from the aggregate path. By removing the TagSetCursor,
we can pass sets of unordered values to the map functions and bypass
the `container/heap` entirely.
2015-10-22 09:41:12 -06:00
Michael Desa 0035b79a84 Remove unneeded lines 2015-10-21 19:26:58 -07:00
Philip O'Toole bb80bf5211 Display Enterprise message if no token set 2015-10-20 12:59:22 -07:00
Philip O'Toole 956efaeb94 Merge pull request #4506 from influxdb/enterprise_stats
Enterprise registration as a service
2015-10-20 08:57:19 -07:00
David Norton a3d127f797 Revert "add RENAME DATABASE"
This reverts commit 7212bfce83.

Conflicts:
	influxql/parser.go
	influxql/token.go
	meta/internal/meta.pb.go
	meta/internal/meta.proto
2015-10-20 09:01:34 -04:00
David Norton 307d51dad5 Revert "add integration test for RENAME DATABASE"
This reverts commit d2afd881e6.
2015-10-20 08:43:57 -04:00
David Norton 20929c3db2 Revert "change syntax to ALTER DATABASE ... RENAME TO ..."
This reverts commit 668b5b9bfb.
2015-10-20 08:43:45 -04:00
David Norton 73a0c0a247 Revert "return error when database rename conflicts with continuous queries"
This reverts commit 60d298936e.
2015-10-20 08:39:03 -04:00
Philip O'Toole 878663e1e3 Periodic upload of stats to Enterprise 2015-10-19 15:25:07 -07:00
Philip O'Toole 667ad3342a Refactor registration as a service
Registration also involves statistics and diagnostics upload, for the
purposes of remote management. This means there will be long-running
goroutines in effect. Therefore move the code to a service model.
2015-10-19 15:01:14 -07:00
Jason Wilder efea0edb82 Merge pull request #4504 from influxdb/jw-4444
Fix panic: runtime error: index out of range - Values.MinTime
2015-10-19 13:44:28 -06:00
David Norton a268ba6bb4 feat #3523: add unit test for no matches 2015-10-19 14:40:06 -04:00
Jason Wilder 1bcd8dd5de Handle reading partially written tsm files better
If a tsm file was partially written, we were not able to read the
raw block data because we panic/exited when reading the corrupted
index.  This allows us to read the raw blocks if we can.
2015-10-19 12:03:12 -06:00
David Norton 401447cbed feat #3523: filter SHOW MEASUREMENTS by WITH 2015-10-19 14:00:53 -04:00
Daniel Morsing e73c37088f Merge pull request #4454 from influxdb/intofixes
Intofixes
2015-10-19 18:58:42 +01:00
Charles Chan 456a9a8ab7 Fix typos.
* meaining --> meaning
* communcation --> communication
* deterimine --> determine
* mistmatch --> mistmatch
2015-10-17 07:50:45 -07:00
David Norton 026611aea9 fix #4475: update unit test for new error message 2015-10-16 10:50:35 -04:00
Cory LaNou a2102e19ba always return time, never strings. fixes #4415 2015-10-15 20:19:58 -05:00
Philip O'Toole 64bf96e007 100B_STD should actually write 100B points
[ci skip]
2015-10-15 16:54:29 -07:00
Philip O'Toole 81390db622 Actually check connection errors
Fix issue #4463
2015-10-15 15:07:18 -07:00
Philip O'Toole 42995ea326 Merge pull request #4459 from influxdb/add_token
Register with Enterprise server
2015-10-15 14:01:08 -07:00
Mark Bates 8f16a85cd2 Fixed issue sending JSON numbers to Enterprise when it wants strings 2015-10-15 16:51:48 -04:00
Philip O'Toole 0f001a6d9a Handle registration errors from Enterprise server 2015-10-15 13:48:23 -07:00
Philip O'Toole 07db774423 Register with Enterprise if token available 2015-10-15 13:13:34 -07:00
Philip O'Toole a7e841f447 Add config support for Enterprise token 2015-10-15 13:02:16 -07:00
Jason Wilder ae925625ce Merge pull request #4451 from influxdb/jw-int64
Int64 encoding enhancements
2015-10-15 13:44:55 -06:00
Jason Wilder b19fbec093 Merge pull request #4445 from influxdb/jw-tsm
Add influx_inspect filtering support
2015-10-15 11:16:33 -06:00
Nathaniel Cook cb1aaa8e42 Merge pull request #4375 from influxdb/subscriptions
Feature add subscriber service for creating/dropping subscriptions
2015-10-15 09:17:26 -06:00
Daniel Morsing d990b5f28d fix into queries when encountering nil values.
For aggregate queries, having a null result means that you haven't
got any data for that time period. CQs used this as a signal that
the measurement was not created and dropped the entire write.

INTO queries can have any structure, including wildcards, so dropping
the entire query isn't going to work. Instead, just drop the nulls
returned.
2015-10-15 12:12:40 +00:00
Jason Wilder 30364aa2b0 Remove dead code 2015-10-14 19:26:46 -06:00
Jason Wilder d3691425e0 Update influx_inspect to show RLE for int64 blocks 2015-10-14 19:24:04 -06:00
Michael Desa 7870b84f20 Merge pull request #4450 from influxdb/md-flags-override
Flags overwriting config file
2015-10-14 16:19:46 -07:00
Michael Desa 359f50ff85 Add support for flags overwriting config file
Previously the test file would over write any flags passed to
influx_stress, now flags overwrite config file options

Ammended with nit fixes
2015-10-14 16:14:20 -07:00
Sean Beckett 82f104a8b1 Merge pull request #4436 from influxdb/tag-names-to-keys
WIP tag name --> tag key, field name --> field key
2015-10-14 16:02:46 -07:00
Nathaniel Cook 8b31007aa7 Adds subscriber service for creating/dropping subscriptions to the
InfluxDB data stream.
2015-10-14 15:23:45 -06:00
Philip O'Toole f298e88b39 Auto-create UDP service database
All other services operate like this, so make UDP service consistent.
2015-10-14 08:30:09 -07:00
Jason Wilder 214e451af5 Move info command to separate file 2015-10-14 09:27:24 -06:00
Jason Wilder 4e9e3a4763 Shorten dumptsm flags 2015-10-14 09:24:54 -06:00
Daniel Morsing 6d188d9703 Merge pull request #4409 from influxdb/intoq
wire up INTO queries.
2015-10-14 15:29:54 +01:00
Daniel Morsing 48223a90f9 Fix spelling nit.
Make it obvious that INTO is a keyword and not part of the sentence
2015-10-14 15:16:27 +01:00
Jason Wilder bbe0eb49bc Add ability to filter index and block by key string match 2015-10-13 18:16:16 -06:00
Sean Beckett 8e65f0c84f Update server_test.go 2015-10-13 16:53:10 -07:00
Sean Beckett 9a9e04084f Update config.go 2015-10-13 16:49:09 -07:00
Jason Wilder 467ada073a Add flags for dumping only index, block or all data 2015-10-13 17:47:37 -06:00
Jason Wilder 1a3f8c403e Re-work influx_inspect command-line options to use sub-commands
Should make adding new functionality easier.
2015-10-13 17:26:23 -06:00
Jason Wilder ad35dcea38 Handle case where IDs file is out of sync with tsm1 file or missing
Avoids a panic if a series ID exists in the tsm file but not in the IDs file.
Also handles the case were we don't have an ids file and just a tsm file.
2015-10-13 17:19:59 -06:00
Daniel Morsing 822af73f88 implement continuous queries as regular execs of into queries.
Now that we have into queries, we can implement them as regular
queries that are just run on a timer.
2015-10-13 15:51:19 +00:00
Daniel Morsing 62dff895e2 wire up INTO queries.
Since INTO queries need to have absolute information about the database
to work, we need to create a loopback interface back to the cluster
in order to perform them.
2015-10-13 15:00:36 +00:00
Cory LaNou 6787525912 fixes multiple selectors overwriting each other. fixes #4360 2015-10-12 21:40:57 -05:00
Jason Wilder 16b3084ca9 Merge pull request #4397 from influxdb/jw-tsmdump
tsm1 file dump
2015-10-12 08:12:23 -06:00
Jason Wilder f58c283d8a Add some comments 2015-10-09 22:53:58 -06:00
Jason Wilder bc6d677b06 Add tsm file dump support to influx_inspect
This will read a tsm file and dump index, block and compression level info from the file.
It reads the file directly as opposed to reading it through the tsm engine which should
help with debugging and troubleshooting data file issues.

The implementation is not pretty but the output is very useful.  In the future, we can
add data extraction, recovery and verification functionality if needed.
2015-10-09 22:32:11 -06:00
David Norton 512d6ac050 fix #4280: only drop points matching WHERE clause 2015-10-09 18:34:32 -04:00
Philip O'Toole 455191d784 Merge pull request #4386 from influxdb/rename_inspect
Rename 'inspect' to 'influx_inspect'
2015-10-09 11:10:53 -07:00
Philip O'Toole 1e7a86aa61 Rename 'inspect' to 'influx_inspect' 2015-10-09 11:03:39 -07:00
linearb 60d298936e return error when database rename conflicts with continuous queries 2015-10-09 13:57:02 -04:00
linearb 668b5b9bfb change syntax to ALTER DATABASE ... RENAME TO ... 2015-10-09 13:56:23 -04:00
linearb d2afd881e6 add integration test for RENAME DATABASE 2015-10-09 13:55:38 -04:00
linearb 7212bfce83 add RENAME DATABASE 2015-10-09 13:55:38 -04:00
Philip O'Toole 5b0a8ed306 HH should not process dropped nodes 2015-10-08 18:23:12 -07:00