Commit Graph

1129 Commits (8901125a5a68ff280e790f6320d63c6d5cc7cdcd)

Author SHA1 Message Date
Jason Wilder 7d6d23e661 Write as many points as we can parse via line protocol
This changes the HTTP line protocol handler to behave similar to the other
handler in that they will write as many points as possible.  Previously, we
would fail the entire batch if one point failed.  This can happen more frequently
now with NaN being more explicitly unsupported.  Now it will write as many points
that parse successfully and return a "partial write" error to the client with the
lines that failed to parse.
2015-10-27 17:12:57 -06:00
Philip O'Toole f703f58d22 Add HH diagnostics 2015-10-26 18:59:58 -07:00
Cory LaNou ff4209436f close raftState before waiting 2015-10-23 14:48:32 -06:00
Cory LaNou 90beaee803 silence subscriber service logging during testing 2015-10-23 14:48:32 -06:00
Ben Johnson e9d303531e reuse tsm1 decode buffer
This commit changes `tsm1.DecodeBlock()` to reuse the same
slice of `[]tsm1.Value` instead of reallocating a new one each time.
2015-10-23 12:51:55 -06:00
Michael Desa f47634ec30 Merge pull request #4540 from influxdb/md-cleanup
Remove unneeded lines
2015-10-23 10:12:00 -07:00
Ben Johnson 28b585e639 refactor tsdb query engine
This commit refactors the tsdb query engine to use separate aggregate
and raw execution paths, encapsulates cursor functionality, and removes
the TagSetCursor from the aggregate path. By removing the TagSetCursor,
we can pass sets of unordered values to the map functions and bypass
the `container/heap` entirely.
2015-10-22 09:41:12 -06:00
Michael Desa 0035b79a84 Remove unneeded lines 2015-10-21 19:26:58 -07:00
Philip O'Toole bb80bf5211 Display Enterprise message if no token set 2015-10-20 12:59:22 -07:00
Philip O'Toole 956efaeb94 Merge pull request #4506 from influxdb/enterprise_stats
Enterprise registration as a service
2015-10-20 08:57:19 -07:00
David Norton a3d127f797 Revert "add RENAME DATABASE"
This reverts commit 7212bfce83.

Conflicts:
	influxql/parser.go
	influxql/token.go
	meta/internal/meta.pb.go
	meta/internal/meta.proto
2015-10-20 09:01:34 -04:00
David Norton 307d51dad5 Revert "add integration test for RENAME DATABASE"
This reverts commit d2afd881e6.
2015-10-20 08:43:57 -04:00
David Norton 20929c3db2 Revert "change syntax to ALTER DATABASE ... RENAME TO ..."
This reverts commit 668b5b9bfb.
2015-10-20 08:43:45 -04:00
David Norton 73a0c0a247 Revert "return error when database rename conflicts with continuous queries"
This reverts commit 60d298936e.
2015-10-20 08:39:03 -04:00
Philip O'Toole 878663e1e3 Periodic upload of stats to Enterprise 2015-10-19 15:25:07 -07:00
Philip O'Toole 667ad3342a Refactor registration as a service
Registration also involves statistics and diagnostics upload, for the
purposes of remote management. This means there will be long-running
goroutines in effect. Therefore move the code to a service model.
2015-10-19 15:01:14 -07:00
Jason Wilder efea0edb82 Merge pull request #4504 from influxdb/jw-4444
Fix panic: runtime error: index out of range - Values.MinTime
2015-10-19 13:44:28 -06:00
David Norton a268ba6bb4 feat #3523: add unit test for no matches 2015-10-19 14:40:06 -04:00
Jason Wilder 1bcd8dd5de Handle reading partially written tsm files better
If a tsm file was partially written, we were not able to read the
raw block data because we panic/exited when reading the corrupted
index.  This allows us to read the raw blocks if we can.
2015-10-19 12:03:12 -06:00
David Norton 401447cbed feat #3523: filter SHOW MEASUREMENTS by WITH 2015-10-19 14:00:53 -04:00
Daniel Morsing e73c37088f Merge pull request #4454 from influxdb/intofixes
Intofixes
2015-10-19 18:58:42 +01:00
Charles Chan 456a9a8ab7 Fix typos.
* meaining --> meaning
* communcation --> communication
* deterimine --> determine
* mistmatch --> mistmatch
2015-10-17 07:50:45 -07:00
David Norton 026611aea9 fix #4475: update unit test for new error message 2015-10-16 10:50:35 -04:00
Cory LaNou a2102e19ba always return time, never strings. fixes #4415 2015-10-15 20:19:58 -05:00
Philip O'Toole 64bf96e007 100B_STD should actually write 100B points
[ci skip]
2015-10-15 16:54:29 -07:00
Philip O'Toole 81390db622 Actually check connection errors
Fix issue #4463
2015-10-15 15:07:18 -07:00
Philip O'Toole 42995ea326 Merge pull request #4459 from influxdb/add_token
Register with Enterprise server
2015-10-15 14:01:08 -07:00
Mark Bates 8f16a85cd2 Fixed issue sending JSON numbers to Enterprise when it wants strings 2015-10-15 16:51:48 -04:00
Philip O'Toole 0f001a6d9a Handle registration errors from Enterprise server 2015-10-15 13:48:23 -07:00
Philip O'Toole 07db774423 Register with Enterprise if token available 2015-10-15 13:13:34 -07:00
Philip O'Toole a7e841f447 Add config support for Enterprise token 2015-10-15 13:02:16 -07:00
Jason Wilder ae925625ce Merge pull request #4451 from influxdb/jw-int64
Int64 encoding enhancements
2015-10-15 13:44:55 -06:00
Jason Wilder b19fbec093 Merge pull request #4445 from influxdb/jw-tsm
Add influx_inspect filtering support
2015-10-15 11:16:33 -06:00
Nathaniel Cook cb1aaa8e42 Merge pull request #4375 from influxdb/subscriptions
Feature add subscriber service for creating/dropping subscriptions
2015-10-15 09:17:26 -06:00
Daniel Morsing d990b5f28d fix into queries when encountering nil values.
For aggregate queries, having a null result means that you haven't
got any data for that time period. CQs used this as a signal that
the measurement was not created and dropped the entire write.

INTO queries can have any structure, including wildcards, so dropping
the entire query isn't going to work. Instead, just drop the nulls
returned.
2015-10-15 12:12:40 +00:00
Jason Wilder 30364aa2b0 Remove dead code 2015-10-14 19:26:46 -06:00
Jason Wilder d3691425e0 Update influx_inspect to show RLE for int64 blocks 2015-10-14 19:24:04 -06:00
Michael Desa 7870b84f20 Merge pull request #4450 from influxdb/md-flags-override
Flags overwriting config file
2015-10-14 16:19:46 -07:00
Michael Desa 359f50ff85 Add support for flags overwriting config file
Previously the test file would over write any flags passed to
influx_stress, now flags overwrite config file options

Ammended with nit fixes
2015-10-14 16:14:20 -07:00
Sean Beckett 82f104a8b1 Merge pull request #4436 from influxdb/tag-names-to-keys
WIP tag name --> tag key, field name --> field key
2015-10-14 16:02:46 -07:00
Nathaniel Cook 8b31007aa7 Adds subscriber service for creating/dropping subscriptions to the
InfluxDB data stream.
2015-10-14 15:23:45 -06:00
Philip O'Toole f298e88b39 Auto-create UDP service database
All other services operate like this, so make UDP service consistent.
2015-10-14 08:30:09 -07:00
Jason Wilder 214e451af5 Move info command to separate file 2015-10-14 09:27:24 -06:00
Jason Wilder 4e9e3a4763 Shorten dumptsm flags 2015-10-14 09:24:54 -06:00
Daniel Morsing 6d188d9703 Merge pull request #4409 from influxdb/intoq
wire up INTO queries.
2015-10-14 15:29:54 +01:00
Daniel Morsing 48223a90f9 Fix spelling nit.
Make it obvious that INTO is a keyword and not part of the sentence
2015-10-14 15:16:27 +01:00
Jason Wilder bbe0eb49bc Add ability to filter index and block by key string match 2015-10-13 18:16:16 -06:00
Sean Beckett 8e65f0c84f Update server_test.go 2015-10-13 16:53:10 -07:00
Sean Beckett 9a9e04084f Update config.go 2015-10-13 16:49:09 -07:00
Jason Wilder 467ada073a Add flags for dumping only index, block or all data 2015-10-13 17:47:37 -06:00
Jason Wilder 1a3f8c403e Re-work influx_inspect command-line options to use sub-commands
Should make adding new functionality easier.
2015-10-13 17:26:23 -06:00
Jason Wilder ad35dcea38 Handle case where IDs file is out of sync with tsm1 file or missing
Avoids a panic if a series ID exists in the tsm file but not in the IDs file.
Also handles the case were we don't have an ids file and just a tsm file.
2015-10-13 17:19:59 -06:00
Daniel Morsing 822af73f88 implement continuous queries as regular execs of into queries.
Now that we have into queries, we can implement them as regular
queries that are just run on a timer.
2015-10-13 15:51:19 +00:00
Daniel Morsing 62dff895e2 wire up INTO queries.
Since INTO queries need to have absolute information about the database
to work, we need to create a loopback interface back to the cluster
in order to perform them.
2015-10-13 15:00:36 +00:00
Cory LaNou 6787525912 fixes multiple selectors overwriting each other. fixes #4360 2015-10-12 21:40:57 -05:00
Jason Wilder 16b3084ca9 Merge pull request #4397 from influxdb/jw-tsmdump
tsm1 file dump
2015-10-12 08:12:23 -06:00
Jason Wilder f58c283d8a Add some comments 2015-10-09 22:53:58 -06:00
Jason Wilder bc6d677b06 Add tsm file dump support to influx_inspect
This will read a tsm file and dump index, block and compression level info from the file.
It reads the file directly as opposed to reading it through the tsm engine which should
help with debugging and troubleshooting data file issues.

The implementation is not pretty but the output is very useful.  In the future, we can
add data extraction, recovery and verification functionality if needed.
2015-10-09 22:32:11 -06:00
David Norton 512d6ac050 fix #4280: only drop points matching WHERE clause 2015-10-09 18:34:32 -04:00
Philip O'Toole 455191d784 Merge pull request #4386 from influxdb/rename_inspect
Rename 'inspect' to 'influx_inspect'
2015-10-09 11:10:53 -07:00
Philip O'Toole 1e7a86aa61 Rename 'inspect' to 'influx_inspect' 2015-10-09 11:03:39 -07:00
linearb 60d298936e return error when database rename conflicts with continuous queries 2015-10-09 13:57:02 -04:00
linearb 668b5b9bfb change syntax to ALTER DATABASE ... RENAME TO ... 2015-10-09 13:56:23 -04:00
linearb d2afd881e6 add integration test for RENAME DATABASE 2015-10-09 13:55:38 -04:00
linearb 7212bfce83 add RENAME DATABASE 2015-10-09 13:55:38 -04:00
Philip O'Toole 5b0a8ed306 HH should not process dropped nodes 2015-10-08 18:23:12 -07:00
Nick Dawbarn 26f6d00668 Bugfix for #3429 String representations of RegexLiterals generated in influxql/ast.go add the / char as a start and end delimiter, but does not escape any / characters that may exist with the regex 2015-10-08 19:41:36 +10:00
Michael Desa 897a5effff Merge pull request #4329 from influxdb/md-stress-timestamps
Add support for evenly spaced timestamps
2015-10-06 16:26:08 -07:00
David Norton 4375545064 fix #4276: walk DropSeriesStatement 2015-10-05 19:56:30 -04:00
Michael Desa 02349a63d5 Change precison on example 2015-10-05 12:29:58 -07:00
Michael Desa 70c7d1c4d8 Change file names to be more semantic 2015-10-05 12:29:11 -07:00
Michael Desa 2ca11072e8 Change `jitter` to false in examples 2015-10-05 12:19:59 -07:00
Michael Desa 52b7e557c1 Add support for timestamp jitter 2015-10-05 12:09:08 -07:00
Michael Desa 68c1d05ad4 First pass at adding timestamps 2015-10-02 16:05:06 -07:00
Philip O'Toole d74e0690c7 Revert "Merge pull request #4233 from influxdb/drop-server"
This reverts commit 0bdb36f6dc, reversing
changes made to 3085fbc138.
2015-10-02 08:39:57 -07:00
Cory LaNou 99da67007d no more shutdown 2015-10-01 15:39:15 -05:00
Cory LaNou 73372ed907 [Ee]xecuteShutdown -> [Mm]onitorShutdown 2015-10-01 15:39:15 -05:00
Cory LaNou 34bfb6b330 be sure to exit the go routine if we terminate normally 2015-10-01 15:39:15 -05:00
Cory LaNou 7a3e1f6b27 removing peer wip 2015-10-01 15:39:15 -05:00
Michael Desa 027da3dbb4 Add examples folder 2015-09-30 15:55:09 -07:00
Michael Desa f056753afe Add moderate burn test
First pass at constructing points myself
2015-09-30 15:55:07 -07:00
Michael Desa d6027071d2 Add optional jitter to timestamps 2015-09-30 15:55:07 -07:00
Michael Desa 293fad1e20 Add note about buffer time and change example_2 2015-09-30 15:55:07 -07:00
Michael Desa 8a76e7db78 Add comments and tests 2015-09-30 15:55:07 -07:00
Michael Desa ee9c78735e Add configurable channel buffer size 2015-09-30 15:55:07 -07:00
Michael Desa ecb9bd9592 Add support for stress test under query load 2015-09-30 15:55:07 -07:00
Michael Desa 2465dbc788 Add high performance stress test example
First round at adding query load

Working draft:

Not happy with things, but it works
2015-09-30 15:55:07 -07:00
Michael Desa 22a6f79a3c Add support for `tag_count` config option
It is now possible to configure arbitrarily many tags in a generic
format. That is specifying the config option `tag_count=10` will add 10
tags to a series that are of the form `tag-key-n=tag-value` where n
ranges from 0 to 9.

Save current state
2015-09-30 15:55:06 -07:00
Michael Desa 03f291d78c Add comments and shuffle var declarations 2015-09-30 15:55:06 -07:00
Michael Desa fdfb039a44 Allow configuration via config file or flags
Note that config file takes precedence to flags
2015-09-30 15:55:06 -07:00
Michael Desa 4e587b4622 Add comment to example toml file 2015-09-30 15:55:06 -07:00
Michael Desa 48dde6b16c Add support for config file 2015-09-30 15:55:06 -07:00
Michael Desa 911623f5f6 Add quick notes 2015-09-30 15:55:06 -07:00
Michael Desa e608e9b79b Add stress
First pass at running stress test from a toml
2015-09-30 15:55:06 -07:00
Michael Desa e43b60b8e1 Add example config for stress test 2015-09-30 15:55:06 -07:00
Ben Johnson 343dd23ee7 refactor map functions to use list of values
This commit changes `tsdb.mapFunc` to use `tsdb.MapInput` instead
of an iterator. This will make it easier and faster to pass blocks
of values from the new storage engine into the engine.
2015-09-29 14:00:33 -06:00
Philip O'Toole 7cb8c2d2ec Add build timestamp to version data 2015-09-24 23:40:53 -07:00
Cory LaNou b1becfbcfc more tests, simplify mapFunc signatures 2015-09-23 09:27:19 -05:00
Cory LaNou 78bc740434 full support for min/max/first/last 2015-09-23 09:03:57 -05:00
Ben Johnson 8e27cf1fd8 Merge remote-tracking branch 'upstream/master' into refactor-select-mapper
Conflicts:
	tsdb/store.go
2015-09-22 13:58:24 -06:00