Commit Graph

431 Commits (0883182798c8155b066fdc7754f70e759c5b258e)

Author SHA1 Message Date
Ben Johnson 0883182798 simplify select mapper stmt 2015-09-22 12:27:14 -06:00
Nathaniel Cook 79e6e3e07a Merge pull request #4196 from influxdb/export_iterator
export tsdb.Iterator
2015-09-22 11:09:08 -06:00
Philip O'Toole d96119cc01 Correct MapperValueAsJSON comment
[ci skip]
2015-09-22 09:49:57 -07:00
Nathaniel Cook 007508bde0 export tsdb.Iterator 2015-09-22 10:29:49 -06:00
Philip O'Toole e43ad09f44 Perform custom unmarshal during unit tests 2015-09-22 00:24:43 -07:00
Philip O'Toole 56193be05c Simple tests work 2015-09-21 22:50:29 -07:00
Philip O'Toole 07c9d40b87 Merge pull request #4179 from mark-rushakoff/sorted-measurements-by-tag-filters
Sort DatabaseIndex.measurementsByTagFilters result
2015-09-21 11:19:37 -07:00
Daniel Morsing 57b211a538 Merge branch 'master' into bottom
resolve changelog conflict
2015-09-21 12:31:29 +00:00
Mark Rushakoff 85275e7d59 Sort DatabaseIndex.measurementsByTagFilters result
Fixes #4118
2015-09-20 14:37:27 -07:00
Daniel Morsing 5b24841973 rename topReduceOut
Also, gofmt
2015-09-18 15:04:09 +00:00
Daniel Morsing b07c36288d Merge pull request #4130 from influxdb/topopt
optimize top queries
2015-09-18 14:40:57 +00:00
Daniel Morsing b5fc2a96b1 Implement bottom
After the rework of the ordering for top, this was just a matter
of adding a flag telling the minheap which way the values should
be sorted.
2015-09-18 14:39:46 +00:00
Daniel Morsing ce1dc840ef Better documentation for typeCompare. 2015-09-18 13:11:46 +00:00
Philip O'Toole f9bfb2fcc5 Merge pull request #4142 from influxdb/nil_partition
If partition is nil return on Close immediately
2015-09-17 16:37:37 -07:00
Cory LaNou 72f6f7d268 Merge pull request #4134 from influxdb/issue-3447
Refactor Points and Rows to dedicated packages
2015-09-17 15:27:48 -05:00
Daniel Morsing d9e4b3b851 split comparison into 2 stages, one for type and one for value
Also, fix it so that heap inserts sort on tags as well.

This change makes it easier to implement bottom and also fixes the test that the previous change broke.
2015-09-17 14:59:02 +00:00
Philip O'Toole f73bc6ff19 Merge pull request #4140 from influxdb/engine_config
Make engine configurable
2015-09-16 21:17:43 -07:00
Philip O'Toole 5e991f1703 If partition is nil return on Close immediately 2015-09-16 19:38:02 -07:00
Philip O'Toole 7b1a4e6700 Control whether each query should be logged
Fixes issue #4138
2015-09-16 19:26:23 -07:00
Philip O'Toole e4fde993f1 Make engine configurable 2015-09-16 19:09:25 -07:00
Cory LaNou ba830be3b9 actually move influxql.Row* -> models.Row* 2015-09-16 16:32:50 -05:00
Cory LaNou d19a510ad2 refactor Points and Rows to dedicated packages 2015-09-16 15:33:08 -05:00
Cameron Sparr 6d4319d244 Add function to tsdb.point to get line-protocol string in the correct units 2015-09-16 10:53:59 -07:00
Daniel Morsing 59307b8b78 optimize top queries
Instead of rounding up the points, sorting and then slicing, keep a
heap that allows us to quickly see if the point needs to be in the
set. This cuts a top query on a dataset of 8 million points from 35
seconds to 11 seconds.
2015-09-16 17:02:44 +00:00
Cory LaNou 5395ac7634 Period in field name that matches measurement fails. Fixes #3457 2015-09-15 16:26:39 -05:00
Daniel Morsing 51b22f180f simplify the sorting for top/distinct.
Instead of using closures and 2 different sort routines, have an
interface compare method that makes it easy to switch directions
for comparisons.

Note that this changes the sort order of distinct to match that of
top. While it is a change, I don't think it will break any code. The
important thing for distinct is just that the ordering is absolute,
not what the order is.
2015-09-15 15:03:31 +00:00
Philip O'Toole 93f1fcb38c Merge pull request #4073 from influxdb/wal_stat_fixes
WAL statistics fixes
2015-09-14 07:10:26 -07:00
Daniel Morsing eb65f50593 gofmt 2015-09-11 14:41:59 +00:00
Daniel Morsing ab9ae468ca unexport some functions
For good measure basically. Not needed for correctness, but it keeps
people from using these.
2015-09-11 14:39:09 +00:00
Daniel Morsing 66fc270d1e Move aggregate funcs into tsdb
Pure move, No functional changes.
2015-09-11 14:27:47 +00:00
Cory LaNou 5c1ba44c9b Merge pull request #4071 from influxdb/issue-3902
Issue 3902
2015-09-11 06:58:27 -05:00
Philip O'Toole 40b1068c81 Use unified statMap for WAL
Don't declare distinct stat map for partitions. It's more useful to see
the stats collated together per-WAL. This may need further change in the
future.
2015-09-10 14:23:40 -07:00
Philip O'Toole 13a302e533 WAL tag keys are "path" not "bind". 2015-09-10 14:10:45 -07:00
Philip O'Toole bf55f61edd Add stats for the WAL 2015-09-10 12:30:47 -07:00
Philip O'Toole 5086ea42fa Update WAL comments
[ci skip]
2015-09-10 11:29:43 -07:00
Philip O'Toole 101a4d2a55 Merge pull request #4066 from influxdb/pd-fail-writes-on-memory-pressure
Update WAL to fail writes if pressure too high.
2015-09-10 11:27:32 -07:00
Cory LaNou 05f69b3d6c Validate Dimension for proper time scenarios. Fixes #3902 2015-09-10 13:10:21 -05:00
Philip O'Toole ed917aa7f8 Log each query before execution
If a query causes a server to panic, the query is nowhere in the logs,
which makes debug very difficult.
2015-09-10 10:52:51 -07:00
Ben Johnson 733fa0a109 disable bz1 recompression
This commit only appends new blocks of points and disables checks for
recompressing small blocks at the end of a series.
2015-09-10 11:26:29 -06:00
Paul Dix 2d67a9ea22 Update WAL to fail writes if pressure too high.
If the memory gets 5x above the partition size threshold, the WAL will start returning write failures to the clients. This will allow them to backoff their write volume.

Also updated the stress script to track failed requests and output messages on failure and when it returns to success.
2015-09-09 22:41:32 -07:00
Paul Dix 482e00d3e3 Merge pull request #4011 from influxdb/pd-simplify-wal
Simplify WAL to not compact
2015-09-08 22:32:53 -07:00
Philip O'Toole 3db9cc9b76 Basic instrumentation for shards 2015-09-08 19:56:42 -07:00
Philip O'Toole 2b0a40e262 Merge pull request #4007 from influxdb/instrument_bz1
Basic instrumentation for bz1 engine
2015-09-08 19:56:06 -07:00
Paul Dix ecbc79e7e3 Fix disksize to work with new WAL 2015-09-08 19:37:33 -07:00
Philip O'Toole 5373f263a3 Add pending control to batcher
With this change, the generic batcher used by many inputs can now be
buffered. Testing shows that this performance of the Graphite input by
10-100%, with the biggest improvements at lower numbers of connections.
2015-09-08 19:32:00 -07:00
Paul Dix dfd6b11dda Fix memory compaction logic.
* Only fire a go routine to flush and compact if it isn't already running
* Have a sleep backoff time that scales up as the percentage of memory used goes up
2015-09-08 19:28:29 -07:00
Paul Dix a1fb77198b Simplify WAL to not compact since it doesn't really help the engine anyway 2015-09-08 19:28:29 -07:00
Philip O'Toole 76903f7440 Instrument bz1 engine 2015-09-08 19:09:39 -07:00
Cory LaNou 62e9c24b25 fixes #3926 2015-09-08 14:15:48 -05:00
Philip O'Toole 255fb3364d Don't close nil channel
Obviously a TSDB store may be closed before it's opened.
2015-09-08 10:49:45 -07:00