Ben Johnson
0883182798
simplify select mapper stmt
2015-09-22 12:27:14 -06:00
Nathaniel Cook
79e6e3e07a
Merge pull request #4196 from influxdb/export_iterator
...
export tsdb.Iterator
2015-09-22 11:09:08 -06:00
Philip O'Toole
d96119cc01
Correct MapperValueAsJSON comment
...
[ci skip]
2015-09-22 09:49:57 -07:00
Nathaniel Cook
007508bde0
export tsdb.Iterator
2015-09-22 10:29:49 -06:00
Philip O'Toole
e43ad09f44
Perform custom unmarshal during unit tests
2015-09-22 00:24:43 -07:00
Philip O'Toole
56193be05c
Simple tests work
2015-09-21 22:50:29 -07:00
Philip O'Toole
07c9d40b87
Merge pull request #4179 from mark-rushakoff/sorted-measurements-by-tag-filters
...
Sort DatabaseIndex.measurementsByTagFilters result
2015-09-21 11:19:37 -07:00
Daniel Morsing
57b211a538
Merge branch 'master' into bottom
...
resolve changelog conflict
2015-09-21 12:31:29 +00:00
Mark Rushakoff
85275e7d59
Sort DatabaseIndex.measurementsByTagFilters result
...
Fixes #4118
2015-09-20 14:37:27 -07:00
Daniel Morsing
5b24841973
rename topReduceOut
...
Also, gofmt
2015-09-18 15:04:09 +00:00
Daniel Morsing
b07c36288d
Merge pull request #4130 from influxdb/topopt
...
optimize top queries
2015-09-18 14:40:57 +00:00
Daniel Morsing
b5fc2a96b1
Implement bottom
...
After the rework of the ordering for top, this was just a matter
of adding a flag telling the minheap which way the values should
be sorted.
2015-09-18 14:39:46 +00:00
Daniel Morsing
ce1dc840ef
Better documentation for typeCompare.
2015-09-18 13:11:46 +00:00
Philip O'Toole
f9bfb2fcc5
Merge pull request #4142 from influxdb/nil_partition
...
If partition is nil return on Close immediately
2015-09-17 16:37:37 -07:00
Cory LaNou
72f6f7d268
Merge pull request #4134 from influxdb/issue-3447
...
Refactor Points and Rows to dedicated packages
2015-09-17 15:27:48 -05:00
Daniel Morsing
d9e4b3b851
split comparison into 2 stages, one for type and one for value
...
Also, fix it so that heap inserts sort on tags as well.
This change makes it easier to implement bottom and also fixes the test that the previous change broke.
2015-09-17 14:59:02 +00:00
Philip O'Toole
f73bc6ff19
Merge pull request #4140 from influxdb/engine_config
...
Make engine configurable
2015-09-16 21:17:43 -07:00
Philip O'Toole
5e991f1703
If partition is nil return on Close immediately
2015-09-16 19:38:02 -07:00
Philip O'Toole
7b1a4e6700
Control whether each query should be logged
...
Fixes issue #4138
2015-09-16 19:26:23 -07:00
Philip O'Toole
e4fde993f1
Make engine configurable
2015-09-16 19:09:25 -07:00
Cory LaNou
ba830be3b9
actually move influxql.Row* -> models.Row*
2015-09-16 16:32:50 -05:00
Cory LaNou
d19a510ad2
refactor Points and Rows to dedicated packages
2015-09-16 15:33:08 -05:00
Cameron Sparr
6d4319d244
Add function to tsdb.point to get line-protocol string in the correct units
2015-09-16 10:53:59 -07:00
Daniel Morsing
59307b8b78
optimize top queries
...
Instead of rounding up the points, sorting and then slicing, keep a
heap that allows us to quickly see if the point needs to be in the
set. This cuts a top query on a dataset of 8 million points from 35
seconds to 11 seconds.
2015-09-16 17:02:44 +00:00
Cory LaNou
5395ac7634
Period in field name that matches measurement fails. Fixes #3457
2015-09-15 16:26:39 -05:00
Daniel Morsing
51b22f180f
simplify the sorting for top/distinct.
...
Instead of using closures and 2 different sort routines, have an
interface compare method that makes it easy to switch directions
for comparisons.
Note that this changes the sort order of distinct to match that of
top. While it is a change, I don't think it will break any code. The
important thing for distinct is just that the ordering is absolute,
not what the order is.
2015-09-15 15:03:31 +00:00
Philip O'Toole
93f1fcb38c
Merge pull request #4073 from influxdb/wal_stat_fixes
...
WAL statistics fixes
2015-09-14 07:10:26 -07:00
Daniel Morsing
eb65f50593
gofmt
2015-09-11 14:41:59 +00:00
Daniel Morsing
ab9ae468ca
unexport some functions
...
For good measure basically. Not needed for correctness, but it keeps
people from using these.
2015-09-11 14:39:09 +00:00
Daniel Morsing
66fc270d1e
Move aggregate funcs into tsdb
...
Pure move, No functional changes.
2015-09-11 14:27:47 +00:00
Cory LaNou
5c1ba44c9b
Merge pull request #4071 from influxdb/issue-3902
...
Issue 3902
2015-09-11 06:58:27 -05:00
Philip O'Toole
40b1068c81
Use unified statMap for WAL
...
Don't declare distinct stat map for partitions. It's more useful to see
the stats collated together per-WAL. This may need further change in the
future.
2015-09-10 14:23:40 -07:00
Philip O'Toole
13a302e533
WAL tag keys are "path" not "bind".
2015-09-10 14:10:45 -07:00
Philip O'Toole
bf55f61edd
Add stats for the WAL
2015-09-10 12:30:47 -07:00
Philip O'Toole
5086ea42fa
Update WAL comments
...
[ci skip]
2015-09-10 11:29:43 -07:00
Philip O'Toole
101a4d2a55
Merge pull request #4066 from influxdb/pd-fail-writes-on-memory-pressure
...
Update WAL to fail writes if pressure too high.
2015-09-10 11:27:32 -07:00
Cory LaNou
05f69b3d6c
Validate Dimension for proper time scenarios. Fixes #3902
2015-09-10 13:10:21 -05:00
Philip O'Toole
ed917aa7f8
Log each query before execution
...
If a query causes a server to panic, the query is nowhere in the logs,
which makes debug very difficult.
2015-09-10 10:52:51 -07:00
Ben Johnson
733fa0a109
disable bz1 recompression
...
This commit only appends new blocks of points and disables checks for
recompressing small blocks at the end of a series.
2015-09-10 11:26:29 -06:00
Paul Dix
2d67a9ea22
Update WAL to fail writes if pressure too high.
...
If the memory gets 5x above the partition size threshold, the WAL will start returning write failures to the clients. This will allow them to backoff their write volume.
Also updated the stress script to track failed requests and output messages on failure and when it returns to success.
2015-09-09 22:41:32 -07:00
Paul Dix
482e00d3e3
Merge pull request #4011 from influxdb/pd-simplify-wal
...
Simplify WAL to not compact
2015-09-08 22:32:53 -07:00
Philip O'Toole
3db9cc9b76
Basic instrumentation for shards
2015-09-08 19:56:42 -07:00
Philip O'Toole
2b0a40e262
Merge pull request #4007 from influxdb/instrument_bz1
...
Basic instrumentation for bz1 engine
2015-09-08 19:56:06 -07:00
Paul Dix
ecbc79e7e3
Fix disksize to work with new WAL
2015-09-08 19:37:33 -07:00
Philip O'Toole
5373f263a3
Add pending control to batcher
...
With this change, the generic batcher used by many inputs can now be
buffered. Testing shows that this performance of the Graphite input by
10-100%, with the biggest improvements at lower numbers of connections.
2015-09-08 19:32:00 -07:00
Paul Dix
dfd6b11dda
Fix memory compaction logic.
...
* Only fire a go routine to flush and compact if it isn't already running
* Have a sleep backoff time that scales up as the percentage of memory used goes up
2015-09-08 19:28:29 -07:00
Paul Dix
a1fb77198b
Simplify WAL to not compact since it doesn't really help the engine anyway
2015-09-08 19:28:29 -07:00
Philip O'Toole
76903f7440
Instrument bz1 engine
2015-09-08 19:09:39 -07:00
Cory LaNou
62e9c24b25
fixes #3926
2015-09-08 14:15:48 -05:00
Philip O'Toole
255fb3364d
Don't close nil channel
...
Obviously a TSDB store may be closed before it's opened.
2015-09-08 10:49:45 -07:00