Cory LaNou
9ef95ccb5a
update go dependencies
2016-07-22 14:33:20 -05:00
Jonathan A. Sternberg
680de727b9
Merge pull request #7020 from influxdata/js-7011-create-man-pages
...
Create man pages for commands
2016-07-22 10:59:42 -05:00
Jonathan A. Sternberg
e50850da5b
Update pull request template to reference man pages and update changelog
2016-07-22 10:34:40 -05:00
Jonathan A. Sternberg
94f6c19eab
Install man pages inside of the packages
2016-07-22 10:34:40 -05:00
Jonathan A. Sternberg
e091b6d51a
Initial work creating man pages
2016-07-22 10:34:40 -05:00
Cory LaNou
3c24504370
Merge pull request #7046 from influxdata/cjl-tsm-export
...
Finish tsm file exporter
2016-07-21 18:02:07 -05:00
Cory LaNou
968d322d6d
finish tsm file exporter
2016-07-21 17:20:51 -05:00
Jason Wilder
da10220016
Merge pull request #7038 from influxdata/jw-compact-query
...
Fix queries against compacted files
2016-07-21 12:26:06 -06:00
Jason Wilder
fb5a143b08
Fix typos
2016-07-21 12:13:04 -06:00
Jason Wilder
13147efb24
Close underlying cursors when closing iterators
...
If a query is interrupted via kill query, the tsm files managed
by the file store purger would never get removeed because
KeyCursor.Close was never called.
KeyCursor.Close should always be called now.
2016-07-21 12:13:04 -06:00
Jason Wilder
822f409b31
Allow queries to complete before closing TSM files
...
If a query was running against a file being compacted, we close the file
and the query would end wherever it had read up to. This could result
in queries that randomly lost data, but running them again showed the
full results.
We now use a reference counting approach and move the in-use files out
of the way in the filestore and allow the queries to complete against
the old tsm files. The new files are installed and new queries will
use them.
Fixes #5501
2016-07-21 12:13:04 -06:00
Jonathan A. Sternberg
92825b418f
Merge pull request #6920 from influxdata/js-6909-log-cq-execution-time
...
Log the CQ execution time when continuous query logging is enabled
2016-07-21 12:56:03 -05:00
Jonathan A. Sternberg
4bdf57534b
Log the CQ execution time when continuous query logging is enabled
2016-07-21 12:16:53 -05:00
Cory LaNou
e3ecbf0d19
Merge pull request #7043 from influxdata/cjl-walkshards-remove-limiter
...
remove limiter from walkShards
2016-07-21 11:31:14 -05:00
Cory LaNou
fd86670518
remove limiter from walkShards
2016-07-21 11:23:31 -05:00
Edd Robinson
785e50b546
Merge pull request #6980 from influxdata/er-tsm-log
...
Add trace logging options to tsm engine
2016-07-21 12:55:20 +01:00
Edd Robinson
ff9d38540f
Update release notes and sample config
2016-07-21 11:50:21 +01:00
Edd Robinson
f37e726869
Add trace logging statements to tsdb
2016-07-21 11:14:29 +01:00
Edd Robinson
44231abcbd
Add trace logger controlled via DataLoggingEnabled
2016-07-21 11:14:29 +01:00
Edd Robinson
217bd4de84
Disable trace logging by default
2016-07-21 11:14:29 +01:00
Edd Robinson
83cc580ff8
Tidy up logging
2016-07-21 11:14:29 +01:00
Jason Wilder
6b71474434
Merge pull request #6995 from influxdata/mr-fuzz-crash-repros
...
Check slice bounds in tsm1 to avoid panics
2016-07-20 16:38:30 -06:00
Mark Rushakoff
518bd3b565
Micro-optimize BooleanDecoder for 20% speedup
...
benchmark old ns/op new ns/op delta
BenchmarkBooleanDecoder_2048-4 9954 7846 -21.18%
benchmark old allocs new allocs delta
BenchmarkBooleanDecoder_2048-4 0 0 +0.00%
benchmark old bytes new bytes delta
BenchmarkBooleanDecoder_2048-4 0 0 +0.00%
2016-07-20 08:43:05 -07:00
Mark Rushakoff
523aea715a
Protect against bounds errors in FloatDecoder
2016-07-19 15:59:27 -07:00
Mark Rushakoff
e483689563
Protect against bounds errors in BooleanDecoder
2016-07-19 15:59:27 -07:00
Mark Rushakoff
35e3adc890
Protect against bounds errors in IntegerDecoder
2016-07-19 15:43:27 -07:00
Mark Rushakoff
42b35ca068
Protect against bounds errors in TimeDecoder
2016-07-19 15:43:27 -07:00
Mark Rushakoff
be589a6760
Protect against bounds errors in StringDecoder
2016-07-19 15:43:27 -07:00
Mark Rushakoff
5b549ffdfe
Handle bounds errors in UnpackBlock
2016-07-19 15:43:27 -07:00
Mark Rushakoff
39f12e376c
Defend against some boundary errors in TSM reading
2016-07-19 15:43:27 -07:00
Mark Rushakoff
28f31b4a0c
Add test cases to repro corruption panics
2016-07-19 15:36:17 -07:00
David Norton
16f5ff3c03
Merge pull request #7034 from influxdata/dgn-importer-example
...
add example data to importer README.md
2016-07-19 13:25:19 -04:00
David Norton
3bcb85ff11
add example data to importer README.md
2016-07-19 13:01:26 -04:00
Cory LaNou
44262e005f
Merge pull request #7031 from influxdata/cjl-issue-template-debug-commands
...
Add debug commands to issue template
2016-07-19 10:15:14 -05:00
Cory LaNou
ec3b463c89
Add debug commands to issue template
...
Offer better suggestions for creating debug artifacts when filing issues.
2016-07-19 09:58:57 -05:00
Ross McDonald
15798f2159
Merge pull request #7026 from influxdata/ross-circle-update
...
Correct Docker image name for Circle builds
2016-07-19 08:40:19 -05:00
Jason Wilder
f38c75a00c
Merge pull request #7027 from influxdata/jw-dups
...
Fix duplicate data returned in queries
2016-07-19 07:37:46 -06:00
Jason Wilder
c31f0c25b4
Fix duplicate series getting created
...
There was a race where the same series would get added to the in-memory
index for a measurement more than once. This would result in the same
series being returned more than once during queries causing duplicate
results. The issue was that we check for the series under the read
lock, but did not check again under the write lock where there was
a small window where the series could be added by another goroutine.
We now check for the series under the write lock.
Fixes #6946
2016-07-18 16:46:36 -06:00
Jason Wilder
757f31bd45
Fix panic:runtime error: invalid memory address or nil pointer dereference
...
github.com/influxdata/influxdb/tsdb.(*Shard).FieldDimensions(0xc820244000, 0xc821b70fb0, 0x1, 0x1, 0xc822b9cc00, 0xc822b9cc30, 0x0, 0x0)
/Users/jason/go/src/github.com/influxdata/influxdb/tsdb/shard.go:588 +0xa62
github.com/influxdata/influxdb/tsdb.(*shardIteratorCreator).FieldDimensions(0xc8202b6078, 0xc821b70fb0, 0x1, 0x1, 0xc822b9cbd0, 0x0, 0x0, 0x0)
/Users/jason/go/src/github.com/influxdata/influxdb/tsdb/shard.go:818 +0x53
github.com/influxdata/influxdb/influxql.IteratorCreators.FieldDimensions(0xc821b71250, 0x1, 0x1, 0xc821b70fb0, 0x1, 0x1, 0xc822b9cba0, 0xc822b9cbd0, 0x0, 0x0)
/Users/jason/go/src/github.com/influxdata/influxdb/influxql/iterator.go:639 +0x15a
github.com/influxdata/influxdb/influxql.(*IteratorCreators).FieldDimensions(0xc822a32ae0, 0xc821b70fb0, 0x1, 0x1, 0x20, 0x18, 0x0, 0x0)
<autogenerated>:163 +0xd3
2016-07-18 16:35:33 -06:00
Ross McDonald
28571994aa
Correct Docker image name in circle file.
2016-07-18 16:56:02 -05:00
Jonathan A. Sternberg
30efa2d922
Merge pull request #6989 from influxdata/js-6950-show-measurements-performance
...
Optimize SHOW MEASUREMENTS so it consults the database index directly
2016-07-18 15:23:17 -05:00
Jason Wilder
d8fcd9f38e
Merge pull request #7024 from influxdata/jw-drop
...
Bug fixes
2016-07-18 12:28:13 -06:00
Jason Wilder
b692ef4f48
Rename throttle package to limiter
2016-07-18 12:00:58 -06:00
Jonathan A. Sternberg
4121590b01
Optimize SHOW MEASUREMENTS so it consults the database index directly
...
SHOW MEASUREMENTS doesn't need to visit every shard in the open source
version since all of them contain the same database index.
2016-07-18 12:53:23 -05:00
Jason Wilder
c2370b437b
Limit in-flight wal writes/encodings
...
A slower disk can can cause excessive allocations to occur when
writing to the WAL because the slower encoding and compression occurs
before taking the write lock. The encoding/compression grabs a large
byte slice from a pool and ultimately waits until it can acquire the
write lock.
This adds a throttle to limit how many inflight WAL writes can be queued
up to prevent OOMing the processess with slower disks and heavy writes.
2016-07-17 23:53:12 -06:00
Jason Wilder
46fdcba6e3
Remove compaction enabled logging
...
Too verbose
2016-07-17 23:53:12 -06:00
Jason Wilder
2fa28ba1d3
Don't log error when compactions are aborted
2016-07-17 23:53:12 -06:00
Jason Wilder
b48d88ce9e
Abort running compactions when series are deleted
...
If a delete is issued while a compaction is running, the a newly
deleted series could re-appear after the compaction completed. This
could occur the compaction had already written the blocks for series
that were just deleted. When the compaction completes, the newly
written tombstone files would be deleted, essentially undeleting the
series.
2016-07-17 23:53:12 -06:00
Jason Wilder
cc4a668be5
Don't return statistic if engine is closed
2016-07-17 23:53:12 -06:00
Ross McDonald
27650da7b9
Merge pull request #7012 from influxdata/ross-circle-update
...
Update circle.yml to automate release upload on version tag
2016-07-15 16:21:06 -05:00