Commit Graph

11371 Commits (718fae7edbb40bcb10b9547501060490781ad964)

Author SHA1 Message Date
Michael Nikitochkin 65b08e56f7 [#7323]: Allow add items to array config via ENV
Allow to create a new templates or tags configs, if there are no records
in the default config.

Fixes: #6943
2016-12-23 09:20:46 +01:00
Michael Desa 759d78feb1 Merge pull request #7757 from influxdata/fix-changelog-typo
Fix changelog typo for fill linear PR
2016-12-22 13:26:44 -05:00
Michael Desa 34bfa52272 Fix changelog typo for fill linear PR
Thanks @inselbuch for noticing the issue
2016-12-22 00:53:10 -05:00
Mark Rushakoff 41677b753e Merge pull request #7750 from influxdata/er-demo-config
Clarify collectd directory usage in demo config
2016-12-21 09:15:17 -08:00
Harry Rose 0cb456bda1 Update CHANGELOG.md 2016-12-20 20:18:43 +00:00
Harry Rose a07103ca72 Add bound parameters map to Query object. Fixes #7687 2016-12-20 20:07:28 +00:00
Cory LaNou bc5736f59d Merge pull request #7672 from influxdata/cjl-7563-rp-duration-inf
Enforce minimum shard duration when creating retention policies
2016-12-20 12:16:07 -06:00
Edd Robinson da812b9d32 Update config; fixes #7736 2016-12-20 16:17:07 +00:00
Cory LaNou e883053a6b Merge pull request #7708 from influxdata/cjl-3188-cli-rp-context
add the ability for retention policy context in cli with use command
2016-12-20 10:06:11 -06:00
Cory LaNou 880c7cdcc8 Merge branch 'master' into cjl-3188-cli-rp-context 2016-12-20 09:55:40 -06:00
Cory LaNou f2ea3e1d64 Merge pull request #7709 from influxdata/cjl-cli-clear-command
add clear command to cli
2016-12-20 09:54:49 -06:00
Cory LaNou 0cbdea531a add the ability for retention policy context in cli with use command 2016-12-20 09:15:38 -06:00
Cory LaNou fbc9e3cfcc add clear command to cli 2016-12-20 09:14:20 -06:00
Cory LaNou 572da8985c enforce minimum shard duration when creating retention policies 2016-12-20 09:11:43 -06:00
Edd Robinson f55995f9be Merge pull request #7740 from oiooj/pr-fix
fix scan tag value panic
2016-12-20 10:42:42 +00:00
timhallinflux fa80b9c8cf Update CHANGELOG.md
v0.13.0 -- Added PR #6277. 
- [#6277](https://github.com/influxdata/influxdb/pull/6277): Fix deadlock in tsm1/file_store
2016-12-19 20:02:43 -08:00
timhallinflux 6cad2ca408 Update CHANGELOG.md
v0.13.0 -- added #6419: Fix panic in transform iterator on division. @thbourlove
v0.12.2 -- #6419 was backported to 0.12.2 as well as PR #6431: Fix panic in transform iterator on division. @thbourlove.  Added.
2016-12-19 19:46:49 -08:00
timhallinflux fdc0fea1d3 Update CHANGELOG.md
v0.13.0 -- removed duplicate from bugfixes:  - [#6468](https://github.com/influxdata/influxdb/issues/6468): Panic with truncated wal segments
2016-12-19 19:29:24 -08:00
timhallinflux 090e131980 Update CHANGELOG.md
v0.13.0 -- removed duplicate entry for  - [#6477](https://github.com/influxdata/influxdb/pull/6477): Don't catch SIGQUIT or SIGHUP signals.
2016-12-19 19:27:29 -08:00
timhallinflux 3d819abd7f Update CHANGELOG.md
Features reported in v0.13.0:
- [#6593](https://github.com/influxdata/influxdb/pull/6593): Add ability to create snapshots of shards.
- [#6585](https://github.com/influxdata/influxdb/pull/6585): Parallelize iterators

were not released until v1.0.0.  Moved these into the v1.0.0 release notes.
2016-12-19 17:19:34 -08:00
kun de4436e9d9 fix scan tag value panic 2016-12-20 08:39:18 +08:00
timhallinflux 2433660e68 Update CHANGELOG.md
v1.0.0 bug fixes referenced issue #6649...but that issue was addressed by #6648.  Changelog now correctly references #6648...
2016-12-19 16:31:23 -08:00
timhallinflux f42c1e28ba Update CHANGELOG.md
removed duplicate entry in the bugfix section.  #7119 was there 2x.
2016-12-19 16:20:17 -08:00
timhallinflux 247d987eb2 Update CHANGELOG.md
v1.0.1 - fixed issue 7299's URL -- missing an "i" in issues.
2016-12-19 15:24:02 -08:00
timhallinflux d1669c8143 Update CHANGELOG.md
re-ordered features and bugfixes in numerical order, descending for releases 0.13.0 through 0.10.0
2016-12-19 15:10:27 -08:00
timhallinflux aff45aa47c Update CHANGELOG.md
re-ordered all features and bugfixes in numerical order, descending from 1.1.0 through 1.0.0
2016-12-19 15:02:36 -08:00
timhallinflux f667d96500 Update CHANGELOG.md
re-ordered v1.1.1 bugfixes... numerical order, descending
2016-12-19 14:57:26 -08:00
timhallinflux a2f939834a Update CHANGELOG.md
re-ordered Features and Bugfixes in numerical order, descending for v1.2.0
2016-12-19 14:56:01 -08:00
timhallinflux 0fcd0ac3bc Update CHANGELOG.md
Made 1.1.0 Features Section consistent with the other releases.  Github issue # -- followed by summary text.
2016-12-19 14:35:48 -08:00
Jason Wilder 47a8fed63a Merge pull request #7735 from influxdata/jw-cache-sort
Reduce lock contention when snapshotting
2016-12-19 14:38:47 -07:00
Jason Wilder 2468347ffb Fix comment 2016-12-19 14:17:49 -07:00
Jason Wilder 326557e539 Fix race in partition.reset 2016-12-19 14:17:01 -07:00
Jason Wilder e91e45d71c Fix panic in cache benchmark 2016-12-19 14:17:01 -07:00
Jason Wilder 0b6b9ea1cb Use atomics for cache.snapshotSize stat 2016-12-19 14:17:01 -07:00
Jason Wilder 637a67ea35 Reduce lock contention on measurementFields 2016-12-19 14:17:01 -07:00
Jason Wilder b7c1e625b0 Move needSort tracking to Deduplicate
This eliminates some *UnixNano() calls and also simplifies the cache
logic so that it does not need to worry about whether entries are
sorted.
2016-12-19 14:17:01 -07:00
Jason Wilder dea87703cd Reduce UnixNano pointer call 2016-12-19 14:17:01 -07:00
Jason Wilder 346b62aea0 Merge pull request #7703 from influxdata/jw-merge-111
Merge 1.1.1 to master
2016-12-19 14:16:05 -07:00
Jason Wilder 34c06d222a Update changelog 2016-12-19 11:47:00 -07:00
Jason Wilder 3fa8492965 Merge pull request #7641 from influxdata/cs-string-escape-unit-tests
String escape & unescape unit tests & optimizations
2016-12-19 11:38:35 -07:00
Jason Wilder 4787ed1b94 Update 1.1.1 release date 2016-12-19 11:11:50 -07:00
Edd Robinson 43834d3db8 Update Go version to 1.7.4 2016-12-19 11:11:00 -07:00
Edd Robinson db4e50f34f Fixes #7625 2016-12-19 11:09:10 -07:00
Mark Rushakoff b8ef792606 Merge pull request #7744 from influxdata/mr-check-read-block-error
Fix unchecked error in templated Read${TYPE}Block
2016-12-19 09:48:15 -08:00
Mark Rushakoff 722b6345fe Fix unchecked error in templated Read${TYPE}Block 2016-12-19 09:31:26 -08:00
Mark Rushakoff 55afd56cc2 Merge pull request #7741 from influxdata/mr-export-cleanup
Clean up `influx_inspect export` command and improve performance
2016-12-19 09:18:20 -08:00
Mark Rushakoff 295a29d4ea Fix quoting on exported string fields
The previous implementation was wrong and double-escaped quotes and
backslashes.
2016-12-18 00:37:48 -08:00
Mark Rushakoff 15ba7958f8 Use strings.Replacer to escape string field
benchmark                                        old ns/op     new ns/op     delta
BenchmarkEscapeStringField_Plain-4               167           65.3          -60.90%
BenchmarkEscapeString_Quotes-4                   167           165           -1.20%
BenchmarkEscapeString_Backslashes-4              211           184           -12.80%
BenchmarkEscapeString_QuotesAndBackslashes-4     413           397           -3.87%

BenchmarkExportTSMStrings_100s_250vps-4     33833611      27381442           -19.07%
BenchmarkExportWALStrings_100s_250vps-4     34977761      29222717           -16.45%

benchmark                                        old allocs     new allocs     delta
BenchmarkEscapeStringField_Plain-4               4              1              -75.00%
BenchmarkEscapeString_Quotes-4                   4              3              -25.00%
BenchmarkEscapeString_Backslashes-4              5              3              -40.00%
BenchmarkEscapeString_QuotesAndBackslashes-4     9              5              -44.44%

BenchmarkExportTSMStrings_100s_250vps-4     201605          76938              -61.84%
BenchmarkExportWALStrings_100s_250vps-4     225371         100728              -55.31%

benchmark                                        old bytes     new bytes     delta
BenchmarkEscapeStringField_Plain-4               56            16            -71.43%
BenchmarkEscapeString_Quotes-4                   56            48            -14.29%
BenchmarkEscapeString_Backslashes-4              104           80            -23.08%
BenchmarkEscapeString_QuotesAndBackslashes-4     208           160           -23.08%

BenchmarkExportTSMStrings_100s_250vps-4     10872629       6062048           -44.24%
BenchmarkExportWALStrings_100s_250vps-4     10094933       5269980           -47.80%
2016-12-17 23:46:58 -08:00
Mark Rushakoff 9effe6f364 Update CHANGELOG 2016-12-17 20:34:04 -08:00
Mark Rushakoff ff78c84b0f Improve export performance
Benchmark improvements with this change:

benchmark                                   old ns/op     new ns/op     delta
BenchmarkExportTSMFloats_100s_250vps-4      23206480      10279106      -55.71%
BenchmarkExportTSMInts_100s_250vps-4        17995000      5762310       -67.98%
BenchmarkExportTSMBools_100s_250vps-4       17067605      4235467       -75.18%
BenchmarkExportTSMStrings_100s_250vps-4     54846997      34682568      -36.76%
BenchmarkExportWALFloats_100s_250vps-4      23459937      10436297      -55.51%
BenchmarkExportWALInts_100s_250vps-4        18747150      6236062       -66.74%
BenchmarkExportWALBools_100s_250vps-4       17988273      4814358       -73.24%
BenchmarkExportWALStrings_100s_250vps-4     59700802      35815739      -40.01%

benchmark                                   old allocs     new allocs     delta
BenchmarkExportTSMFloats_100s_250vps-4      201442         51738          -74.32%
BenchmarkExportTSMInts_100s_250vps-4        201442         51728          -74.32%
BenchmarkExportTSMBools_100s_250vps-4       201441         51638          -74.37%
BenchmarkExportTSMStrings_100s_250vps-4     404092         201584         -50.11%
BenchmarkExportWALFloats_100s_250vps-4      250322         75627          -69.79%
BenchmarkExportWALInts_100s_250vps-4        250323         75617          -69.79%
BenchmarkExportWALBools_100s_250vps-4       250321         75527          -69.83%
BenchmarkExportWALStrings_100s_250vps-4     452868         225291         -50.25%

benchmark                                   old bytes     new bytes     delta
BenchmarkExportTSMFloats_100s_250vps-4      5170539       2351789       -54.52%
BenchmarkExportTSMInts_100s_250vps-4        5143189       2331276       -54.67%
BenchmarkExportTSMBools_100s_250vps-4       3724951       2143780       -42.45%
BenchmarkExportTSMStrings_100s_250vps-4     17131400      10796281      -36.98%
BenchmarkExportWALFloats_100s_250vps-4      4487868       1468109       -67.29%
BenchmarkExportWALInts_100s_250vps-4        4458395       1452359       -67.42%
BenchmarkExportWALBools_100s_250vps-4       2838719       1258755       -55.66%
BenchmarkExportWALStrings_100s_250vps-4     16787201      10010700      -40.37%

Also, after improving those benchmarks, I did a time-filtered export on
a 450MB TSM file to a 21GB plain text output, with and without the
bufio.BufferedWriter.

Without buffering, it took about 263s, and with buffering, it took about
60s, for a delta of about -77%.
2016-12-17 20:15:39 -08:00