ae821f4e2d
Rework compaction scheduling
...
This changes the compaction scheduling to better utilize the available
cores that are free. Previously, a level was planned in its own goroutine
and would kick off a number of compactions groups. The problem with this
model was that if there were 4 groups, and 3 completed quickly, the planning
would be blocked for that level until the last group finished. If the compactions
at the prior level are running more quickly, a large backlog could accumlate.
This now moves the planning to a single goroutine that plans each level in
succession and starts as many groups as it can. When one group finishes,
the planning will start the next group for the level.
2017-10-03 10:48:13 -06:00
f668b0cc3f
Only use O_SYNC for tsm file writing
...
Doing this for the WAL reduces throughput quite a bit.
2017-10-03 10:48:13 -06:00
1610ae5727
Don't return tsm files part of a compaction plan
2017-10-03 10:48:13 -06:00
1525069213
Merge pull request #8892 from influxdata/jl-tag-values
...
auth: add series auth to 'show tag values'
2017-10-03 08:47:39 -04:00
defb81413e
Merge branch 'master' into er-changelog
2017-10-03 12:20:49 +01:00
1566deb320
Merge pull request #8902 from influxdata/js-uint-binary-expr
...
Support unsigned binary math in fields
2017-10-02 20:32:14 -05:00
79092610c8
Support unsigned binary math in fields
...
Field math works similar to condition evaluation, but not the exact same
because we have more information to work with in field expressions than
we do in conditional math because fields retain the information about
their source while conditions do not.
The main difference is that you cannot add an unsigned literal to the
output of an integer iterator while you can inside of a condition. You
can perform math on a positive integer literal to an unsigned iterator.
Inside of the condition, we aren't sure if an integer is because of a
literal or because of an iterator so we can't make that distinction.
2017-10-02 17:06:49 -05:00
cd84509313
Merge pull request #8901 from influxdata/revert-8840-bugfix/issues/8813
...
Revert "Convert duration to string without dot and zeros"
2017-10-02 16:55:32 -05:00
06994a6585
Revert "Convert duration to string without dot and zeros"
2017-10-02 16:31:03 -05:00
4d32c157a9
Update changelog
2017-10-02 11:49:16 -07:00
e623b1b16b
Use `command` instead of `which`
...
Some systems don't have `which` installed.
Also fix some whitespace issues.
Fixes #8900 .
2017-10-02 11:49:08 -07:00
9cf517bcdf
Merge pull request #8896 from influxdata/lh-batcher-leak
...
Fix a minor memory leak when batching points for some services.
2017-10-02 12:26:58 -06:00
7e5fd14e8a
add in some optimization
2017-10-02 12:02:38 -06:00
a6cbce0d3e
fix issues brought up by joe
2017-10-02 11:41:03 -06:00
38dc837910
Fix a minor memory leak when batching points for some services.
...
fixes #8895
2017-10-02 11:26:25 -06:00
1a920c5c42
Merge pull request #8897 from influxdata/js-msgpack-formatter
...
Add message pack formatter
2017-10-02 11:31:35 -05:00
8328bc1e04
Merge pull request #8828 from influxdata/jl-show-measurements
...
auth: Fix permissions for SHOW MEASUREMENTS
2017-09-29 14:13:26 -06:00
a0df2fe504
Add message pack formatter
2017-09-29 14:58:38 -05:00
4d6672fa66
Merge with master
2017-09-29 11:07:40 -06:00
9db4439984
Merge pull request #8840 from liketic/bugfix/issues/8813
...
Convert duration to string without dot and zeros
2017-09-29 11:24:40 -05:00
986a0e18da
Convert duration to string without dot and zeros
2017-09-28 11:56:25 -05:00
7d1c32fb96
Merge pull request #8763 from influxdata/js-8762-document-subquery-ordering-change
...
Document that query ordering must be consistent in subqueries
2017-09-28 11:15:22 -05:00
8c70cfd74b
Merge pull request #8808 from liketic/feature/issues/8590
...
Influx CLI: Make cli case insensitive
2017-09-28 09:13:19 -07:00
f0acb988d6
Merge pull request #8884 from influxdata/js-uint-eval
...
Implement uint64 logic into eval
2017-09-28 10:26:11 -05:00
1443b22379
auth: add series auth to 'show tag values'
2017-09-27 20:01:18 -04:00
d474a0ed9c
Handle UnsignedLiteral in the Reduce operations
2017-09-27 15:10:30 -05:00
f0fb0174b6
Implement uint64 logic into eval
...
Any operation between an int64 and uint64 results in the type becoming a
uint64. This is because the most common will usually be an unsigned
cursor being modified by an int literal. Even in cases where we were to
add an unsigned literal to an integer iterator, that would just result
in it being recast back and overflow.
2017-09-27 15:10:16 -05:00
e0cba4477c
Merge pull request #8885 from influxdata/er-entry-race
...
Fix race on Cache entry
2017-09-27 18:42:45 +01:00
152b97bfc3
Merge pull request #8743 from influxdata/er-8742-go-bits
...
Prepare for Go 1.9 math/bits package.
2017-09-27 18:13:25 +01:00
d0b81c1e6c
Fix race on Cache entry
2017-09-27 18:10:23 +01:00
963cbfd275
Update eval type for unsigned
2017-09-27 11:31:52 -05:00
a1b67160f6
Use math/bits in encoder
2017-09-26 12:51:08 +01:00
a174f65595
use math/bits in HLL implementation
2017-09-26 12:51:08 +01:00
7fed382dbf
Merge pull request #8872 from influxdata/jw-mmap
...
Fix long process stalls
2017-09-25 14:49:35 -06:00
4e6075e819
Merge pull request #8873 from influxdata/js-emitter-unsigned-type
...
Support the unsigned type in query.Emitter
2017-09-25 15:45:28 -05:00
1d833cd920
Support the unsigned type in query.Emitter
2017-09-25 15:08:18 -05:00
122a74c692
Use synchronous IO for wal and tsm writing
...
The fysncs due to large writes when writing to TSM files and the
WAL can eventually cause large pauses. Since we already buffer
writes, using synchronous IO reduces fsync latency by ensuring
the individiual writes hit disk. This spreads out the latecncy
across multiple writes better.
2017-09-25 12:44:57 -06:00
660c2f8ae2
Merge pull request #8847 from influxdata/er-8842-engine-races
...
Fix various engine races
2017-09-25 18:34:29 +01:00
311f1fa619
Merge pull request #8864 from influxdata/js-8848-subquery-math-on-greater-than-two-fields
...
Prevent deadlock when doing math on the result of a subquery
2017-09-25 11:58:02 -05:00
612ed90b53
Merge pull request #8870 from nwante/patch-1
...
simple typo fix
2017-09-25 11:49:10 -05:00
2def219f09
Refactor Shard to further protect Engine
2017-09-25 17:43:30 +01:00
4a67f92acc
Prevent store from directly accessing Shard's engine
2017-09-25 17:43:01 +01:00
8e9cabbb9c
Fix race in TagValues when reaching into engine
2017-09-25 17:43:01 +01:00
7739ff749a
Ensure engine protected by shard mutex
2017-09-25 17:42:30 +01:00
2c43654552
Add some tests for concurrent server access
2017-09-25 17:42:30 +01:00
5774b44a4c
Remove MADV_RANDOM
...
This was inadvertently added when merging the solaris and unix
mmap files. This causes large delays due to major page faults.
2017-09-25 10:25:06 -06:00
58b674d16e
Merge pull request #8857 from influxdata/er-bloom
...
Improve performance of TSI Bloom Filter
2017-09-25 16:50:09 +01:00
e995bba24e
simple typo fix
...
just a simple wording fix when I was reading the docs.
2017-09-25 08:16:57 -04:00
e442bd87ea
Master 1657 ( #8865 )
...
Bugfix, was overwriting non-static package with static package
2017-09-22 16:59:54 -04:00
dbbb1090da
Merge pull request #8863 from influxdata/er-appveyor
...
Adjust AppVeyor CI options
2017-09-22 21:41:18 +01:00
Jason Wilder
Joe LeGasse
Edd Robinson
Jonathan A. Sternberg
Mark Rushakoff
Lyon Hill
Andrew Hare
Andrew Hare
liketic
Mark Rushakoff
Jason Wilder
nwante
Adam