47f97ea134
use parsed measurement and models.Tags
2017-05-26 13:21:59 -07:00
3ec9b401f7
fix benchmark test
2017-05-26 13:21:59 -07:00
cec0712141
Add authorization error behavior API
2017-05-26 13:21:59 -07:00
46796d932f
add database to index, engine and shard; call AuthorizeSeriesRead
2017-05-26 13:21:50 -07:00
815f740f4c
initial fga work
...
wip
wip
fix tests / build
2017-05-26 13:16:27 -07:00
3b08f65a20
Merge pull request #8431 from influxdata/sgc-tagsets
...
improvements to inmem/Measurement.TagSets API
2017-05-26 10:29:56 -07:00
c30c33dbcb
Merge remote-tracking branch 'origin/master' into sgc-tagsets
2017-05-26 09:10:18 -07:00
a40ef53b49
Merge pull request #8429 from influxdata/jw-go-183
...
Update to go1.8.3
2017-05-26 09:28:59 -06:00
944c9c2b19
Update to go1.8.3
2017-05-26 09:12:31 -06:00
44c81f8754
Merge pull request #8430 from influxdata/jw-log-compile
...
Fix compile error
2017-05-26 08:45:55 -06:00
c89d98dc02
gofmt
2017-05-25 16:00:23 -07:00
386720b2e7
improvements to inmem/Measurement.TagSets API
...
```
benchmark old ns/op new ns/op delta
BenchmarkMeasurement_TagSetsNoDimensions_1000-8 234054 117315 -49.88%
BenchmarkMeasurement_TagSetsDimensions_1000-8 996838 313313 -68.57%
BenchmarkMeasurement_TagSetsNoDimensions_100000-8 58940464 39452117 -33.06%
BenchmarkMeasurement_TagSetsDimensions_100000-8 175612060 70195562 -60.03%
benchmark old allocs new allocs delta
BenchmarkMeasurement_TagSetsNoDimensions_1000-8 1026 26 -97.47%
BenchmarkMeasurement_TagSetsDimensions_1000-8 8026 2029 -74.72%
BenchmarkMeasurement_TagSetsNoDimensions_100000-8 100064 64 -99.94%
BenchmarkMeasurement_TagSetsDimensions_100000-8 800064 200067 -74.99%
benchmark old bytes new bytes delta
BenchmarkMeasurement_TagSetsNoDimensions_1000-8 117080 69080 -41.00%
BenchmarkMeasurement_TagSetsDimensions_1000-8 549081 117176 -78.66%
BenchmarkMeasurement_TagSetsNoDimensions_100000-8 23298264 18498265 -20.60%
BenchmarkMeasurement_TagSetsDimensions_100000-8 66498276 23298360 -64.96%
```
2017-05-25 15:52:27 -07:00
14b54e08cb
Fix compile error
2017-05-25 15:18:35 -06:00
62a9325e79
Merge pull request #8428 from influxdata/dn-rm-NewShardOwner
...
remove unused NewShardOwner func
2017-05-25 15:04:12 -04:00
6b594351e9
Merge pull request #8425 from influxdata/jw-max-key
...
Fix large field keys preventing snapshot compactions
2017-05-25 12:19:59 -06:00
c767b65766
Merge pull request #8427 from benbjohnson/tsi-zap
...
Implement zap logging in TSI.
2017-05-25 12:00:30 -06:00
c345f5d700
remove unused NewShardOwner func
2017-05-25 11:37:08 -04:00
24446a0297
Implement zap logging in TSI.
2017-05-25 08:57:50 -06:00
f1181cc402
Update changelog
2017-05-24 14:47:01 -06:00
5372db6327
Fix point validation to include field key length
...
The series key stored in TSM files includes the field. We validated
the series length using only the measurement and tag set which allowed
very large field names to overflow. This now checks the series key
as the measurement + tagset + field + the tsm field key separator size.
2017-05-24 14:39:54 -06:00
208ef09f87
Prevent writing series keys that exceed max key size
...
WriteBlock was missing the check for the max series keys which allowed
series keys to be written that were larger than the 2 bytes allocated
to store their length. When this occurred, the TSM can fail to load.
2017-05-24 13:41:09 -06:00
6608f97de7
Merge pull request #8398 from influxdata/js-7129-top-bottom-write-as-tags
...
Maintain the tags of points selected by top() or bottom() when writing the results
2017-05-23 16:48:49 -05:00
9edf236cc8
Maintain the tags of points selected by top() or bottom() when writing the results
...
When a `SELECT ... INTO ...` is used with `top()` or `bottom()` used
with tags, the points will be written with the tags still intact instead
of converted to fields.
2017-05-23 15:00:21 -05:00
2c91eab241
Merge pull request #8420 from influxdata/jw-snap-err
...
Compaction planning fixes
2017-05-23 13:59:48 -06:00
e0e29e2af4
Merge pull request #8421 from benbjohnson/tsi-cleanup
...
Fix tsi go vet issues.
2017-05-23 13:59:25 -06:00
547db32d01
Fix tsi go vet issues.
2017-05-23 13:42:38 -06:00
afc03611d7
Merge pull request #8402 from influxdata/js-query-test-cases
...
Add test cases for older issues that are now resolved
2017-05-23 14:32:25 -05:00
b18a7e8deb
Merge pull request #8396 from influxdata/changelog-merges
...
Add 1.2.4 and 1.1.5 CHANGELOG updates.
2017-05-23 14:31:09 -04:00
29e4287fd2
Preven masking root errors when compactions are in progress
...
The root error when creating a tmp file when writing a snapshot
was hidden making it difficult to determine why snapshots were
failing.
2017-05-23 12:09:36 -06:00
bd6d0681e9
Ensure planned files are released
...
The defer was never executed because the planning happens in a
long running goroutine that loops. The plans need to be released
immediately after applying them.
2017-05-23 12:08:25 -06:00
4e582f297a
Fix race in findGenerations
...
It was possible that the findGenerations could get stuck returning
no files even when generations existed on disk.
2017-05-23 12:05:47 -06:00
3023052f58
Merge pull request #8290 from benbjohnson/tsi-tag-block-delta-encode
...
TSI Compaction Refactor
2017-05-23 10:25:16 -06:00
48456d80ad
Remove tsi commented code.
2017-05-23 10:24:37 -06:00
5619946b85
Merge pull request #8416 from influxdata/jw-tsm-tmp
...
Fix TSM tmp file lingering on disk
2017-05-23 10:12:18 -06:00
2524df3405
Convert tsi1 series keys to uint32.
2017-05-23 09:48:13 -06:00
c744e2f562
TSI pull request fixes.
2017-05-23 09:01:05 -06:00
57eeae03fc
Add note about SeriesIDs() limitation.
2017-05-23 08:42:25 -06:00
e7f39c06ab
Refactor TSI1 compaction.
2017-05-23 08:42:25 -06:00
1975940f76
intermediate compaction commit
2017-05-23 08:42:25 -06:00
79edc0979c
Add temporary debugging stats for offset lookups.
2017-05-23 08:41:31 -06:00
48a06432df
Add tsi1 bloom filter.
2017-05-23 08:41:31 -06:00
f3e08c5871
Delta encode tag and measurement block series data.
2017-05-23 08:41:31 -06:00
6f58149052
Increase tsi compaction factor.
2017-05-23 08:40:26 -06:00
a6c5430397
Merge pull request #8405 from influxdata/sgc-move-meta
...
move Measurement and Series to inmem package
2017-05-22 14:43:57 -07:00
31d2309177
Update changelog
2017-05-22 14:53:06 -06:00
1833475c09
Fix TSM tmp files leaking
...
TMP files could leak when compactions failed for various reasons. They
were also being deleted inadvertently when compactions were disabled causing
other errors to be reported in the logs.
2017-05-22 14:51:18 -06:00
4bdce21a9a
Merge pull request #8394 from influxdata/js-top-bottom-performance
...
Optimize top() and bottom() using an incremental aggregator
2017-05-19 14:32:55 -05:00
b8a2507bda
Merge pull request #8408 from benbjohnson/hll-size-fix
...
Fix HLL variableLengthList size decoding.
2017-05-19 12:48:03 -06:00
623ff67221
Fix HLL variableLengthList size decoding.
2017-05-19 11:44:25 -06:00
55f2f83e34
Merge pull request #8407 from influxdata/jw-8392
...
Return partial write error when points outside of retention policy ar…
2017-05-19 11:25:08 -06:00
Stuart Carnie
Joe LeGasse
Jason Wilder
Jason Wilder
David Norton
Ben Johnson
Jonathan A. Sternberg
Ryan Betts