Commit Graph

12082 Commits (aa762b96df3a5868ef4c3230696bc0f0aed3c981)

Author SHA1 Message Date
Stuart Carnie aa762b96df update field keys 2017-06-13 13:32:18 +10:00
Stuart Carnie 2de52834f0 CQ statistics written to monitor database, addresses #8188
* off by default, enabled by `query-stats-enabled`
* writes to cq_query measurement of configured monitor database
* see CHANGELOG for schema of individual points
2017-06-10 09:20:38 +08:00
Ben Johnson 4957b3d8be Merge pull request #8455 from benbjohnson/tsi-level-file-count-check
Check file count before attempting a TSI level compaction.
2017-06-07 14:09:12 -06:00
Ben Johnson bcc6ef769b
Check file count before attempting a TSI level compaction.
This check was previously in a different section of code which
was lost during a refactor to the new compaction strategy. The
compaction planning now makes a check to ensure at least two
files are available for compaction in a level.
2017-06-06 11:08:59 -06:00
Stuart Carnie 160fafb6c0 Merge pull request #8452 from influxdata/sgc-8299
Configuration to limit size of client request body
2017-06-06 18:17:26 +08:00
Stuart Carnie 099371f2e7 Add config test; add negative value test 2017-06-06 08:42:45 +08:00
Stuart Carnie 98f2050bcb Update config sample and CHANGELOG 2017-06-05 22:05:00 +08:00
Stuart Carnie cac5dbfa5a NEW max-body-size config; HTTP 413 if body exceeds max size; fixes #8299 2017-06-05 21:38:33 +08:00
Stuart Carnie 55d1ba6d79 rework gzip compressor so it is lazily created for 200 OK requests only
* fix issue when panicking (before Write) gzip writer is closed, causing
header to be written and default status of 200 OK being written.
* update recovery middleware to set 500 Internal Server Error
2017-06-05 21:38:32 +08:00
Ben Johnson 9520a0b9cb Merge pull request #8447 from benbjohnson/fix-tag-value-dedupe
Fix SHOW TAG VALUES deduplication.
2017-06-02 08:37:21 -06:00
Ben Johnson 3128c6a42e
Fix SHOW TAG VALUES deduplication. 2017-06-01 15:38:35 -06:00
Stuart Carnie cabdcf4233 Merge pull request #8445 from influxdata/sgc-protobuf
Update gogo protobuf dependency
2017-06-01 08:42:30 +08:00
Stuart Carnie 6b3aa44d89 Update gogo protobuf 2017-06-01 08:20:06 +08:00
Ryan Betts 19ef39d947 Merge pull request #8437 from influxdata/jl-points-auth
Fine Grained Authorization
2017-05-31 10:23:49 -04:00
Ryan Betts 8432c2bd5e Merge pull request #8433 from tobiasschaefer/fix-typos
Fix typos in comments.
2017-05-30 13:17:30 -04:00
Jonathan A. Sternberg fe37d39ab8 Merge pull request #7963 from influxdata/js-7957-url-auth-query-parameters
URL query parameter credentials take priority over Authentication header
2017-05-30 11:50:28 -05:00
Jonathan A. Sternberg 906bcb7b32 Merge pull request #8442 from influxdata/js-fix-bottom-with-no-tags
Queries for `bottom()` with no tags got messed up while changing the implementation
2017-05-30 11:50:08 -05:00
Jonathan A. Sternberg 78a32cba0e Queries for `bottom()` with no tags got messed up while changing the implementation
It didn't properly pass the variable reference when creating the
variable iterator so a null iterator got passed back instead.

Duplicate the `top()` tests in TopInt to also test `bottom()` with the
same queries so `bottom()` stops getting neglected so often.
2017-05-30 11:28:41 -05:00
Jonathan A. Sternberg 6a78f1cf4a URL query parameter credentials take priority over Authentication header 2017-05-30 09:26:24 -05:00
Tobias Schaefer 7d665ba560 Fix typos in comments. 2017-05-28 07:30:55 +02:00
Stuart Carnie 8d8a7a0bfe pass meta.User to avoid future search requests 2017-05-26 15:05:38 -07:00
Stuart Carnie 47f97ea134 use parsed measurement and models.Tags 2017-05-26 13:21:59 -07:00
Stuart Carnie 3ec9b401f7 fix benchmark test 2017-05-26 13:21:59 -07:00
Stuart Carnie cec0712141 Add authorization error behavior API 2017-05-26 13:21:59 -07:00
Stuart Carnie 46796d932f add database to index, engine and shard; call AuthorizeSeriesRead 2017-05-26 13:21:50 -07:00
Joe LeGasse 815f740f4c initial fga work
wip

wip

fix tests / build
2017-05-26 13:16:27 -07:00
Stuart Carnie 3b08f65a20 Merge pull request #8431 from influxdata/sgc-tagsets
improvements to inmem/Measurement.TagSets API
2017-05-26 10:29:56 -07:00
Stuart Carnie c30c33dbcb Merge remote-tracking branch 'origin/master' into sgc-tagsets 2017-05-26 09:10:18 -07:00
Jason Wilder a40ef53b49 Merge pull request #8429 from influxdata/jw-go-183
Update to go1.8.3
2017-05-26 09:28:59 -06:00
Jason Wilder 944c9c2b19 Update to go1.8.3 2017-05-26 09:12:31 -06:00
Jason Wilder 44c81f8754 Merge pull request #8430 from influxdata/jw-log-compile
Fix compile error
2017-05-26 08:45:55 -06:00
Stuart Carnie c89d98dc02 gofmt 2017-05-25 16:00:23 -07:00
Stuart Carnie 386720b2e7 improvements to inmem/Measurement.TagSets API
```
benchmark                                             old ns/op     new ns/op     delta
BenchmarkMeasurement_TagSetsNoDimensions_1000-8       234054        117315        -49.88%
BenchmarkMeasurement_TagSetsDimensions_1000-8         996838        313313        -68.57%
BenchmarkMeasurement_TagSetsNoDimensions_100000-8     58940464      39452117      -33.06%
BenchmarkMeasurement_TagSetsDimensions_100000-8       175612060     70195562      -60.03%

benchmark                                             old allocs     new allocs     delta
BenchmarkMeasurement_TagSetsNoDimensions_1000-8       1026           26             -97.47%
BenchmarkMeasurement_TagSetsDimensions_1000-8         8026           2029           -74.72%
BenchmarkMeasurement_TagSetsNoDimensions_100000-8     100064         64             -99.94%
BenchmarkMeasurement_TagSetsDimensions_100000-8       800064         200067         -74.99%

benchmark                                             old bytes     new bytes     delta
BenchmarkMeasurement_TagSetsNoDimensions_1000-8       117080        69080         -41.00%
BenchmarkMeasurement_TagSetsDimensions_1000-8         549081        117176        -78.66%
BenchmarkMeasurement_TagSetsNoDimensions_100000-8     23298264      18498265      -20.60%
BenchmarkMeasurement_TagSetsDimensions_100000-8       66498276      23298360      -64.96%
```
2017-05-25 15:52:27 -07:00
Jason Wilder 14b54e08cb Fix compile error 2017-05-25 15:18:35 -06:00
David Norton 62a9325e79 Merge pull request #8428 from influxdata/dn-rm-NewShardOwner
remove unused NewShardOwner func
2017-05-25 15:04:12 -04:00
Jason Wilder 6b594351e9 Merge pull request #8425 from influxdata/jw-max-key
Fix large field keys preventing snapshot compactions
2017-05-25 12:19:59 -06:00
Ben Johnson c767b65766 Merge pull request #8427 from benbjohnson/tsi-zap
Implement zap logging in TSI.
2017-05-25 12:00:30 -06:00
David Norton c345f5d700 remove unused NewShardOwner func 2017-05-25 11:37:08 -04:00
Ben Johnson 24446a0297
Implement zap logging in TSI. 2017-05-25 08:57:50 -06:00
Jason Wilder f1181cc402 Update changelog 2017-05-24 14:47:01 -06:00
Jason Wilder 5372db6327 Fix point validation to include field key length
The series key stored in TSM files includes the field.  We validated
the series length using only the measurement and tag set which allowed
very large field names to overflow.  This now checks the series key
as the measurement + tagset + field + the tsm field key separator size.
2017-05-24 14:39:54 -06:00
Jason Wilder 208ef09f87 Prevent writing series keys that exceed max key size
WriteBlock was missing the check for the max series keys which allowed
series keys to be written that were larger than the 2 bytes allocated
to store their length.  When this occurred, the TSM can fail to load.
2017-05-24 13:41:09 -06:00
Jonathan A. Sternberg 6608f97de7 Merge pull request #8398 from influxdata/js-7129-top-bottom-write-as-tags
Maintain the tags of points selected by top() or bottom() when writing the results
2017-05-23 16:48:49 -05:00
Jonathan A. Sternberg 9edf236cc8 Maintain the tags of points selected by top() or bottom() when writing the results
When a `SELECT ... INTO ...` is used with `top()` or `bottom()` used
with tags, the points will be written with the tags still intact instead
of converted to fields.
2017-05-23 15:00:21 -05:00
Jason Wilder 2c91eab241 Merge pull request #8420 from influxdata/jw-snap-err
Compaction planning fixes
2017-05-23 13:59:48 -06:00
Ben Johnson e0e29e2af4 Merge pull request #8421 from benbjohnson/tsi-cleanup
Fix tsi go vet issues.
2017-05-23 13:59:25 -06:00
Ben Johnson 547db32d01
Fix tsi go vet issues. 2017-05-23 13:42:38 -06:00
Jonathan A. Sternberg afc03611d7 Merge pull request #8402 from influxdata/js-query-test-cases
Add test cases for older issues that are now resolved
2017-05-23 14:32:25 -05:00
Ryan Betts b18a7e8deb Merge pull request #8396 from influxdata/changelog-merges
Add 1.2.4 and 1.1.5 CHANGELOG updates.
2017-05-23 14:31:09 -04:00
Jason Wilder 29e4287fd2 Preven masking root errors when compactions are in progress
The root error when creating a tmp file when writing a snapshot
was hidden making it difficult to determine why snapshots were
failing.
2017-05-23 12:09:36 -06:00