Commit Graph

12102 Commits (643b2eb30cd4726e58a9052ee6f15ec9bea759cf)

Author SHA1 Message Date
Seif Lotfy 643b2eb30c Switch to LogLog-Beta Cardinality estimation
The new algorithm uses only one formula and needs no additional bias corrections for the entire range of cardinalities,
therefore, it is more efficient and simpler to implement. Our simulations show that the accuracy provided by the new
algorithm is as good as or better than the accuracy provided by either of HyperLogLog or HyperLogLog++. The sparse
representation was kept in to provide better low cardinality accuracy. However the linear counting and range estimations
are replaced.
2017-06-20 15:25:01 +02:00
Stuart Carnie 0b4528b26d Merge pull request #8471 from influxdata/sgc-8188
CQ statistics written to monitor database, addresses #8188
2017-06-14 09:43:15 +08:00
Stuart Carnie 932edd90b2 Merge branch 'master' into sgc-8188 2017-06-14 10:55:06 +10:00
Stuart Carnie 3657dbc256 update CHANGELOG with key names 2017-06-14 10:37:04 +10:00
Jason Wilder 206fd857c3 Merge pull request #8481 from influxdata/jw-subscriber
Decouple Subscriber from PointsWriter
2017-06-13 15:55:43 -06:00
Jason Wilder 0717c18426 Merge pull request #8487 from influxdata/jw-8483
Fix panic in ForEachMeasurementTagKey
2017-06-13 12:53:45 -06:00
Jason Wilder 71579fcbe9 Remove direct Subscriber dependency from PointsWriter 2017-06-13 12:51:02 -06:00
Jason Wilder 77afe50f7e Fix panic in ForEachMeasurementTagKey
If a shard was closed, ForEachMeasurementTagKey and TagKeyCardinality
would panic because the engine was nil.
2017-06-13 12:04:32 -06:00
Jonathan A. Sternberg e2c1da05e4 Merge pull request #8480 from influxdata/js-stats-interval
Change the default stats interval to 1 second instead of 10 seconds
2017-06-13 12:08:23 -05:00
Ben Johnson 2c30f28654 Merge pull request #8468 from benbjohnson/8459-fix-tsi-non-contiguous-compaction
Fix TSI non-contiguous compaction panic.
2017-06-13 10:53:45 -06:00
Ben Johnson b51f604030
Fix TSI non-contiguous compaction panic.
This fixes the case where log files are compacted out of order
and cause non-contiguous sets of index files to be compacted.

Previously, the compaction planner would fetch a list of index files
for each level and compact them in order starting with the oldest
ones. This can be a problem for level 1 because level 0 (log files)
are compacted individually and in some cases a log file can finish
compacting before older log files are finished compacting. This
causes there to be a gap in the list of level 1 files that is
ignored when fetching a list of index files.

Now, the planner reads the list of index files starting from the
oldest but stops once it hits a log file. This prevents that gap
from being ignored.
2017-06-13 10:53:26 -06:00
Ben Johnson 4568ddd298 Merge pull request #8475 from marchtea/master
fix index file fd leak
2017-06-13 10:51:33 -06:00
Stuart Carnie aa762b96df update field keys 2017-06-13 13:32:18 +10:00
Jason Wilder 1d8fa27272 Add write suscriber support to PointsWriter 2017-06-12 16:59:27 -06:00
Jonathan A. Sternberg f7382982fd Change the default stats interval to 1 second instead of 10 seconds 2017-06-12 13:15:25 -05:00
Jonathan A. Sternberg 9c0d31cb36 Update the comment for `max-select-point`
Point out that this limit is only checked every 10 seconds.
2017-06-12 13:07:44 -05:00
Edd Robinson a7ca7b58e6 Merge pull request #8478 from lrita/rm-duplicate-assignment
remove duplicated assignment in cmd/influxd/run/server
2017-06-12 14:20:25 +01:00
lrita 20e6b820bb remove duplicated assignment in cmd/influxd/run/server 2017-06-12 15:58:52 +08:00
Summer d17c205b54 fix typo 2017-06-12 11:20:08 +08:00
marchtea 16dfe2a0ae update CHANGELOG.md 2017-06-12 11:00:27 +08:00
marchtea 6e6f92c99a fix index file fd leak 2017-06-12 10:58:05 +08:00
Stuart Carnie 2de52834f0 CQ statistics written to monitor database, addresses #8188
* off by default, enabled by `query-stats-enabled`
* writes to cq_query measurement of configured monitor database
* see CHANGELOG for schema of individual points
2017-06-10 09:20:38 +08:00
Ben Johnson 4957b3d8be Merge pull request #8455 from benbjohnson/tsi-level-file-count-check
Check file count before attempting a TSI level compaction.
2017-06-07 14:09:12 -06:00
Ben Johnson bcc6ef769b
Check file count before attempting a TSI level compaction.
This check was previously in a different section of code which
was lost during a refactor to the new compaction strategy. The
compaction planning now makes a check to ensure at least two
files are available for compaction in a level.
2017-06-06 11:08:59 -06:00
Stuart Carnie 160fafb6c0 Merge pull request #8452 from influxdata/sgc-8299
Configuration to limit size of client request body
2017-06-06 18:17:26 +08:00
Stuart Carnie 099371f2e7 Add config test; add negative value test 2017-06-06 08:42:45 +08:00
Stuart Carnie 98f2050bcb Update config sample and CHANGELOG 2017-06-05 22:05:00 +08:00
Stuart Carnie cac5dbfa5a NEW max-body-size config; HTTP 413 if body exceeds max size; fixes #8299 2017-06-05 21:38:33 +08:00
Stuart Carnie 55d1ba6d79 rework gzip compressor so it is lazily created for 200 OK requests only
* fix issue when panicking (before Write) gzip writer is closed, causing
header to be written and default status of 200 OK being written.
* update recovery middleware to set 500 Internal Server Error
2017-06-05 21:38:32 +08:00
Ben Johnson 9520a0b9cb Merge pull request #8447 from benbjohnson/fix-tag-value-dedupe
Fix SHOW TAG VALUES deduplication.
2017-06-02 08:37:21 -06:00
Ben Johnson 3128c6a42e
Fix SHOW TAG VALUES deduplication. 2017-06-01 15:38:35 -06:00
Stuart Carnie cabdcf4233 Merge pull request #8445 from influxdata/sgc-protobuf
Update gogo protobuf dependency
2017-06-01 08:42:30 +08:00
Stuart Carnie 6b3aa44d89 Update gogo protobuf 2017-06-01 08:20:06 +08:00
Ryan Betts 19ef39d947 Merge pull request #8437 from influxdata/jl-points-auth
Fine Grained Authorization
2017-05-31 10:23:49 -04:00
Ryan Betts 8432c2bd5e Merge pull request #8433 from tobiasschaefer/fix-typos
Fix typos in comments.
2017-05-30 13:17:30 -04:00
Jonathan A. Sternberg fe37d39ab8 Merge pull request #7963 from influxdata/js-7957-url-auth-query-parameters
URL query parameter credentials take priority over Authentication header
2017-05-30 11:50:28 -05:00
Jonathan A. Sternberg 906bcb7b32 Merge pull request #8442 from influxdata/js-fix-bottom-with-no-tags
Queries for `bottom()` with no tags got messed up while changing the implementation
2017-05-30 11:50:08 -05:00
Jonathan A. Sternberg 78a32cba0e Queries for `bottom()` with no tags got messed up while changing the implementation
It didn't properly pass the variable reference when creating the
variable iterator so a null iterator got passed back instead.

Duplicate the `top()` tests in TopInt to also test `bottom()` with the
same queries so `bottom()` stops getting neglected so often.
2017-05-30 11:28:41 -05:00
Jonathan A. Sternberg 6a78f1cf4a URL query parameter credentials take priority over Authentication header 2017-05-30 09:26:24 -05:00
Tobias Schaefer 7d665ba560 Fix typos in comments. 2017-05-28 07:30:55 +02:00
Stuart Carnie 8d8a7a0bfe pass meta.User to avoid future search requests 2017-05-26 15:05:38 -07:00
Stuart Carnie 47f97ea134 use parsed measurement and models.Tags 2017-05-26 13:21:59 -07:00
Stuart Carnie 3ec9b401f7 fix benchmark test 2017-05-26 13:21:59 -07:00
Stuart Carnie cec0712141 Add authorization error behavior API 2017-05-26 13:21:59 -07:00
Stuart Carnie 46796d932f add database to index, engine and shard; call AuthorizeSeriesRead 2017-05-26 13:21:50 -07:00
Joe LeGasse 815f740f4c initial fga work
wip

wip

fix tests / build
2017-05-26 13:16:27 -07:00
Stuart Carnie 3b08f65a20 Merge pull request #8431 from influxdata/sgc-tagsets
improvements to inmem/Measurement.TagSets API
2017-05-26 10:29:56 -07:00
Stuart Carnie c30c33dbcb Merge remote-tracking branch 'origin/master' into sgc-tagsets 2017-05-26 09:10:18 -07:00
Jason Wilder a40ef53b49 Merge pull request #8429 from influxdata/jw-go-183
Update to go1.8.3
2017-05-26 09:28:59 -06:00
Jason Wilder 944c9c2b19 Update to go1.8.3 2017-05-26 09:12:31 -06:00