Commit Graph

14918 Commits (db/6263/compaction-debug-logging)

Author SHA1 Message Date
Edd Robinson 7431808996
Merge pull request #10403 from gupsho/fix_golint_warnings_services_graphite
Fix golint warnings for services/graphite
2019-02-01 08:20:42 -08:00
Edd Robinson 424dce8173
Merge pull request #10401 from gupsho/fix_lint_warnings_snapshotter
Fix lint warnings snapshotter
2019-02-01 08:06:26 -08:00
Edd Robinson 4356c06a71
Merge pull request #10336 from wrrn/error-golint
Fix linting errors in the errlist package
2019-02-01 07:58:05 -08:00
Hercules Mango Churchill 87adbea5f3 Update changelog 2019-02-01 15:55:05 +00:00
Edd Robinson e7a40402ea
Merge pull request #10276 from brookst/abs-fix
Fix bug with incorrect ABS results for negative integer values
2019-02-01 07:54:46 -08:00
Edd Robinson 7520253ec9
Merge pull request #11615 from influxdata/BP1.8-er-cow-off
Remove copy-on-write when caching bitmaps
2019-01-28 11:55:39 -08:00
Edd Robinson 301ab71ba0 Remove copy-on-write when caching bitmaps
In the case of caching TSI bitmaps belonging to immutable .tsi files,
the underlying bitset data can be mmapped. It is possible, though rare,
for this data to be unmapped (e.g., via a TSI compaction) but for the
cached bitmap to be subsequently read. This leads to a segfault.

This only happens when copy-on-write is set to true on the roaring
bitmap, because in that case only the internal pointers are cloned.

This change will reduce the TSI cache performance by around 10%, which I
have deemed to account for only a few microseconds typically.
2019-01-25 18:02:48 +00:00
Hercules Mango Churchill 7590d807e5 Update changelog 2019-01-25 17:33:27 +00:00
Edd Robinson 7da81848de
Merge pull request #11525 from influxdata/er-cache-config
Allow TSI bitset cache to be configured
2019-01-25 17:33:09 +00:00
Edd Robinson efdddbb31a Allow TSI bitset cache size to be configured
This commit adds a config option to the tsdb Config allowing the size of
the bitset cached in the TSI index to be specified.

Setting the cache size to 0 will disable the cache.
2019-01-24 17:41:45 +00:00
Edd Robinson e20541d2ba Expose functional option for setting TSI cache size 2019-01-23 17:15:48 +00:00
Mark Rushakoff 26afe32611
Merge pull request #11001 from influxdata/changelog-1.x-only
Only update the changelog on 1.x branches
2019-01-11 09:43:55 -08:00
Edd Robinson 489a0f6ad0
Merge pull request #10958 from influxdata/er-sketch-cardinality
Fix cardinality estimation error
2019-01-11 17:28:05 +00:00
Mark Rushakoff beb6848d95 Only update the changelog on 1.x branches
Master is switching to 2.x development today, and we are not going to
continue using the changelog strategy we used in 1.x.
2019-01-11 08:54:44 -08:00
Stuart Carnie c47a3ea2af feat(flux): Add support for optionally logging Flux queries
New configuration:

```toml
[http]
flux-log-enabled = true
```

will produce log entries similar to:

```
ts=2019-01-11T14:47:46.124347Z lvl=info msg="Executed Flux query" log_id=0CwLysq0000 service=httpd compiler_type=flux response_size=1467 query="from(bucket:\"test\") |> range(start: -5000h) |> limit(n:5)" stat_total_duration=3.949ms stat_compile_duration=3.183ms stat_queue_duration=0.026ms stat_plan_duration=0.055ms stat_requeue_duration=0.000ms stat_execute_duration=0.668ms stat_max_allocated=3200 stat_concurrency=1
```
2019-01-11 09:09:26 -07:00
Edd Robinson 3a055a6107 Fix cardinality estimation error
This commit fixes an error in the TSI index with estimating the
cardinality of series recently added and then removed.
2019-01-10 17:46:30 +00:00
Hercules Mango Churchill a62e7864bb Update changelog 2019-01-09 23:10:14 +00:00
Jonathan A. Sternberg 2987bcec1c
Merge pull request #10664 from influxdata/js-fix-function-types
Marked functions that always return floats as always returning floats
2019-01-09 17:09:58 -06:00
Jonathan A. Sternberg 865e6a05f0
Marked functions that always return floats as always returning floats
These functions, when used on non-float types in subqueries, would
return incorrect results as the type system thought they would return a
different type than the actual implementation would return.
2019-01-09 16:56:29 -06:00
David Norton 8ab48459ce
Merge pull request #10617 from influxdata/dn-fix-prom-api-panic
Fix panic in Prometheus read API
2019-01-09 10:15:26 -05:00
David Norton 8026cd6c86 fix #10595: fix panic in Prometheus read API 2019-01-08 13:41:41 -05:00
Tim Yocum 4d21ab9e0e
Merge pull request #10613 from influxdata/readme-fix
Fixing date; capitalization of InfluxDB
2019-01-07 12:30:25 -06:00
Nathaniel Cook 3fe2e9db9a
Merge pull request #10608 from influxdata/flux-staging
chore: update Flux to v0.12.0
2019-01-07 10:56:17 -07:00
Tim Yocum b2bc1cd315
Fixing date; capitalization of InfluxDB 2019-01-07 11:28:06 -06:00
Nathaniel Cook 7ecab55018 chore: update Flux to v0.12.0 2019-01-03 15:14:10 -07:00
Ben Johnson dd481f35df
Merge pull request #10599 from influxdata/sgc-check-utf8
Add -check-utf8 to verify sub-command
2019-01-02 13:29:43 -07:00
Stuart Carnie 8aba6f73a5
feat(influx_inspect): Add -check-utf8 to verify sub-command 2018-12-21 10:44:43 -07:00
Ryan Betts 38b07bbaab
Merge pull request #10597 from influxdata/announce
Add repo change announcement to readme
2018-12-21 11:29:26 -05:00
Ryan Betts d7fdd7d296 Add repo change announcment to readme 2018-12-21 10:19:21 -05:00
Hercules Mango Churchill 7db3db278b Update changelog 2018-12-20 22:10:34 +00:00
Nathaniel Cook e0949fd691
Merge pull request #10590 from influxdata/flux-staging
build(flux): update to Flux v0.11.0
2018-12-20 15:10:16 -07:00
Dilan Bellinghoven 7666694cfc
services/http/handler_test.go: Added unit test to test for case when Store.Read() returns nil, nil 2018-12-19 17:57:43 -05:00
Stuart Carnie 216cfa329f feat(flux): Add user authentication and authorization support
* Add AuthorizeDatabase API to QueryAuthorizer to verify a user has
  appropriate access to the specified database
* Update serverFluxQuery handler to require a meta.User when auth is
  enabled
* update Flux createFromSource and createBucketsSource dependencies to
  require Authorizer when auth is enabled in configuration
* update createFromSource to verify read permissions for each bucket
  specified in a Flux query
* update BucketsDecoder, which implements the buckets() Flux function,
  to return buckets that the user has read or write permissions to
* add unit tests to verify authentication is required for Flux HTTP
  requests when auth is enabled in configuration
2018-12-19 14:46:12 -07:00
Dilan Bellinghoven fa7cafea41
Fixed issue where nil reads.ResultSet.Close() is called resulting in a panic 2018-12-19 15:45:12 -05:00
Jonathan A. Sternberg ee86d75361
Merge pull request #10586 from influxdata/js-flux-update
Update flux to 0.11.0
2018-12-19 14:25:50 -06:00
Jonathan A. Sternberg 41a46166e3
Update flux to 0.11.0 2018-12-19 13:49:01 -06:00
Edd Robinson 8629d001c1
Merge pull request #10583 from influxdata/er-fix-utf8-fields
Fix invalid UTF-8 fields error
2018-12-19 17:28:34 +00:00
Edd Robinson 77fe5a9a62 Treat fields and measurements as raw bytes 2018-12-19 14:38:50 +00:00
Edd Robinson 348dac1672 Add repro test case for UTF-8 issue 2018-12-19 14:38:31 +00:00
David Norton db8f51ff2f
Merge pull request #10578 from influxdata/dn-limit-name-len
Limit database and retention policy names to 255 characters
2018-12-18 12:55:49 -05:00
David Norton 8575378ae8 fix #10110: limit db & rp name length to 255 2018-12-17 16:58:28 -05:00
Ben Johnson b88d852c54
Merge pull request #10536 from influxdata/bj-limit-full-compaction
Limit force-full and cold compaction size.
2018-12-17 10:44:10 -07:00
tmgordeeva 95ac681c4b
Merge pull request #10572 from influxdata/tg-mixed-tests
tsdb: mixed shard tests
2018-12-14 14:37:19 -08:00
Stuart Carnie 0331214016 chore(platform): Update platform to resolve panic with group push down
influxdata/platform#1896
2018-12-13 11:33:13 -07:00
Tanya Gordeeva 0a39786ea7 tsdb: mixed shard tests
Specifically tests around the global index for fields with mixed shard types.
2018-12-13 08:31:49 -08:00
Nathaniel Cook 451ed5feed
Merge pull request #10569 from influxdata/flux-staging
build: update Flux to v0.9.0
2018-12-12 16:59:48 -07:00
Stuart Carnie 881f27fe6f fix(flux): Call storage API to correctly map group mode
This fix ensures group(mode:"by") is correctly pushed down to the
storage layer.
2018-12-12 13:03:33 -07:00
Nathaniel Cook 72876b1120 build: update Flux to v0.9.0 2018-12-12 12:57:54 -07:00
Nathaniel Cook d04a1b9e3e
Merge pull request #10561 from influxdata/flux-staging
chore: update Flux to v0.8.0
2018-12-12 09:28:47 -07:00
Stuart Carnie 23d1281b2a feat(influx_tools): Add gen-init and gen-exec commands
* gen-init initializes a database based on the provided CLI spec
* gen-exec generates the data for the target database based on the same
  CLI spec as gen-init
2018-12-12 07:38:21 -07:00