Commit Graph

13360 Commits (733d8428126d77a84c92f768114e3a98ce891c48)

Author SHA1 Message Date
Jonathan A. Sternberg 733d842812 Turn the ExecutionContext into a context.Context
Along with modifying ExecutionContext to be a context and have the
TaskManager return the context itself, this also creates a Monitor
interface and exposes the Monitor through the Context. This way, we can
access the monitor from within the query.Select method and keep all of
the limits inside of the query package instead of leaking them into the
statement executor.

An eventual goal is to remove the InterruptCh from the IteratorOptions
and use the Context instead, but for now, we'll just assign the done
channel from the Context to the IteratorOptions so at least they refer
to the same channel.
2018-03-08 14:03:20 -06:00
Jonathan A. Sternberg ed27a00255
Merge pull request from influxdata/js-remove-query-prefix
Rename some of the structs and interfaces in the query package
2018-03-07 18:00:37 -06:00
Gershon Shif 6ac835404e
Merge pull request from influxdata/gs-change-log-update
Updated CHANGELOG.md to the GA released date - 2017-03-06
2018-03-06 11:31:00 -08:00
Gershon Shif 356e9523d2 Updated CHANGELOG.md to the GA released date - 2017-03-06 2018-03-06 11:24:48 -08:00
Hercules Mango Churchill 48d1cc5839 Update changelog 2018-03-06 18:42:54 +00:00
Ben Johnson 548e244a8b
Merge pull request from influxdata/bj-fix-missing-store-unlock
Fix missing Store.Close() unlock.
2018-03-06 11:42:36 -07:00
Ben Johnson d0688201ba
Fix missing Store.Close() unlock. 2018-03-06 10:36:44 -07:00
Hercules Mango Churchill f627a2d48d Update changelog 2018-03-05 22:27:25 +00:00
Ben Johnson 520dbc142b
Merge pull request from influxdata/bj-fix-tsi-recovery
Fix TSI log file recovery.
2018-03-05 15:27:08 -07:00
Ben Johnson 8e62e8d3bd
Fix TSI log file recovery. 2018-03-05 14:49:12 -07:00
Stuart Carnie 044ca2ac89 ensure ENV overrides are applied when configuring logging
Additionally, the config file is only parsed once.
2018-03-03 07:38:15 -07:00
Jonathan A. Sternberg de4390ae83 Rename some of the structs and interfaces in the query package
Remove the `Query` prefix from some structs and interfaces. They were
there so when the query engine was in the same package as influxql,
these would be differentiated. Now that the package name is query, the
extra prefix seems redundant.
2018-03-02 09:44:12 -06:00
Hercules Mango Churchill af1c35b4a2 Update changelog 2018-02-28 15:49:18 +00:00
Ben Johnson fb3187f62f
Merge pull request from influxdata/bj-fix-series-key-replay-after-delete
Fix panic on tsi1 log replay of deleted series.
2018-02-28 08:37:07 -07:00
Hercules Mango Churchill 3fa3af4e1b Update changelog 2018-02-28 15:22:12 +00:00
Jonathan A. Sternberg 87ac8ad385
Merge pull request from influxdata/js-9290-index-boolean-literals
Evaluate a true boolean literal when calculating tag sets
2018-02-28 09:14:24 -06:00
Ben Johnson 567a35d364
Fix panic on tsi1 log replay of deleted series. 2018-02-28 08:06:30 -07:00
Jonathan A. Sternberg 6baf354818 Evaluate a true boolean literal when calculating tag sets 2018-02-28 08:08:21 -06:00
Hercules Mango Churchill 6a83bf4e39 Update changelog 2018-02-28 14:06:33 +00:00
Jonathan A. Sternberg 8240008ceb
Merge pull request from influxdata/js-9271-implicit-timerange-end-subquery
Fix the implicit time range in a subquery
2018-02-28 08:06:15 -06:00
Edd Robinson 3086f02b2e
Merge pull request from influxdata/er-time-test
Support less granular mtime in LastModified test
2018-02-28 10:14:39 +00:00
Jason Wilder 4eaae6111e
Merge pull request from influxdata/jw-tagsets-contains
Skip creating cursors for series not in a shard
2018-02-27 21:47:49 -07:00
Stuart Carnie 3547331f54
Merge pull request from influxdata/sgc-logging
use child logger
2018-02-27 21:41:14 -07:00
Jason Wilder 2896d210af Skip creating cursors for series not in a shard
There was a check in inmem TagSets to see if a series was assigned
to a shard to prevent cursors for non-existent series getting created.
This check was lost during TSI development because inmem Series tracking
was removed and then replaced with bitsets.  The bitsets were not
re-incorporated as before.  This adds the functionality back using
the bitsets.
2018-02-27 21:23:59 -07:00
Stuart Carnie e493a3e1db use child logger 2018-02-27 20:27:24 -07:00
Jonathan A. Sternberg 9e122eb1a4 Fix the implicit time range in a subquery
The implicit time range for an interval is supposed to be now when no
end is specified. In a subquery though, the interval doesn't exist and
so it doesn't set the end time to now, but to the max time. Since the
subquery qualifies as something that should have the implicit end time
apply, this results in a query that runs slowly because it is filling in
a bunch of unasked for intervals if a fill is specified.

This hack adds the implicit end time if it sees the parent query's end
time is set to the maximum available time.

This is a temporary fix for this problem. The query compilation should
perform these time range calculations in the compilation stage and the
subqueries should use the compilation stage during execution instead of
ignoring it. That work takes a lot more effort though and is more prone
to running into unforeseen bugs.

This fix introduces a subtle, but likely rare to run into bug. If the
top level query specifies the maximum time as the end time and the
subquery has an interval, the subquery should use the end time rather
than now as the time range. With this hack, it will interpret it as an
implicit time rather than an explicit one. This is unlikely to matter
though.
2018-02-27 17:10:10 -06:00
Hercules Mango Churchill 8fa9f0f681 Update changelog 2018-02-27 16:26:59 +00:00
Ben Johnson fee6149791
Merge pull request from influxdata/bj-dumptsi-cardinality
Add dumptsi path error handling.
2018-02-27 09:15:03 -07:00
Edd Robinson 45af822200 Support less granular mtime 2018-02-27 16:12:59 +00:00
Stuart Carnie 48fb2a4cc5
Merge pull request from influxdata/sgc-tagsets
fallback to inmem TagSets implementation
2018-02-27 09:06:54 -07:00
Hercules Mango Churchill bf88bbc232 Update changelog 2018-02-27 15:48:57 +00:00
Edd Robinson 863fe59de7
Merge pull request from influxdata/er-inmem-startup
Improve startup time of inmem index
2018-02-27 15:48:40 +00:00
Ben Johnson b3fcc63a78
Add dumptsi path error handling. 2018-02-27 08:30:12 -07:00
Stuart Carnie b72e0c5941 fallback to inmem TagSets implementation 2018-02-27 07:49:51 -07:00
Edd Robinson 96c0ecf618 Improve startup time of `inmem` index
This commit improves the startup time when using the `inmem` index by
ensuring that the series are created in the index and series file in
batches of 10000, rather than individually.

Fixes .
2018-02-27 13:33:00 +00:00
Stuart Carnie 632e01e068
Merge pull request from influxdata/sgc-logging-key
prefix with `tsm1_` for consistency
2018-02-26 13:17:33 -07:00
Stuart Carnie b03cf6a953 prefix with `tsm1_` for consistency 2018-02-26 13:00:03 -07:00
Stuart Carnie c71edd79f8
Merge pull request from influxdata/sgc-log-keys
rename + namespace keys, fix doc comment
2018-02-26 11:27:23 -07:00
Stuart Carnie a74d296200 use underscore vs period, fix doc comment, add database name to CQ 2018-02-26 10:08:43 -07:00
Jason Wilder 89a88d218e
Merge pull request from influxdata/sgc-tsi-series-ordering
series keys are produced in ascending order
2018-02-22 14:01:17 -07:00
Stuart Carnie 0a5a07dc3a series keys are produced in ascending order 2018-02-22 13:08:36 -07:00
Hercules Mango Churchill 01288bdb08 Update changelog 2018-02-21 22:33:40 +00:00
Jonathan A. Sternberg 5888cc8331
Merge pull request from influxdata/js-log-config-and-query-executor
Update sample config with information on logging levels
2018-02-21 16:25:51 -06:00
Stuart Carnie d40d3ecc2e
Merge pull request from influxdata/sgc-logging
Generate trace logs for a number of important InfluxDB operations
2018-02-21 15:09:18 -07:00
Stuart Carnie d135aecf02 Generate trace logs for a number of significant influx operations
* tsdb Store.Open traces all events related to opening files
    * op.name : tsdb.open
* retention policy shard deletions
    * op.name : retention.delete_check
* all TSM compaction strategies
    * op.name : tsm1.compact_group
* series file compactions
    * op.name : series_partition.compaction
* continuous query execution (if logging enabled)
    * op.name : continuous_querier.execute
* TSI log file compaction
    * op_name: index.tsi.compact_log_file
* TSI level compaction
    * op.name: index.tsi.compact_to_level
2018-02-21 15:08:49 -07:00
Jason Wilder 448a114559
Merge pull request from influxdata/jw-engine-trace
Remove noisy trace logging in TSM engine
2018-02-21 14:37:21 -07:00
Jason Wilder fd90ec2b04 Remove noisy trace logging in TSM engine
This logging is noisy and allocates a lot of garbage.  There are
stats now that have the same information.
2018-02-21 12:51:01 -07:00
Jonathan A. Sternberg 426b6ee151 Update sample config with information on logging levels
Update the query executor to log a message using the style guide. The
actual message is static and the query is now in a context field.
2018-02-21 11:25:38 -06:00
Hercules Mango Churchill 290717bd04 Update changelog 2018-02-21 16:55:35 +00:00
Jason Wilder a865e14455
Merge pull request from influxdata/jw-cur-close
Make closing TSM cursors idempotent
2018-02-21 09:34:13 -07:00