Commit Graph

1287 Commits (2a7abbab1fce8f9b34995c13f159f267c0f24499)

Author SHA1 Message Date
Tait Clarridge 45b3e61ac7 Add configurable shard duration to retention policies
Allows configuration of shard group duration at database creation, and retention
policy create/alter time.

Query examples:

```
CREATE DATABASE testdb WITH DURATION 90d SHARD DURATION 30m NAME rp_testdb
CREATE RETENTION POLICY rp_testdb2 ON testdb DURATION INF REPLICATION 1 SHARD DURATION 30m
ALTER RETENTION POLICY rp_testdb2 ON testdb SHARD DURATION 1h
```

This can be useful with long duration retention policies with lots of data, where
you can split into smaller shards to relieve memory pressure.
2016-03-24 00:25:49 -04:00
Ben Johnson a6d9930b6f limit series count in selection
This commit adds a configurable limit to the number of series that
can be returned from a `SELECT` statement. The limit is checked
immediately after planning and is determined by the use of iterator
stats.

Fixes #6076
2016-03-23 12:48:48 -06:00
Jason Wilder f233a8bac8 Update v0.11.0 release date 2016-03-23 09:35:52 -06:00
Jonathan A. Sternberg d85b7334cd Merge pull request #6081 from influxdata/js-6075-query-time-limit
Support a timeout for running queries in the query manager
2016-03-23 11:32:08 -04:00
Valeriy Simonov 938453b0dc Changelog update 2016-03-23 10:41:52 +05:00
Jonathan A. Sternberg b89edfd71c Fix the code that handles semicolons
This allows multiple semicolons in a row now and also requires that a
semicolon separate commands. The query specification says this is
required, but a boolean error in `ParseQuery` makes one semicolon
optional and multiple semicolons an error.

Fixes #5728.
2016-03-22 15:32:54 -04:00
Jonathan A. Sternberg 79fe4490c2 Support a timeout for running queries in the query manager
Include an interrupt iterator at the top level to interrupt the fill
iterator if it is producing too many points.

Fixes #6075.
2016-03-22 13:30:40 -04:00
Jonathan A. Sternberg a35d9602cd Fix where filters when a OR is used and when a tag does not exist
If an OR was used, merging filters between different expressions would
not work correctly. If one of the sides had a set of series ids with a
condition and the other side had no series ids associated with the
expression, all of the series from the side with a condition would have
the condition ignored. Instead of defaulting a non-existant series
filter to true, it should just be false and the evaluation of the one
side that does exist should take care of determining if the series id
should be included or not. The AND condition used false correctly so did
not have to be changed.

If a tag did not exist and `!=` or `!~` were used, it would return false
even though the neither a field or a tag equaled those values. This has
now been modified to correctly return the correct series ids and the
correct condition.

Also fixed a panic that would occur when a tag caused a field access to
become unnecessary. The filter using the field access still got created
and used even though it was unnecessary, resulting in an attempted
access to a non-initialized map.

Fixes #5152 and a bunch of other miscellaneous issues.
2016-03-22 12:19:06 -04:00
Jonathan A. Sternberg abae1cfed0 Limit the maximum number of concurrent queries
Fixes #6079.
2016-03-21 22:34:27 -04:00
Ben Johnson 7156c1f9bd add IteratorStats
This commit adds an `IteratorStats` that holds aggregate
iterator processing information. A method is also added to
`Iterator` to return the stats:

	Stats() influxql.IteratorStats

The remote iterators will also emit their stats in the point
stream upon first connection, on a given interval, and then
finally once the last point has been sent.
2016-03-21 16:25:19 -06:00
Jason Wilder ee2f21e76f Merge pull request #6082 from influxdata/jw-tsm
Fix partially written TSM files
2016-03-21 15:42:27 -06:00
Jason Wilder 7567453c9a Ensure TSM files are fsync'd
Make sure TSM files are fsync'd when closed and also that the parent
dir is fsync'd when they are renamed.
2016-03-21 15:03:52 -06:00
Jonathan A. Sternberg 504bac53a9 Update changelog for the query management feature 2016-03-21 12:40:56 -04:00
mvadu 8af9170c1d Add platform specific override for file rename.
In windows, it first deletes the target file (if it already exists).
2016-03-18 21:45:29 +05:30
Jonathan A. Sternberg e47426ff6e Support integer literals in the query language
Numbers in the query without any decimal will now be emitted as integers
instead and be parsed as an IntegerLiteral. This ensures we keep the
original context that a query was issued with and allows us to act more
similar to how programming languages are typically structured when it
comes to floats and ints.

This adds functionality for dealing with integers promoting to floats in
the various different places where math are used.

Fixes #5744 and #5629.
2016-03-17 10:37:34 -04:00
Gunnar c6ff2588d1 Merge pull request #6025 from influxdata/ga-remove-json
Remove deprecated JSON write path
2016-03-16 14:17:23 -07:00
Todd Persen 58d1c8ded0 Display results of multiple queries in Admin UI, Not just the first query. 2016-03-16 13:22:37 -07:00
gunnaraasen 773486ae35 Update CHANGELOG.md 2016-03-15 23:55:48 -07:00
Jason Wilder 0703b85589 Add 0.10.3 changelog entries
[ci skip]
2016-03-15 16:13:51 -06:00
Paul Dix ce8f994d55 Update CHANGELOG with 0.11 release notes 2016-03-15 14:40:36 -07:00
Edd Robinson e5a41f7796 DROP SHARD 2016-03-14 22:59:55 +00:00
David Norton a369ed8565 update CHANGELOG.md 2016-03-14 17:48:53 -04:00
Cory LaNou ba6a95e9bc Merge pull request #5994 from influxdata/single-server-lite
Single Server
2016-03-14 16:11:37 -05:00
Joe LeGasse 288ac64e9d updated changelog 2016-03-14 16:49:06 -04:00
Jason Wilder 348c468ea2 Update changelog 2016-03-14 12:38:02 -06:00
Ben Johnson ea37ed98e5 CHANGELOG 2016-03-14 16:55:54 +00:00
Vidhuran Harichandra Babu 90b9291953 Removed condition to check if values are returned for queries so that the admin ui displays the same results as cli.
Fixes #4688
2016-03-11 06:29:19 +02:00
Jason Wilder db9d403fd1 Update changelog
[ci skip]
2016-03-10 09:08:25 -07:00
Jason Wilder 998cb0a6a2 Merge pull request #5963 from influxdata/jw-deadlock
Fix possible deadlock
2016-03-10 09:01:31 -07:00
Jason Wilder f020547d60 Update changelog 2016-03-09 17:42:06 -07:00
Jonathan A. Sternberg a55896a555 Merge pull request #5956 from influxdata/js-2715-allow-regex-for-field-values
Support using field regex comparisons in the WHERE clause
2016-03-09 17:38:39 -05:00
Edd Robinson 58c03448aa Merge pull request #5514 from influxdata/er-engine-panic
Ensure shards and engine are safely closed
2016-03-09 18:56:36 +00:00
Jonathan A. Sternberg 4ba3386679 Support using field regex comparisons in the WHERE clause
Fixes #2715.
2016-03-09 13:21:24 -05:00
Jonathan A. Sternberg 546de3f7cb Return error message when improper types are used in SELECT
Fixes #5949.
2016-03-09 11:36:18 -05:00
Ben Johnson 41dde61226 SHOW SERIES 2016-03-08 11:47:57 -07:00
Joe LeGasse af967a3cac Fix b1 conversion regression added in 0.10.2
Fixes #5924
2016-03-08 11:17:59 -05:00
Todd Persen 31d5f13e86 Update CHANGELOG.md 2016-03-07 17:17:19 -08:00
Jonathan A. Sternberg 2f0e246757 Implemented the tag values iterator for `SHOW TAG VALUES`
`SHOW TAG VALUES` output has been modified to print the measurement name
for every measurement and to return the output in two columns: key and
value. An example output might be:

    > SHOW TAG VALUES WITH KEY IN (host, region)
    name: cpu
    ---------
    key     value
    host    server01
    region  useast

    name: mem
    ---------
    key     value
    host    server02
    region  useast

`measurementsByExpr` has been taught how to handle reserved keys (ones
with an underscore at the beginning) to allow reusing that function and
skipping over expressions that don't matter to the call.

Fixes #5593.
2016-03-06 09:52:34 -05:00
Jason Wilder a937e8af98 Add 0.10.2 changelog entries
[ci skip]
2016-03-03 15:38:42 -07:00
Joe LeGasse acd2e1eb51 influx_tsm: Properly limit blocks per key per TSM file
This should fix #5865

This commit also removes the dependecy on the influxql package constants
that were used to write b1 and bz1 files and have changed since the
release of 0.10
2016-03-03 09:05:32 -05:00
Joe LeGasse 92955fa701 Updated CHANGELOG
Fixes #5880
2016-03-02 13:03:10 -05:00
Jason Wilder 6bbd09ed94 Update changelog 2016-03-01 21:23:28 -07:00
Jason Wilder e3fef5593c Merge pull request #5855 from jonseymour/jss-5854-go-master-breaks-build
fix tests to cope with future changes to testing.quick.Check - see #5854
2016-03-01 19:03:21 -07:00
Mark Rushakoff cdcb079769 Tag TSM stats with database, retention policy
... by extracting the db/rp from the given path.

Now that the code has "standardized" on extracting db/rp this way, the
ShardLocation struct is no longer necessary and thus has been removed.
We're back on the previous style of passing the path and walPath to
NewShard.
2016-02-29 09:17:34 -08:00
Jon Seymour a01d02066d Update CHANGELOG for issue #5854 (PR #5855)
Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2016-02-29 20:37:51 +11:00
Ben Johnson 16eea8eecc add SeriesList marshaling 2016-02-25 15:38:16 -07:00
Jason Wilder 8d70d65a82 Convert time.Time to int64 2016-02-25 15:15:01 -07:00
Jon Seymour ddcb92c8db Update CHANGELOG for #5832.
Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2016-02-26 07:59:18 +11:00
Jason Wilder 76dc958db0 Update changelog
[ci skip]
2016-02-25 09:20:49 -07:00
Ross McDonald 2b66f521fa Updated changelog for build updates. 2016-02-25 09:42:20 -06:00