1e1c1f72e4
Merge pull request #9111 from influxdata/js-encode-duration-as-string
...
Encode durations as a string so they are more user-friendly
2017-11-14 11:08:35 -06:00
db551f5489
Merge pull request #9103 from influxdata/mr-14-changelog
...
Update changelog for 1.4.1
2017-11-14 08:35:58 -08:00
332de90f9d
Encode durations as a string so they are more user-friendly
2017-11-14 10:35:10 -06:00
711da24562
Update changelog for 1.4.1
2017-11-14 08:15:57 -08:00
56a8929347
Merge pull request #9104 from influxdata/sgc-ifql
...
fix descending queries and ranges
2017-11-13 18:18:23 -07:00
2e04e871c9
fix descending queries
...
* did not handle cached values correctly
* sort shards by time in either ascending or descending
order depending on the RPC request ordering to ensure they
are traversed in the correct order.
2017-11-13 17:14:36 -08:00
48e21e6fc8
Merge pull request #9084 from influxdata/jw-delete-time
...
Handle high cardinality deletes in TSM engine
2017-11-13 14:39:54 -07:00
a8646b6d4d
Update changelog
...
[ci skip]
2017-11-13 14:33:47 -07:00
ca5a773c34
Initial jenkinsfile
2017-11-13 14:02:23 -06:00
8b18cc4456
Optimize deletes in tsi
...
The DropSeries code path ended up creating a MeasurementSeriesIterator
for each dropped series, this was too expensive just to see if a
series exists.
This adds a HasSeries func and fixes and issue where TSI files were
compacted while an iterator was still in use causing a panic.
2017-11-13 12:35:38 -07:00
ae0b28a583
Merge pull request #9098 from influxdata/sgc-ifql
...
rename config section to ifql
2017-11-13 12:10:50 -07:00
40ffa49a62
rename config section to ifql
...
Renaming for discoverability for the initial release of ifql
2017-11-13 11:05:02 -08:00
080b2ec781
Merge pull request #9096 from influxdata/js-zap-lock-writer
...
Lock the zap write output to avoid race conditions when logging
2017-11-13 10:39:42 -06:00
a1329cc0cb
Merge pull request #9095 from stop-start/fix-shell-ignores-extra-parameters
...
shell shows error and usage when given extra parameters
2017-11-13 08:25:47 -08:00
2123fc3b04
changelog
2017-11-13 18:24:01 +02:00
75e142c41a
use of flag.Args instead of flag.NArg
2017-11-13 18:07:00 +02:00
5763d01613
Fix brtfs docker build messages
2017-11-13 09:02:10 -07:00
c0631c2b95
Fix temp tombstone files leaking
2017-11-13 09:02:10 -07:00
13692639cb
Fix create/delete series race
...
This fixes a race where writes and deletes to the same series and
measurements could sometimes leave the index in an inconsistent state.
2017-11-13 09:02:10 -07:00
04f4c3e993
Optimize bytesutil.Pack
2017-11-13 09:02:10 -07:00
80cd5e63af
Optimize DeleteSeriesRange
...
This removes more allocations and speeds up some critical sections.
2017-11-13 09:02:10 -07:00
aee395d3bd
Make DeleteSeriesRange take SeriesIterator
2017-11-13 09:02:10 -07:00
f893beb6d8
Use MeasurementSeriesKeysByExprIterator for deletes
2017-11-13 09:02:10 -07:00
16d1f4309b
Extract MeasurementSeriesKeysByExprIterator
2017-11-13 09:02:10 -07:00
000768371f
Optimized deletes in TSM index
...
This optimizes how deletes are processed to reduce memory usage
and improve efficiency.
2017-11-13 09:02:08 -07:00
eebd88f825
Don't write tombstones for keys that do not exist
...
This filters out keys that do not exist in a TSM file to avoid
writing entries that would end up being ignored when applied.
2017-11-13 08:50:07 -07:00
ca4998f29e
Fix pid test to ignore local data
...
If you have lots of data stored locally, this test takes a while to
complete since it loads it all up from the users home dir.
2017-11-13 08:50:07 -07:00
88c48ec78b
Rework Engine.DeleteSeriesRange to avoid allocations
...
This removes the containsSeries func which ends up creating a map
sized to the slice of keys passed in. This doesn't scale well to
high cardinalities and creates a lot of garbage.
2017-11-13 08:50:07 -07:00
cb658774bb
Reduce allocations when reading tombstone v4
2017-11-13 08:50:07 -07:00
1c65bb3bb1
Fix leaked goroutine in FileStore.WalkKeys
...
If fn returned and error, the goroutines sending keys from TSM files
would get blocked indefinitely and leak.
2017-11-13 08:50:07 -07:00
b0c7a44eaa
Adjust min/max time to work in the engine
...
The query language min and max times are slighly different than the
values used in the engine. This allows faster codes to be used when
the whole time range is deleted.
2017-11-13 08:50:07 -07:00
2959b8d2eb
Make BatchDeleters concurrent
2017-11-13 08:50:07 -07:00
5a775c50d9
Add DeleteRangeWith
...
This is a version of DeleteRange that take a func predicate to determine
whether a series key should be deleted or not. This avoids the large
slice allocations with higher cardinalities.
2017-11-13 08:50:07 -07:00
de5592cda9
Extract ParseKeyBytes from ParseKey
...
Allows callers to use []byte and avoid a string allocation
2017-11-13 08:48:03 -07:00
6b19d2b673
Add BatchDeleters type
2017-11-13 08:48:03 -07:00
9ac83601cf
Use BatchDeleter in FileStore
2017-11-13 08:48:03 -07:00
4ed19348fd
Add a BatchDelete capability to TSMReader
2017-11-13 08:48:03 -07:00
44e782f173
Store temporary tombstones on disk
...
This removes the in-memory tombstone buffer when writing tombstones
which eliminates one source of large memory spikes during deletes.
2017-11-13 08:48:03 -07:00
bd15d37c70
Extract commit func
2017-11-13 08:48:03 -07:00
1e56894097
Extract writeTombstone func
2017-11-13 08:48:03 -07:00
b958c68ce5
Avoid re-reading tombstones when writing new ones
...
This adds a new v4 tombstone format that extends the v3 format
by allowing multiple batches of tombstones to be written without
having to re-read all the existing tombstones. This uses gzip
multi stream to append multiple v3 files together to create a v4
format.
2017-11-13 08:48:03 -07:00
17bae05370
Allow buffering tombstones before writing to disk
2017-11-13 08:48:03 -07:00
7757b827c4
Lock the zap write output to avoid race conditions when logging
2017-11-13 09:42:53 -06:00
1c256e1441
shell shows error and usage when given extra parameters
2017-11-13 17:06:58 +02:00
7cae889b13
Merge pull request #9055 from influxdata/js-update-zap-logger
...
Update the zap logger dependency
2017-11-10 22:01:00 -06:00
0b7c56bcd8
Update the zap logger dependency
...
The previous sha was taken from a revision on a devel branch that I
thought would continue staying in the tree after it was merged. That
revision was rebased away and the API was changed for the logger.
This updates the usage of the logger and adds a simple package for
constructing the base logger.
The 1.0 version of zap changed the format of the default console logger
so this change moves over to this new logger instead of attempting to
retain backwards compatibility with the old format.
2017-11-10 16:27:16 -06:00
ef42c367f0
Merge pull request #9091 from influxdata/sgc-ifql
...
don't panic here; nil cursor is handled for now. fixes #9090
2017-11-10 11:25:45 -07:00
57677be010
don't panic here; nil cursor is handled for now. fixes #9090
2017-11-10 11:21:31 -07:00
fe35aee4c4
Merge pull request #9086 from influxdata/jw-points-panic
...
Fix panic: runtime error: slice bounds out of range
2017-11-09 08:50:55 -07:00
ed246db55a
Fix panic: runtime error: slice bounds out of range
...
Fixes #8538
2017-11-08 17:00:25 -07:00
Jonathan A. Sternberg
Mark Rushakoff
Stuart Carnie
Jason Wilder
Jason Wilder
e-wave