Commit Graph

12694 Commits (ed2ff3b40136c614ef2a7365c92174c851e4a192)

Author SHA1 Message Date
Ben Johnson d17d0f18e0
Move copyBytes() and copyByteSlices() to bytesutil. 2017-10-18 07:19:46 -06:00
Jason Wilder a6f4069ca7 Fix max select series limit for tsi
TSI did not check that the max select series limit during planning
the same way that inmem did.  This means that the limit could be
set but the planning of a high cardinality query would still OOM
the server.  This fixes that limit as well as makes the query interruptible
during planning.
2017-10-17 15:24:41 -06:00
Ben Johnson dceb88eb30
Copy returned bytes from TSI meta functions. 2017-10-17 14:05:35 -06:00
Jason Wilder 049a9a859d Merge pull request #8949 from influxdata/jw-engine-fixes
Engine race fixes
2017-10-16 11:14:30 -06:00
Jason Wilder 4f8580fbaa Fix race in disableLevelCompactions
There was a race on the WaitGroup where we could end up calling Add
while another goroutine was still waiting.  The functions were confusing
so they have been simplified a bit since the compactions goroutines
have been reworked a lot already.
2017-10-16 10:50:16 -06:00
Jason Wilder 5033783a33 Handle deleted series when rebuilding measurment index 2017-10-16 10:50:16 -06:00
Jason Wilder e683502dd6 Merge pull request #8961 from lrita/master
remove duplicated code in cacheKeyIterator.encode()
2017-10-16 10:17:32 -06:00
Jason Wilder bc360ccfd5 Merge pull request #8970 from influxdata/jw-wal-panic
Fix corrupted wal segment panic on 32 bit systems
2017-10-16 10:00:02 -06:00
Jason Wilder fb7135ddc8 Fix corrupted wal segment panic on 32 bit systems 2017-10-16 09:41:20 -06:00
Mark Rushakoff 5bf9191a82 Merge pull request #8954 from influxdata/mr-config-tests
Initial integration tests for config settings
2017-10-13 17:55:10 -07:00
Mark Rushakoff 4ed2e6f21e Minor cleanup 2017-10-13 17:28:24 -07:00
lrita 2f0aa4a420 remove duplicated code in cacheKeyIterator.encode() 2017-10-13 20:39:15 +08:00
Mark Rushakoff 84583edf97 Merge pull request #8956 from influxdata/mr-rpm-shadow-utils
Add rpm dependency on shadow-utils for useradd
2017-10-12 09:59:17 -07:00
Mark Rushakoff be0438ad36 Add rpm dependency on shadow-utils for useradd
Fixes #8951.
2017-10-12 09:13:01 -07:00
Stuart Carnie 85425e8d7f Merge pull request #8955 from influxdata/sgc-cleanup
remove unnecessary err value
2017-10-12 08:35:01 -07:00
Stuart Carnie a0848eac8c remove unnecessary err value
readKey never sets error, so it is always nil
2017-10-12 08:28:53 -07:00
Mark Rushakoff f3f1cc1064 Initial integration tests for config settings 2017-10-11 17:16:42 -07:00
Jason Wilder 6d93507389 Merge pull request #8942 from influxdata/jw-inspect
Add support for exact cardinality count to influx_inspect
2017-10-10 10:44:31 -06:00
Jason Wilder 00223fc55f Merge pull request #8940 from influxdata/jw-compact2
Only schedule one compaction per shard at a time
2017-10-10 10:05:36 -06:00
Mark Rushakoff 767583c31a Merge pull request #8944 from influxdata/mr-package-dir
Fix tarball packaging paths
2017-10-10 08:00:27 -07:00
Mark Rushakoff ed4a826e52 Fix tarball packaging paths
The releng scripts' tarballs had paths like `./usr/bin/influx` whereas
the build.py output had `./influxdb-1.3.5-1/usr/bin/influx`. Now the
releng scripts match the build.py output.
2017-10-09 15:55:05 -07:00
Jason Wilder c1b17114f5 Add time range summary 2017-10-09 14:35:30 -06:00
Jason Wilder 742c871302 Add exact counting
This adds a new flag -exact that will return exact counts instead of
estimates.  The default is to return estimates since exact counting
on a problem shard could consume a lot of memory.
2017-10-09 14:01:57 -06:00
Jason Wilder 2abd7bd1d8 Report shards in sorted shard ID order 2017-10-09 13:50:37 -06:00
Jason Wilder 1401950b10 Only schedule one compaction per shard at a time
The scheduling logic ended up favoring more backlogged shards
too much and would starved active, less backed up shards.  This
occurred because the scheduling kicks in once a second.  When it
runs, it schedules as many compactions as it can.  A backed up shard
would end up having more compactions to run during the loop an would
generally get to schedule them more frequently.

This now allows each shard to try and schedule one compaction at a time
which provides a more balanced approach.  At some point, we'll probably
want to more directly balanc the each shards backlog vs letting it happen
somewhat randomly.
2017-10-09 11:40:32 -06:00
Jonathan A. Sternberg a55dd0f50e Merge pull request #8938 from influxdata/js-uint-integration-tests
Add an integration test for writing the uint protocol and reading it
2017-10-09 12:24:46 -05:00
Jonathan A. Sternberg 194939bbfc Add an integration test for writing the uint protocol and reading it 2017-10-09 11:00:21 -05:00
Jonathan A. Sternberg e415d0b10f Merge pull request #8835 from influxdata/js-uint-write-protocol
Add uint support into the write protocol
2017-10-09 10:55:16 -05:00
Jason Wilder 0ea4615b4a Merge pull request #8934 from influxdata/jw-inspect
Update influx_inspect to report total cardinalities
2017-10-09 09:23:10 -06:00
Byungjin Park f8dd2423fe Fix mis-typing in README.md of UDP Service 2017-10-08 03:09:01 +09:00
Jason Wilder c69ad0978c Update influx_inspect to report total cardinalities
This updates the report command to be able to report cardinalities across
all dbs and shards
2017-10-06 16:00:20 -06:00
Mark Rushakoff 10c4276eeb Merge pull request #8931 from influxdata/mr-update-go
Update to next version of Go with security fixes
2017-10-06 08:51:32 -07:00
Jonathan A. Sternberg f292dda847 Merge pull request #8795 from silenceshell/patch-1
enclose url with params
2017-10-06 10:12:47 -05:00
Jonathan A. Sternberg 7f18eaa1d2 Merge pull request #8866 from influxdata/js-8690-fill-lower-limit
Implicitly decide on the lower limit for fill queries when none is present
2017-10-06 10:11:11 -05:00
Mark Rushakoff b3deccb187 Update to next version of Go with security fixes 2017-10-05 16:54:02 -07:00
Jason Wilder 7948befde5 Merge pull request #8930 from influxdata/jw-compact
Reduce allocation in tsmKeyIterator.Next
2017-10-05 15:15:15 -06:00
Jonathan A. Sternberg f20cab6e99 Implicitly decide on the lower limit for fill queries when none is present
This allows the query:

    SELECT mean(value) FROM cpu GROUP BY time(1d)

To function in some way that makes sense. The upper limit is implicitly
the `now()` starting time and the lower limit will be whichever interval
the lowest point falls into.

When no lower bound is specified and `max-select-buckets` is specified,
the query will only consider points that would satisfy
`max-select-buckets`. So if you have one point written in 1970, have
another point within the last minute, and then do the above query with
`max-select-buckets` being equal to 10, the older point from 1970 will
not be considered.
2017-10-05 15:56:44 -05:00
Mark Rushakoff 76f5a65938 Merge pull request #8928 from influxdata/mr-releng-manpage-test
Fix manpage test
2017-10-05 11:57:18 -07:00
Mark Rushakoff f1bcbdc36c Fix manpage test 2017-10-05 11:33:29 -07:00
Jonathan A. Sternberg 31d50ec15e Merge pull request #8926 from influxdata/js-uint-marshaling-support
Support marshaling unsigned points
2017-10-05 12:35:58 -05:00
Mark Rushakoff d4b38a25f1 Merge pull request #8924 from influxdata/mr-releng-windows-binary-names
Ensure Windows binaries have .exe suffix
2017-10-05 10:02:41 -07:00
Jonathan A. Sternberg 18cc515345 Support marshaling unsigned points 2017-10-05 11:44:27 -05:00
Mark Rushakoff d689ee904b Ensure Windows binaries have .exe suffix 2017-10-05 09:33:24 -07:00
Jonathan A. Sternberg 5f76f11ebc Merge pull request #8921 from influxdata/js-uint-client
Add support for uint64 in the clients
2017-10-05 10:58:03 -05:00
Jonathan A. Sternberg cdea0d21d3 Merge pull request #8922 from influxdata/js-uint-influx-inspect
Update influx inspect to support unsigned types
2017-10-05 10:46:00 -05:00
Jonathan A. Sternberg abf2649d3a Update influx inspect to support unsigned types 2017-10-05 10:26:14 -05:00
Jonathan A. Sternberg 2f47c3d28f Add support for uint64 in the clients 2017-10-05 09:35:06 -05:00
Jonathan A. Sternberg b5a248802e Merge pull request #8917 from influxdata/js-remove-makefile
Remove the unused Makefile
2017-10-05 09:13:03 -05:00
Jason Wilder 00a403f60e Reduce allocation in tsmKeyIterator.Next
This reuses some intermediate buffers and structs while compacting
files.
2017-10-04 17:35:56 -06:00
Mark Rushakoff b18561cd9d Merge pull request #8920 from influxdata/master_namingfix
Master namingfix
2017-10-04 13:50:24 -07:00