Commit Graph

12174 Commits (4a87662d60eb469e190d80a32d3bcdae76d4a83c)

Author SHA1 Message Date
Jonathan A. Sternberg 21856e66c7 Merge pull request #8289 from influxdata/js-8266-top-bottom-group-by-time
top() and bottom() now returns the time for every point
2017-04-26 15:21:59 -05:00
Jonathan A. Sternberg be3bce5212 top() and bottom() now returns the time for every point
`top()` and `bottom()` will now organize the points by time and also
keep the points original time even when a time grouping is used. At the
same time, `top()` and `bottom()` will no longer honor any fill options
that are present since they don't really make sense for these specific
functions.

This also fixes the aggregate and selectors to honor the ordered
iterator option so iterator remain ordered and to also respect the
buckets that are created by the final dimensions of the query so that
two buckets don't overlap each other within the same reducer. A test has
been added for this situation. This should clarify and encourage the use
of the ordered attribute within the query engine.
2017-04-26 15:07:10 -05:00
Jonathan A. Sternberg 4776b216a4 Merge pull request #8253 from influxdata/js-8065-restrict-top-bottom-query
Restrict top() and bottom() selectors to be used with no other functions
2017-04-26 15:06:30 -05:00
Jason Wilder 4db3b69b9d Update to go1.8.1 2017-04-26 11:32:42 -06:00
Jason Wilder 8ca2a0e045 Remove old docker stuff
Official images are maintined at https://github.com/influxdata/influxdata-docker
2017-04-26 11:25:46 -06:00
Jason Wilder 21b48ca8b7 Remove old packaging script
Not used an very out of date
2017-04-26 11:24:07 -06:00
Ryan Betts 30d941d4e7 Merge pull request #8306 from influxdata/js-8273-remove-the-admin-ui
Remove the admin UI
2017-04-26 10:10:13 -07:00
Regan Kuchan 801c6d18bf Update CONTRIBUTING with InfluxData Community link 2017-04-25 18:48:42 -07:00
Jonathan A. Sternberg 1300f4cc6c Remove the admin UI 2017-04-25 16:58:24 -05:00
Ben Johnson aa64c908d0 Merge pull request #8314 from benbjohnson/tsi-doc
Add TSI documentation
2017-04-24 10:58:31 -06:00
Ben Johnson ba7108f94e
Add TSI documentation. 2017-04-21 14:45:03 -06:00
Jason Wilder fce183f21a Merge pull request #8305 from influxdata/jw-wal
Optimize WAL segment reading
2017-04-20 14:36:47 -06:00
Jason Wilder d88604f6f2 Move repetive loop checks outside of values loop 2017-04-20 13:45:04 -06:00
Jason Wilder 888689f5d3 Move values loop under type switch
All the values read must be of the same type so repeatedly using
the type switch is confusing and less efficiient.
2017-04-20 13:39:49 -06:00
Jason Wilder b0988511bf Use fixed size array instead of slice 2017-04-20 13:38:33 -06:00
Jason Wilder da6bdfdda8 Use bufio.Reader when reading wal segments
Reduces disk IO due to small reads.
2017-04-20 13:33:42 -06:00
Jason Wilder 8e9cbd7ffc Simplify WALSegmentReader.UnmarshalBinary
There were two loops over nvals which created some extra allocation
which coudl be replaced with a simplet slice capacity and append.
2017-04-20 13:33:42 -06:00
Jason Wilder 4da7054221 Merge pull request #8302 from influxdata/jw-writes2
Write throughput/concurrency improvements
2017-04-20 13:23:24 -06:00
Jason Wilder 71825d20c8 Update changelog 2017-04-20 12:31:06 -06:00
Jason Wilder 02b663b651 Fix lock contention in Index.CreateSeriesListIfNotExists
There was contention on the write lock which only needs to be acquired
when checking to see if the log file should be rolled over.
2017-04-20 12:28:42 -06:00
Jason Wilder 40ec85aacd Fix lock contention in LogFile.SeriesWithBuffer
Under high write load, the check for each series was done sequentially
which caused a lot of CPU time to acquire/release the RLock on LogFile.

This switches the code to check multiple series at once under an RLock
similar to the chang for inmem.
2017-04-20 12:28:42 -06:00
Jason Wilder 0e715b5b74 Reduce lock contention on MeasurementFields 2017-04-20 12:28:42 -06:00
Jason Wilder ef65ee77f4 Switch WAL byte pools to sync/pool
The current bytes.Pool will hold onto byte slices indefinitely. Large
writes can cause the pool to hold onto very large buffers over time.
Testing w/ sync/pool seems to perform similarly now so using a sync/pool
will allow these buffers to be GC'd when necessary.
2017-04-20 12:28:42 -06:00
Jason Wilder d155d37ca8 Reduce TSM write buffer
When many TSM files are being compacted, the buffers can add up fairly
quickly.
2017-04-20 12:28:42 -06:00
Jason Wilder 3c2825a851 Reduce lock thrashing when checking series
The inmem index would call CreateSeriesIfNotExist for each series
which takes and releases and RLock to see if a series exists. Under
high write load, the lock shows up in profiles quite a bit.  This
adds a filtering step that obtains a single RLock and checks all the
series and returns the non-existent series to contine though the slow
path.
2017-04-20 12:28:41 -06:00
Jason Wilder 8aeda47a8e Avoid growing slice when mapping points to shards 2017-04-20 12:28:41 -06:00
Jason Wilder d7c5dd0a3e Reduce wal sync goroutine churn
Under high write load, the sync goroutine would startup, and end
very frequently.  Starting a new goroutine so frequently adds a small
amount of latency which causes writes to take long and sometimes timeout.

This changes the goroutine to loop until there are no more waiters which
reduce the churn and latency.
2017-04-20 12:28:34 -06:00
Jason Wilder aa9925621b Fix deadlock in wal
If the sync waiters channel was full, it would block sending to the
channel while holding a the wal write lock.  The sync goroutine would
then be stuck acquiring the write lock and could not drain the channel.

This increases the buffer to 1024 which would require a very high write
load to fill as well as retuns and error if the channel is full to prevent
the blocking.
2017-04-19 11:33:13 -06:00
Jason Wilder a19ce9c10f Reduce index lock contention
Series and Measurment have their own locks and we do not need to
hold locks on the index while using those types.
2017-04-18 16:32:33 -06:00
Jason Wilder 883b3dcbbb Reduce lock content in AssignShard
The lock shows up under write load.  It only needs to be assigned
once so a read lock eliminates the contention.
2017-04-18 16:32:33 -06:00
Jason Wilder eeaad877bc Merge pull request #8297 from influxdata/jw-merge-123
Merge 1.2.3 changes to master
2017-04-17 09:18:46 -06:00
Jason Wilder 5c51ae7319 Merge branch '1.2' into jw-merge-123 2017-04-14 14:36:54 -06:00
Cory LaNou e6e5968c3a Merge pull request #8294 from influxdata/cjl-cli-redact-password-history
Cherry Pick sanitize passwords in CLI history
2017-04-14 13:38:10 -05:00
Ryan Betts 7e6bd5be6b Fix spelling mistake in HTTP section of config (influxdb#8231)
Fixes plutonium#1198
2017-04-14 14:26:31 -04:00
Cory LaNou 8c0f5a7dbe
redact passwords before saving history in cli 2017-04-14 13:13:56 -05:00
Ryan Betts f1882ae705 Fix spelling mistake in HTTP section of config (influxdb#8231) 2017-04-14 14:13:44 -04:00
Jonathan A. Sternberg 57a2abbc87 Restrict top() and bottom() selectors to be used with no other functions 2017-04-14 10:23:07 -05:00
Cory LaNou 0572f14a5c Merge pull request #8293 from influxdata/cjl-1.2-fixes
Cherry Pick Security Fixes to 1.2
2017-04-13 15:25:44 -05:00
Cory LaNou 775c5d243d Add changelog for 8187 2017-04-13 13:33:25 -05:00
Cory LaNou 215b5fc89c Add HasDefaultDatabase interface to several statements 2017-04-13 13:32:17 -05:00
Cory LaNou 31db9d6f46 Merge pull request #8292 from influxdata/cjl-changelog-8187
Add changelog for 8187
2017-04-13 13:30:30 -05:00
Cory LaNou f96b59ed20 Add changelog for 8187 2017-04-13 10:31:31 -05:00
Cory LaNou 4ca132765b Merge pull request #8187 from influxdata/cjl-create-subscription-add-default-database
Several statements were missing the DefaultDatabase method
2017-04-12 16:57:19 -05:00
Cory LaNou 9060a2a5ff
Add HasDefaultDatabase interface to several statements 2017-04-12 13:41:28 -05:00
Jonathan A. Sternberg c64524b6b0 Merge pull request #8279 from influxdata/js-junit-test-output
Use go junit formatter to output tests in junit format on CircleCI
2017-04-12 10:13:04 -05:00
Jonathan A. Sternberg d653b76b5b Merge pull request #8282 from influxdata/js-8281-influxql-select-tests
Fix influxql select tests
2017-04-11 15:05:08 -05:00
Jonathan A. Sternberg 48f1c0a013 Merge pull request #8258 from influxdata/js-8067-forbid-fill-none-linear-for-raw-values
Restrict fill(none) and fill(linear) to be usable only with aggregate queries
2017-04-10 20:52:32 -05:00
Jonathan A. Sternberg c6e1b83906 Fix influxql select tests
The inputs are now sent to the tested iterator in the correct order so
we can more accurately test each individual select statement.
2017-04-10 20:51:14 -05:00
Jonathan A. Sternberg a550d323c4 Restrict fill(none) and fill(linear) to be usable only with aggregate queries 2017-04-10 15:58:05 -05:00
Jonathan A. Sternberg 9d83e4626d Merge pull request #8267 from influxdata/js-8252-fix-or-condition-with-null-values
Implicitly cast null to false in binary expressions with a boolean
2017-04-10 15:54:23 -05:00