Commit Graph

10115 Commits (fd840f242c7a3afc90e9198d68b4a97225f78299)

Author SHA1 Message Date
Jason Wilder ca8b0ca143 Optimize locking in CreateFieldIfNotExists
Also remove some dead code that is no longer relevant with tsm.
2016-04-01 20:44:40 -06:00
Jason Wilder 3f4c5a5585 Fix race on measurementFields
Both Shard and Engine had the same reference to the measurementField map,
but they each protected it with their own locks.  This causes a race when
write and queries are occurring because writes can add new fields to the
map while queries are reading from it.

The fix moves the ownership to the Engine and provides protected accessors
to that Shard now users.  For the most parts, the access on shard were old
dead code.

Fixing the measurementFields map race created a new race on the internal
fields map.  This is now unexported and protected via MeasurementFields
exported funcs.

Fixes #6188
2016-04-01 18:57:01 -06:00
Jonathan A. Sternberg 43e3330480 Fix the reader iterator so it doesn't read the first point when creating the iterator 2016-04-01 17:31:28 -04:00
Jonathan A. Sternberg d45ca3741e Merge pull request #6183 from jonseymour/jss-use-go-1.4.3-in-builder-docker.sh
Use preferred go1.4.3 for docker images too.
2016-04-01 14:28:44 -04:00
Edd Robinson 1d6b38c803 Merge pull request #6181 from influxdata/er-fix-recreate-rp
Ensure ShardGroupDuration checked when recreating an RP
2016-04-01 15:30:59 +01:00
Jon Seymour f45263da91 Use preferred go1.4.3 for docker images too.
Some people (e.g. me!) use build-docker.sh to create docker images.

I got burnt by the go 1.5 performance issue because I didn't override
the default GO_VER variable.

This change sets the default to the same as used in the main build.

Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2016-04-01 22:37:01 +11:00
Edd Robinson 10b271968c Merge pull request #5329 from bIgBV/patch-1
Update README.md to include simple error handling.
2016-04-01 12:36:11 +01:00
Edd Robinson 712cc3f290 ShardGroup Duration is checked when recreating rp
Fixes #6178.
2016-04-01 11:59:41 +01:00
Cory LaNou 2f6340b496 Merge pull request #6158 from influxdata/restore-fixes
WIP - Restore fixes
2016-03-31 17:39:19 -05:00
Cory LaNou 9bd60c3e07 remove node.json as well, change where we check for raft.db in startup 2016-03-31 17:15:58 -05:00
Cory LaNou 7bda8102ac update changelog 2016-03-31 17:15:58 -05:00
Cory LaNou 6c6fe87a40 add error message if detecting raft.db file 2016-03-31 17:15:42 -05:00
Cory LaNou a961ff9ebf minor restore fixes; fsync meta snapshots 2016-03-31 17:15:42 -05:00
Jonathan A. Sternberg c7758c546a Merge pull request #6166 from influxdata/js-influxdb-client-chunked-output
Support chunked queries in the Go InfluxDB client
2016-03-31 17:06:23 -04:00
Jonathan A. Sternberg 8752d1b1e3 Support chunked queries in the Go InfluxDB client
Modify the CLI to always use chunked queries.
2016-03-31 15:30:43 -04:00
Jonathan A. Sternberg d9b32ea160 Ensure the query is always "killed" after it is finished
If the http.CloseNotifier didn't go off for some reason (and it's not
guaranteed to go off just because the HTTP connection is closed), the
query wouldn't get correctly recycled when chunked output was requested.

The query id in the query executor was also not being set correctly.
This seems to have been an oversight when merging the point limit
monitor.
2016-03-31 15:30:43 -04:00
Ben Johnson c8d59f5e00 Merge pull request #6138 from influxdata/js-3932-error-on-invalid-timestamp
Throw an error when time is compared to an invalid literal
2016-03-31 12:36:19 -06:00
Ben Johnson 1a753b9f00 Merge pull request #6180 from benbjohnson/clean-config
Remove old config options from sample config
2016-03-31 12:05:36 -06:00
Ben Johnson 6ec50975e5 remove old config options from sample config
This commit removes the entire `hinted-handoff` section and some
`meta` config options from the sample configuration file.

Fixes #6176
2016-03-31 11:46:00 -06:00
Jonathan A. Sternberg c193bde61c Throw an error when time is compared to an invalid literal
A bigger refactor of these functions is needed to support #3290, but
this will work for the more common case that someone uses double quotes
instead of single quotes when surrounding a time literal.

Fixes #3932.
2016-03-31 11:29:20 -06:00
Edd Robinson 7816d53915 Merge pull request #6177 from influxdata/er-fix-create-db
Check ShardGroup Duration when recreating database
2016-03-31 18:24:21 +01:00
Edd Robinson f68637205c Check ShardGroup Duration when recreating database
Fixes #6153
2016-03-31 18:11:50 +01:00
Edd Robinson 105bcd3bb3 Merge pull request #6174 from influxdata/er-fix-shard-duration
Let SHARD DURATION be specified in isolation
2016-03-31 17:54:42 +01:00
Jason Wilder 328b39ae9b Add v0.11.1 changelog entries
[ci skip]
2016-03-31 10:50:32 -06:00
Edd Robinson 9cd0bc65f5 Let SHARD DURATION be specified in isolation
Fixed #6152.
2016-03-31 17:42:50 +01:00
Jason Wilder 319a2d90db Merge pull request #6168 from influxdata/jw-locks
Fix write path lock contention
2016-03-31 10:35:34 -06:00
Jason Wilder 07e3215d11 Remove ununsed Series.match func 2016-03-31 10:19:46 -06:00
Jason Wilder 34f1f4a1fb Update changelog 2016-03-31 10:19:46 -06:00
Jason Wilder 40c4973423 Remove per measurement stats collection
The stats setup ends up creating a lot of lock contention which signifcantly
impacts write throughput when a large number of measurements are used.

Fixes #6131
2016-03-31 10:19:27 -06:00
Jason Wilder f1bb87d4f8 Convert index write lock to series lock 2016-03-31 10:19:27 -06:00
Ross McDonald 86385f9930 Merge pull request #6172 from influxdata/ross-gh6110
Re-add RPM upgrade logic for 0.9 branch
2016-03-31 11:15:53 -05:00
Ben Johnson 497ff7643c Merge pull request #6173 from benbjohnson/init-merge-iterator
Mark MergeIterator as initialized
2016-03-31 10:10:16 -06:00
Ross McDonald 630996e2a1 Re-add RPM upgrade logic for 0.9 branch. 2016-03-31 11:07:02 -05:00
Ben Johnson b28c4db3d0 mark merge iterator as initialized
This commit sets the `MergeIterator.init` flag after initialization.
Previously this would generate a new heap on every call to `Next()`
which caused some aggregate queries to slow by ~10,000%.
2016-03-31 09:56:23 -06:00
Edd Robinson 63b89b9215 Merge pull request #6151 from influxdata/er-iterator-panic
Ensure safe access to Shard engine
2016-03-31 16:36:50 +01:00
Jonathan A. Sternberg d8807ffaff Merge pull request #6167 from influxdata/js-6078-max-group-by-buckets
Limit bucket count in selection
2016-03-31 11:16:24 -04:00
Edd Robinson 8e2d1e48c7 Check if engine closed. Fixes #6140 2016-03-31 15:59:04 +01:00
Edd Robinson 75a2218fa1 Ensure syncronised access to engine 2016-03-31 15:58:19 +01:00
Jason Wilder e7cce69530 Merge pull request #6170 from influxdata/jw-tsm-panic
Fix TSM UnmarshalBinary panic
2016-03-31 08:44:04 -06:00
Jason Wilder 3f34ae69c1 Update changelog 2016-03-31 00:06:12 -06:00
Jason Wilder aa842fd38f Return error if creating a point would exceed max key length 2016-03-30 23:57:41 -06:00
Jason Wilder 873ac2715d Fix panic: runtime error: slice bounds out of range
Writing a key that exceeds the max key length could cause a panic
when reading a tsm file because the 2 bytes used for the key length
would not be enough to represent the actual key length.

The writer will now return an error if when trying to write a key
that is too large.
2016-03-30 23:44:17 -06:00
Jonathan A. Sternberg ad7480e64b Limit bucket count in selection
Fixes #6078.
2016-03-30 22:57:09 -04:00
Jonathan A. Sternberg eb467d8d7f Merge pull request #6126 from influxdata/js-6115-chunked-query-support-mid-series
Support chunking in the middle of a series in the emitter
2016-03-30 20:59:24 -04:00
Jonathan A. Sternberg 178a6e2f0a Merge pull request #6113 from influxdata/js-6112-simple-moving-average
Implement simple moving average
2016-03-30 20:57:55 -04:00
Jason Wilder dc8a69eba2 Merge pull request #6160 from influxdata/jw-consistency
Fixed consistency level parameter being ignored
2016-03-30 16:55:16 -06:00
Jason Wilder 5e6247ac58 Fixed consistency level parameter being ignored
The http handler consistency level parameter was removed and hard-coded
to "any."  It needs to be read and passed through to the points writer.
2016-03-30 16:37:58 -06:00
Ben Johnson fb6a54fe05 Merge pull request #6164 from benbjohnson/mux-timeout
Use timer for mux timeout
2016-03-30 15:58:11 -06:00
Ben Johnson 86cb81c868 use timer for mux timeout
This commit changes the timeout for `mux.Mux.handleConn()` to use
`time.Timer` instead of `time.After()` so that the channel can be
closed immediately once the connection is handed off.
2016-03-30 15:47:24 -06:00
Gunnar 57bb9bba91 Merge pull request #6141 from influxdata/ga-issue-template
Add issue template
2016-03-30 14:41:00 -07:00