Commit Graph

8277 Commits (239f43b529071fd8ac9a39666530399398841c5e)

Author SHA1 Message Date
Jason Wilder 239f43b529 Remove commented out test skip
[ci skip]
2015-10-28 16:14:54 -06:00
Jason Wilder 1cd30501fd Ensure calling Delete on a deleted file does not panic 2015-10-28 16:11:42 -06:00
Jason Wilder 0db2192f10 Replace use of reflect.DeepEquals with dataFilesEquals
Since the reflect.DeepEquals seems to reach into the dataFile without
acquiring a lock, it's not safe to use it.
2015-10-28 16:02:13 -06:00
Jason Wilder 9d8018297d Prevent writing to a deleted file
When a dataFile is deleted, the f file pointer is set to nil.  Since deleting
a file happens asynchronously, code that had a reference when it was valid may
run when it's gone.
2015-10-28 15:56:46 -06:00
Jason Wilder a1d8af2441 Fix data race in tsm dataFile
dataFile was not protected by a mutex which causes a data race and live
code and tests.  filesAndLock used reflect.DeepEqual on a copy of dataFile
slices.  reflect.DeepEqual appears to access unexported dataFile fields
which can't be protected.  This was changed to use a equals func that will
require a mutex to be acquired.

The other issue was that many of the dataFile funcs access the mmap without
acquiring a lock.  When a dataFile is deleted (possibly during rewriting),
reads from the mmap could return invalid data because references to the dataFile
are still in use by other goroutines.

Fixes #4534
2015-10-28 15:21:36 -06:00
Philip O'Toole bb8ee65261 Merge pull request #4592 from glennon/patch-1
Update QUERIES.md
2015-10-28 09:38:43 -07:00
Philip O'Toole 2b5bbae39f Merge pull request #4597 from influxdb/clearer_precreate
Clearer log messages on shard-precreation
2015-10-28 08:42:07 -07:00
Philip O'Toole 2f3f7b82bc Clearer log messages on shard-precreation 2015-10-28 08:33:39 -07:00
Jason Wilder 7508a2a252 Merge pull request #4587 from influxdb/jw-nan
Prevent NaN float values from being stored
2015-10-28 09:28:04 -06:00
Philip O'Toole 3ee1f19316 Add precreation section to sample config 2015-10-28 08:19:37 -07:00
Alan Glennon 285a6d2ceb Update QUERIES.md
simple spelling correction: continous --to--> continuous
2015-10-27 23:02:18 -07:00
Philip O'Toole d8e4655e0f Merge pull request #4586 from influxdb/engine_fail_msg
Exit when invalid engine is selected
2015-10-27 21:50:01 -07:00
Philip O'Toole 7278ec96a9 Merge pull request #4590 from influxdb/token_msg_on_cli_only
Only display Enterprise hint on CLI mode
2015-10-27 18:33:31 -07:00
Philip O'Toole 6311a2bf0a Merge pull request #4518 from Lanzafame/master
Updated godoc.org link to v2 docs.
2015-10-27 18:13:17 -07:00
Philip O'Toole 00b2454c53 Exit if invalid engine is selected
Fix #4584, related to #4583
2015-10-27 17:29:18 -07:00
Philip O'Toole a727a8dd3f Only display Enterprise hint on CLI mode
This change moves the logic to detect and display the Enterprise
registration hint into the same logic check as that which decides if the
successful-connection message should be displayed.

Fixes #4514.
2015-10-27 17:18:18 -07:00
Jason Wilder caa240a61c Update changelog 2015-10-27 17:12:57 -06:00
Jason Wilder 7d6d23e661 Write as many points as we can parse via line protocol
This changes the HTTP line protocol handler to behave similar to the other
handler in that they will write as many points as possible.  Previously, we
would fail the entire batch if one point failed.  This can happen more frequently
now with NaN being more explicitly unsupported.  Now it will write as many points
that parse successfully and return a "partial write" error to the client with the
lines that failed to parse.
2015-10-27 17:12:57 -06:00
Jason Wilder 4d24b05ac1 Log WAL points that fail to parse
Mainly for debugging as since this should not happen going forward.  Since
there may be points with NaN already stored in the WAL, this is helpful for
troubleshooting panics.
2015-10-27 17:12:56 -06:00
Jason Wilder 7f4a3f516b Return error if NaN is encoded in a block 2015-10-27 17:12:56 -06:00
Jason Wilder 0926b19e6b Prevent creating points with NaN float values
Float values are not supported in the existing engine and the tsm1
engines.  This changes NewPoint to return an error if a field value
contains a NaN field.  It also allows us to validate fields to prevent
other unsupported types from sneaking in through other input plugins.
2015-10-27 17:12:52 -06:00
Jason Wilder c874e48406 Return parse error for NaN float values
Not currently supported.
2015-10-27 16:50:56 -06:00
Philip O'Toole 335e4325d8 Merge pull request #4516 from influxdb/hh_processor_per_node
Refactor hinted-handoff service
2015-10-27 14:43:08 -07:00
Philip O'Toole 2cda3be9c0 Update CHANGELOG for PR 4582
[ci skip]
2015-10-27 12:02:28 -07:00
Philip O'Toole 1f75ca2df1 Merge pull request #4582 from oiooj/master
fix logger tag
2015-10-27 12:01:14 -07:00
MrLee.Kun 883640a288 change cluster logger tag 2015-10-27 15:32:51 +08:00
MrLee.Kun 45a9532b04 add tcp log tag 2015-10-27 15:31:20 +08:00
Philip O'Toole f38c53695d Add node's active state to diagnostic output 2015-10-26 18:59:58 -07:00
Philip O'Toole 95f9937d8f Update CHANGELOG 2015-10-26 18:59:58 -07:00
Philip O'Toole f703f58d22 Add HH diagnostics 2015-10-26 18:59:58 -07:00
Philip O'Toole 87299caad1 Add HH statistics 2015-10-26 18:59:58 -07:00
Philip O'Toole 9a73d26bfb Implement NodeProcessor
A NodeProcessor wraps an on-disk queue and the goroutine that attempts
to drain that queue and send the data to the associated target node.
2015-10-26 18:59:55 -07:00
Philip O'Toole 2fe5e6b4f7 Merge pull request #4577 from ch33hau/update-influxql-keyword-list
Updated keyword list in INFLUXQL.md
2015-10-26 17:44:06 -07:00
Philip O'Toole 1f74b46bdb Merge pull request #4565 from bwhaley/clarify_filters
Update README.md
2015-10-26 17:24:10 -07:00
Philip O'Toole 7d22fc75a3 Support configurable purge interval 2015-10-26 13:07:25 -07:00
Jason Wilder 68c2b6e79e Merge pull request #4580 from influxdb/jw-4538
Fix dropping database under write load
2015-10-26 14:03:22 -06:00
Jason Wilder d30848e224 Update changelog 2015-10-26 13:44:55 -06:00
Jason Wilder 56d85d44ad Use RemoveAll instead of Remove
When a database is dropped, removing old segments returns an error
because the files are already gone.  Using RemoveAll handles this
case more gracefully.
2015-10-26 13:16:32 -06:00
Jason Wilder 8af066b8ee Add more context to errors when flushes fail 2015-10-26 13:08:06 -06:00
Jason Wilder 801e766a00 Remove database from meta store before delete local files
Prevents a race where shards are recreated after a database is dropped.
2015-10-26 13:06:06 -06:00
Jason Wilder 9046244df3 Remove the shard references when database is dropped
The shards map still held a reference to a shard that was dropped
which caused the periodic mainteance task to report errors continuously.
2015-10-26 13:04:57 -06:00
Jason Wilder 4d277e7772 Ensure WAL is closed when closing engine
If a database is dropped, the WAL maintenance goroutines could still
kick in an fail becase the DB dirs are gone.
2015-10-26 10:38:52 -06:00
Jason Wilder 6240972121 Log errors returned from failed compactions 2015-10-26 10:37:09 -06:00
ch33hau aeb48501d1 Updated keyword list in INFLUXQL.md 2015-10-27 00:31:38 +08:00
Jason Wilder 562ccb6492 Add missing cacheLock/writeLock.Unlock calls
If an error occurred in this code path, the locks would not be released.
2015-10-26 10:17:47 -06:00
Cory LaNou fdcc811f6a Merge pull request #4547 from influxdb/drop-raft-node
Drop raft node
2015-10-26 11:07:39 -05:00
Jason Wilder 4afb98ba8b Return error instead of panicing if we can't create a new WAL segment
If a drop database is executed while writes are in flight, a panic
could occur because the WAL would fail to write to the DB dirs where
had been removed.

Partil fix for #4538
2015-10-26 09:53:47 -06:00
Philip O'Toole c01e768253 Merge pull request #4567 from ch33hau/fix-minor-typo
Fix typo and double spaces for comments
2015-10-26 09:38:36 -06:00
Cory LaNou 25a9127aa9 minor changes based on PR feedback 2015-10-26 10:07:40 -05:00
ch33hau 2924616585 Fix typo and double spaces for comments 2015-10-26 09:37:02 +08:00