Commit Graph

9412 Commits (f315444f867f1bcece5176b841275c2fb8bd2873)

Author SHA1 Message Date
Edd Robinson f315444f86 Merge pull request #5255 from titilambert/github4752
Workaround for #4752
2016-02-17 11:00:58 +00:00
Jonathan A. Sternberg 316e44c324 Merge pull request #5705 from influxdata/js-5563-create-database-if-exists
Fix meta.Client CreateDatabaseWithRetentionPolicy RPC command
2016-02-16 16:35:57 -05:00
Jonathan A. Sternberg 23da067593 Fix meta.Client CreateDatabaseWithRetentionPolicy RPC command
Previously, meta.Client would drop the default retention policy when
trying to create a database with a retention policy. The RPC has now
been modified to include the desired retention policy in the
CreateDatabase command and have it use that retention policy information
instead of the default configuration when provided.

This also lowers the number of RPC calls for
CreateDatabaseWithRetentionPolicy to only a single RPC call instead of
two.

Protections have also been included so creating a retention policy with
different parameters will return an error similar to if you tried to
modify the retention policy separately.

Fixes #5696.
2016-02-16 16:21:26 -05:00
joelegasse 94a383e66d Merge pull request #5704 from influxdata/jl-influx-tsm
influx_tsm bugfixes in 0.10.0
2016-02-16 14:23:04 -05:00
Joe LeGasse 7657d01f86 Updated CHANGELOG 2016-02-16 13:51:51 -05:00
Joe LeGasse 9af4894c1c influx_tsm: ignore series index and convert all points
A case (#5606) was found where a lot of data unexpectedly disappeared from a database
following a TSM conversion.

The proximate cause was an inconsistency between the root Bolt DB bucket list
and the meta data in the "series" bucket of the same shard. There were apparently valid
series in Bolt DB buckets that were no longer referenced by the meta data
in the "series" bucket - so-called orphaned series; since the conversion
process only iterated across the series found in the meta data, the conversion process
caused the orphaned series to be removed from the converted shards. This resulted in the
unexpected removal of data from the TSM shards that had previously been accessible
(despite the meta data inconsistency) in the b1 shards.

The root cause of the meta data inconsistency in the case above was a failure, in versions prior
to v0.9.3 (actually 3348dab) to update the "series" bucket with series that had been created in
previous shards during the life of the same influxd process instance.

This fix is required to avoid data loss during TSM conversions for shards that were created with
versions of influx that did not include 3348dab (e.g. prior to v0.9.3).

Analysis-by: Jon Seymour <jon@wildducktheories.com>
2016-02-16 13:46:01 -05:00
Joe LeGasse 1b8fc0c154 influx_tsm: don't defer reader.Close() until after Open()
Fixes #5656
2016-02-16 13:44:08 -05:00
Jason Wilder 06c1c48b3b Merge pull request #5666 from influxdata/jw-gdm
Manage dependencies with gdm
2016-02-16 09:52:22 -07:00
Jason Wilder 8115cdf5bf Merge pull request #5682 from influxdata/mr-separate-diagnostics-package
Move monitor.Diagnostics to its own package
2016-02-16 09:38:15 -07:00
Jason Wilder c28fc50b69 Merge pull request #5700 from li-ang/rm_wal
Remove redundant wal files
2016-02-16 09:23:27 -07:00
Ross McDonald 6bb1097d6b Merge pull request #5638 from influxdata/ross-http-version-handler
Added test coverage to httpd handler version header
2016-02-16 10:05:41 -06:00
Ross McDonald e3f8350cc4 Substituting 'go get' for gdm commands. Slight restructure of commands. 2016-02-16 09:33:39 -06:00
Jason Wilder 9d478fa5b3 Merge pull request #5695 from influxdata/jw-cluster
Remove MetaServers from node.json
2016-02-16 08:17:28 -07:00
Nicholas Katsaros a727266744 Add graphite and udp services to the default config generator
Fix #4752
2016-02-16 10:12:48 -05:00
Ross McDonald a724c90477 Changed body to io.Reader. 2016-02-16 09:01:09 -06:00
liang@qiniu.com 1ad0f933f4 Remove redundant wal files 2016-02-16 20:45:13 +08:00
Jason Wilder 6fb00c1a9b Remove MetaServers from node.json
This removes the MetaServers property from node.json to eliminate one
of the four places those addresses are stored on disk.  We always use
the values that come through the config (via file, env var or -join arg).
2016-02-15 22:42:51 -07:00
Mark Rushakoff e1af9fe596 Deregister diagnostics client in service.Close
The hinted handoff and graphite services called out
DeregisterDiagnosticsClient in the inlined Monitor interface but never
called it.
2016-02-13 15:04:05 -08:00
Mark Rushakoff 5a61bdad70 Move monitor.Diagnostics to its own package
I was trying to create a Diagnostics Client in the tsdb package, but
IIRC importing `monitor` caused an import cycle of:
tsdb -> monitor -> cluster -> tsdb.

Moving Diagnostics to its own package will allow further use of
diagnostics.Client without running into import cycles.
2016-02-13 14:56:15 -08:00
Jason Wilder b45b2c99d1 Use ClusterTracing config to control meta handler logging
Meta HTTP commands are cluster level requests and were showing up in
the main log creating a lot of noise.  Switch them to use the ClusterTracing
config option which is disabled by default.
2016-02-12 16:40:10 -07:00
Jason Wilder 2af618c2d7 Manage dependencies with gdm
Since we are pinned to go 1.4.3, we're using the same dependency
manager as telegraf to make builds more reproducible.  We'll re-evaluate
vendoring when we can move off of 1.4.3.
2016-02-12 16:27:17 -07:00
Jason Wilder 8e100998fa Merge pull request #5659 from influxdata/jw-vet
Fix go vet
2016-02-12 14:50:30 -07:00
Jonathan A. Sternberg 447db9d219 Merge pull request #5641 from jsternberg/js-fill-implicit-end
Pass the implicit end time from the query executor to the select call
2016-02-12 16:43:39 -05:00
Jonathan A. Sternberg 559a11d0ab Pass the implicit end time from the query executor to the select call
The select call and the query executor would both calculate the time
range, but in separate ways. The query executor needed some way to pass
in the implicit end time that is placed there by the query executor.

Fixes #5636.
2016-02-12 16:03:24 -05:00
Jason Wilder 24dd5ef0ee Fix go vet 2016-02-12 13:55:41 -07:00
Ross McDonald f1a5201e67 Condensed check for version header into one line. 2016-02-12 14:32:07 -06:00
Jonathan A. Sternberg c267e1eb5a Merge pull request #5652 from influxdata/js-5640-derivative-iterator
Support derivative() call for integer fields in the new query engine
2016-02-12 14:59:35 -05:00
Jason Wilder ef571fc104 Merge pull request #5602 from influxdata/cluster-startup
Simplify cluster startup for scripting and deployment
2016-02-12 12:23:40 -07:00
Jason Wilder cd568548fd Fix race in peerStore 2016-02-12 12:06:23 -07:00
Jack Zampolin 30a31d3acf Merge pull request #5654 from influxdata/jz-delete-from
Remove DELETE FROM from query spec
2016-02-12 10:47:57 -08:00
Cory LaNou 7ad31fa6ab address pr feedback 2016-02-12 11:35:20 -07:00
Jason Wilder ddcfac7e8e Remove peers.json
No longer needed now that peers are pull from the meta nodes.
2016-02-12 11:35:20 -07:00
Cory LaNou 1b25c0cb80 ask for a free port immediatly before using to prevent it being returned to the available pool 2016-02-12 11:35:19 -07:00
Cory LaNou 52077b2dfc fix race condition 2016-02-12 11:35:19 -07:00
Cory LaNou e9a2c33556 give less time to lose lease on random port for test 2016-02-12 11:35:19 -07:00
Cory LaNou df5d587105 make meta test suite less racy 2016-02-12 11:35:19 -07:00
Cory LaNou 360f40561e misc fixes and changelog 2016-02-12 11:35:19 -07:00
Cory LaNou 92e8516660 specify raft bind address with real random ports 2016-02-12 11:35:19 -07:00
Cory LaNou 7e62201793 specify bind address meta test 2016-02-12 11:35:19 -07:00
Cory LaNou b17293f75c fix data race 2016-02-12 11:35:19 -07:00
Cory LaNou f861d5811e fix adhoc joining of cluster 2016-02-12 11:35:19 -07:00
Cory LaNou 807354f195 passing test suite... hopefully 2016-02-12 11:32:53 -07:00
Cory LaNou d9f1df0ecf sane cluster starting with join args 2016-02-12 11:32:53 -07:00
Jason Wilder e1effa6601 fix build after rebase on master 2016-02-12 11:32:53 -07:00
Edd Robinson b7ad1bc7fa Merge pull request #5649 from influxdata/er-update-cla
Update link to CLA
2016-02-12 18:22:23 +00:00
Jack Zampolin 014bbd3ef9 Remove DELETE FROM from query spec 2016-02-12 10:10:47 -08:00
Gunnar 5a7b695bba Merge pull request #5645 from influxdata/ga-readme
Update README for 0.10
2016-02-12 09:47:41 -08:00
Jonathan A. Sternberg 42b9166000 Support derivative() call for integer fields in the new query engine
Fixes #5640.
2016-02-12 11:36:59 -05:00
joelegasse b273980bc1 Merge pull request #5644 from influxdata/jl-auth-cache
Update authentication cache to work for clusters
2016-02-12 08:21:33 -05:00
Joe LeGasse 1852814612 Update authentication cache to work for clusters
Also removed unused code and duplicated test code
2016-02-12 07:16:57 -05:00