Commit Graph

1243 Commits (fd85ae5b7fada9142aac66603200e6cc124f9aed)

Author SHA1 Message Date
Cory LaNou f8b1aa69a1 ignore join arguments on restart 2016-02-01 12:47:15 -05:00
joelegasse 834744a4c3 Merge pull request #5472 from influxdata/jl-backup-dir
Update influx_tsm to use a backup directory
2016-01-28 13:35:57 -05:00
Joe LeGasse 8f3131b97d Update influx_tsm to use a backup directory 2016-01-28 12:36:34 -05:00
Cory LaNou 0f6c75ab7d make tests pass 2016-01-28 11:03:44 -06:00
Cory LaNou 53323737b2 no longer need nil check 2016-01-28 10:05:54 -06:00
Cory LaNou d70b694d7d fix misc meta statup bugs 2016-01-28 10:05:53 -06:00
Cory LaNou 31c2e7012a allow for node upgrade 2016-01-28 10:05:53 -06:00
joelegasse 9ab5de0a34 Merge pull request #5454 from joelegasse/influx_tsm
TSM conversion tool improvements
2016-01-28 10:38:47 -05:00
Joe LeGasse 482772997e Updated tests for 'influx_tsm'
Also changed some things to fix failing tests on circleCI, and
removed old TODO item
2016-01-28 09:34:00 -05:00
Jason Wilder 716714364a Backup node.json with metastore backup 2016-01-27 17:39:54 -07:00
Joe LeGasse 908259340b Improvements to influx_tsm
- Improve logging and status updates
- Added debug http endpoint
- Properly resume/skip backed up files
2016-01-27 16:13:23 -08:00
Todd Persen 3723680747 Merge pull request #5460 from sczk/issue-5436
Prevent exponential growth in ~/.influx_history
2016-01-27 15:12:31 -08:00
Joe LeGasse 4f89c15bd3 Replaced more log.Print();os.Exit(1) with log.Fatal() 2016-01-27 07:25:46 -08:00
Adam Svoboda 40e04d89fc Prevent exponential growth in ~/.influx_history
The history file is cleared before WriteHistory is called after each
command/exit() to prevent exponential file growth.

This commit addresses issue #5436, please see PR for full explanation.
2016-01-26 20:53:41 -06:00
Jason Wilder 5abdb42a7d Use a bounded pool for remote writes
Under highly conncurrent write load, the coordinating node would
create a connection to any other node that is part of the replica
group.  Since each connection can be expensive, OOM sitations could
occur because there was no bounds on the number of new connections
that would be created.  If writes on a remote node were slow, connections
could pile up an exacerbate the problem.

This switches the pool to be bounded and has a checkout that is blocking
with a timeout.  If a connection is available, it's returned immediately.
If the pool still has room for more connections, it will create one if needed.
Otherwise, the call will block until a connection becomes available or
the timeout expires.  In the case of a timeout, it is propogated back up
to the PointsWriter that determine what do return to the client.
2016-01-26 17:08:36 -07:00
Joe LeGasse cdde2959af Limit parallelism for 'influx_tsm -parallel' 2016-01-26 09:11:09 -08:00
Jason Wilder 1696db1c40 Fixup default hostname and config 2016-01-22 17:05:25 -07:00
David Norton 914a9a1de6 fix build after rebase 2016-01-21 15:38:13 -05:00
Jason Wilder 8456169855 Update backup/restore to use MetaClient 2016-01-21 15:32:35 -05:00
Cory LaNou ef596c6b6b skip backup/restore test until we update the code 2016-01-21 15:32:03 -05:00
Cory LaNou 15314111cb buildable test suite 2016-01-21 15:31:27 -05:00
David Norton 19c79af840 fix build break 2016-01-21 15:31:27 -05:00
David Norton 177ce33b02 fix build break 2016-01-21 15:31:27 -05:00
Jason Wilder b7e1ecf471 Close idle MetaClient http connections
Prevents too many open files when running tests
2016-01-21 15:30:09 -05:00
Jason Wilder ad52d0fbd9 Fix tests 2016-01-21 15:30:09 -05:00
Jason Wilder bbe13c2818 Ensure HTTP and TCP bind addresses have hostnames
If a bind-address of :8088 is used, cluster nodes cannot
connect to those nodes because there is no hostname portion
of the address.  When we see a bind-address without a hostname,
use the os hostname or localhost if that fails if it is not specified
in the config already.
2016-01-21 15:28:34 -05:00
Ross McDonald 83cca53e9e Removed references to restore from influxd's main.go, which was causing compile issues. 2016-01-21 15:28:34 -05:00
Paul Dix 7b71b66e31 Update meta service, meta client, and httpd handler
* Improve the ping endpoint so that it can optionally check for leader agreement across all meta servers
* Add Ping method to the meta client
* Fix ClusterID tests
* Remove WaitForLeader from meta client and remove unnecessary references to it
2016-01-21 15:28:33 -05:00
Paul Dix 101ab32571 Fix meta-service for server integration tests
* Updated CreateShardGroup to not return an error if it already exists so it's idempotent
* Removed old test making sure you can't delete the default RP. You can delete it now, there was no reason to disallow it.
* Wired up the UpdateRetentionPolicy functionality
2016-01-21 15:28:33 -05:00
Paul Dix 68f33c93ce Finish wiring up meta service to server 2016-01-21 15:28:33 -05:00
Paul Dix f385945058 Update Server to work with new metaservice/client 2016-01-21 15:28:33 -05:00
Paul Dix c9d82ad0ad Wire up meta service functionality
* Add dir, hostname, and bind address to top level config since it applies to services other than meta
* Add enabled flags to example toml for data and meta services
* Wire up add/remove raft peers and meta servers to meta service
* Update DROP SERVER to be either DROP META SERVER or DROP DATA SERVER
* Bring over statement executor from old meta package
* Start meta service client implementation
* Update meta service test to use the client
* Wire up node ID/meta server storage information
2016-01-21 15:28:32 -05:00
Cory LaNou 9ec7a710c9 some misc refactoring on influxd startup 2016-01-21 15:28:32 -05:00
Cory LaNou 8d878fff91 buildable meta -> services/meta 2016-01-21 15:28:32 -05:00
Jason Wilder b51c6a935f Improve backup/restore logging and help commands 2016-01-20 13:46:14 -07:00
Joe LeGasse 8791011b10 Validate metadata backup blob
Fixes #5349
2016-01-19 10:30:08 -08:00
Joe LeGasse dfc59e8a13 Ensure the backup directory exists.
Fixes #5350
2016-01-15 14:38:33 -08:00
Philip O'Toole 82e16a1899 Merge pull request #5309 from influxdata/c_usage
Unit test scrubbing values during conversion
2016-01-07 14:59:39 -08:00
Philip O'Toole 653dba3759 Merge pull request #5129 from e-dard/fix-precision-flag
Ensure precision flag is respected in CLI
2016-01-07 14:48:57 -08:00
Jason Wilder 16829dedc8 Merge pull request #5308 from influxdata/jw-compact-large
Use block size and file size before skipping a file during compactions
2016-01-07 15:48:03 -07:00
Philip O'Toole cd2de5f25d Unit test scrubbing values during conversion 2016-01-07 14:33:42 -08:00
Edd Robinson c6d32bd1bb Fix #5127 2016-01-07 22:30:46 +00:00
Philip O'Toole 2d2c315356 Dump points per TSM point written 2016-01-07 13:58:23 -08:00
Jason Wilder 0264d77545 Fix block sizes reported by influx_inspect 2016-01-07 14:51:59 -07:00
Philip O'Toole 13d2b69c29 Dump conversion factor on completion 2016-01-07 13:50:56 -08:00
Philip O'Toole bab2a00e5d Track bytes written by conversion tool 2016-01-07 13:50:45 -08:00
Philip O'Toole 9b02808e6c ShardInfos now returns size 2016-01-07 13:36:25 -08:00
Philip O'Toole 067cc71923 Count number of fieldless points filtered 2016-01-06 11:52:42 -08:00
Philip O'Toole ff96e17ddb Skip points without fields 2016-01-06 11:45:20 -08:00
Philip O'Toole 9c916b0b76 Best-effort cleanup of converter. 2016-01-05 19:27:27 -08:00