Commit Graph

293 Commits (38bb2cf62e4c4a974d32e7ea5fe9f383994f5937)

Author SHA1 Message Date
Todd Persen ff1c61c5c1 Only report if ReportingDisabled is set to false. 2015-02-23 10:42:39 -08:00
Todd Persen 2ac2538ed3 Don't block for stats reporting. 2015-02-23 10:42:39 -08:00
Todd Persen c366fcbbf6 Update stats reporting to just POST for now. 2015-02-23 10:42:38 -08:00
Philip O'Toole 3e727ac01e Change "Rows" to "Series" in API output 2015-02-22 21:21:49 -08:00
Philip O'Toole 9ab1221a35 Move Raft command types to own file
server.go is getting long, so start breaking it up a little.
2015-02-22 11:50:43 -08:00
Cory LaNou 8637a10b6a start with seriesByMeasurement 2015-02-21 22:18:25 -07:00
Cory LaNou 29910c3c99 better transaction batching for drop series 2015-02-21 21:48:18 -07:00
Cory LaNou d5ac049812 remove bogus method 2015-02-21 20:20:36 -07:00
Cory LaNou d35e2a92b1 locking is now done in process messages 2015-02-21 19:14:00 -07:00
Cory LaNou c575ee9a04 fixing a fat fingering rebase 2015-02-21 19:13:01 -07:00
Cory LaNou 2752ada587 moving more responsibility to database.dropSeries 2015-02-21 17:21:27 -07:00
Cory LaNou 6114c8138e refactoring drop series 2015-02-21 17:21:27 -07:00
David Norton 61352f78b6 pass all series IDs to Server.DropSeries at once 2015-02-21 17:18:50 -07:00
David Norton 9a6e29ece8 collect all series IDs then unlock 2015-02-21 17:18:50 -07:00
Cory LaNou 5ab3731159 delete -> drop for series naming 2015-02-21 17:18:50 -07:00
Cory LaNou 697e9721dd fixing rebase conflicts 2015-02-21 17:10:12 -07:00
Cory LaNou 0d6b7616de accidentally lost this in my rebase 2015-02-21 17:10:11 -07:00
Cory LaNou 495cedb53b move where we unlock 2015-02-21 17:10:11 -07:00
Cory LaNou 4948b62784 first working version of drop series. more testing to come 2015-02-21 17:10:11 -07:00
Cory LaNou 8306057179 actually drop shard data 2015-02-21 17:10:11 -07:00
Cory LaNou 6d5be3da25 wip. compiles now. tests next 2015-02-21 17:10:11 -07:00
Cory LaNou 7cfc2a5601 wip 2015-02-21 17:10:11 -07:00
Cory LaNou 6370a4ef2b wip in progress for actually dropping the series data 2015-02-21 17:05:08 -07:00
Ben Johnson 4e5b6e93ff Merge pull request #1672 from influxdb/data-node-recovery
Add index tracking to metastore.
2015-02-21 15:34:54 -07:00
Ben Johnson 4dbd1541f7 Add index tracking to metastore.
This commit adds tracking of the index to the metastore so that data
nodes will ignore replayed indexes when they are restarted. This
does not include index persistence for the shards.
2015-02-21 13:46:16 -07:00
David Norton 9bff9cdeee issue #1431: wire up regex queries 2015-02-21 15:38:35 -05:00
Philip O'Toole 9c4174a006 Simplify locking in WriteSeries()
In addition, memomize the Field codecs.
2015-02-20 14:26:12 -08:00
Philip O'Toole 612ef1fa08 Write batch in a single BoltDB transaction 2015-02-20 11:28:07 -08:00
Philip O'Toole bd4352c77d Remove unused shardsBySeriesID
Its presence is making Bolt-level batching quite awkward, and since it's
not used, just remove it.
2015-02-20 11:28:07 -08:00
Philip O'Toole 169409ac03 Move to slices for creating measurements
Using maps was resulting in unpredicatable ordering of columns and tags.
2015-02-20 11:28:07 -08:00
Philip O'Toole f5b2962d42 Incorporate inital code review feedback 2015-02-20 11:28:07 -08:00
Philip O'Toole 5c61b7d8b8 Add new fields even when Measurement exists 2015-02-20 11:28:07 -08:00
Philip O'Toole 0e3e223e84 Always ensure measurement exists in command
Unit tests need updating since some tests are no longer valid.
2015-02-20 11:28:07 -08:00
Philip O'Toole 2585a9ea4f Encode real batches for shards 2015-02-20 11:28:07 -08:00
Philip O'Toole ff765793e6 Implement applyCreateMeasurementsIfNotExists 2015-02-20 11:28:07 -08:00
Philip O'Toole 25c3b104b7 WriteSeries now uses batching 2015-02-20 11:28:06 -08:00
Philip O'Toole 0d3ab9fa1d Create-measurement command in local function 2015-02-20 11:28:06 -08:00
Philip O'Toole 3435da9626 Correctly initialize createMeasurement maps
Full unit tests added for happy paths.
2015-02-20 11:28:06 -08:00
Philip O'Toole 55fbd7e42c Batch Measurement creation 2015-02-20 11:28:06 -08:00
Paul Dix 6fd7dd028a Fix conflict with createFields and createContinuousQuery message types 2015-02-17 21:06:48 -05:00
Paul Dix 36d16a3172 Update broker to have URLs for replicas
* Update the infludb broker to not need a server so that it'll work on non-data node servers
* Update messaging broker to keep track of connect urls for replicas
2015-02-17 21:02:53 -05:00
Paul Dix 8fee14fbf8 Fixes based on PR feedback.
* Pull out magic numbers for running CQs in the broker
* Typo fixes in comments
* Update the process_continuous_queries endpoint to not have gzip
* Remove previous implementation of MeasurementNames in favor of new simpler one
2015-02-17 21:02:53 -05:00
Paul Dix edcc20bcab Wire up show continuous queries 2015-02-17 21:02:52 -05:00
Paul Dix 8d9bcdbc97 Finish wiring up basic version of CQs 2015-02-17 21:02:52 -05:00
Paul Dix fec6764b09 WIP: wire up continuous queries
* Fix run to work with CQ broker
* Fix CQ handler
* Fix SetTimeRange to use RFC3339Nano
* Fix the time range tests
* Fix the parser to parse for RFC3339Nano literals in addition to the other format
* Add logic for running CQs
* Remove duplicate WriteBufferSize default setting from config
2015-02-17 21:02:18 -05:00
Paul Dix b0d4b6da55 WIP: fix cq query times 2015-02-17 21:01:21 -05:00
Paul Dix f2d132b361 Implement continuous queries with group by intervals
* Update defaults on Broker for when to trigger CQ runs
* Add config settings for how often to calculate and recalculate CQ results
* Update Server to have CQ settings
* Update AST to fold removed time literals when setting time range
* Add periodic CQ running functionality to server
2015-02-17 21:00:24 -05:00
Paul Dix 4217778a08 Add periodic triggering of continuous queries to broker.
* Create influxdb specific broker that will periodically start continuous query calculation. Will send to the same data node as long as it's up and responding
* Add endpoint in handler to start processing of continuous queries on a data node
2015-02-17 21:00:24 -05:00
Paul Dix 5f14d5faf5 WIP: start implementation of continuous queries
* Update SelectStatement to have GroupByInterval
* Update parser to verify that CQs have GroupByInterval if Aggregated
* Implement CreateContinousQuery on Server
* Add ContinuousQueries to database
2015-02-17 21:00:24 -05:00
Frontend bacd500a7f fix typo stuct to struct 2015-02-17 16:53:31 -05:00
Philip O'Toole e74fadfd53 Merge branch 'master' of github.com:influxdb/influxdb into support_all_value_types 2015-02-17 12:55:12 -08:00
Philip O'Toole ae81dff9f6 Use Field codec in debug code 2015-02-16 16:43:35 -08:00
Philip O'Toole 6db74aa9bb Implement codec's encode 2015-02-16 16:01:52 -08:00
Philip O'Toole 8cdee6a997 Clarify use of ReadSeries() 2015-02-16 10:28:06 -08:00
Philip O'Toole dcdb4b77a1 Merge branch 'master' into support_all_value_types
Conflicts:
	database.go
	server.go
2015-02-16 09:21:10 -08:00
Philip O'Toole 9db17a7e09 Only update Metastore if new fields were created
It is quite possible that multiple applyCreateFieldsIfNotExist messages
will sit unapplied in the Raft commit log, each carrying exactly the same
information about new fields. So during application of this message only
change the Metastore if the fields actually changed.
2015-02-15 16:58:29 -08:00
Philip O'Toole 276c5ded5a int maps to influxql.Number 2015-02-13 16:28:12 -08:00
Philip O'Toole 9061a70953 Don't perform marshalling during field creation 2015-02-13 15:59:46 -08:00
Philip O'Toole 31f65361e4 Fix up locking 2015-02-13 15:41:27 -08:00
Philip O'Toole 75ebfaf3dd Use "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole 32faba7248 Add "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole c0655fb45d Release RLock if database does not exist 2015-02-13 15:19:17 -08:00
Philip O'Toole 0ca98ea6c2 Remove unmarshalValues 2015-02-12 16:07:25 -08:00
Philip O'Toole 5b8c0748af Remove marshalValues
Code now on Measurement type
2015-02-12 16:07:20 -08:00
Philip O'Toole bf9bfd6106 Error if field's type has changed 2015-02-12 16:06:37 -08:00
David Norton 8f9f8051a4 fix #1579: SHOW MEASUREMENTS format 2015-02-11 23:03:44 -05:00
Philip O'Toole 19cd5509c0 Retention policy and database were reversed in log 2015-02-11 10:11:09 -08:00
Philip O'Toole 8cb06c5b8e Refactor retention policy enforcement for testing 2015-02-11 09:54:07 -08:00
Philip O'Toole ddb57b4569 Explain why shard deletion may fail 2015-02-11 09:54:07 -08:00
Philip O'Toole 91f863258c Close shard before deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 65edd6b277 Detect shard groups due for deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 6a20100d2f Implement "delete shard group" command 2015-02-11 09:54:07 -08:00
Philip O'Toole 37647cc6a6 Add function to return shard group by ID
If shard groups were stored in a map by ID, this lookup could be sped
up.
2015-02-11 09:54:07 -08:00
Philip O'Toole 50ef1672cb Add stubbed enable of retention policy enforcement 2015-02-11 09:54:07 -08:00
Ben Johnson e4178520da Close shards on server close. 2015-02-10 22:18:36 -07:00
Philip O'Toole d00718c3a8 Update retention policy before saving database
Without this change, new shard group information is not persisted in the
metastore and only when the next database-save took place would this
update be persisted. If the server shutdown before the update, the new
shard group would be lost.
2015-02-10 19:21:02 -08:00
Philip O'Toole c003b39611 Only need read-lock for path 2015-02-10 16:53:43 -08:00
Philip O'Toole bb73ff8825 Only need a read lock for server ID 2015-02-10 16:51:01 -08:00
Cory LaNou 9bfbf15bad signature no longer requires database as an argument 2015-02-10 11:03:07 -07:00
Cory LaNou 0811af6211 sorting was not required, it was a testing setup issue 2015-02-10 09:49:22 -07:00
Cory LaNou adcf038323 Merge pull request #1550 from influxdb/cli-not-reporting-errors
CLI needs to echo out errors from client library.
2015-02-10 09:28:27 -07:00
Cory LaNou 1f56514c29 Merge pull request #1540 from influxdb/select-wildcard
Select wildcard functionality implemented
2015-02-10 09:07:31 -07:00
Cory LaNou 7b28df0d49 someone needs to add a precommit hook... 2015-02-10 08:54:19 -07:00
Cory LaNou 84ac4dbddb sort fields for select * for consitency in results 2015-02-10 08:40:40 -07:00
Todd Persen 6b70408864 Merge pull request #1351 from influxdb/go-external
Change "code.google.com/p/go.*" to "golang.org/x/*"
2015-02-09 20:23:26 -08:00
Cory LaNou 82ae461378 defend against select *,value 2015-02-09 19:59:13 -07:00
Cory LaNou 8a1bb5922c added wildcard query functionality. fixes #1432 2015-02-09 19:59:13 -07:00
Cory LaNou 804b426068 removing obsolete code 2015-02-09 19:58:11 -07:00
Cory LaNou f84ea8268a Merge pull request #1526 from influxdb/http-status-endpoint
Start of a status http endpoint
2015-02-06 16:12:39 -07:00
Cory LaNou 74a0dc2e2a do not need a write lock, just read, better performance 2015-02-06 15:53:51 -07:00
Cory LaNou 339e170d82 start of a status http endpoint 2015-02-06 13:52:28 -07:00
David Norton 3f3c00da8d fix #1510: panics when measurement doesn't exist 2015-02-06 15:43:53 -05:00
Cory LaNou 3dec0e7ed5 remove debug output 2015-02-06 10:05:19 -07:00
Cory LaNou 973bb78808 add tests for logging unauthorized access request 2015-02-06 10:03:34 -07:00
Cory LaNou 4225cd7407 move Authorize from func to method for Server 2015-02-06 09:16:45 -07:00
Cory LaNou d23191b0d1 add additional comment to NewServer about authentication 2015-02-05 16:40:41 -07:00
Cory LaNou 09d4a4e2d7 no need to lock a bool 2015-02-05 16:20:02 -07:00
Cory LaNou 1604d7f604 refactor how we default authentication enabled 2015-02-05 15:54:32 -07:00
Cory LaNou f4dfb87acc first pass at hardening authorize 2015-02-05 14:39:40 -07:00
David Norton d0dc677292 fix #1516: ALTER RETENTION POLICY 2015-02-05 12:54:06 -05:00