Commit Graph

221 Commits (6370a4ef2b9fd69d44faeb0a6e7203ed93521aab)

Author SHA1 Message Date
Cory LaNou 6370a4ef2b wip in progress for actually dropping the series data 2015-02-21 17:05:08 -07:00
Ben Johnson 4e5b6e93ff Merge pull request #1672 from influxdb/data-node-recovery
Add index tracking to metastore.
2015-02-21 15:34:54 -07:00
Ben Johnson 4dbd1541f7 Add index tracking to metastore.
This commit adds tracking of the index to the metastore so that data
nodes will ignore replayed indexes when they are restarted. This
does not include index persistence for the shards.
2015-02-21 13:46:16 -07:00
David Norton 9bff9cdeee issue #1431: wire up regex queries 2015-02-21 15:38:35 -05:00
Philip O'Toole 9c4174a006 Simplify locking in WriteSeries()
In addition, memomize the Field codecs.
2015-02-20 14:26:12 -08:00
Philip O'Toole 612ef1fa08 Write batch in a single BoltDB transaction 2015-02-20 11:28:07 -08:00
Philip O'Toole bd4352c77d Remove unused shardsBySeriesID
Its presence is making Bolt-level batching quite awkward, and since it's
not used, just remove it.
2015-02-20 11:28:07 -08:00
Philip O'Toole 169409ac03 Move to slices for creating measurements
Using maps was resulting in unpredicatable ordering of columns and tags.
2015-02-20 11:28:07 -08:00
Philip O'Toole f5b2962d42 Incorporate inital code review feedback 2015-02-20 11:28:07 -08:00
Philip O'Toole 5c61b7d8b8 Add new fields even when Measurement exists 2015-02-20 11:28:07 -08:00
Philip O'Toole 0e3e223e84 Always ensure measurement exists in command
Unit tests need updating since some tests are no longer valid.
2015-02-20 11:28:07 -08:00
Philip O'Toole 2585a9ea4f Encode real batches for shards 2015-02-20 11:28:07 -08:00
Philip O'Toole ff765793e6 Implement applyCreateMeasurementsIfNotExists 2015-02-20 11:28:07 -08:00
Philip O'Toole 25c3b104b7 WriteSeries now uses batching 2015-02-20 11:28:06 -08:00
Philip O'Toole 0d3ab9fa1d Create-measurement command in local function 2015-02-20 11:28:06 -08:00
Philip O'Toole 3435da9626 Correctly initialize createMeasurement maps
Full unit tests added for happy paths.
2015-02-20 11:28:06 -08:00
Philip O'Toole 55fbd7e42c Batch Measurement creation 2015-02-20 11:28:06 -08:00
Paul Dix 6fd7dd028a Fix conflict with createFields and createContinuousQuery message types 2015-02-17 21:06:48 -05:00
Paul Dix 36d16a3172 Update broker to have URLs for replicas
* Update the infludb broker to not need a server so that it'll work on non-data node servers
* Update messaging broker to keep track of connect urls for replicas
2015-02-17 21:02:53 -05:00
Paul Dix 8fee14fbf8 Fixes based on PR feedback.
* Pull out magic numbers for running CQs in the broker
* Typo fixes in comments
* Update the process_continuous_queries endpoint to not have gzip
* Remove previous implementation of MeasurementNames in favor of new simpler one
2015-02-17 21:02:53 -05:00
Paul Dix edcc20bcab Wire up show continuous queries 2015-02-17 21:02:52 -05:00
Paul Dix 8d9bcdbc97 Finish wiring up basic version of CQs 2015-02-17 21:02:52 -05:00
Paul Dix fec6764b09 WIP: wire up continuous queries
* Fix run to work with CQ broker
* Fix CQ handler
* Fix SetTimeRange to use RFC3339Nano
* Fix the time range tests
* Fix the parser to parse for RFC3339Nano literals in addition to the other format
* Add logic for running CQs
* Remove duplicate WriteBufferSize default setting from config
2015-02-17 21:02:18 -05:00
Paul Dix b0d4b6da55 WIP: fix cq query times 2015-02-17 21:01:21 -05:00
Paul Dix f2d132b361 Implement continuous queries with group by intervals
* Update defaults on Broker for when to trigger CQ runs
* Add config settings for how often to calculate and recalculate CQ results
* Update Server to have CQ settings
* Update AST to fold removed time literals when setting time range
* Add periodic CQ running functionality to server
2015-02-17 21:00:24 -05:00
Paul Dix 4217778a08 Add periodic triggering of continuous queries to broker.
* Create influxdb specific broker that will periodically start continuous query calculation. Will send to the same data node as long as it's up and responding
* Add endpoint in handler to start processing of continuous queries on a data node
2015-02-17 21:00:24 -05:00
Paul Dix 5f14d5faf5 WIP: start implementation of continuous queries
* Update SelectStatement to have GroupByInterval
* Update parser to verify that CQs have GroupByInterval if Aggregated
* Implement CreateContinousQuery on Server
* Add ContinuousQueries to database
2015-02-17 21:00:24 -05:00
Frontend bacd500a7f fix typo stuct to struct 2015-02-17 16:53:31 -05:00
Philip O'Toole e74fadfd53 Merge branch 'master' of github.com:influxdb/influxdb into support_all_value_types 2015-02-17 12:55:12 -08:00
Philip O'Toole ae81dff9f6 Use Field codec in debug code 2015-02-16 16:43:35 -08:00
Philip O'Toole 6db74aa9bb Implement codec's encode 2015-02-16 16:01:52 -08:00
Philip O'Toole 8cdee6a997 Clarify use of ReadSeries() 2015-02-16 10:28:06 -08:00
Philip O'Toole dcdb4b77a1 Merge branch 'master' into support_all_value_types
Conflicts:
	database.go
	server.go
2015-02-16 09:21:10 -08:00
Philip O'Toole 9db17a7e09 Only update Metastore if new fields were created
It is quite possible that multiple applyCreateFieldsIfNotExist messages
will sit unapplied in the Raft commit log, each carrying exactly the same
information about new fields. So during application of this message only
change the Metastore if the fields actually changed.
2015-02-15 16:58:29 -08:00
Philip O'Toole 276c5ded5a int maps to influxql.Number 2015-02-13 16:28:12 -08:00
Philip O'Toole 9061a70953 Don't perform marshalling during field creation 2015-02-13 15:59:46 -08:00
Philip O'Toole 31f65361e4 Fix up locking 2015-02-13 15:41:27 -08:00
Philip O'Toole 75ebfaf3dd Use "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole 32faba7248 Add "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole c0655fb45d Release RLock if database does not exist 2015-02-13 15:19:17 -08:00
Philip O'Toole 0ca98ea6c2 Remove unmarshalValues 2015-02-12 16:07:25 -08:00
Philip O'Toole 5b8c0748af Remove marshalValues
Code now on Measurement type
2015-02-12 16:07:20 -08:00
Philip O'Toole bf9bfd6106 Error if field's type has changed 2015-02-12 16:06:37 -08:00
David Norton 8f9f8051a4 fix #1579: SHOW MEASUREMENTS format 2015-02-11 23:03:44 -05:00
Philip O'Toole 19cd5509c0 Retention policy and database were reversed in log 2015-02-11 10:11:09 -08:00
Philip O'Toole 8cb06c5b8e Refactor retention policy enforcement for testing 2015-02-11 09:54:07 -08:00
Philip O'Toole ddb57b4569 Explain why shard deletion may fail 2015-02-11 09:54:07 -08:00
Philip O'Toole 91f863258c Close shard before deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 65edd6b277 Detect shard groups due for deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 6a20100d2f Implement "delete shard group" command 2015-02-11 09:54:07 -08:00