Commit Graph

291 Commits (7717b11e6bd710d37053ad70f23b21b4b76da835)

Author SHA1 Message Date
Philip O'Toole 6db74aa9bb Implement codec's encode 2015-02-16 16:01:52 -08:00
Philip O'Toole 8cdee6a997 Clarify use of ReadSeries() 2015-02-16 10:28:06 -08:00
Philip O'Toole dcdb4b77a1 Merge branch 'master' into support_all_value_types
Conflicts:
	database.go
	server.go
2015-02-16 09:21:10 -08:00
Philip O'Toole 9db17a7e09 Only update Metastore if new fields were created
It is quite possible that multiple applyCreateFieldsIfNotExist messages
will sit unapplied in the Raft commit log, each carrying exactly the same
information about new fields. So during application of this message only
change the Metastore if the fields actually changed.
2015-02-15 16:58:29 -08:00
Philip O'Toole 276c5ded5a int maps to influxql.Number 2015-02-13 16:28:12 -08:00
Philip O'Toole 9061a70953 Don't perform marshalling during field creation 2015-02-13 15:59:46 -08:00
Philip O'Toole 31f65361e4 Fix up locking 2015-02-13 15:41:27 -08:00
Philip O'Toole 75ebfaf3dd Use "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole 32faba7248 Add "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole c0655fb45d Release RLock if database does not exist 2015-02-13 15:19:17 -08:00
Philip O'Toole 0ca98ea6c2 Remove unmarshalValues 2015-02-12 16:07:25 -08:00
Philip O'Toole 5b8c0748af Remove marshalValues
Code now on Measurement type
2015-02-12 16:07:20 -08:00
Philip O'Toole bf9bfd6106 Error if field's type has changed 2015-02-12 16:06:37 -08:00
David Norton 8f9f8051a4 fix #1579: SHOW MEASUREMENTS format 2015-02-11 23:03:44 -05:00
Philip O'Toole 19cd5509c0 Retention policy and database were reversed in log 2015-02-11 10:11:09 -08:00
Philip O'Toole 8cb06c5b8e Refactor retention policy enforcement for testing 2015-02-11 09:54:07 -08:00
Philip O'Toole ddb57b4569 Explain why shard deletion may fail 2015-02-11 09:54:07 -08:00
Philip O'Toole 91f863258c Close shard before deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 65edd6b277 Detect shard groups due for deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 6a20100d2f Implement "delete shard group" command 2015-02-11 09:54:07 -08:00
Philip O'Toole 37647cc6a6 Add function to return shard group by ID
If shard groups were stored in a map by ID, this lookup could be sped
up.
2015-02-11 09:54:07 -08:00
Philip O'Toole 50ef1672cb Add stubbed enable of retention policy enforcement 2015-02-11 09:54:07 -08:00
Ben Johnson e4178520da Close shards on server close. 2015-02-10 22:18:36 -07:00
Philip O'Toole d00718c3a8 Update retention policy before saving database
Without this change, new shard group information is not persisted in the
metastore and only when the next database-save took place would this
update be persisted. If the server shutdown before the update, the new
shard group would be lost.
2015-02-10 19:21:02 -08:00
Philip O'Toole c003b39611 Only need read-lock for path 2015-02-10 16:53:43 -08:00
Philip O'Toole bb73ff8825 Only need a read lock for server ID 2015-02-10 16:51:01 -08:00
Cory LaNou 9bfbf15bad signature no longer requires database as an argument 2015-02-10 11:03:07 -07:00
Cory LaNou 0811af6211 sorting was not required, it was a testing setup issue 2015-02-10 09:49:22 -07:00
Cory LaNou adcf038323 Merge pull request #1550 from influxdb/cli-not-reporting-errors
CLI needs to echo out errors from client library.
2015-02-10 09:28:27 -07:00
Cory LaNou 1f56514c29 Merge pull request #1540 from influxdb/select-wildcard
Select wildcard functionality implemented
2015-02-10 09:07:31 -07:00
Cory LaNou 7b28df0d49 someone needs to add a precommit hook... 2015-02-10 08:54:19 -07:00
Cory LaNou 84ac4dbddb sort fields for select * for consitency in results 2015-02-10 08:40:40 -07:00
Todd Persen 6b70408864 Merge pull request #1351 from influxdb/go-external
Change "code.google.com/p/go.*" to "golang.org/x/*"
2015-02-09 20:23:26 -08:00
Cory LaNou 82ae461378 defend against select *,value 2015-02-09 19:59:13 -07:00
Cory LaNou 8a1bb5922c added wildcard query functionality. fixes #1432 2015-02-09 19:59:13 -07:00
Cory LaNou 804b426068 removing obsolete code 2015-02-09 19:58:11 -07:00
Cory LaNou f84ea8268a Merge pull request #1526 from influxdb/http-status-endpoint
Start of a status http endpoint
2015-02-06 16:12:39 -07:00
Cory LaNou 74a0dc2e2a do not need a write lock, just read, better performance 2015-02-06 15:53:51 -07:00
Cory LaNou 339e170d82 start of a status http endpoint 2015-02-06 13:52:28 -07:00
David Norton 3f3c00da8d fix #1510: panics when measurement doesn't exist 2015-02-06 15:43:53 -05:00
Cory LaNou 3dec0e7ed5 remove debug output 2015-02-06 10:05:19 -07:00
Cory LaNou 973bb78808 add tests for logging unauthorized access request 2015-02-06 10:03:34 -07:00
Cory LaNou 4225cd7407 move Authorize from func to method for Server 2015-02-06 09:16:45 -07:00
Cory LaNou d23191b0d1 add additional comment to NewServer about authentication 2015-02-05 16:40:41 -07:00
Cory LaNou 09d4a4e2d7 no need to lock a bool 2015-02-05 16:20:02 -07:00
Cory LaNou 1604d7f604 refactor how we default authentication enabled 2015-02-05 15:54:32 -07:00
Cory LaNou f4dfb87acc first pass at hardening authorize 2015-02-05 14:39:40 -07:00
David Norton d0dc677292 fix #1516: ALTER RETENTION POLICY 2015-02-05 12:54:06 -05:00
Philip O'Toole b424c2fe0c Merge pull request #1503 from influxdb/top_level_timestamps
Fix batched writes
2015-02-04 08:25:46 -08:00
David Norton 2b84113487 issue #1423: wire up show field keys 2015-02-04 10:59:47 -05:00
Philip O'Toole 737f93f572 Sanity-check points before storing 2015-02-03 18:43:23 -08:00
Paul Dix 010e3d0be9 Change locks to read locks since that's what's actually needed 2015-02-03 21:36:41 -05:00
Ben Johnson 98421f6ccc Merge branch 'master' into batch
Conflicts:
	server.go
	tests/siege/urlgen
2015-02-02 20:57:05 -07:00
David Norton a8b86dc29b golint cleanup 2015-02-01 13:47:48 -05:00
Philip O'Toole 9846f05edf Quit value-less requests as soon as possible 2015-01-30 23:01:13 -08:00
David Norton 8693d771ed issue #1418: persit user after grant/revoke 2015-01-30 10:46:29 -05:00
David Norton 0b70307ca0 issue #1418: rm param from executeGrantStatement
- Remove database param from executeGrantStatement and use the database
  name specified in the ON clause.

- Add test for granting DB privilege.
2015-01-30 10:46:29 -05:00
David Norton d7814eb5f1 issue #1418: wire up revoke privilege 2015-01-30 10:46:29 -05:00
David Norton 5cfb8d9210 issue #1418: wire up grant permission 2015-01-30 10:46:29 -05:00
Philip O'Toole 9943f86cf4 Enable module-level logging 2015-01-29 15:07:58 -08:00
David Norton f827bf324a issue #1412: wire up show tag values 2015-01-29 15:01:25 -05:00
Ben Johnson 138474f9fe Add simple write series batching.
This commit adds a simple per-request batching of points during writes.
It sends all requests to the broker separately and in parallel and combines
the data at the end.

This is only a stop gap solution until we implement full batching.
2015-01-29 02:11:40 -05:00
David Norton f4383f330f issue #1411: fix result format 2015-01-28 21:33:19 -05:00
David Norton ae33bc99db issue #1411: wire up show tag keys 2015-01-28 21:33:19 -05:00
Cory LaNou 41cb753470 Need to custom unmarshal results 2015-01-28 15:44:49 -07:00
David Norton 4b8f9d8970 fix CREATE RETENTION POLICY ... DEFAULT 2015-01-28 14:27:05 -05:00
David Norton 204aad21d3 fix SHOW SERIES 2015-01-28 11:50:14 -05:00
Paul Dix 3ad3abaf64 Merge pull request #1398 from influxdb/show-queries
Show queries
2015-01-28 10:44:08 -05:00
Paul Dix 821d81c540 Remove writeseries band aid 2015-01-28 10:42:47 -05:00
Paul Dix d5c1406144 Fix locking on show queries 2015-01-28 10:41:10 -05:00
Ben Johnson c9a9f9b988 godoc 2015-01-28 03:59:02 -05:00
Ben Johnson c651fb497a Merge branch 'master' of https://github.com/influxdb/influxdb into normalize-query 2015-01-28 03:45:37 -05:00
David Norton 3a4d12aa76 wip 2015-01-28 03:45:21 -05:00
Ben Johnson ef50a180b4 Fix measurement persistence. 2015-01-28 02:53:16 -05:00
Philip O'Toole f37d7fe5f8 Merge pull request #1393 from influxdb/no_caps
'SHOW DATABASES' should output lower-case keys
2015-01-27 23:45:02 -08:00
Philip O'Toole 655fa7fd59 'SHOW DATABASES' should output lower-case keys 2015-01-27 23:40:49 -08:00
Ben Johnson dc6afbd2e2 Fix metastore copy. 2015-01-28 01:51:08 -05:00
David Norton 16eaae5fbd implement SHOW MEASUREMENTS 2015-01-28 00:51:09 -05:00
David Norton b50e4cc514 implement SHOW SERIES 2015-01-28 00:29:14 -05:00
Ben Johnson a3609ee5b5 Add statement normalization before execution.
This commit adds a call to Server.NormalizeStatement() immediately before execution. It defers normalization
just before execution in case statements leading up it will alter the normalization process.
2015-01-27 22:56:30 -05:00
Ben Johnson def5fc4703 Fix data node reload. 2015-01-27 22:44:22 -05:00
Philip O'Toole 5d26365c01 Merge pull request #1388 from influxdb/richer_api_response
Richer API responses for USERS and RPs
2015-01-27 17:51:48 -08:00
Philip O'Toole be02a9823c Add full details for 'SHOW USERS' 2015-01-27 17:49:28 -08:00
Ben Johnson 385687b8b4 Add multishard iteration. 2015-01-27 20:26:32 -05:00
Ben Johnson 1eda0ffcb9 Refactoring query engine. 2015-01-27 20:26:31 -05:00
Ben Johnson d340ffcf3c Expression expansion and reduction. 2015-01-27 20:26:31 -05:00
Philip O'Toole efefd73c70 Return full details for 'SHOW RETENTION POLICIES' 2015-01-27 16:48:04 -08:00
Philip O'Toole 34181592e9 Set DefaultShardRetention to 1 week 2015-01-27 16:43:21 -08:00
Philip O'Toole a197d16ac8 Add top-level "results" key
This brings the API output into line with the API specification.
2015-01-27 15:47:47 -08:00
Philip O'Toole aad0fe8bec Implement SHOW USERS 2015-01-26 19:12:24 -08:00
David Norton 780831bb17 change LIST to SHOW 2015-01-25 22:56:20 -05:00
Todd Persen dadd97e4e5 Change "code.google.com/p/go.*" to "golang.org/x/*" 2015-01-22 18:36:57 -05:00
Cory LaNou fd626de462 refactoring the refactoring 2015-01-21 18:13:51 -07:00
Cory LaNou 5421285be2 added version to server struct 2015-01-21 12:53:18 -07:00
Cory LaNou 5c0c728fc3 merge conflict 2015-01-21 11:06:59 -07:00
David Norton 2d34c71c0c Add authorization unit tests & code review fixes 2015-01-20 23:45:18 -05:00
David Norton 1796998614 Add authorization 2015-01-20 16:33:28 -05:00
Cory LaNou 3ab277214d first pass at moving handlers to httpd package 2015-01-20 10:50:13 -07:00
Ben Johnson 3c8c8724ed Implement full ident scanning, single quote strings. 2015-01-19 13:05:38 -07:00
Ben Johnson 6462608574 Merge branch 'master' of https://github.com/influxdb/influxdb into normalize 2015-01-18 14:45:39 -07:00
Ben Johnson 81f457907f Add measurement normalization and identifier splitting. 2015-01-18 14:45:22 -07:00
Cory LaNou 72281986b5 Merge branch 'master' into http-json-endpoint 2015-01-15 12:08:29 -07:00
Ben Johnson 2f2300f201 Code review fixes. 2015-01-15 10:35:42 -07:00
Ben Johnson 55d623220c Merge branch 'master' of https://github.com/influxdb/influxdb into engine-intg
Conflicts:
	server_test.go
2015-01-14 22:21:55 -07:00
Ben Johnson 0e2aae61e3 Basic query engine integration. 2015-01-14 16:44:09 -07:00
Cory LaNou a38b47f144 Merge branch 'master' into http-json-endpoint 2015-01-14 13:47:59 -07:00
Cory LaNou 14812626c6 allow json http endpoint to take batches and defaults 2015-01-14 13:45:42 -07:00
Philip O'Toole 771d70b55b Consolidate all switch statements 2015-01-14 12:26:29 -08:00
Philip O'Toole 8254928c21 'Command' -> 'Statement' 2015-01-14 12:25:48 -08:00
Philip O'Toole cbd006b437 Create distinct functions for each statement 2015-01-14 12:22:45 -08:00
Philip O'Toole 517f6e91d6 Push query execution in server 2015-01-14 11:37:01 -08:00
Cory LaNou 808a09af72 need to check that a database was found or we panic the server 2015-01-14 11:12:09 -07:00
Cory LaNou e4604fec36 Refactoring based on PR comments
Changing WriteSeries to take a slice of points instead of variable
arguments

Adding godoc comment for public type Point
2015-01-13 16:26:14 -07:00
Cory LaNou 9e48da134b change signature of WriteSeries to accept a public struct 2015-01-13 16:00:41 -07:00
Ben Johnson 47cd03f3d3 Partial engine integration. 2015-01-13 10:16:43 -07:00
Ben Johnson bbe7d1aa8c fix go vet 2015-01-13 08:00:30 -07:00
Ben Johnson d651deb0ab Fix server close race condition. 2015-01-13 07:47:45 -07:00
Ben Johnson fab5082144 Code review fixes. 2015-01-12 13:13:13 -07:00
Ben Johnson ff470047ef Code review fixes. 2015-01-12 13:10:26 -07:00
Ben Johnson 5652e12c63 Add write series. 2015-01-10 13:29:43 -07:00
Ben Johnson 6912c1415d Merge branch 'master' of https://github.com/influxdb/influxdb into write-series
Conflicts:
	server.go
2015-01-10 10:03:37 -07:00
Ben Johnson d9411c3d84 Merge branch 'master' of https://github.com/influxdb/influxdb into join
Conflicts:
	cmd/influxd/config.go
	cmd/influxd/run.go
2015-01-10 09:10:21 -07:00
Ben Johnson 946007916c Partial write series code. 2015-01-10 08:48:50 -07:00
David Norton c39d012a23 go vet cleanup 2015-01-09 20:08:55 -05:00
Philip O'Toole c64624abff Merge branch 'master' into graphite_distinct_servers
Conflicts:
	cmd/influxd/config.go
2015-01-08 12:31:21 -08:00
Philip O'Toole 8c2f894fab Integrate more code review feedback 2015-01-08 11:14:57 -08:00
Philip O'Toole f3650b4797 Implement a distinct Graphite Parser
This encapsulates a few previously free-floating methods. This means
that params such as "separator" and "last-enabled" are not passed from
function to function, and also makes initialization of TCP and UDP
Servers somewhat clearer.

It also removes early use of "GraphiteProcessor".
2015-01-06 23:20:01 -08:00
Ben Johnson 1f27d042c3 Remove debugging. 2015-01-06 17:29:51 -07:00
Ben Johnson 70d84a9a2e Merge branch 'master' of https://github.com/influxdb/influxdb into join
Conflicts:
	cmd/influxd/run.go
	handler.go
	server.go
2015-01-06 17:25:34 -07:00
Ben Johnson 50a0826026 Add broker snapshot/restore and CLI join. 2015-01-06 17:21:32 -07:00
Philip O'Toole 4c4950a796 Rename AuthenticatedUser to Authenticate
Feedback from final code review.
2015-01-06 09:19:31 -08:00
Cory LaNou 098231f3ea Merge remote-tracking branch 'upstream/master' into graphite 2015-01-05 20:16:38 -07:00
Philip O'Toole 6b7af89119 Add new wrapper handlers for User authentication 2015-01-05 16:03:05 -08:00
Philip O'Toole 77764169b4 Function to return whether there is an admin user 2015-01-05 16:03:05 -08:00
Paul Dix 7743310432 Merge pull request #1264 from influxdb/in_mem_tag_index
Add in memory tag and metastore index
2015-01-02 14:28:25 -05:00
Paul Dix b42def229a Update database style based on feedback 2015-01-02 14:02:02 -05:00
Cory LaNou cc4630e268 vet shoudl pass for server.go 2015-01-02 09:56:25 -06:00
Paul Dix d5548aa136 Refactor Index into database
* Pull database, Measurement, Series, ReplicationPolicy, and Shard into database.go to keep things manageable and clean
* Remove the locks from the index method. The server will handle thread safety for database objects
* Move the Index tests into database_test.go and in the influxdb package because we're not exporting database
2014-12-31 18:55:45 -05:00
Paul Dix 3aa46c6b8a Wire up TagValues on index. 2014-12-31 14:54:28 -05:00
Ben Johnson dbb089488f Create cluster on initial run. 2014-12-31 12:42:53 -07:00
Paul Dix 0f64a29d78 Fix merge conflicts 2014-12-30 17:50:55 -05:00
Ben Johnson 70d561aa6f Refactor main/run. 2014-12-30 15:46:50 -07:00
Paul Dix f763060b68 Refactor measurementIndex into the measurement object.
* Updated megastore to build the per database index for the server object
* Changed Server to have MeasurementNames and MeasurementSeriesIDs methods instead of generic Measurement method.
2014-12-30 16:45:58 -05:00
Ben Johnson 957ea91997 Add DataNode autoincrementing sequence. 2014-12-30 09:01:19 -07:00
Ben Johnson e88bd55762 Rename Node to DataNode. 2014-12-30 08:50:15 -07:00
Ben Johnson a04eb398cf Add node management. 2014-12-29 16:12:51 -07:00
Paul Dix e49d2b728b Rename TagIndex to Index 2014-12-26 11:10:46 -05:00
Paul Dix 9ec210f7f9 Add comments for clarity 2014-12-24 19:01:53 -05:00
Paul Dix bbe859c981 WIP: Add in memory tag and megastore index
* Refactor metastore to remove tag mappings
* Add TagIndex and tests
* Update server to use TagIndex
2014-12-23 23:46:54 -05:00
Ben Johnson 7a1de8a459 Use replica id instead of replica name. 2014-12-23 17:01:06 -07:00