Commit Graph

286 Commits (bb350211e90008a2717fe92d751b216ed5d1d08f)

Author SHA1 Message Date
Philip O'Toole 9061a70953 Don't perform marshalling during field creation 2015-02-13 15:59:46 -08:00
Philip O'Toole 31f65361e4 Fix up locking 2015-02-13 15:41:27 -08:00
Philip O'Toole 75ebfaf3dd Use "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole 32faba7248 Add "create fields" broadcast message 2015-02-13 15:41:27 -08:00
Philip O'Toole c0655fb45d Release RLock if database does not exist 2015-02-13 15:19:17 -08:00
Philip O'Toole 0ca98ea6c2 Remove unmarshalValues 2015-02-12 16:07:25 -08:00
Philip O'Toole 5b8c0748af Remove marshalValues
Code now on Measurement type
2015-02-12 16:07:20 -08:00
Philip O'Toole bf9bfd6106 Error if field's type has changed 2015-02-12 16:06:37 -08:00
David Norton 8f9f8051a4 fix #1579: SHOW MEASUREMENTS format 2015-02-11 23:03:44 -05:00
Philip O'Toole 19cd5509c0 Retention policy and database were reversed in log 2015-02-11 10:11:09 -08:00
Philip O'Toole 8cb06c5b8e Refactor retention policy enforcement for testing 2015-02-11 09:54:07 -08:00
Philip O'Toole ddb57b4569 Explain why shard deletion may fail 2015-02-11 09:54:07 -08:00
Philip O'Toole 91f863258c Close shard before deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 65edd6b277 Detect shard groups due for deletion 2015-02-11 09:54:07 -08:00
Philip O'Toole 6a20100d2f Implement "delete shard group" command 2015-02-11 09:54:07 -08:00
Philip O'Toole 37647cc6a6 Add function to return shard group by ID
If shard groups were stored in a map by ID, this lookup could be sped
up.
2015-02-11 09:54:07 -08:00
Philip O'Toole 50ef1672cb Add stubbed enable of retention policy enforcement 2015-02-11 09:54:07 -08:00
Ben Johnson e4178520da Close shards on server close. 2015-02-10 22:18:36 -07:00
Philip O'Toole d00718c3a8 Update retention policy before saving database
Without this change, new shard group information is not persisted in the
metastore and only when the next database-save took place would this
update be persisted. If the server shutdown before the update, the new
shard group would be lost.
2015-02-10 19:21:02 -08:00
Philip O'Toole c003b39611 Only need read-lock for path 2015-02-10 16:53:43 -08:00
Philip O'Toole bb73ff8825 Only need a read lock for server ID 2015-02-10 16:51:01 -08:00
Cory LaNou 9bfbf15bad signature no longer requires database as an argument 2015-02-10 11:03:07 -07:00
Cory LaNou 0811af6211 sorting was not required, it was a testing setup issue 2015-02-10 09:49:22 -07:00
Cory LaNou adcf038323 Merge pull request #1550 from influxdb/cli-not-reporting-errors
CLI needs to echo out errors from client library.
2015-02-10 09:28:27 -07:00
Cory LaNou 1f56514c29 Merge pull request #1540 from influxdb/select-wildcard
Select wildcard functionality implemented
2015-02-10 09:07:31 -07:00
Cory LaNou 7b28df0d49 someone needs to add a precommit hook... 2015-02-10 08:54:19 -07:00
Cory LaNou 84ac4dbddb sort fields for select * for consitency in results 2015-02-10 08:40:40 -07:00
Todd Persen 6b70408864 Merge pull request #1351 from influxdb/go-external
Change "code.google.com/p/go.*" to "golang.org/x/*"
2015-02-09 20:23:26 -08:00
Cory LaNou 82ae461378 defend against select *,value 2015-02-09 19:59:13 -07:00
Cory LaNou 8a1bb5922c added wildcard query functionality. fixes #1432 2015-02-09 19:59:13 -07:00
Cory LaNou 804b426068 removing obsolete code 2015-02-09 19:58:11 -07:00
Cory LaNou f84ea8268a Merge pull request #1526 from influxdb/http-status-endpoint
Start of a status http endpoint
2015-02-06 16:12:39 -07:00
Cory LaNou 74a0dc2e2a do not need a write lock, just read, better performance 2015-02-06 15:53:51 -07:00
Cory LaNou 339e170d82 start of a status http endpoint 2015-02-06 13:52:28 -07:00
David Norton 3f3c00da8d fix #1510: panics when measurement doesn't exist 2015-02-06 15:43:53 -05:00
Cory LaNou 3dec0e7ed5 remove debug output 2015-02-06 10:05:19 -07:00
Cory LaNou 973bb78808 add tests for logging unauthorized access request 2015-02-06 10:03:34 -07:00
Cory LaNou 4225cd7407 move Authorize from func to method for Server 2015-02-06 09:16:45 -07:00
Cory LaNou d23191b0d1 add additional comment to NewServer about authentication 2015-02-05 16:40:41 -07:00
Cory LaNou 09d4a4e2d7 no need to lock a bool 2015-02-05 16:20:02 -07:00
Cory LaNou 1604d7f604 refactor how we default authentication enabled 2015-02-05 15:54:32 -07:00
Cory LaNou f4dfb87acc first pass at hardening authorize 2015-02-05 14:39:40 -07:00
David Norton d0dc677292 fix #1516: ALTER RETENTION POLICY 2015-02-05 12:54:06 -05:00
Philip O'Toole b424c2fe0c Merge pull request #1503 from influxdb/top_level_timestamps
Fix batched writes
2015-02-04 08:25:46 -08:00
David Norton 2b84113487 issue #1423: wire up show field keys 2015-02-04 10:59:47 -05:00
Philip O'Toole 737f93f572 Sanity-check points before storing 2015-02-03 18:43:23 -08:00
Paul Dix 010e3d0be9 Change locks to read locks since that's what's actually needed 2015-02-03 21:36:41 -05:00
Ben Johnson 98421f6ccc Merge branch 'master' into batch
Conflicts:
	server.go
	tests/siege/urlgen
2015-02-02 20:57:05 -07:00
David Norton a8b86dc29b golint cleanup 2015-02-01 13:47:48 -05:00
Philip O'Toole 9846f05edf Quit value-less requests as soon as possible 2015-01-30 23:01:13 -08:00
David Norton 8693d771ed issue #1418: persit user after grant/revoke 2015-01-30 10:46:29 -05:00
David Norton 0b70307ca0 issue #1418: rm param from executeGrantStatement
- Remove database param from executeGrantStatement and use the database
  name specified in the ON clause.

- Add test for granting DB privilege.
2015-01-30 10:46:29 -05:00
David Norton d7814eb5f1 issue #1418: wire up revoke privilege 2015-01-30 10:46:29 -05:00
David Norton 5cfb8d9210 issue #1418: wire up grant permission 2015-01-30 10:46:29 -05:00
Philip O'Toole 9943f86cf4 Enable module-level logging 2015-01-29 15:07:58 -08:00
David Norton f827bf324a issue #1412: wire up show tag values 2015-01-29 15:01:25 -05:00
Ben Johnson 138474f9fe Add simple write series batching.
This commit adds a simple per-request batching of points during writes.
It sends all requests to the broker separately and in parallel and combines
the data at the end.

This is only a stop gap solution until we implement full batching.
2015-01-29 02:11:40 -05:00
David Norton f4383f330f issue #1411: fix result format 2015-01-28 21:33:19 -05:00
David Norton ae33bc99db issue #1411: wire up show tag keys 2015-01-28 21:33:19 -05:00
Cory LaNou 41cb753470 Need to custom unmarshal results 2015-01-28 15:44:49 -07:00
David Norton 4b8f9d8970 fix CREATE RETENTION POLICY ... DEFAULT 2015-01-28 14:27:05 -05:00
David Norton 204aad21d3 fix SHOW SERIES 2015-01-28 11:50:14 -05:00
Paul Dix 3ad3abaf64 Merge pull request #1398 from influxdb/show-queries
Show queries
2015-01-28 10:44:08 -05:00
Paul Dix 821d81c540 Remove writeseries band aid 2015-01-28 10:42:47 -05:00
Paul Dix d5c1406144 Fix locking on show queries 2015-01-28 10:41:10 -05:00
Ben Johnson c9a9f9b988 godoc 2015-01-28 03:59:02 -05:00
Ben Johnson c651fb497a Merge branch 'master' of https://github.com/influxdb/influxdb into normalize-query 2015-01-28 03:45:37 -05:00
David Norton 3a4d12aa76 wip 2015-01-28 03:45:21 -05:00
Ben Johnson ef50a180b4 Fix measurement persistence. 2015-01-28 02:53:16 -05:00
Philip O'Toole f37d7fe5f8 Merge pull request #1393 from influxdb/no_caps
'SHOW DATABASES' should output lower-case keys
2015-01-27 23:45:02 -08:00
Philip O'Toole 655fa7fd59 'SHOW DATABASES' should output lower-case keys 2015-01-27 23:40:49 -08:00
Ben Johnson dc6afbd2e2 Fix metastore copy. 2015-01-28 01:51:08 -05:00
David Norton 16eaae5fbd implement SHOW MEASUREMENTS 2015-01-28 00:51:09 -05:00
David Norton b50e4cc514 implement SHOW SERIES 2015-01-28 00:29:14 -05:00
Ben Johnson a3609ee5b5 Add statement normalization before execution.
This commit adds a call to Server.NormalizeStatement() immediately before execution. It defers normalization
just before execution in case statements leading up it will alter the normalization process.
2015-01-27 22:56:30 -05:00
Ben Johnson def5fc4703 Fix data node reload. 2015-01-27 22:44:22 -05:00
Philip O'Toole 5d26365c01 Merge pull request #1388 from influxdb/richer_api_response
Richer API responses for USERS and RPs
2015-01-27 17:51:48 -08:00
Philip O'Toole be02a9823c Add full details for 'SHOW USERS' 2015-01-27 17:49:28 -08:00
Ben Johnson 385687b8b4 Add multishard iteration. 2015-01-27 20:26:32 -05:00
Ben Johnson 1eda0ffcb9 Refactoring query engine. 2015-01-27 20:26:31 -05:00
Ben Johnson d340ffcf3c Expression expansion and reduction. 2015-01-27 20:26:31 -05:00
Philip O'Toole efefd73c70 Return full details for 'SHOW RETENTION POLICIES' 2015-01-27 16:48:04 -08:00
Philip O'Toole 34181592e9 Set DefaultShardRetention to 1 week 2015-01-27 16:43:21 -08:00
Philip O'Toole a197d16ac8 Add top-level "results" key
This brings the API output into line with the API specification.
2015-01-27 15:47:47 -08:00
Philip O'Toole aad0fe8bec Implement SHOW USERS 2015-01-26 19:12:24 -08:00
David Norton 780831bb17 change LIST to SHOW 2015-01-25 22:56:20 -05:00
Todd Persen dadd97e4e5 Change "code.google.com/p/go.*" to "golang.org/x/*" 2015-01-22 18:36:57 -05:00
Cory LaNou fd626de462 refactoring the refactoring 2015-01-21 18:13:51 -07:00
Cory LaNou 5421285be2 added version to server struct 2015-01-21 12:53:18 -07:00
Cory LaNou 5c0c728fc3 merge conflict 2015-01-21 11:06:59 -07:00
David Norton 2d34c71c0c Add authorization unit tests & code review fixes 2015-01-20 23:45:18 -05:00
David Norton 1796998614 Add authorization 2015-01-20 16:33:28 -05:00
Cory LaNou 3ab277214d first pass at moving handlers to httpd package 2015-01-20 10:50:13 -07:00
Ben Johnson 3c8c8724ed Implement full ident scanning, single quote strings. 2015-01-19 13:05:38 -07:00
Ben Johnson 6462608574 Merge branch 'master' of https://github.com/influxdb/influxdb into normalize 2015-01-18 14:45:39 -07:00
Ben Johnson 81f457907f Add measurement normalization and identifier splitting. 2015-01-18 14:45:22 -07:00
Cory LaNou 72281986b5 Merge branch 'master' into http-json-endpoint 2015-01-15 12:08:29 -07:00
Ben Johnson 2f2300f201 Code review fixes. 2015-01-15 10:35:42 -07:00
Ben Johnson 55d623220c Merge branch 'master' of https://github.com/influxdb/influxdb into engine-intg
Conflicts:
	server_test.go
2015-01-14 22:21:55 -07:00
Ben Johnson 0e2aae61e3 Basic query engine integration. 2015-01-14 16:44:09 -07:00
Cory LaNou a38b47f144 Merge branch 'master' into http-json-endpoint 2015-01-14 13:47:59 -07:00
Cory LaNou 14812626c6 allow json http endpoint to take batches and defaults 2015-01-14 13:45:42 -07:00
Philip O'Toole 771d70b55b Consolidate all switch statements 2015-01-14 12:26:29 -08:00
Philip O'Toole 8254928c21 'Command' -> 'Statement' 2015-01-14 12:25:48 -08:00
Philip O'Toole cbd006b437 Create distinct functions for each statement 2015-01-14 12:22:45 -08:00
Philip O'Toole 517f6e91d6 Push query execution in server 2015-01-14 11:37:01 -08:00
Cory LaNou 808a09af72 need to check that a database was found or we panic the server 2015-01-14 11:12:09 -07:00
Cory LaNou e4604fec36 Refactoring based on PR comments
Changing WriteSeries to take a slice of points instead of variable
arguments

Adding godoc comment for public type Point
2015-01-13 16:26:14 -07:00
Cory LaNou 9e48da134b change signature of WriteSeries to accept a public struct 2015-01-13 16:00:41 -07:00
Ben Johnson 47cd03f3d3 Partial engine integration. 2015-01-13 10:16:43 -07:00
Ben Johnson bbe7d1aa8c fix go vet 2015-01-13 08:00:30 -07:00
Ben Johnson d651deb0ab Fix server close race condition. 2015-01-13 07:47:45 -07:00
Ben Johnson fab5082144 Code review fixes. 2015-01-12 13:13:13 -07:00
Ben Johnson ff470047ef Code review fixes. 2015-01-12 13:10:26 -07:00
Ben Johnson 5652e12c63 Add write series. 2015-01-10 13:29:43 -07:00
Ben Johnson 6912c1415d Merge branch 'master' of https://github.com/influxdb/influxdb into write-series
Conflicts:
	server.go
2015-01-10 10:03:37 -07:00
Ben Johnson d9411c3d84 Merge branch 'master' of https://github.com/influxdb/influxdb into join
Conflicts:
	cmd/influxd/config.go
	cmd/influxd/run.go
2015-01-10 09:10:21 -07:00
Ben Johnson 946007916c Partial write series code. 2015-01-10 08:48:50 -07:00
David Norton c39d012a23 go vet cleanup 2015-01-09 20:08:55 -05:00
Philip O'Toole c64624abff Merge branch 'master' into graphite_distinct_servers
Conflicts:
	cmd/influxd/config.go
2015-01-08 12:31:21 -08:00
Philip O'Toole 8c2f894fab Integrate more code review feedback 2015-01-08 11:14:57 -08:00
Philip O'Toole f3650b4797 Implement a distinct Graphite Parser
This encapsulates a few previously free-floating methods. This means
that params such as "separator" and "last-enabled" are not passed from
function to function, and also makes initialization of TCP and UDP
Servers somewhat clearer.

It also removes early use of "GraphiteProcessor".
2015-01-06 23:20:01 -08:00
Ben Johnson 1f27d042c3 Remove debugging. 2015-01-06 17:29:51 -07:00
Ben Johnson 70d84a9a2e Merge branch 'master' of https://github.com/influxdb/influxdb into join
Conflicts:
	cmd/influxd/run.go
	handler.go
	server.go
2015-01-06 17:25:34 -07:00
Ben Johnson 50a0826026 Add broker snapshot/restore and CLI join. 2015-01-06 17:21:32 -07:00
Philip O'Toole 4c4950a796 Rename AuthenticatedUser to Authenticate
Feedback from final code review.
2015-01-06 09:19:31 -08:00
Cory LaNou 098231f3ea Merge remote-tracking branch 'upstream/master' into graphite 2015-01-05 20:16:38 -07:00
Philip O'Toole 6b7af89119 Add new wrapper handlers for User authentication 2015-01-05 16:03:05 -08:00
Philip O'Toole 77764169b4 Function to return whether there is an admin user 2015-01-05 16:03:05 -08:00
Paul Dix 7743310432 Merge pull request #1264 from influxdb/in_mem_tag_index
Add in memory tag and metastore index
2015-01-02 14:28:25 -05:00
Paul Dix b42def229a Update database style based on feedback 2015-01-02 14:02:02 -05:00
Cory LaNou cc4630e268 vet shoudl pass for server.go 2015-01-02 09:56:25 -06:00
Paul Dix d5548aa136 Refactor Index into database
* Pull database, Measurement, Series, ReplicationPolicy, and Shard into database.go to keep things manageable and clean
* Remove the locks from the index method. The server will handle thread safety for database objects
* Move the Index tests into database_test.go and in the influxdb package because we're not exporting database
2014-12-31 18:55:45 -05:00
Paul Dix 3aa46c6b8a Wire up TagValues on index. 2014-12-31 14:54:28 -05:00
Ben Johnson dbb089488f Create cluster on initial run. 2014-12-31 12:42:53 -07:00
Paul Dix 0f64a29d78 Fix merge conflicts 2014-12-30 17:50:55 -05:00
Ben Johnson 70d561aa6f Refactor main/run. 2014-12-30 15:46:50 -07:00
Paul Dix f763060b68 Refactor measurementIndex into the measurement object.
* Updated megastore to build the per database index for the server object
* Changed Server to have MeasurementNames and MeasurementSeriesIDs methods instead of generic Measurement method.
2014-12-30 16:45:58 -05:00
Ben Johnson 957ea91997 Add DataNode autoincrementing sequence. 2014-12-30 09:01:19 -07:00
Ben Johnson e88bd55762 Rename Node to DataNode. 2014-12-30 08:50:15 -07:00
Ben Johnson a04eb398cf Add node management. 2014-12-29 16:12:51 -07:00
Paul Dix e49d2b728b Rename TagIndex to Index 2014-12-26 11:10:46 -05:00
Paul Dix 9ec210f7f9 Add comments for clarity 2014-12-24 19:01:53 -05:00
Paul Dix bbe859c981 WIP: Add in memory tag and megastore index
* Refactor metastore to remove tag mappings
* Add TagIndex and tests
* Update server to use TagIndex
2014-12-23 23:46:54 -05:00
Ben Johnson 7a1de8a459 Use replica id instead of replica name. 2014-12-23 17:01:06 -07:00
Ben Johnson bc84151b00 Fix leaky shard creation. 2014-12-23 11:18:46 -07:00
Ben Johnson ca6d0e30af Code review fixes. 2014-12-23 08:47:32 -07:00
Ben Johnson b25ced9b8e Refactor database methods into server. 2014-12-22 23:18:05 -07:00
Paul Dix 4d4b9656c7 Add Fields to Measurement.
* Add Field
* Changes series on meta to measurements for consistency
* Update metastore to store serialized Series object instead of tags
2014-12-22 07:35:29 -05:00
Paul Dix f6948b14c8 Update Database and Metastore to keep series info
* Change database to keep all data under a bucket in bolt
* Subbucket under the database to keep tagbytes to ids
* Subbucket under the database to keep ids to tag values
2014-12-22 07:35:29 -05:00