b19a8f3968
Fix alias, maintain column sort order
2015-08-06 14:01:03 -05:00
adaef74a44
Add invaled interger example
2015-08-06 10:43:30 -07:00
c0e9fdc3e0
Change float description
2015-08-06 10:43:06 -07:00
cb7f0b8228
Fix parsing string fields with newlines
...
Newlines in a string field would cause the parser to return
the line prematurely causing "unbalanced quotes" errors. This
makes the line scanning aware of quote fields so that the whole
line is returned.
Fixes #3545
2015-08-06 09:28:01 -06:00
5aacb3485b
Merge pull request #3570 from influxdb/jw-fuzz
...
Fix panics found via go-fuzz
2015-08-05 20:03:44 -06:00
4436036acd
Merge pull request #3544 from benbjohnson/bz1
...
BZ1 Pt. II
2015-08-05 16:56:03 -06:00
2d604ac537
Fix panics found via go-fuzz
...
Fixes #3288
2015-08-05 16:41:59 -06:00
25b2f7cbb1
Update line protocol README for new integer spec
...
As noted in https://github.com/influxdb/influxdb/pull/3526 writing
integer values now requires a tailing i. This commit updates the README
appropriately
2015-08-05 14:01:54 -07:00
56d962261e
Fix panic parsing measurement with large number of tags
...
Defaults to handling measurements with up to 100 tags and will
now grow the slice if there are more instead of panicing.
Fixes #3511
2015-08-05 12:45:55 -06:00
f7111e037b
add bz1 testing/quick coverage
2015-08-04 18:36:14 -06:00
d661bf1a06
fix #3414 : shard mappers perform query re-writing
2015-08-04 09:49:50 -04:00
d810682019
Merge pull request #3520 from influxdb/mas-optimize-key
...
Query performance optimization
2015-08-03 17:32:54 -04:00
4077148245
refactor bz1 to integrate with WAL
2015-08-03 14:32:17 -06:00
6be31e7f15
2015-08-03 14:32:17 -06:00
de09c02874
add benchmarks
2015-08-03 14:32:17 -06:00
1ada790de7
add bz1 storage engine
2015-08-03 14:32:17 -06:00
b003522a18
use heap for tagSetCursor lookahead
2015-07-31 13:28:46 -04:00
b154e64d42
add point conversion test for 1.0i
2015-07-30 20:55:08 -05:00
0b5eb09181
integers in line protocol now have to end with `i`
2015-07-30 20:51:18 -05:00
0b248e225c
Fix aggregate queries and time precision on where clauses.
2015-07-29 15:54:55 -04:00
a9cbf6c857
Rename v1 engine to b1
...
This commit changes the 'v1' engine to 'b1' to represent "bolt v1".
2015-07-29 08:55:07 -06:00
9949de3f44
Fix typo in comment
2015-07-22 13:59:43 -07:00
37c971bb82
Fix querying measurements with spaces
...
Fixes #3319
2015-07-22 14:49:54 -06:00
2a9f1d0704
remove Engine.DB
2015-07-22 11:08:10 -06:00
cc0607a5cf
remove Engine.Flush()
2015-07-22 11:08:10 -06:00
a7f50ae03c
refactor storage to engine
2015-07-22 11:08:10 -06:00
4dc15a833e
rename engine.go to executor.go
2015-07-22 11:07:06 -06:00
de1f9a3736
refactor tsdb tests into test package
2015-07-22 11:07:06 -06:00
42b4a0b8bf
string return is totally unused
2015-07-22 02:55:13 -07:00
45dcf9960c
Optimize the very inner loop of cursor iteration
...
This change moves tracking of next timestamp and values to simple
slices, as performance measurement showed that Peek() on TagSet cursors
was a huge performance drain. There is much more that can be done here,
but with this in place query performance has been restored to 0.9.1
levels.
This change also uses -1 to indicate that no value is available for a
given timestamp.
2015-07-22 02:55:09 -07:00
8c715f72ab
Merge pull request #3415 from influxdb/jw-3411
...
Fix parse stuck in loop causing 500 timeout
2015-07-21 14:14:36 -06:00
122d81bd43
Cosmetic change to mapper unit tests
...
This change makes it clear that the key "value" in the Mapper output is
a special value, and not related ot the field name of the input data.
2015-07-21 11:05:25 -07:00
f9287ad47d
Fix parse stuck in loop causing 500 timeout
...
Fixes #3411
2015-07-21 11:20:14 -06:00
7ee7dfd6e1
Merge pull request #3405 from jhorwit2/jah/3379
...
Fixes #3379 - added check for no fields in point
2015-07-21 11:18:58 -06:00
bfc55c16aa
Small refactor of store-creation test code
2015-07-21 09:44:59 -07:00
e19dea8703
Fixes #3379 - added check for no fields in point
2015-07-21 09:01:51 -04:00
7e0fa132c8
Raw query with no valid SELECT fields is not data
2015-07-20 15:59:52 -07:00
aeb51ec2f5
Remove existence restrictions on field and tags
2015-07-20 15:44:07 -07:00
9b19e1e664
Correctly build union of fields and tags
...
Previously the fields and tags were getting overwritten with every loop
of Sources.
2015-07-20 14:44:40 -07:00
df3caefcf9
stringSet now takes varadic slice to add
2015-07-20 14:40:39 -07:00
2aa2fe90dc
Merge pull request #3399 from influxdb/mapper-use-statement
...
mapper takes Statement instead of *SelectStatement
2015-07-20 15:57:56 -04:00
7e20c53025
mapper takes Statement instead of *SelectStatement
2015-07-20 15:48:38 -04:00
425a65fca1
RemoteShard mapping now performed over TCP
...
With this change remote mapping no longer uses HTTP, as the HTTP ports
exposed by nodes on the cluster are not known cluster wide. The TCP
ports exposed by the cluster service are, so this change uses that
functionality. Each RemoteMapper has its own dedicated connection pool
for each node, and remote mapping TCP connections are in no way coupled
with query TCP connections.
2015-07-20 10:44:38 -07:00
4569f3d2ea
Factor out aggregate-only code in LocalMapper Open
2015-07-18 22:37:41 -07:00
6b5b652f39
Correct explanatory comments for LocalMapper
2015-07-18 22:28:32 -07:00
3695ebcd4e
Move to a single LocalMapper type
2015-07-18 16:10:12 -07:00
a2e3f0af3c
Remove unused field attribute
2015-07-18 13:19:36 -07:00
abc05b0fa8
Remove unused decoders attribute
2015-07-18 13:14:58 -07:00
5016caabb1
One Query Executor to rule them all
...
This change significantly simplifies query executor code. Before this
change there were two types of executors -- RawExecutor and
AggregateExecutor. These two types only differed in one function
Execute(). Otherwise all other methods on the Executors were common and
duplicated between executors
This change merges the two executors into a single type called, wait for
it, Executor and simply switches execute functions depending on the
statement type.
2015-07-18 11:27:17 -07:00
f549910a18
Merge pull request #3279 from LK4D4/fix_style_else
...
Fix style issues with else
2015-07-17 11:53:42 -07:00
9ba37325f6
Fixes authorization.
...
Adds GRANT and REVOKE statements for admin privilege. Adds authorization to the query endpoint.
2015-07-17 11:33:06 -07:00
675eacbf2c
Fix style issues with else
...
In go it's better to just continue flow without "else", if it is return in
"if" statement.
Signed-off-by: Alexander Morozov <lk4d4@docker.com>
2015-07-17 11:10:23 -07:00
23b95bf939
Add comment re the complex mapperOutput type
2015-07-17 08:27:53 -07:00
b5984a7032
There is now a single StatefulMapper
2015-07-17 08:27:53 -07:00
5f357020c6
It's not raw or aggregate, it's just "mapper"
2015-07-17 08:27:49 -07:00
56b61beff9
Remove aggMapperOutput type
...
It's identical to rawMapperOutput type.
2015-07-17 08:23:36 -07:00
12f50eba04
Remove aggMapperValue type
...
Identical to rawMapperValue type.
2015-07-17 08:23:36 -07:00
dc0aadf3b0
aggMapperValue is the same as rawMapperValue
2015-07-17 08:23:36 -07:00
134ab87a49
Store a []interface{} in an interface{}
...
This is really pushing the type system, but needs to be done to cleanly
combine the raw and aggregate output mapper types.
2015-07-17 08:23:36 -07:00
0d6c6bbe6f
Correctly check if raw derivative is required
...
The multiple checks for Mapper and Executor type -- the lack of DRYness
in this code -- meant the same checks would need to be copied. Therefore
this change, as well as fixing the bug, improves the situation a little
bit by *asking* the Mappers what type of Executor is required. This code
is still not ideal.
Fixes #3355 .
2015-07-16 23:28:38 -07:00
a1ac8e49cc
Correct JSON tag name
2015-07-16 21:39:43 -07:00
3ddff9114d
Delimit measurement name for Mapper tagsets
2015-07-16 13:28:49 -07:00
d8c31f0b3c
Merge pull request #3320 from influxdb/streaming_dq
...
Support Distributed Queries
2015-07-16 12:33:21 -07:00
16250c5976
More replacement of "now" to outside loop
2015-07-16 12:19:46 -07:00
6131983f83
More unit tests of tagset ordering across Mappers
2015-07-16 11:42:08 -07:00
c468a65bd2
Actually check tagset when looking for lowest time
2015-07-16 11:33:09 -07:00
76d5b7085e
Add engine unit tests
2015-07-15 22:28:41 -07:00
2d162acb53
Rename query_engine.go to engine.go
...
The functionality in this file is more like the older file, so a rename
makes sense.
2015-07-15 22:06:08 -07:00
e254245f2f
Implement simple remote node choice policy
2015-07-15 19:53:10 -07:00
f41d2bab5d
Start move to unified query executor
2015-07-15 19:31:13 -07:00
74cb96646c
Refactor query engine for distributed query support
...
With this change, the query engine code gathers information about
shards and tagsets by working with individual shards, collating the
information, and returning that to the client. It does not assume that any
particular shard is local, and accesses all shards through abstracted
Mappers, of which there are two types -- a Mapper type for Raw queries
and a second type for Aggregate queries. There are corresponding
Executors for each type of Mapper, but both types of Executors share the
same interface.
2015-07-15 12:54:55 -07:00
09d7dfbaae
Form database path correctly on DROP DATABASE
...
Fixes #3330
2015-07-15 11:14:49 -07:00
ebd6e55997
Fix regression parsing boolean True/False values
2015-07-13 11:29:02 -06:00
f4f0373579
Sort points after appending if needed
...
Writing points that were not sorted by time could cause very high
CPU usages and increased latencies because each point inserted would
cause the in-memory cache to be resorted. The worst case would be
writing a large batch of N points in reverse time order which would
invoke N sorts of the slice.
This patch keeps track of which slices need to be sorted and sorts
them once at the end. In the previous example, the N sorts becomes
one. There is still a pathalogical case that would require N/2 sorts.
For example, 10000 points split across 5000 series. Each series has two
points that are in reverse time order. This would incur 5000 sorts still.
Fixes #3159
2015-07-13 10:51:58 -06:00
1641c25479
Fix panic parsing floats without decimal
...
Fixes #3289
2015-07-10 14:18:51 -06:00
7a87fbc58a
Flush WAL as fast as possible on start-up
...
This addresses complaints of long start-up times when there is lots of
data sitting in the WAL.
2015-07-08 17:14:28 -06:00
6b8d3268e6
Fix code review comments
2015-07-07 11:41:12 -06:00
cb75de8b7c
Use UTC for test assertion data
2015-07-06 21:11:09 -06:00
351bc03655
Don't panic if NaN or -/+Inf is used as a field value
...
These are not supported types but previously it would cause the
point.Fields() func to panic. This prevents it from panicing
so the values can be ignored if needed.
2015-07-06 16:14:02 -06:00
4d511571c5
Serialized unknown types as strings
...
When creating a point manually, the field values are interface{}
which allows unsupported types to be passed in. Previously, the
code would panic. It will now default to string representation of
the value if it's not a known type.
2015-07-06 16:14:02 -06:00
736f1c142e
Only start flush timer if duration is set
...
The default of 0 causes the time timer to flush immediately. If
only a batch size is set but not a time, the batch size setting does
not work.
2015-07-06 16:14:02 -06:00
a3ab093996
Parse NaN as float
...
Fixes #3230
2015-07-06 16:14:01 -06:00
dd66491f65
stringSet now returns elements in sorted order
2015-07-06 12:03:58 -04:00
ca86fa2633
Allow WAL inter-flush time to be configurable
2015-07-02 10:40:26 -04:00
39af8e49de
Remove obsolete retention config from tsdb
2015-07-01 09:39:11 -04:00
071c985b5b
Remove obsolete retention auto-create from tsdb
2015-07-01 09:37:29 -04:00
babc63d941
Use typed error for "field not found"
2015-06-30 14:17:04 -04:00
7a284885f2
Add helper to decode specific field by name
2015-06-30 14:16:54 -04:00
fde3d1f6a2
Remove unused, unexported function
2015-06-30 13:28:56 -04:00
41ae8bdae7
Handle escaped commas in measurement name
...
Fixes #3183
2015-06-29 15:15:50 -06:00
eb71f78afb
Merge pull request #3167 from influxdb/jw-2608
...
Fix panic when droppping measurement while writing to it concurrently
2015-06-29 14:05:42 -06:00
7232e6ea7c
Fix panic when droppping measurement while writing to it concurrently
...
Fixes #2608
2015-06-29 14:01:07 -06:00
5fccee3d16
Fix spelling errors in comments and strings.
2015-06-28 02:54:34 -04:00
1a5a8d1675
Fix typos in comments
2015-06-26 14:36:19 -06:00
d33b8bcd6a
Return parsing error when tag name is missing
...
Fixes #2678
2015-06-26 13:47:09 -06:00
5081481ca8
Return error when parsing fields with no name
...
Fixes #3061
2015-06-26 13:39:25 -06:00
b574e2f755
Add write ahead log
...
This commit adds a write ahead log to the shard. Entries are cached
in memory and periodically flushed back into the index. The WAL and
the cache are both partitioned into buckets so that flushing doesn't
stop the world as long.
2015-06-25 15:47:13 -06:00
17432598b1
Prevent out of range ints and floats from being parsed sucessfully
...
Field values that were out of range for the type would panic the database
when being inserted because the parser would allow them as valid points.
This change prevents those invalid values from being parsed and instead
returns an error.
An alternative fix considered was to handle the error and clamp the value
to the min/max value for the type. This would treat numeric range errors
slightly differently than other type erros which might lead to confusion.
The simplest fix with the current parser would be to just convert each field
to the type at parse time. Unfortunately, this adds extra memory allocations
and lowers throughput significantly. Since out of range values are less common
than in-range values, some heuristics are used to determine when the more
expensive type parsing and range checking is performed. Essentially, we only
do the slow path when we cannot determine that the value is in an acceptable
type range.
Fixes #3127
2015-06-25 14:49:42 -06:00
01440f90e9
Merge pull request #3095 from influxdb/beckettsean-patch-3
...
more examples for line protocol
2015-06-23 15:20:26 -07:00
c2a1511e2e
Update README.md
2015-06-23 15:19:53 -07:00
92b38583f3
more examples for line protocol
...
showing escape characters and proper string quoting
2015-06-22 17:10:24 -07:00
1d9aa31e7b
Merge pull request #3072 from influxdb/beckettsean-patch-3
...
typos, clarifications in line protocol doc
2015-06-22 17:00:31 -07:00
cb7baa6d9e
Don't group TagSets when tag values are identical
...
Fixes issue #3059
2015-06-22 16:04:13 -07:00
7873ccbb20
Merge pull request #3039 from neonstalwart/line-comments
...
allow comments in line protocol
2015-06-22 14:09:56 -06:00
cc7e59a12a
Merge pull request #3088 from influxdb/jw-field-values
...
Fix string field value escaping
2015-06-22 13:48:47 -06:00
2854108941
Fix string field value escaping
...
Commas and quotes could get escaped and parsed incorrectly if they
were both present in a string value.
Fixes #3013
2015-06-22 13:17:35 -06:00
01700f79b0
On DROP DATABASE remove from TSDB index
2015-06-22 11:44:46 -07:00
cb9a40df64
Fix invalid field value format not parsed correctly
...
A field value of just a numeric value would be accepted by the line
protocol parser but the value would be set as the field name and
the value would be nil. Instead, return an error because all field
values need a field name.
2015-06-22 10:35:08 -06:00
6911e752af
typos, clarifications
2015-06-19 17:58:28 -07:00
72a76e73f3
Add full example of line protocol
2015-06-19 08:14:38 -07:00
d6eeb12d67
Merge pull request #2997 from influxdb/jw-line-protocol
...
Add line protocol doc
2015-06-19 08:09:12 -07:00
b6252868cc
Add support for marshaling `uint64` in client.
2015-06-18 15:33:37 -07:00
d4a341a5ae
allow comments in line protocol
2015-06-18 14:03:27 -05:00
17be1e2f67
Remove measurement from shard index on a DROP
...
Fixes issue #2955
2015-06-16 12:14:33 -07:00
e0bfd827dc
Add line protocol doc
2015-06-15 16:47:04 -06:00
014eee6fa1
Remove stats support
...
This will soon be re-implemented using the expvar package.
2015-06-15 13:33:29 -07:00
05bd0fc53d
Check database existence during normalization
...
Statements were only being normalized if a default database was included
in the query (usually via the query param 'db'). However if no default
database was included, and none was an explicit part of the measurement
name, no database-existence check was run. This result in a later panic
with wildcard expansion.
2015-06-15 11:51:32 -07:00
e60645e1a2
Remove unused database param
...
It is not used by the code -- the database on the measurement object
that determines the target database.
2015-06-15 11:09:16 -07:00
36cde5f35e
Fix large integers getting converted to floats during remote writes
...
Fixes #2960
Integers were were written back to line protocol using strconv.FormatFloat
incorrectly. Large integers are written in scientific notation which
causes their type to change to a float when parsed back.
2015-06-12 11:20:37 -06:00
30068561ae
Fix parsing negative floats
...
Fixes #2919
2015-06-12 08:39:17 -06:00
861f63e33e
Merge pull request #2949 from influxdb/jw-error-responses
...
Add measurement name to type conflict error messages
2015-06-11 19:59:55 -06:00
be5491ea77
Merge pull request #2918 from pradeepchhetri/master
...
Fixed some typos
2015-06-11 18:28:24 -07:00
20fe5b0218
Add measurement name to type conflict error messages
...
Fixes #2948
2015-06-11 16:16:07 -06:00
c97dedfa3d
Be more explicit about boolean value parsing
...
Supported boolean values are now t, T, true, TRUE, f, F, false, and
FALSE. This is what the strconv.ParseBool function supports with
the exception of 1 and 0. 1 and 0 would be parsed as ints in the
line protocol.
Previously, any non-true value would be parsed as false. e.g.
value=blah would parse to false. This will now return an error as
parsing time.
2015-06-11 14:53:53 -06:00
6d115a7552
Return the line that failed to parse
...
Make it easier to find a bad line in a batch when writing points.
2015-06-11 13:59:30 -06:00
0d82acfde7
Prevent invalid numbers from being parsed via line protocol
...
Adds more tests for invalid numbers such as 0.1a, -2.-4, as well
test for supported formats for negative and positive integers/floats
as well as scientific notation.
2015-06-11 13:50:28 -06:00
b497256dc7
Fix panic when no value is passed to a field
...
Fixes #2927
2015-06-11 11:25:25 -06:00
37750acef6
Fixed some Typos
2015-06-11 17:33:26 +05:45
64af1b6241
Report number of measurements and series per node
2015-06-11 00:21:15 -07:00
ee5406d8a0
Merge pull request #2901 from influxdb/no_query_panic
...
SHOW DIAGNOSTICS is not yet (re)implemented
2015-06-10 21:12:02 -07:00
ffda846f33
SHOW DIAGNOSTICS is not yet (re)implemented
2015-06-10 21:09:25 -07:00
bc31783a00
Refactor backup and restore
...
This commit updates the snapshot code as well as the "backup" and
"restore" command to work with the new architecture.
2015-06-10 22:07:01 -06:00
325ca4ab4b
Merge pull request #2885 from influxdb/datatype-refactor
...
change influxql DataType from string to int
2015-06-10 21:06:08 -07:00
6d26f9c8a8
Merge pull request #2856 from influxdb/rv_fixes
...
Series was not already dropped, return false (and other fixes)
2015-06-10 20:57:46 -07:00
344a1f4948
Don't even return value from DropSeries
2015-06-10 20:50:07 -07:00
5ead14c1d0
Unit test returning empty set when no database
2015-06-10 19:22:16 -07:00
4c2c1ae1dd
Return empty results set if no shard meta database
2015-06-10 19:22:16 -07:00
10ca99ffb8
SHOW DIAGNOSTICS is not yet (re)implemented
2015-06-10 15:49:00 -07:00
0d9a2a5053
Fix wrong value used for incorrect type error message
...
Would result in saying that the field type was always a string which
is incorrect. The field key is a string but the value may not be.
Fixes #2700
2015-06-10 15:57:27 -06:00
67d4ef0e28
Don't queue write failures that due to type conflicts
...
These will never succeed and will stay in the queue indefinitely.
2015-06-10 14:52:59 -06:00
999f4a4c41
Return field type errors as client write errors
...
Fixes #2849
2015-06-10 14:52:26 -06:00
29777f2a8e
change influxql DataType from string to int
2015-06-10 16:02:26 -04:00
bc7e1f6fd6
Fix panic when adding new fields
...
Fixes #2869
When adding a new field to an existing measurment, Shard.validateSeriesAndFields
would also encode the fields as a side-effect. In the case of a new field
that needed to be created, the encoding would fail because the field type
had not been created for the measurement yet. The fields are re-encoded
after validateSeriesAndFields returns and after the field encoding have been
setup properly so this additional encoding during
validation isn't necessary.
2015-06-10 10:30:14 -06:00
98d315b8d8
Ensure tags are always marshalled the same way
...
This added check ensures it's always alphabetically ordered when
marshalled.
2015-06-09 17:10:46 -07:00
8a5b337ae5
There is no more metastore, so correct comment
2015-06-09 14:57:19 -07:00
3e969166c9
Fix parsing commas in string field values
...
Fixes a panic on writes because the field value was not parse correctly.
panic: unsupported value type during encode fields: <nil>
goroutine 117 [running]:
github.com/influxdb/influxdb/tsdb.(*FieldCodec).EncodeFields(0xc2081c4020, 0xc2081dc180, 0x0, 0x0, 0x0, 0x0, 0x0)
/Users/jason/go/src/github.com/influxdb/influxdb/tsdb/shard.go:573 +0x8e3
2015-06-09 15:53:21 -06:00
bc68afbe85
Fix minor spelling mistake
2015-06-09 14:35:38 -07:00
85fd3d0292
Series was not already dropped, return false
2015-06-09 14:25:20 -07:00
a43054adce
add test for querying across shards and fields
2015-06-09 12:51:59 -05:00
fc0bbaf0d1
fix #2814 : remove locking cruft from batcher
2015-06-09 00:34:46 -04:00
3b15a49f7c
fix #2814 : revert making batcher channels buffered
2015-06-09 00:34:46 -04:00
d5f52333a1
fix #2814 : hook collectd service back up
2015-06-09 00:34:46 -04:00
8f712eaf85
Ignore shards that don't have the selected measurement in them.
...
Fixes #2815 and fixes #2818 .
2015-06-08 17:14:42 +02:00
f39cddebf6
Fix locking on write path for getting measurement field encoding.
2015-06-07 11:09:47 +02:00
044e5b71f5
Remote temp dirs in store_test
2015-06-05 22:16:51 -06:00
b925e1c1af
Multi-node clustering.
...
This commit adds the ability to cluster multiple nodes together to share
the same metadata through raft consensus.
2015-06-05 14:41:19 -06:00
0ee71b9755
Merge pull request #2743 from influxdb/tsdb-benchmarks
...
add shard & index benchmarks
2015-06-05 13:15:38 -07:00
ca9f231fa1
Merge pull request #2776 from influxdb/enforce_retention_2_phase
...
Enforce retention policies
2015-06-05 11:15:21 -07:00
4ba7c5d1c1
Merge pull request #2787 from influxdb/pd-drop-database
...
Wire up DROP DATABASE query
2015-06-05 20:09:06 +02:00
61ac4aad80
Fix spelling in test
2015-06-05 20:07:52 +02:00
885e484746
Fix comment typo
2015-06-05 12:47:53 -04:00
70e10b136e
Wire up DROP DATABASE query.
2015-06-05 12:31:04 -04:00
81ec7353ce
TSDB store can return all known Shard IDs
2015-06-04 17:02:22 -07:00
55e0de30bd
Merge pull request #2773 from influxdb/pd-locking
...
Ensure proper locking of index structures on writes and queries.
2015-06-04 19:50:49 -04:00
9bf09ee026
Correct comments in tsdb/meta
2015-06-04 16:08:12 -04:00
c36f5f3f5f
Merge pull request #2771 from influxdb/enforce_retention_2_phase
...
Support deleting shards from TSDB store
2015-06-04 12:32:39 -07:00
5ea2042356
Add DeleteShard to TSDB store
2015-06-04 12:22:38 -07:00
408bc3f81e
Ensure proper locking of index structures on writes and queries.
2015-06-04 14:50:32 -04:00
bafdb7f7cb
explicitly parse time if needed
2015-06-04 12:15:18 -06:00
780fdedbd4
remove spew
2015-06-04 11:29:18 -06:00
47d605b69a
make line protocol round or parse precision as expected
2015-06-04 11:22:53 -06:00
3b9738c87a
fixing more error message regressions
2015-06-03 15:36:18 -06:00
3e7b458eae
fix regression in distinct on tags error
2015-06-03 15:28:45 -06:00
99446786f9
Merge pull request #2752 from influxdb/pd-drop-measurement
...
Wire up DROP MEASUREMENT
2015-06-03 14:02:37 -04:00
f5d59eca3d
Merge pull request #2756 from influxdb/integration-tests
...
And even more Integration tests
2015-06-03 11:56:36 -06:00
be91c40b9a
fix data race in WriteToShard
2015-06-03 11:46:18 -06:00
a7685767f8
Update comment
2015-06-03 13:26:49 -04:00
73a6c7e424
Merge pull request #2745 from influxdb/pd-shard-metadata-to-protobuf
...
Update metadata storage in the shard to use protobuf for serialization.
2015-06-03 11:33:25 -04:00
9c4da3002c
Wire up DROP MEASUREMENT
...
* Add deleteMeasurement to store and shard
* Add DropMeasurement to DatabaseIndex
* Update ErrMeasurementNotFound and ErrDatabaseNotFound to not include the first line of the stack trace.
2015-06-03 11:32:50 -04:00
938ad2ef85
add Store Open benchmark test
2015-06-03 10:09:50 -04:00
808e50f1cb
Add protbuf definitions and code
2015-06-03 09:16:38 -04:00
6f76a4774b
Update UnmarshalBinary comment to be correct
2015-06-03 07:36:39 -04:00
2d9c63f3bd
Update metadata storage in the shard to use protobuf for serialization.
2015-06-02 19:08:48 -04:00
31bb8e70a9
don't build index before benchmarking WritePoints
2015-06-02 17:17:31 -04:00
97c84a6d4f
add benchmark tests for shard WritePoints
2015-06-02 17:00:25 -04:00
67464238ed
add benchmarks for building in-mem series index
2015-06-02 17:00:25 -04:00
900903ee69
fix select tags
2015-06-02 14:48:33 -06:00
b18546be22
Fix tx.go after merge of alpha1
2015-06-02 14:56:20 -04:00
44d38cb430
Merge branch 'master' into alpha1
2015-06-02 10:40:52 -06:00
c098c6fd78
Merge pull request #2728 from influxdb/pd-tsdb-drop-queries
...
Wire up DROP SERIES.
2015-06-02 11:30:49 -04:00
4a1ce77090
Wire up DROP SERIES.
...
* Pulled over updates to ast and parser from master
* Updated store and shard to be able to drop series
* Pulled updates to database.go from master into tsdb/meta.go
2015-06-02 11:20:20 -04:00
4fa9fd5fe9
Merge pull request #2725 from influxdb/jw-client
...
Update client to use line protocol
2015-06-01 17:35:26 -06:00
5c851c4b1c
Fix panic: runtime error: slice bounds out of range in tsdb.measurementFromSeriesKey
...
Writing points without tags caused this since strings.Index(key, ",") returned
-1 if there were no tags.
2015-06-01 17:19:29 -06:00
d962283ae6
adding some integration tests
2015-06-01 16:04:20 -06:00
3597565955
reading and writing yo!
2015-06-01 11:59:58 -06:00
bf823d9887
Integrating cmd/influxd/run.
2015-05-30 14:06:36 -06:00
c916256ac9
Rename cluster.Writer to cluster.ShardWriter.
2015-05-30 14:05:27 -06:00
f3245ab9ac
Make Authenticate return true if no users and creating a root user.
2015-05-30 14:29:16 -04:00
89aee31a5d
Add comments and stub out `executeDropDatabase`
2015-05-30 12:10:24 -04:00
15d37fd388
Make store open every shard on load. Fix shard to set measurementFields on load.
...
Fixes issue where queries wouldn't be able to hit anything because the index does't load until the shard is open.
Fix an issue where field codecs weren't populated in the shard when loading.
2015-05-30 11:53:53 -04:00
cdc5a47efa
Clean up influxdb.
2015-05-30 08:14:10 -06:00
97f9670fa3
Fix influxql.Rows.
2015-05-30 07:19:19 -06:00
f66afc23bb
merging alpha1, fix vet errors
2015-05-29 15:28:08 -06:00
9d4527071e
Refactor run command.
2015-05-29 14:59:57 -06:00
1f294ce8de
Add httpd.Handler.serveQuery() tests.
2015-05-29 14:59:57 -06:00
f660b1a3d3
Create QueryExecutor in tsdb.
2015-05-29 14:59:57 -06:00
072dacc1ab
Update tx.go to work with tsdb
2015-05-29 14:59:57 -06:00
df1aeee70a
WIP
2015-05-29 14:56:30 -06:00
75ab63b538
Refactor meta statement execution to meta.StatementExecutor.
2015-05-29 14:54:04 -06:00
870a183576
Ensure comma,space and equals are escaped
2015-05-29 14:34:06 -06:00
4e7c8bdad2
Add ParsePointsWithPrecision to handle precision write argument
2015-05-29 11:18:40 -06:00
e1322bb7d9
Add initial write_points http handler for text protocol
2015-05-29 11:18:40 -06:00
9a9bb736f7
Add text protocol parsing and serialzation for points
...
This changes the implementation of point to minimize the extra
processing needed to parse and marshal point data though the system.
2015-05-29 11:18:40 -06:00
85f59d696b
Create and open shards on-demand
...
Uses a structure like:
/root/
/db1/rp1/1
/2
/db2/rp2/3
If a write is assigned to a shard on the local node but the shard
has not been created, create it when the write returns an error
and retry the write.
2015-05-26 16:38:45 -06:00
7ace10f7e6
Load shards from filesystem when tsdb.Store is opened
2015-05-26 15:43:46 -06:00
01618dc143
Move data.Node to tsdb.Store. Move data to cluster.
2015-05-26 15:56:54 -04:00
21bfb150a1
Wire up new write path
...
This allows the new write path to be hooked up if you start the
server with `INFLUXDB_ALPHA1=1`. When set, writes will go though
the coordinator and be stubbed out to write to a single local data
node with one shards. The write will be logged and written to
disk .
The env var is used so that the current write path is not completely
broken which would break many of the tests that depend on writes.
Note that queries are not currently working w/ the this change.
2015-05-26 12:07:56 -06:00
6c80108f63
Change Database to DatabaseIndex, remove leftover warn statement
2015-05-24 07:39:45 -04:00
c3ab88a715
Make the metadata index shared across shards while keeping field types and encoding local to each shard.
2015-05-23 18:06:07 -04:00
1076153a00
Convert Point to interface
...
Should be possible to replace the implementation with a more
optimized version now.
2015-05-22 15:39:55 -06:00
528f47e093
Convert Point.Fields to Point.Fields()
2015-05-22 15:22:03 -06:00
f8d599cda9
Convert Point.Tags to Point.Tags()
2015-05-22 15:12:34 -06:00
5dcab443dc
Move data.Point to tsdb.Point
2015-05-22 15:00:51 -06:00
8f937cae87
Initial implementation for writing data to a shard.
2015-05-22 16:11:18 -04:00
Cory LaNou
Michael Desa
Jason Wilder
Ben Johnson
David Norton
Cory LaNou
Philip O'Toole
Philip O'Toole
Josh Horwitz
gunnaraasen
Alexander Morozov
Joseph Crail
Sean Beckett
Todd Persen
ben hockey
Pradeep Chhetri
Paul Dix
Todd Persen