Commit Graph

7133 Commits (a74f7e32aa1b3fcff2fe35b4ccaeb8109b5d52ba)

Author SHA1 Message Date
Philip O'Toole 5bb699e9a9 Enhance precreation log messages 2015-08-18 16:20:55 -07:00
Jon Seymour bdce79fe57 Merge branch 'secure-options-minimal' into secure-options 2015-08-19 09:15:58 +10:00
Jon Seymour e1dcdfc897 CHANGELOG.md: add #3686
Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2015-08-19 09:15:41 +10:00
Jon Seymour 1d5ff55d76 Remove redaction logic from parseCredentials.
We now redact the credentials in the logger, so the function implemented
by the deleted lines now seems redudndant.

Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2015-08-19 09:08:54 +10:00
Daniel Morsing e2db51e4d5 Merge pull request #3721 from influxdb/timeliteral
interpret number literals compared against time as nanoseconds from epoch
2015-08-18 14:31:53 -07:00
Daniel Morsing 8fb548b9cc update changelog 2015-08-18 14:30:11 -07:00
Daniel Morsing 59ee00ba0d interpret number literals compared against time as nanoseconds from epoch
fixes #3719
2015-08-18 14:20:20 -07:00
Paul Dix e7f7be4536 Merge pull request #3717 from benbjohnson/pd-wal
add WAL recovery
2015-08-18 17:12:55 -04:00
Ben Johnson 0f2d66fb70 add WAL recovery 2015-08-18 15:08:01 -06:00
Paul Dix 9df3b7d828 Add WAL configuration options 2015-08-18 16:59:54 -04:00
Philip O'Toole d036368e9c Merge pull request #3720 from influxdb/fields_test
Update test to also test Mapper fields
2015-08-18 13:46:35 -07:00
Philip O'Toole abcb9ef35e Update test to also test Mapper fields 2015-08-18 13:41:35 -07:00
Philip O'Toole 28a6b1f3fd Merge pull request #3697 from influxdb/chunking_10k
Merge same-series data if not chunking
2015-08-18 13:23:10 -07:00
Paul Dix 30bcd3e0e4 Combine all WAL partition cache maps into one 2015-08-18 10:18:06 -04:00
Paul Dix a3cdf0b97c Ensure that metadata is always loaded out of the index in sorted order 2015-08-18 08:27:09 -04:00
Paul Dix 41cf76f722 Fix vet 2015-08-18 08:15:02 -04:00
Paul Dix a509df0484 Compress metadata, add Delete to WAL.
* All metadata for each shard is now stored in a single key with compressed value
* Creation of new metadata no longer requires a syncrhnous write to Bolt. It is passed to the WAL and written to Bolt periodically outside the write path
* Added DeleteSeries to WAL and updated bz1 to remove series there when DeleteSeries or DropMeasurement are called
2015-08-18 08:10:51 -04:00
Jon Seymour 2805c4a9b5 Ensure 'p' parameter is not logged, even on OPTIONS requests.
Previously password redaction only occurred inside the
authentication handler and the authentication handler is not on
the request path for OPTIONS requests and, in any case, would
not be invoked because of an early return on OPTIONS
requests by the CORS handler.

Now, we change the response logger to explictly replace any
occurrence of the 'p' parameter from the query string with
'[REDACTED]' prior to logging the response.

Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2015-08-18 09:41:16 +10:00
Philip O'Toole 8de66eb370 Merge pull request #3705 from influxdb/dupe_log
Don't repeat retention policy log message
2015-08-17 16:19:44 -07:00
Philip O'Toole 6415944d01 Don't repeat retention policy log message 2015-08-17 16:15:51 -07:00
Philip O'Toole ccd1b7fc1c Merge pull request #3703 from influxdb/fill_issues
Add some unit tests related to partner testing
2015-08-17 14:40:26 -07:00
Philip O'Toole 0eb93d675d Add some unit tests related to partner testing 2015-08-17 14:36:13 -07:00
Philip O'Toole 836311c2b1 Update CHANGELOG 2015-08-17 13:43:20 -07:00
Philip O'Toole 487c336571 Correctly merge rows for identical series
If no chunking was requested by the user, the co-ordinating node buffers all
results in RAM before emitting a single result. However buffering was not
merging results for rows which had data for the same series. This change fixes this.

Fixes issue #3242.
2015-08-17 13:43:17 -07:00
Philip O'Toole deabf8d2a8 Minor GoDoc fix 2015-08-17 11:26:12 -07:00
Daniel Morsing ac8bf75f01 Merge pull request #3694 from influxdb/blockprof
adjust granularity of block profile
2015-08-17 10:04:46 -07:00
Daniel Morsing 29de960638 adjust granularity of block profile
32bit int platforms can't handle a constant this high, so cap it at
1 second instead.
2015-08-17 09:55:38 -07:00
Jason Wilder 6bdfa47065 Merge pull request #3693 from influxdb/jw-hh
Prevent out of memory range slices from being created
2015-08-17 10:52:35 -06:00
Jason Wilder 7cf31a74cd Prevent out of memory range slices from being created
If the hinted handoff segment is corrupt, the size read could be
invalid and attempting to create a slice using that size causes
a panic.  Ideally, we'd have a checksum on the seqment record but
for now just return an error when the size is larger than the
segment file.

Fixes #3687
2015-08-17 10:48:01 -06:00
Paul Dix 3348dab4e0 Fix bug with new shards not getting series data persisted. 2015-08-16 15:45:09 -04:00
Daniel Morsing 1548f6289f Merge pull request #3671 from influxdb/enginecache
protect engine points cache from concurrent modifications.
2015-08-16 11:12:51 -07:00
Paul Dix abc71aee53 Add failing test for metadata not getting persisted in new shards. 2015-08-16 12:46:50 -04:00
Paul Dix 9a53406e55 remove extraneous debug stuff 2015-08-16 12:46:50 -04:00
Paul Dix 6776014047 Fix bug in stress script, remove extraneous printlns 2015-08-16 12:46:50 -04:00
Paul Dix 48ede78d98 mend 2015-08-16 12:46:50 -04:00
Paul Dix a77a91933e WIP: fix bug with how bz writes index. fix bug with wal not having index set. 2015-08-16 12:46:50 -04:00
Paul Dix b583b896ce Integrate WAL and BZ1 and make BZ1 the default engine. 2015-08-16 12:46:50 -04:00
Paul Dix 301b014f3f Make WAL flush after inactive for writes for a given interval. 2015-08-16 12:46:50 -04:00
Paul Dix d4b04510ab Make flush check configurable to avoid race in tests 2015-08-16 12:46:49 -04:00
Paul Dix 006403ce1d Add WAL back pressure when over memory threshold 2015-08-16 12:46:49 -04:00
Paul Dix 1bffb70a61 Refactoring and cleanup based on PR comments 2015-08-16 12:46:49 -04:00
Paul Dix eebdd5b7db Add initial WAL implementation and tests 2015-08-16 12:46:49 -04:00
Philip O'Toole c2dbf16a8e Merge pull request #3676 from influxdb/memomize_key
Memomize tagset cursor's key
2015-08-14 20:39:18 -07:00
Philip O'Toole 0cf824713c Update CHANGELOG 2015-08-14 20:03:45 -07:00
Philip O'Toole 7e72a1a6b9 Precompute cursor keys
CPU profiling shows that computing the tagset-based key of each point is significant CPU cost. These keys actually don't change per cursor, so precompute once at mapper-open time, and then use those values as points are drained from the cursor.

Before this change the cursor tag was getting computed on every point, which involved marshalling tags.
2015-08-14 20:02:21 -07:00
Philip O'Toole 34dcead452 Update CHANGELOG for PR 3673
[ci skip]
2015-08-14 18:12:12 -07:00
Philip O'Toole 21a6bd267b Merge pull request #3673 from influxdb/dont_list
No need to list, just take map's size
2015-08-14 16:09:14 -07:00
Philip O'Toole 2a77726f94 No need to list, just take map's size
A particular test query goes from 2 minutes 40 seconds to 1 minute 25
seconds.
2015-08-14 16:00:12 -07:00
Jason Wilder 15f7eda702 Merge pull request #3672 from influxdb/jw-index
Remove unused in-memory index hash
2015-08-14 16:51:11 -06:00
Jason Wilder 1221de8cad Update changelog 2015-08-14 16:47:10 -06:00