Commit Graph

13795 Commits (adbfee28b321990d024fe1242b957aee3346666d)

Author SHA1 Message Date
Jonathan A. Sternberg b326db531c
Merge pull request #9646 from influxdata/js-math-type-mapper-tests
Introduce unit tests for the math type mapper
2018-04-25 12:48:33 -05:00
tmgordeeva 79f2a6b996
Merge pull request #9752 from influxdata/tg-import
Command line tool to import binary format data
2018-04-25 10:05:54 -07:00
Tanya Gordeeva 0badc89b11 influx-tools/importer: Clean up shards with errors 2018-04-25 09:33:43 -07:00
Tanya Gordeeva 1ea9397353 influx-tools/importer: Binary format import command
Import command using the binary format reader to directly write TSM data,
optionally replacing existing retention policies and shards.
2018-04-25 09:33:43 -07:00
Tanya Gordeeva 15b46c8ebe influx-tools/importer: Binary format reader unit tests 2018-04-25 09:33:43 -07:00
Tanya Gordeeva 6f99a3cfad influx-tools/importer: Binary format reader
Binary format reader for output from `import-tools export -format binary`.
2018-04-25 09:33:43 -07:00
Jeff d21365d804
Merge pull request #9762 from influxdata/jmw-abstract-measurement-validation
Add FieldValidator to allow custom validations on measurements

Fixes #9745.
2018-04-25 10:23:37 -06:00
Jacob Marble 1c63c4a3da Fix tsdb/index/inmem benchmark tests 2018-04-25 08:51:28 -07:00
Jeff Wendling e5dbc18d0b remove bool return param from dataTypeFromModelsFieldType 2018-04-25 09:48:24 -06:00
Jeff 1816de09c1
Merge pull request #9769 from influxdata/jmw-flaky-subscriber-tests
fix flaky subscriber tests
2018-04-25 09:29:51 -06:00
Adam b3cd949c3f
Update backup flags to have long/short versions (#9713)
Updated flags, help text, removed documentation for deprecated legacy options.  Updated documentation to describe the  syntax and options for the newer -portable format. Legacy support remains, but is only referenced in the online documentation.
2018-04-25 10:49:46 -04:00
Edd Robinson 0b4a403679 Provide warning when mixed index used on db 2018-04-25 13:57:08 +01:00
Edd Robinson 32e195860b Log index type when opening shard 2018-04-25 13:02:09 +01:00
Jeff Wendling e89438f7c2 fix flaky subscriber tests
Fixes #9554.
2018-04-24 12:34:45 -06:00
Jacob Marble 63f0eee472 HLL++: estimate memory footprint bytes 2018-04-24 09:28:25 -07:00
Jonathan A. Sternberg 373506e335 Add retention policy query parameter to queries 2018-04-24 11:21:12 -05:00
Hercules Mango Churchill bac46fd1bb Update changelog 2018-04-24 16:06:02 +00:00
Jonathan A. Sternberg ba8dabbac0
Merge pull request #9260 from phemmer/ta_algs
Add additional technical analysis algorithms
2018-04-24 11:05:45 -05:00
Jonathan A. Sternberg d42062def2 Add technical analysis algorithms
This adds numerous technical analysis algorithms:

* exponential_moving_average
* double_exponential_moving_average
* triple_exponential_moving_average
* relative_strength_index
* triple_exponential_average
* kaufmans_efficiency_ratio (commonly referred to as just "Efficiency Ratio")
* kaufmans_adaptive_moving_average
* chande_momentum_oscillator (both the common 'smoothed' version, and the ta-lib version)
2018-04-23 22:27:21 -04:00
Jeff Wendling 29a62e4f74 Add FieldValidator to allow custom validations on measurements
No appreciable changes in benchmark results. It seems like this
function is less than 4% of cpu time in the write workloads in the
benchmarks at least.
2018-04-23 20:21:27 -06:00
Hercules Mango Churchill c3af5bb845 Update changelog 2018-04-23 21:26:02 +00:00
Jonathan A. Sternberg cb565d8e9d
Merge pull request #9751 from influxdata/js-9721-multiple-nested-distinct-calls
Fix the validation for multiple nested distinct calls
2018-04-23 16:16:09 -05:00
Jeff 1147f19445
Merge pull request #9759 from influxdata/jmw-fix-shard-benchmarks
Fix shard benchmarks
2018-04-23 14:22:24 -06:00
Jonathan A. Sternberg 58bcc6fdc9 Fix the validation for multiple nested distinct calls 2018-04-23 14:38:02 -05:00
Jeff Wendling d55979450a Fix shard benchmarks
at some point, the Inmem field on the engine options became
required, but the benchmarks weren't updated.

also uses filepath everywhere when manipulating file paths.
2018-04-23 12:39:24 -06:00
Hercules Mango Churchill fbb3486352 Update changelog 2018-04-23 18:10:13 +00:00
Jonathan A. Sternberg 6d325398cb
Merge pull request #9757 from influxdata/js-suppress-write-log
Add suppress-write-log option to disable the write log when the log is enabled
2018-04-23 13:09:54 -05:00
Jonathan A. Sternberg a7e1da5f86 Add suppress-write-log option to disable the write log when the log is enabled 2018-04-23 12:45:48 -05:00
Jonathan A. Sternberg dff34939f8
Merge pull request #9028 from cbushko/lint-the-c-dirs
Fix linting on cmd files
2018-04-23 10:41:05 -05:00
Hercules Mango Churchill 1bf0d16dbf Update changelog 2018-04-20 14:14:40 +00:00
Ben Johnson dbbe9d8467
Merge pull request #9615 from influxdata/bj-check-shard-count-on-series-iterator-master
Remove error for series file when no shards exist
2018-04-20 08:14:24 -06:00
Ben Johnson 9a58835b82
Merge pull request #9743 from influxdata/bj-delete-tsm
Add 'influx_inspect deletetsm'
2018-04-20 07:41:25 -06:00
Stuart Carnie 14dcc5d6e7 PR feedback 2018-04-19 18:05:55 -07:00
Stuart Carnie 29ce031fc2 influx-tools/export: driver for reshaping and exporting data
The only file require in Enterprise is a reimplementation of main.go,
the server.Interface and server.MetaClient interfaces.
2018-04-19 18:05:55 -07:00
Stuart Carnie 9e79b5cbaf influx-tools/format: implementation of various series and value writers
A format.Writer is an abstraction for reading data from
storage.ResultSet and writing to various formats. Those included are

* binary: efficient binary format using protocol buffers. This is the
  expected format for the import tooling. The data is written in the
  desired shard group shape so that it can be read and streams to
  TSM files without further transformation.

* line: line protocol use for exporting field type conflicts or as an
  alternative, lossless export format

* text: two debugging modes for outputting series or series and values
  in a more efficient format that line protocol.

* discard: reads and discards the source data. This can be useful for
  benchmarking and profiling the read and decode performance.
2018-04-19 18:05:55 -07:00
Stuart Carnie 338d6b463d influx-tools/server: abstractions to simplify usage in Enterprise
This package is the only component that must be implemented to
use the influx-tools in the Enterprise edition.
2018-04-19 18:05:55 -07:00
Stuart Carnie a8f3c8ed5b import-tools: minimal storage API to read shard data efficiently
* this implementation produces a cursor per shard to permit the export
  tool to distinguish field type conflicts
2018-04-19 18:05:55 -07:00
Stuart Carnie a8692a9e24 services/meta: improve readability of Contains function, add unit tests 2018-04-19 18:05:55 -07:00
Stuart Carnie e7389b18c0 tsdb: add additional engine options
* filters allow specific combinations of database, retention policy and
  shard groups to be opened. This was added to reduce the start-up time
  of the export tool and limit the memory usage.
2018-04-19 18:05:55 -07:00
Ben Johnson 8c9d179a94
Add 'influx_inspect deletetsm' 2018-04-19 10:36:08 -06:00
Jacob Marble 232be14aef respect rp parameter in /query 2018-04-19 08:31:43 -07:00
Hercules Mango Churchill 12b1ecc40e Update changelog 2018-04-17 19:49:05 +00:00
Jonathan A. Sternberg 672a32a5ef
Merge pull request #9620 from Tomcat-Engineering/more-math-functions
Add more math functions to influxql
2018-04-17 13:07:12 -05:00
Tom Young 42581c7432 Add new math functions:
- abs
- asin, acos, atan, atan2
- exp, ln, log, log2, log10
- pow, sqrt
2018-04-17 12:56:36 -05:00
Jonathan A. Sternberg 7463195035
Merge pull request #9710 from jangaraj/master
Update client README - close client resources
2018-04-16 16:56:18 -05:00
Jacob Marble 321ae4ff04
update CircleCI config to 2.0 syntax (#9711)
* enable flaky test, see if CircleCI fails

* Use CircleCI 2.0 with docker layer caching

* update CONTRIBUTING
2018-04-16 12:00:44 -07:00
Jan Garaj fd3156e4c1 Update client README - close client resources 2018-04-16 18:45:58 +01:00
Stuart Carnie 7ebfc9c544 add default to avoid blocking 2018-04-12 15:42:33 -07:00
Adam a00e4dc70b
Changed file download retry rate to have exponential wait times (#9706)
* Changed file download retry rate to have exponential wait times

* Fixes from PR review
2018-04-12 15:21:02 -04:00
Jacob Marble 10a7ffb647
Check for errors from binary.Uvarint when reading TSI logs (#9705)
* Check for errors from binary.Uvarint when reading TSI logs

* also check len(parsed) == len(input)

* wrap binary.Uvarint

* make uvarint() more generally useful/used
2018-04-12 09:59:56 -07:00