Commit Graph

13576 Commits (cf81a3e66e3a42a46f18f49f6cb78658529c45dd)

Author SHA1 Message Date
Jeff Wendling cf81a3e66e
Merge pull request #9770 from influxdata/jmw-inspect-series-file
Add verify-seriesfile to influx_inspect
2018-05-02 11:27:53 -06:00
Hercules Mango Churchill 0f90374627 Update changelog 2018-05-02 13:29:24 +00:00
Jonathan A. Sternberg 6607c29a02
Merge pull request #9649 from influxdata/js-eval-functions-in-where
Allow math functions to be used in the condition
2018-05-02 08:29:08 -05:00
Hercules Mango Churchill 3a9a046b59 Update changelog 2018-05-01 20:08:52 +00:00
Jonathan A. Sternberg 10ed277e7a
Merge pull request #9791 from influxdata/js-spread-stream-function
Optimize the spread function to process points iteratively instead of in batch
2018-05-01 15:08:34 -05:00
Hercules Mango Churchill ef505542ad Update changelog 2018-04-30 21:38:26 +00:00
Ben Johnson 2e470974ec
Merge pull request #9793 from influxdata/bj-delete-nonprintable-unicode
Add key sanitization to deletetsm
2018-04-30 15:38:08 -06:00
Ben Johnson f459d87325
Merge pull request #9785 from influxdata/rename-bad-tsm-file
Rename & log corrupt tsm files on load
2018-04-30 15:37:45 -06:00
Jacob Marble 63b9c98187 fix tests by closing iterators and cursors 2018-04-30 13:46:03 -07:00
Jacob Marble 7de2dcd3d9 TSM: TSMReader.Close blocks until reads complete 2018-04-30 13:46:03 -07:00
Ben Johnson 4cb36d5301
Add key sanitization to deletetsm
This commit adds the `-sanitize` flag to `influx_inspect deletetsm`
which will delete all keys that contain invalid, non-printable, or
replacement character unicode.

Usage:

```sh
$ influx_inspect deletetsm -sanitize PATH
```
2018-04-30 13:06:33 -06:00
Jacob Marble fa24142467 tsdb/indx/inmem: Fix megacheck issue 2018-04-30 10:25:07 -07:00
Jonathan A. Sternberg 9d049c4b62 Optimize the spread function to process points iteratively instead of in batch 2018-04-30 11:25:29 -05:00
Stuart Carnie e0ae9c5a2d tsm1: Replace goroutine `merge` with k-way merge
Previously replaced WalkKeys implementation for a considerable
improvement to startup time
2018-04-30 07:57:55 -07:00
Ben Johnson 108fa09439
Rename corrupt tsm files on load. 2018-04-27 14:27:44 -06:00
Jonathan A. Sternberg ecf474fd98
Merge pull request #9778 from influxdata/js-query-task-status
Include the query task status in the QueryInfo struct
2018-04-27 12:39:01 -05:00
Jacob Marble b23e32321c Remove unused code in tsdb/index/inmem 2018-04-26 13:19:01 -07:00
Jacob Marble 4282bf2744 Remove unused function parameter 2018-04-26 13:19:01 -07:00
Jeff Wendling 02b90d195e verify-seriesfile: update verbose logging 2018-04-26 12:54:32 -06:00
Jeff Wendling bc2801c3fc verify-seriesfile: some style and renaming fixes 2018-04-26 12:11:02 -06:00
Jonathan A. Sternberg d9a528ecd4 Include the query task status in the QueryInfo struct
Previously, the task manager was modified to keep the query status so it
could track which queries were running and which ones were killed.
In those previous versions, we removed a task from the process table
as soon as it was killed and did not remove it after it had finished
executing. This meant there could be zombie goroutines running in the
background that were impossible to see.

When the task manager was updated to track the task status, we forgot to
expose the status in the public interface so consumers could see the
task status.
2018-04-26 08:17:41 -05:00
Hercules Mango Churchill c3138fa926 Update changelog 2018-04-26 09:56:08 +00:00
Edd Robinson ba16268f41
Merge pull request #9777 from influxdata/er-index-log
Log information about index version during startup
2018-04-26 10:48:54 +01:00
Hercules Mango Churchill de942aca52 Update changelog 2018-04-26 09:42:32 +00:00
Edd Robinson a446134d6f
Merge pull request #8034 from dsouzae/br_validate_points
Validate points on input
2018-04-26 10:42:12 +01:00
Jeff Wendling c38108eb8a fix some megacheck errors 2018-04-25 18:14:25 -06:00
Jeff Wendling 388a664acc verify-seriesfile: verify partitions in parallel 2018-04-25 18:10:27 -06:00
Jeff Wendling 696ab40ddb verify-seriesfile: reduce compaction threshold in tests
helps it run faster, and hopefully not OOM in teeny environments.
2018-04-25 18:10:23 -06:00
Jeff Wendling adeec62c0d reorganize the verify commands into a folder 2018-04-25 18:10:22 -06:00
Jeff Wendling 3e7a01b1db refactor verify_seriesfile
- some style changes
- export and make usable the verify functions
- make smaller functions for verification
- change the flags to be more intuitive
2018-04-25 18:10:20 -06:00
Jeff Wendling 9f09a3c1c2 add tests for verify_seriesfile
does some basic sanity checks. it's hard to be more exhaustive without
either taking a crazy amount of time, or being non-deterministic,
but at least this makes sure we barf in some cases.
2018-04-25 18:10:19 -06:00
Jeff Wendling e771040a7d Add verify-seriesfile to influx_inspect
Fixes #9767
2018-04-25 18:10:17 -06:00
Jonathan A. Sternberg b326db531c
Merge pull request #9646 from influxdata/js-math-type-mapper-tests
Introduce unit tests for the math type mapper
2018-04-25 12:48:33 -05:00
tmgordeeva 79f2a6b996
Merge pull request #9752 from influxdata/tg-import
Command line tool to import binary format data
2018-04-25 10:05:54 -07:00
Tanya Gordeeva 0badc89b11 influx-tools/importer: Clean up shards with errors 2018-04-25 09:33:43 -07:00
Tanya Gordeeva 1ea9397353 influx-tools/importer: Binary format import command
Import command using the binary format reader to directly write TSM data,
optionally replacing existing retention policies and shards.
2018-04-25 09:33:43 -07:00
Tanya Gordeeva 15b46c8ebe influx-tools/importer: Binary format reader unit tests 2018-04-25 09:33:43 -07:00
Tanya Gordeeva 6f99a3cfad influx-tools/importer: Binary format reader
Binary format reader for output from `import-tools export -format binary`.
2018-04-25 09:33:43 -07:00
Jeff d21365d804
Merge pull request #9762 from influxdata/jmw-abstract-measurement-validation
Add FieldValidator to allow custom validations on measurements

Fixes #9745.
2018-04-25 10:23:37 -06:00
Jacob Marble 1c63c4a3da Fix tsdb/index/inmem benchmark tests 2018-04-25 08:51:28 -07:00
Jeff Wendling e5dbc18d0b remove bool return param from dataTypeFromModelsFieldType 2018-04-25 09:48:24 -06:00
Jeff 1816de09c1
Merge pull request #9769 from influxdata/jmw-flaky-subscriber-tests
fix flaky subscriber tests
2018-04-25 09:29:51 -06:00
Adam b3cd949c3f
Update backup flags to have long/short versions (#9713)
Updated flags, help text, removed documentation for deprecated legacy options.  Updated documentation to describe the  syntax and options for the newer -portable format. Legacy support remains, but is only referenced in the online documentation.
2018-04-25 10:49:46 -04:00
Edd Robinson 0b4a403679 Provide warning when mixed index used on db 2018-04-25 13:57:08 +01:00
Edd Robinson 32e195860b Log index type when opening shard 2018-04-25 13:02:09 +01:00
Jeff Wendling e89438f7c2 fix flaky subscriber tests
Fixes #9554.
2018-04-24 12:34:45 -06:00
Jacob Marble 63f0eee472 HLL++: estimate memory footprint bytes 2018-04-24 09:28:25 -07:00
Hercules Mango Churchill bac46fd1bb Update changelog 2018-04-24 16:06:02 +00:00
Jonathan A. Sternberg ba8dabbac0
Merge pull request #9260 from phemmer/ta_algs
Add additional technical analysis algorithms
2018-04-24 11:05:45 -05:00
Jonathan A. Sternberg d42062def2 Add technical analysis algorithms
This adds numerous technical analysis algorithms:

* exponential_moving_average
* double_exponential_moving_average
* triple_exponential_moving_average
* relative_strength_index
* triple_exponential_average
* kaufmans_efficiency_ratio (commonly referred to as just "Efficiency Ratio")
* kaufmans_adaptive_moving_average
* chande_momentum_oscillator (both the common 'smoothed' version, and the ta-lib version)
2018-04-23 22:27:21 -04:00