76dbc44e3c
feat(storage): Add influxd inspect dumpwal tool ( #14237 )
...
* feat(storage/wal/dump): initial influxd inspect dumptsmwal implementation
* feat(storage/wal/dump): add org bucket formatting to dumpwal tool; improve test cases
* refactor(storage/wal/dump): add long description for dumpstmwal tool
* refactor(storage/wal/dump): rename dumptsmwal flag
* chore(storage/wal/dump): gofmt
* refactor(storage/wal/dump): update error printing in dumptsmwal tool
* refactor(storage/wal/dump): address review comments
* refactor(storage/wal/dump): rename dumpwal command source file
* refactor(storage/wal/dump): clarify print flag comment
* refactor(inspect): remote unnecessary for-loop in influxd inspect command
2019-08-23 13:05:06 -07:00
0cc9caa1d4
refactor(tasks): separate coordinator and middleware ( #14779 )
2019-08-23 19:05:13 +00:00
6ffbab89d4
Merge pull request #14316 from influxdata/mu-verify-series-2.x
...
feat(inspect): add verify-seriesfile tool to 2.x
2019-08-23 11:40:39 -07:00
6d361201d3
refactor(inspect): add shorthand for command line args
2019-08-22 11:01:02 -07:00
1ce93f0ca4
refactor(inspect): address config changes
2019-08-22 11:01:02 -07:00
6f5c81f0dc
feat(inspect): add verify-seriesfile to 2.x
2019-08-22 11:01:02 -07:00
ed7b88525b
fix(launcher): print inspect as a subcommand when running with --help flag
2019-08-21 16:15:30 -07:00
64e42271be
feat(cmd/launcher): add notification endpoint
2019-08-15 21:56:24 -04:00
757fb4f80c
Merge pull request #14280 from influxdata/er-rename
...
feat(fs): API for replacing os calls
2019-08-07 11:33:57 -07:00
a2fc43ff0c
Merge pull request #14470 from influxdata/mu-reportTSI-2.x
...
feat(tsi1): add report-tsi tool to 2.x
2019-08-07 19:30:58 +01:00
64747e9781
refactor(tsi1): address config changes to report-tsi tool
2019-08-05 10:03:32 -07:00
87730440ee
feat(cmd/launcher): add check to launcher
2019-07-31 19:00:26 -04:00
4fef1683a0
refactor(tsi1): address review comments for report-tsi tool
2019-07-26 16:21:11 -07:00
7ce1b8109f
chore(tsi1): Clean up flags and naming in report-tsi tool; add comments
2019-07-26 11:16:59 -07:00
9bd6200f15
fix(tsi1): make mergeable
2019-07-26 11:16:12 -07:00
17b1dd8562
feat(tsi1): add shorthand for --top flag as -t, plus cleaning
2019-07-26 11:12:15 -07:00
aa2f7a8ff7
feat(tsi1): add a --top flag for limiting output, output now sorted
2019-07-26 11:12:15 -07:00
32b283d25a
feat(tsi1/report): Add ability to filter by measurement; add additional maps for efficient retrieval of total org/bucket cardinalities
2019-07-26 11:12:15 -07:00
5e5fa96c5b
feat(tsi1): add flags for --org-id and --bucket-id
2019-07-26 11:12:15 -07:00
bfd38d93d8
feat(tsi1): provide API tooling for use in testing
2019-07-26 11:12:15 -07:00
8f99d20deb
feat(tsi1): port report-tsi tool to influxdb 2.x
2019-07-26 11:12:15 -07:00
eb6d0f4478
feat(tsi): report cardinality for all indexes, still needs to be cleaned
...
Fix iteration logic and clean up
2019-07-26 11:12:00 -07:00
99c0622ea0
fix(pkg/fs): merge branch 'master' into HEAD
2019-07-25 15:17:15 -07:00
a6a7d3471d
feat(cmd/influx): add flags for notification rule auth
2019-07-25 15:15:35 -04:00
149cbcf0e6
feat(cmd/influxd/launcher): add notification rule service
2019-07-25 15:15:35 -04:00
979c075931
Merge branch 'master' into HEAD
2019-07-22 10:21:59 -07:00
63c0f40548
fix(query): use auth-wrapped org and bucket services for query
2019-07-19 20:02:53 -06:00
42c893f31d
fix(cmd/influx): user flag shouldn't be ignore
2019-07-16 13:25:13 -04:00
030e11a82a
feat: Allow existing influxdb.ID type to be used as a pflag
2019-07-09 09:20:02 +10:00
00561d5a1b
feedback: Move verify routines to `tsm1` package for consistency
...
Should have left it there to begin with 🤣
2019-07-09 09:00:41 +10:00
46952afe37
feat(influxd): New influxd verify tsm-blocks command
...
This command performs verification of TSM blocks
* expected and actual CRC-32 checksums match
* expected and actual min and max timestamps match decoded
data
2019-07-09 09:00:41 +10:00
2202d727da
fixes merge conflicts
2019-07-08 14:07:04 -04:00
ca5a599261
Merge branch 'master' into er-rename
2019-07-08 13:42:24 -04:00
fe748128e3
replaces os.Rename calls w api calls to fs.RenameFile. tests now are failing
2019-07-03 13:14:43 -04:00
08e24faf4c
feat(tsdb): Add block exporter.
...
Adds export tooling to `influxd inspect export-blocks` so that we
can dump out block data in SQL format for better analysis during
the debugging process.
2019-07-01 10:10:52 -06:00
24baec9e6d
Gofmt verify-wal files
2019-06-27 16:28:28 -07:00
f4faa9b2f5
feat(storage): Small verify-wal output and test tweaks
2019-06-27 16:28:28 -07:00
c868ece4f6
feat(storage): Initial 2.x verify-wal tool functionality
2019-06-27 16:28:28 -07:00
9dc5438e06
feat(cmd/influxd): add http error handler
2019-06-26 21:39:22 -04:00
435c8bbed5
fix(task): add logging into the task analytical store ( #14124 )
...
* fix(task): add logging into the task analytical store
* add in more detail around log structure
2019-06-12 20:01:41 -06:00
04a427e99e
feat(tasks): add runID to Log struct
2019-06-06 11:24:38 -07:00
21c80f3e93
refactor(query/control): move the controller from flux to influxdb ( #13991 )
...
The controller implementation is primarily used by influxdb so it
shouldn't be part of the flux repository. This copies the code from flux
to influxdb so it can be removed from the next flux release.
2019-05-29 09:04:34 -05:00
4bbfa8c6f4
Merge pull request #13552 from influxdata/kv_log_time
...
feat(http): add audit log
2019-05-16 11:10:56 -04:00
f75f27c0bd
feat(http): add audit log
2019-05-16 10:57:28 -04:00
2e26f23f9e
feat(authentication): Add cli args for specifying session length and renewal ( #13924 )
...
Co-authored-by: Jade McGough <jade@influxdata.com>
* Add session renew option to launcher and use in middlewhere
* pass session options to services
* Update SessionAutoRenew to SessionRenewDisabled
* Add test for service constructor defaults
* Update changelog
2019-05-15 10:16:47 -07:00
3b6cf6234f
Update read/write generate token to have option to create all buckets token
2019-05-09 15:08:30 -07:00
fb39ac39ce
fix(storage): Store.Read behavior changed to return unsorted series keys
...
Closes #13581
2019-04-26 10:38:59 -07:00
ab8d964a85
fix(query): remove per-query memory limit from OSS
...
Fixes #13639 .
2019-04-25 15:08:07 -07:00
e75d10d6b7
test(launcher): fix ill-formatted query; range must come before filter
...
Until https://github.com/influxdata/flux/issues/1215 is fixed, the query
writer must make sure to always place a range directly after a from
operation. Otherwise the query will fail planning.
2019-04-25 11:16:11 -07:00
5c973b6830
fix(launcher): call Done on query that errors
2019-04-25 11:16:11 -07:00
9f39ddfbef
refactor(tasks): move validator to authorizer package
2019-04-24 11:36:54 -07:00
808acf4a56
Merge pull request #13392 from zhulongcheng/cmd-find-auth
...
feat(cmd/influx): find auths by org
2019-04-23 10:29:32 -07:00
bc17af2118
Merge pull request #13569 from influxdata/flux-staging
...
chore(dep): update Flux to v0.27.0
2019-04-22 18:34:39 -06:00
7a72c363f2
remove org from bucket
2019-04-22 18:39:05 -04:00
9d44ac3635
rename bucket organization to org
2019-04-22 18:39:01 -04:00
a49d1696dc
Merge branch 'master' into flux-staging
2019-04-22 14:25:33 -06:00
c9f94d4ee8
refactor(query): add parameters to query controller config ( #13554 )
...
Recently added to controller config:
ConcurrencyQuota
MemoryBytesQuotaPerQuery
QueueSize
2019-04-22 12:11:32 -07:00
726fbefe9a
Integrate the new changes to tasks ( #13473 )
...
* Integrat the new changes to tasks
2019-04-19 08:37:59 -06:00
4c77e3598b
Merge branch 'master' into flux-staging
2019-04-18 11:01:22 -06:00
cd64ec8718
Fix typos in miscellaneous packages
2019-04-17 13:30:22 -07:00
8b918539db
Merge branch 'master' into flux-staging
2019-04-17 12:26:10 -06:00
e00c071c2c
feat(influxdb): add query/write http event recorders
...
feat(http): add prometheus counters for tracking write/query usage
feat(http/metric): add metric recoder for recording http metrics
feat(prometheus): implement metric.Recorder for prometheus metrics
fix(prometheus): remove erroneous fmt.Printlns
feat(http): add prometheus registry to API backend
This was done as exposing prometheus metrics to a higher level was quite
difficult. It was much simple to simply pass the registry down to
anything that needs it.
feat(cmd/influxd/launcher): pass prom registry in on api backend
feat(http): collect metrics for write and query endpoints
This was much messier than I would have preferred. Future work is
outlined in TODOs.
review(influxdb): rename metric.Metric to metric.Event
2019-04-17 08:33:31 -04:00
17304da3da
feat(cmd/influx): find auths by org
2019-04-15 14:06:27 +08:00
b68b5053db
refactor: replace usages of the spec compiler with the ast compiler ( #13222 )
...
This replaces usages of the spec compiler with the ast compiler and it
removes the error message referencing the spec compiler as an available
input.
It does not remove any of the code using the spec compiler that is
involved for proxying requests and it does not remove it from the API.
2019-04-12 07:15:27 -07:00
16b9158b39
refactor(task): make tasks use new Query interface ( #13219 )
...
Fixes #12883 .
2019-04-12 07:15:27 -07:00
67bf2f54ac
Merge pull request #13052 from influxdata/auth_update_interface
...
fix(influxdb): updated auth shall return
2019-04-11 11:24:02 -04:00
f56c42794b
chore(tracing): Cleanup ( #13296 )
...
* chore(tracing): Cleanup
* broken test
* fix unused var
* fix test
2019-04-10 19:28:21 -07:00
fbd313456a
Merge pull request #13061 from influxdata/swagger_proto_definition
...
fix(http): swagger proto definition
2019-04-03 15:55:51 -04:00
1cf600aca9
remove proto
2019-04-03 15:42:25 -04:00
986a1acdbe
Update task executor to use a TaskService ( #13099 )
2019-04-02 15:55:31 -06:00
83000361c3
Update task coordinator to act as a TaskService middleware ( #13068 )
...
* Update task coordinator to act as a TaskService middleware
2019-04-01 16:45:44 -06:00
712010d013
if(influxdb): updated auth shall return
2019-04-01 12:56:29 -04:00
22dd44c4d1
Merge pull request #12955 from influxdata/auth_description_update
...
feat(kv): add auth description update
2019-03-29 14:08:34 -04:00
c78344c441
update task schedler to use the new task control service ( #12949 )
2019-03-28 16:52:25 -06:00
4d83e886fb
Merge pull request #12967 from zhulongcheng/cmd-kv-svc
...
refactor(cmd): replace bolt.Client with kv.Service
2019-03-28 12:32:42 -04:00
97140920a9
refactor(cmd): replace bolt.Client with kv.Service
...
Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>
2019-03-28 23:58:23 +08:00
a2c0bdbe77
feat(kv): add new update
2019-03-28 11:46:41 -04:00
90a48c74f6
test(launcher): test for query memory limits and launcher test helpers
2019-03-27 15:50:35 +01:00
dbca30dac5
Add integration tests for cache snapshotting
2019-03-25 11:44:01 +00:00
16cef36aa2
Move tests around
2019-03-25 11:44:01 +00:00
af3f7bc9cb
Add new cache configuration value
2019-03-25 11:44:01 +00:00
8abb76cb4e
Merge pull request #12710 from influxdata/sgc/data-gen
...
Add data generation subcommand to influxd
2019-03-20 11:08:49 -07:00
9541fbb859
fix(task): report query statistics correctly
...
The synchronous executor was missing a call to ResultIterator.Release.
The asynchronous executor wasn't even calling Query.Statistics.
Also add a test that the scheduler records the statistics to the run
log, and that the statistics are visible from the launcher test. The
launcher test is the most likely place to catch if something goes wrong
in the full stack.
2019-03-20 08:11:14 -07:00
8669e94904
feat(influxd): Add the generate subcommand
2019-03-19 21:52:26 -07:00
c4cc3ca7bc
Fix
2019-03-19 15:12:35 +00:00
f383ec9225
Add ability to use report-tsm programmatically
2019-03-19 14:29:25 +00:00
117a5a98e8
Static analysis
2019-03-19 14:29:25 +00:00
fb8db80c22
Add doc to sub-command
2019-03-19 14:29:25 +00:00
a3bab05cb1
Refactor command
2019-03-19 14:29:24 +00:00
f5e608bce6
WIP - defaults not working
2019-03-19 14:28:47 +00:00
70e5a33bff
Add inspect sub-command
2019-03-19 14:25:51 +00:00
d1e1d8f063
Add inspect sub-command
2019-03-19 13:47:36 +00:00
ce7b53ef37
feat(task): log authorization errors
...
This should simplify debugging when a user isn't allowed to do something
with a task, that they expect to be able to do.
2019-03-14 14:04:37 -07:00
c8d70fdaf0
feedback(influxd): Use InfoLevel constant
2019-03-14 09:23:54 -07:00
c7c58275f9
feedback(influxd): Respond to PR feedback
...
* Add CHANGELOG entry
* Remote erroneous comment
2019-03-14 09:23:53 -07:00
e8045ae187
feat(influxd): Migrate influxd binary to cobra Command package
...
This commit consists of several improvements or changes:
* migrate the influxd binary to cobra.Command
* introduce a default run sub-command to start the server
* register the run sub-command flags with viper
to maintain compatibility with the existing behavior of automatic
binding of flags to environment variables.
Closes #12602
2019-03-14 09:23:53 -07:00
9d3b5932ba
fix(influx): return the error when token file already exists
2019-03-07 20:10:48 -05:00
603a1f26e0
use tracing.StartSpanFromContext
2019-03-07 12:12:31 -07:00
9541e861a3
goimports -w -local github.com/influxdata/influxdb
2019-03-07 12:12:31 -07:00
92fa813c45
add spans to multiple services
2019-03-07 12:12:31 -07:00
Adam Perlin
George
maxunt
Max U
Nathaniel Cook
Kelvin Wang
Edd Robinson
Christopher Wolff
Stuart Carnie
Ben Johnson
Lyon Hill
Alirie Gray
Jonathan A. Sternberg
kelwang
Iris Scholten
Palak Bhojani
jlapacik
Jade McGough
Todd Persen
Michael Desa
zhulongcheng
Jacob Marble
Lorenzo Affetti
Mark Rushakoff
Jacob Marble