c540b40f05
chore(deps): bump tokio from 1.12.0 to 1.13.0
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.12.0 to 1.13.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.12.0...tokio-1.13.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-11-01 11:21:59 +00:00
3ab81b7d7b
chore(deps): bump tracing-subscriber from 0.3.0 to 0.3.1
...
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing ) from 0.3.0 to 0.3.1.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.3.0...tracing-subscriber-0.3.1 )
---
updated-dependencies:
- dependency-name: tracing-subscriber
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-11-01 01:28:23 +00:00
6e29cec502
refactor: rename `query` mode to `database`
2021-10-27 09:31:46 +02:00
41bc373fe8
refactor: offer different modes via "run" CLI
...
Running a server is now using `influxdb_iox run MODE [args]`, e.g.
`influxdb_iox run query --server-id 1`. Another mode that will follow
soon is `router`.
The old syntax `influxdb_iox run [args]` (w/o the mode part) is still
supported but a deprecation note will be printed.
2021-10-27 09:31:46 +02:00
b7186d0bec
chore(deps): bump tracing-subscriber from 0.2.25 to 0.3.0
...
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing ) from 0.2.25 to 0.3.0.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.25...tracing-subscriber-0.3.0 )
---
updated-dependencies:
- dependency-name: tracing-subscriber
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-25 17:01:50 +02:00
bc7244c48e
chore: use Rust edition 2021
2021-10-25 10:58:20 +02:00
9c9a31a402
chore: remove unused `iox_data_generator` => `tracing-futures` dep
2021-10-19 14:46:26 +02:00
93987ff107
chore: remove unused `iox_data_generator` => `packers` dep
2021-10-19 14:46:26 +02:00
3f921d43e6
chore(deps): bump tracing-subscriber from 0.2.24 to 0.2.25
...
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing ) from 0.2.24 to 0.2.25.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.24...tracing-subscriber-0.2.25 )
---
updated-dependencies:
- dependency-name: tracing-subscriber
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 08:14:11 +00:00
b46541406a
chore: update itertools ( #2615 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-22 18:25:35 +00:00
a51e9d8c19
chore(deps): bump tracing-subscriber from 0.2.22 to 0.2.24
...
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing ) from 0.2.22 to 0.2.24.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.22...tracing-subscriber-0.2.24 )
---
updated-dependencies:
- dependency-name: tracing-subscriber
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-09-20 09:27:21 +00:00
3ffb16daa6
feat: remove parse_duration ( #2574 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-19 11:27:24 +00:00
69939a5ae2
perf: Don't open the output file each time we write.
...
This improves performance of the the file output mode, which should
make it easier to improve the performance of the core generation
logic.
Benchmarked via:
```
time \
./target/release/iox_data_generator \
--spec iox_data_generator/schemas/fully-supported.toml \
--output /tmp/out \
--start '1 month ago'
```
Before:
```
Submitted 271608 total points
real 10.912 10911567us
user 3.129 3129032us
sys 6.257 6257340us
cpu 86%
mem 7152 KiB
```
After:
```
Submitted 271588 total points
real 2.291 2291364us
user 1.969 1969357us
sys 0.058 58030us
cpu 88%
mem 7104 KiB
```
That's 21.0% of the previous time.
2021-09-16 10:57:59 -04:00
6d3ac4db46
chore: pr cleanup on data generator
2021-09-13 17:45:53 -04:00
32f2410597
feat: Add print to stdout to data generator ( #2512 )
...
This adds a flag to the data generator to print samples to standard out. It disables logging output so that only the line protocol is output.
2021-09-13 17:45:53 -04:00
914c6e712b
chore: remove rogue println in data generator
2021-09-13 17:45:53 -04:00
a94854d4d0
fix: build error in data generator bench
2021-09-13 17:45:53 -04:00
5f0b3b336e
refactor: optimizations to make tag set generation significantly faster
2021-09-13 17:45:53 -04:00
7f915ba9d4
feat: Add pre-generated values and tag sets to data generator
...
This adds the ability to pre-generate values and tag sets in the data generator. This makes it easy to have tags that depend on other tag values (like buckets in an org) and have tag values that have one associated tag (like if something is in production or staging environment). Follow on work will add the actual generation to the agent spec. An added bonus of these pre-generated values is that generating samples won't require any sort of template evaluation for all of the tags in the tag sets. Only unique values (like trace_id or span_id) would need to be generated during sampling generation.
2021-09-13 17:45:53 -04:00
a64e3d8adf
chore(deps): bump tracing-subscriber from 0.2.20 to 0.2.21
...
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing ) from 0.2.20 to 0.2.21.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.20...tracing-subscriber-0.2.21 )
---
updated-dependencies:
- dependency-name: tracing-subscriber
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-09-13 01:23:46 +00:00
bb4fba0c4c
chore: `iox_data_generator` QA
...
- Move main binary to `src/bin`. It's easier to reason about when all
binaries are in a single directory and the other files in `src` just
belong to the lib. Note that `cargo run [-p iox_data_generator]` still
works.
- Enable lints that we use elsewhere. Fix the few issues that were found
by this (e.g. broken intradoc links).
2021-09-07 11:05:09 +02:00
b67610d9b9
chore(deps): bump tokio from 1.10.1 to 1.11.0
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.10.1 to 1.11.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.10.1...tokio-1.11.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 09:11:38 +00:00
fdfec8fa4f
feat: create initial performance test ( #2358 )
...
* feat: introduce perf/perf.py: performance tests
* fix: use Python requirements.txt for dependency requirements
* chore: call ManagementService.GetServerStatus directly
* chore: s/decode()/text
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-03 13:20:45 +00:00
ecf1f99ddb
refactor: more flexible writer buffer config
...
This allows:
- different types (instead of guessing through the connection URL)
- sequencer counts (not used yet but will be by #2455 )
- extensible configs (e.g. to configure Kafka in a more granular way,
not wired up yet)
- future extensions (since we use a message now instead of a single
string)
**BREAKING: This requires changes for deployed systems / existing DBs!**
2021-09-02 16:41:35 +02:00
fee8a986b6
chore(deps): bump handlebars from 3.5.5 to 4.1.2
...
Bumps [handlebars](https://github.com/sunng87/handlebars-rust ) from 3.5.5 to 4.1.2.
- [Release notes](https://github.com/sunng87/handlebars-rust/releases )
- [Changelog](https://github.com/sunng87/handlebars-rust/blob/master/CHANGELOG.md )
- [Commits](https://github.com/sunng87/handlebars-rust/compare/v3.5.5...v4.1.2 )
---
updated-dependencies:
- dependency-name: handlebars
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:18:48 +00:00
64fca1ee34
feat: Support sampling interval strings in data generator
...
This changes the sampling_interval in the data generator to be a string, supporting things like ns, us, ms, s, m, h and others.
2021-08-25 17:35:01 -04:00
405e6d4bf5
refactor: avoid manual iteration
2021-08-20 16:14:10 -04:00
e854527182
chore: fixup data generator based on feedback
2021-08-20 11:08:45 -04:00
42fbb90d8c
feat: Add batching to the data generator
...
Adds batch_size to the data genrator to optionally gather multiple calls to generate for each agent. For example, if you have a sampling interval of 10 seconds and start at some point back in time with a batch size of 3, it gather 3 samplings before writing to the points writer. For runs against a server API, this will batch them together in a single API call.
2021-08-20 11:08:45 -04:00
033035d10a
docs: Update a few more instances of un-prefixed data_generator
2021-08-19 15:23:31 -04:00
7c401fbf28
fix: fmt in data generator field
2021-08-19 15:17:22 -04:00
31ead36fc0
test: Don't compare floats for strict equality
2021-08-19 15:02:34 -04:00
266dffea86
fix: Don't pass a unit value to a function arg
2021-08-19 15:00:19 -04:00
a72fb5b468
fix: Don't assert_eq on a bool
2021-08-19 14:56:52 -04:00
9fe1117d89
fix: Crate rename
2021-08-19 14:56:25 -04:00
d5f01a2a68
refactor: move data generator to IOx repo and fix build
2021-08-19 14:26:15 -04:00
dependabot[bot]
Marco Neumann
Raphael Taylor-Davies
Jake Goulding
Paul Dix
Paul Dix
Jacob Marble
Carol (Nichols || Goulding)