04605eb266
tsm1: speed up deleterange for large keys
...
rather than starting at the first key, do a binary search to the
first key. changes O(N) when deleting the largest key to O(log N).
benchmark old ns/op new ns/op delta
BenchmarkIndirectIndex_DeleteRangeFull-8 17884166763 738717473 -95.87%
2018-12-14 10:06:24 -07:00
687a390aaf
tsm1: add benchmarks for deletes
2018-12-14 10:06:24 -07:00
f383e8337a
test(tsdb/tsi1): test series id cache delete concurrently
...
Report the total number of gets, puts, and deletes at the end of the
test. I've found this kind of output to be a useful sanity check in
similar tests that exercise concurrency involving tasks.
Use a local random source in each goroutine. I unscientifically
eyeballed that to increase total operations by 5-10%.
Also call t.Parallel in a few more tests that involve disk access. This
shaves 1-2 seconds off the full tsi1 test suite on my machine.
2018-12-12 08:21:17 -08:00
eba485f2be
Fix nil tracker for full compactions
2018-12-11 18:30:59 +00:00
c4b42c72be
Add option to disable TSI metrics
2018-12-10 15:02:26 +00:00
6b63a3def7
Add option to disable sfile metrics
2018-12-10 14:36:28 +00:00
3ff39cd9dc
Merge pull request #1789 from influxdata/er-cache-size
...
Allow TSI cache to be dynamically altered
2018-12-10 11:23:15 +00:00
df0b084543
Merge pull request #1785 from influxdata/bj-tss-file-observer
...
Allow stats files to be observed for finishing/unlinking.
2018-12-07 18:46:35 -07:00
e0cddadffd
Allow TSI cache to be dynamically altered
2018-12-07 18:35:25 +00:00
73d8c85aa2
Allow stats files to be observed for finishing/unlinking.
...
This commit adds the `.tss` files generated for TSM statistics to
the `FileObserver` so that package users can be notified when new
stats files are created and removed.
2018-12-07 10:20:32 -07:00
e13309ebbe
Fix metric names
2018-12-07 16:37:17 +00:00
b015757c06
Ensure all tsi1 metrics support multiple instances
2018-12-07 14:32:34 +00:00
bff655786f
Ensure tsdb metrics properly registered
2018-12-07 14:32:34 +00:00
aa936df138
Ensure all tsm1 metrics support multiple instances
2018-12-07 14:32:34 +00:00
d94f898c8b
WIP
2018-12-07 14:32:34 +00:00
79b108d174
Fix bug with slice reuse
2018-12-07 14:32:34 +00:00
de491968ba
Fix rebase
2018-12-07 14:32:34 +00:00
93892c20ab
Fix test
2018-12-07 14:32:34 +00:00
a8b6827c9e
megacheck
2018-12-07 14:32:34 +00:00
2bb558a9d1
Ensure fileset protected by lock
2018-12-07 14:32:34 +00:00
a1804d27be
Fix race
2018-12-07 14:32:34 +00:00
f9a2f7a017
go fmt
2018-12-07 14:32:34 +00:00
e0c10227d0
Fix metric issue in series file
2018-12-07 14:32:34 +00:00
7960ccc320
Add TSI index metrics
2018-12-07 14:32:34 +00:00
55caa0fe54
Add RHH metrics
2018-12-07 14:32:34 +00:00
d1fe2bc188
Add series file metrics
2018-12-07 14:32:34 +00:00
8ca637bd80
Refactor default labels and retention metrics
2018-12-07 14:32:34 +00:00
6c5dec8f88
Refactor tracker names
2018-12-07 14:32:34 +00:00
44e5fbae0a
Convert WAL stats
2018-12-07 14:32:34 +00:00
3b980ed7e3
Convert Cache statistics
2018-12-07 14:32:34 +00:00
d61b9f1645
Convert Filestore stats
2018-12-07 14:32:34 +00:00
f56bc0853f
Convert TSM compaction stats to Prom metrics
...
This commits converts all the 1.x TSM compaction statistics, which
previously were written to an _internal db, to Prometheus metrics.
2018-12-07 14:32:34 +00:00
186e0392ed
Address PR feedback
2018-11-30 10:54:24 +00:00
e11789f46a
Omit unused receiver name: ST1006
2018-11-30 10:54:24 +00:00
eaa4a4f49a
Removes unused methods: U1000
2018-11-30 10:54:24 +00:00
9403c1ec8e
Ensure error strings not capitalised ST1005
2018-11-30 10:54:24 +00:00
308a5148cf
Remove iterators
2018-11-30 10:54:24 +00:00
98d24f7e3c
Merge pull request #1625 from influxdata/remove-influxdb-dependency
...
Remove influxdb dependency.
2018-11-29 14:23:00 -07:00
0084d4d824
Remove influxdb dependency.
2018-11-29 11:44:22 -07:00
7ccb201b80
Merge pull request #1332 from zhulongcheng/rm-create-series
...
Remove Index.CreateSeriesIfNotExists
2018-11-29 18:36:48 +00:00
1862b4421d
Integrate scanned values statistics tracking.
2018-11-28 15:32:06 -07:00
e22aff46cb
Force create TSS files.
...
This commit replaces an `os.OpenFile()` call with an `os.Create()`
call which drops `O_EXCL` for `O_TRUNC` since `.tss` files are only
created after `.tsm` files so lingering temporary files are safe to
overwrite.
2018-11-27 08:07:21 -07:00
ed799a3d6c
remove Index.CreateSeriesIfNotExists
2018-11-21 20:16:45 +08:00
dbfa140cc4
remove Engine.CreateSeriesIfNotExists
2018-11-21 20:16:45 +08:00
085ce852b7
remove CreateSeriesIfNotExists from engine tests
2018-11-21 20:16:45 +08:00
8ab01c99c0
test(tsdb/tsm1): skip long tests in short mode
...
The tsdb/tsm1 package was one of the test suites that took the longest
to run in platform with go test -short. The rule of thumb on the Go
project is that short mode should skip any individual test that takes
longer than one second. This change skips two such tests, and it
eliminates a string concatenation loop in two other tests, so that they
report completion in "0.00s" rather than about 0.94s, on my machine.
These cumulative changes take `go test -short ./tsdb/tsm1` from about 14
seconds to about 7 seconds on my machine.
2018-11-16 08:06:23 -08:00
bbd460e7d9
Add method QueryRawJSON to influxql.service (for querytest tool) ( #1402 )
2018-11-15 10:45:38 -08:00
e7bc29a590
reduce parsing and copying of tags
2018-11-15 20:45:16 +08:00
305ebb8729
fix: Allow compactor to make progress if v.MaxTime() != entry.MaxTime
2018-11-14 12:14:45 +00:00
b35533e7f7
chore: Compactor test which replicates issue #10465
...
Due to an encoding bug with simple8b, it is possible that the
MaxTime for a TSM index entry does not match the last encoded timestamp.
2018-11-14 12:14:43 +00:00
Jeff Wendling
Mark Rushakoff
Edd Robinson
Ben Johnson
zhulongcheng
Christopher M. Wolff
Stuart Carnie