8b682fdeac
fix duplicate watch channel task ( #20670 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-17 15:31:09 +08:00
38845d9669
Reduce log frequency in IndexCoord ( #20638 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-17 15:13:08 +08:00
15ae68faa5
Refresh targets atomically ( #20666 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-17 14:15:08 +08:00
2917856793
Reduce unnecessary logs of get compaction results ( #20643 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-17 10:09:12 +08:00
279cf6f5e5
Revert Index Codec ( #20652 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-16 19:47:08 +08:00
6b1bb85426
Only balance segments in targets ( #20636 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-16 14:33:11 +08:00
d01092a119
Fix Index Codec memory and storage usage ( #20622 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-16 11:45:08 +08:00
31ee7098b5
Limit concurrency of decoded index file and do force gc ( #20624 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 23:55:09 +08:00
0ea2ff7858
Use GetSegmentUnsafe when get unhealthy segment ( #20620 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-15 20:55:08 +08:00
2880a75dfc
Fix querynode panics when watch/unsub runs concurrently ( #20606 ) ( #20619 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 20:03:06 +08:00
715878c86f
Set delBuf's start-end position of compacted segment ( #20615 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:43:08 +08:00
cb294d1441
Add some msgstream metrics ( #20601 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-15 19:41:16 +08:00
6c651d25a4
Ensure compatibility of channel seek position and move syncPeriod to config ( #20504 ) ( #20597 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:39:18 +08:00
d3dedfc933
Remove not needed RLock for getVersion ( #20596 ) ( #20613 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:27:12 +08:00
3d4cfe14f8
Add a string func for allocation ( #20610 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 19:21:12 +08:00
2dc6d0c92a
Keep individual segment's updates in a single Etcd operation ( #20612 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 19:19:06 +08:00
8791d1c4f3
Fix panic error due to rollDeleteOp ahead by load-and-delete ( #20563 ) ( #20603 )
...
issue:#20501
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-15 17:53:07 +08:00
a28edf9643
Add version for subscribed channel ( #20585 ) ( #20592 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:53:07 +08:00
69cbbfc44a
Record load latency for loaded collection ( #20538 ) ( #20590 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:25:08 +08:00
d1ee0bb43b
Add channel level checkpoint [ #20350 ] ( #20542 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 14:07:07 +08:00
663d4259d9
Refine query logs ( #20559 ) ( #20583 )
...
See also: #20406
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 12:25:07 +08:00
5cfff621ac
Avoid delete segment which has been loaded ( #20530 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-15 11:25:07 +08:00
221d044cdf
Disk quota only checks healthy segments ( #20576 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-14 22:07:07 +08:00
037f733c28
Fix GCTuner Overflow ( #20498 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-14 22:05:08 +08:00
c5c6875349
Return real-time indexed rows and total rows ( #20460 ) ( #20565 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-14 19:59:07 +08:00
a0b697d3ff
improve search latency ( #20472 )
...
Signed-off-by: wgcn <1026688210@qq.com>
2022-11-14 17:05:07 +08:00
c2dacde26b
Fix checkFullLoaded always returns all partitions as unloaded ( #20519 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 11:43:07 +08:00
bb19bf20d8
Scheduler should returns err if the queue is full ( #20539 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 10:27:07 +08:00
9aa2a0831d
Fix bulkinsert bug for int64 value ( #20506 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-14 10:15:10 +08:00
f857360cb4
enable delbuf auto flush function to avoid OOM when del msg accumulating ( #20213 ) ( #20512 )
...
issue: #19713
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-14 10:13:06 +08:00
056aebf9c2
Remove kafka consumer ack ( #20518 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-13 18:51:06 +08:00
2284378f87
Fix spell PQ error ( #20527 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:19:04 +08:00
5e87eced6d
Limit MinDim to build disk index ( #20495 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:17:09 +08:00
7c502601b1
skip balance on loading collection ( #20507 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 16:01:04 +08:00
8f13fcd612
Only log if the refresh actually happens ( #20505 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 14:37:05 +08:00
faa2df3aac
Clear stale replicas ( #20487 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 10:25:06 +08:00
47951a81a5
Drop fail jobs on indexnode ( #20425 ) ( #20496 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-11 09:57:04 +08:00
b565145ad1
Remove too frequent logs ( #20454 ) ( #20476 )
...
Half of the log messages come from this log if DataNode in stale.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-10 21:11:03 +08:00
0d5fbe8922
Fix GetDiskUsedSize not work ( #20469 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-10 20:37:04 +08:00
ea45a2aa4b
Refine QueryCoordV2 metrics ( #20471 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 17:09:06 +08:00
14a544d631
Fix delete log ( #20407 ) ( #20446 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:21:04 +08:00
dd4eb8ba0b
Fix some unreasonable logs in Proxy ( #20411 ) ( #20436 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:19:08 +08:00
d63e082a34
Fix log of RootCoord ( #20412 ) ( #20435 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:17:14 +08:00
dc147357d9
Fix log of alter collection ( #20413 ) ( #20428 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:15:04 +08:00
a1cd03ddca
Dont expire pending import tasks ( #20432 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-10 10:25:08 +08:00
13dbc0902b
Fix querycoord metrics ( #20429 ) ( #20448 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:13:04 +08:00
e34acf5f4e
Fix rootcoord metrics ( #20427 ) ( #20447 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:11:04 +08:00
6faa579928
Fix rpc log of Proxy ( #20409 ) ( #20441 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:03:05 +08:00
a1bc8c2bb2
Fix an error message ( #20404 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-09 14:51:03 +08:00
2c69b9e9e6
Add goroutine pool for creating index ( #20391 ) ( #20408 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-09 14:47:03 +08:00
wei liu
cai.zhang
yah01
XuanYang-cn
Xiaofan
congqixia
bigsheeper
jaime
Ten Thousand Leaves
MrPresent-Han
xige-16
wgcn
groot
Jiquan Long