Commit Graph

6095 Commits (dbcbe4d8f998bd098dcce233de11c76245e6764e)

Author SHA1 Message Date
bigsheeper dbcbe4d8f9
Disable tt delay protection (#20658)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-17 20:21:14 +08:00
wei liu 8b682fdeac
fix duplicate watch channel task (#20670)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-17 15:31:09 +08:00
cai.zhang 38845d9669
Reduce log frequency in IndexCoord (#20638)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-17 15:13:08 +08:00
yah01 15ae68faa5
Refresh targets atomically (#20666)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-17 14:15:08 +08:00
XuanYang-cn 2917856793
Reduce unnecessary logs of get compaction results (#20643)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-17 10:09:12 +08:00
Xiaofan 279cf6f5e5
Revert Index Codec (#20652)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-16 19:47:08 +08:00
yah01 6b1bb85426
Only balance segments in targets (#20636)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-16 14:33:11 +08:00
Xiaofan d01092a119
Fix Index Codec memory and storage usage (#20622)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-16 11:45:08 +08:00
congqixia 31ee7098b5
Limit concurrency of decoded index file and do force gc (#20624)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 23:55:09 +08:00
cai.zhang 0ea2ff7858
Use GetSegmentUnsafe when get unhealthy segment (#20620)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-15 20:55:08 +08:00
congqixia 2880a75dfc
Fix querynode panics when watch/unsub runs concurrently (#20606) (#20619)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 20:03:06 +08:00
bigsheeper 715878c86f
Set delBuf's start-end position of compacted segment (#20615)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:43:08 +08:00
jaime cb294d1441
Add some msgstream metrics (#20601)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-15 19:41:16 +08:00
bigsheeper 6c651d25a4
Ensure compatibility of channel seek position and move syncPeriod to config (#20504) (#20597)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:39:18 +08:00
congqixia d3dedfc933
Remove not needed RLock for getVersion (#20596) (#20613)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:27:12 +08:00
XuanYang-cn 3d4cfe14f8
Add a string func for allocation (#20610)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 19:21:12 +08:00
Ten Thousand Leaves 2dc6d0c92a
Keep individual segment's updates in a single Etcd operation (#20612)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 19:19:06 +08:00
MrPresent-Han 8791d1c4f3
Fix panic error due to rollDeleteOp ahead by load-and-delete (#20563) (#20603)
issue:#20501
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-15 17:53:07 +08:00
yah01 a28edf9643
Add version for subscribed channel (#20585) (#20592)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:53:07 +08:00
yah01 69cbbfc44a
Record load latency for loaded collection (#20538) (#20590)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:25:08 +08:00
bigsheeper d1ee0bb43b
Add channel level checkpoint [#20350] (#20542)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 14:07:07 +08:00
XuanYang-cn 663d4259d9
Refine query logs (#20559) (#20583)
See also: #20406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 12:25:07 +08:00
xige-16 5cfff621ac
Avoid delete segment which has been loaded (#20530)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-15 11:25:07 +08:00
bigsheeper 221d044cdf
Disk quota only checks healthy segments (#20576)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-14 22:07:07 +08:00
Xiaofan 037f733c28
Fix GCTuner Overflow (#20498)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-14 22:05:08 +08:00
cai.zhang c5c6875349
Return real-time indexed rows and total rows (#20460) (#20565)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-14 19:59:07 +08:00
wgcn a0b697d3ff
improve search latency (#20472)
Signed-off-by: wgcn <1026688210@qq.com>
2022-11-14 17:05:07 +08:00
yah01 c2dacde26b
Fix checkFullLoaded always returns all partitions as unloaded (#20519)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 11:43:07 +08:00
yah01 bb19bf20d8
Scheduler should returns err if the queue is full (#20539)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 10:27:07 +08:00
groot 9aa2a0831d
Fix bulkinsert bug for int64 value (#20506)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-14 10:15:10 +08:00
MrPresent-Han f857360cb4
enable delbuf auto flush function to avoid OOM when del msg accumulating (#20213) (#20512)
issue: #19713

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-14 10:13:06 +08:00
jaime 056aebf9c2
Remove kafka consumer ack (#20518)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-13 18:51:06 +08:00
xige-16 2284378f87
Fix spell PQ error (#20527)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:19:04 +08:00
xige-16 5e87eced6d
Limit MinDim to build disk index (#20495)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:17:09 +08:00
wei liu 7c502601b1
skip balance on loading collection (#20507)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 16:01:04 +08:00
yah01 8f13fcd612
Only log if the refresh actually happens (#20505)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 14:37:05 +08:00
yah01 faa2df3aac
Clear stale replicas (#20487)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 10:25:06 +08:00
cai.zhang 47951a81a5
Drop fail jobs on indexnode (#20425) (#20496)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-11 09:57:04 +08:00
XuanYang-cn b565145ad1
Remove too frequent logs (#20454) (#20476)
Half of the log messages come from this log if DataNode in stale.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-10 21:11:03 +08:00
xige-16 0d5fbe8922
Fix GetDiskUsedSize not work (#20469)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-10 20:37:04 +08:00
yah01 ea45a2aa4b
Refine QueryCoordV2 metrics (#20471)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 17:09:06 +08:00
Jiquan Long 14a544d631
Fix delete log (#20407) (#20446)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:21:04 +08:00
Jiquan Long dd4eb8ba0b
Fix some unreasonable logs in Proxy (#20411) (#20436)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:19:08 +08:00
Jiquan Long d63e082a34
Fix log of RootCoord (#20412) (#20435)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:17:14 +08:00
Jiquan Long dc147357d9
Fix log of alter collection (#20413) (#20428)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:15:04 +08:00
groot a1cd03ddca
Dont expire pending import tasks (#20432)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-10 10:25:08 +08:00
Jiquan Long 13dbc0902b
Fix querycoord metrics (#20429) (#20448)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:13:04 +08:00
Jiquan Long e34acf5f4e
Fix rootcoord metrics (#20427) (#20447)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:11:04 +08:00
Jiquan Long 6faa579928
Fix rpc log of Proxy (#20409) (#20441)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:03:05 +08:00
groot a1bc8c2bb2
Fix an error message (#20404)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-09 14:51:03 +08:00