Commit Graph

16277 Commits (c5ff8bf7c8083c954a35761604c3e2ae4b3681bb)

Author SHA1 Message Date
wei liu 1177ed1a33
fix duplicate watch channel task (#20667)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-17 15:05:08 +08:00
congqixia e6831d5029
Stop querynode for unit tests (#20665)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-17 14:23:08 +08:00
XuanYang-cn bd20536c6a
Reduce unnecessary logs of get compaction results (#20642)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-17 10:09:12 +08:00
groot 8da44638ac
Refine json parser for import (#20545)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-16 19:05:08 +08:00
ThreadDao a8b6906084
[test] Fix compaction case for insert during compact (#20628)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-11-16 16:53:08 +08:00
yah01 31872f436c
Only balance segments in targets (#20635)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-16 14:33:11 +08:00
cai.zhang 35db3d2352
Reduce log frequency in IndexCoord (#20629)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-16 14:23:09 +08:00
Jenny Li 7a413468ab
[skip e2e] Fix replace image tag logic (#20609)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-16 14:21:14 +08:00
congqixia b0a07983ce
Limit concurrency of decoded index file and do force gc (#20587)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 21:15:11 +08:00
cai.zhang 3c09a5f2e8
Use GetSegmentUnsafe when get unhealthy segment (#20617)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-15 19:55:07 +08:00
bigsheeper 2d307c1909
Set delBuf's start-end position of compacted segment (#20614)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:41:16 +08:00
zhuwenxing 50791bd932
[skip e2e]Fix verification of chaos delete (#20604)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 19:27:12 +08:00
zhuwenxing f077cfea68
[skip e2e]Fix deploy test (#20582)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 19:25:14 +08:00
zhuwenxing aa04787f32
[skip e2e]Add compact before verification (#20618)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 19:23:08 +08:00
XuanYang-cn 51093dfccd
Add a string func for allocation (#20611)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 19:21:12 +08:00
ThreadDao 5cb0de9daf
[test] Fix case compact during insert (#20561)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-11-15 19:11:06 +08:00
congqixia ac9a993a39
Fix querynode panics when watch/unsub runs concurrently (#20606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:03:08 +08:00
aoiasd d8f8296b03
Make internal proxy use internal port and isolate internal interface and external interface in proxy grpc server (#20558)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-11-15 16:53:07 +08:00
Ten Thousand Leaves f3ef430c2e
Keep individual segment's updates in a single Etcd operation (#20525)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 16:45:07 +08:00
congqixia 35ebd17fe4
Remove not needed RLock for getVersion (#20596)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 15:35:08 +08:00
zhuwenxing 3cb3cb7918
[skip e2e]Fix reconnection in chaos test (#20600)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 15:17:07 +08:00
Jenny Li 091291f99c
Make docker base separate from milvus image (#20473)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-15 15:15:07 +08:00
MrPresent-Han c848896bc8
Fix panic error due to rollDeleteOp ahead by load-and-delete (#20563)
issue:#20501
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-15 14:45:07 +08:00
bigsheeper db33ffa518
Pass endPosition with vchannel in datanode flowgraph (#20589)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 14:37:07 +08:00
zhenshan.cao c5dc076b04
Fix start of DataCoord (#20581)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-11-15 14:19:06 +08:00
yah01 2d806788fb
Add version for subscribed channel (#20585)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 13:21:07 +08:00
Ten Thousand Leaves 480a2b8632
Improve compaction logs (#20490)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 11:13:07 +08:00
Xiaofan 58ae746f69
Fix GC Tuner Overflow (#20497)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-15 10:43:06 +08:00
XuanYang-cn 3b45189ce9
Refine query logs (#20559)
See also: #20406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 10:37:08 +08:00
yah01 d37ebe538b
Record load latency for loaded collection (#20538)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 10:11:07 +08:00
yah01 bec1d4c50f
Revert "Make proxy process data definition requests concurrently (#20503)" (#20566)
This reverts commit 911921d5a7.

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 00:41:06 +08:00
liliu-z 0ae4e5265f
Optimize some low efficient code (#20529)
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
2022-11-14 21:05:07 +08:00
bigsheeper e73bdbe17d
Disk quota only checks healthy segments (#20574)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-14 21:03:09 +08:00
yah01 69481471ec
Remove unstable assertion for small segment indexed rows (#20569)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 19:41:07 +08:00
smellthemoon a7ba416b5a
Remove invalid timestamp (#20557)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-14 16:21:07 +08:00
yah01 911921d5a7
Make proxy process data definition requests concurrently (#20503)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 16:03:07 +08:00
smellthemoon 7325b3e1c3
Substitute traceid for msgid in rpc (#20450)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-14 15:29:06 +08:00
wei liu 6a2e458f90
fix collection not exist cause query coord panic (#20553)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-14 14:51:06 +08:00
Jenny Li 44aed995ae
[skip e2e] Add time caculate for cpp ut && go ut (#20552)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-14 14:43:06 +08:00
Xiaofan af66a0b621
Fix Time Tick session2ChanTs map use the same nodeID (#20537)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-14 14:41:11 +08:00
cai.zhang 2b02b869ec
Return real-time indexed rows and total rows (#20460)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-14 14:37:07 +08:00
Enwei Jiao b37a9c5fe2
Fix log to file not work (#20541)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-14 14:23:07 +08:00
Jiquan Long b11df55499
Fix test_compact_cross_partition (#20547)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-14 11:41:05 +08:00
groot e217b951ee
Fix bulkinsert bug for int64 value (#20491)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-14 10:15:10 +08:00
bigsheeper fc15789da9
Ensure compatibility of channel seek position and move syncPeriod to config (#20504)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-12 21:09:04 +08:00
congqixia c21497fbb4
Filter fake segments for recovery info (#20493)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-11 18:03:05 +08:00
yah01 a82c235599
Scheduler should returns err if the queue is full (#20465)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 17:55:05 +08:00
zhuwenxing f91c504db6
[test]Add bulk insert testcases (#20521)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-11 17:53:05 +08:00
binbin 97b3c34271
Modify test case for async indexing (#20516)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-11-11 16:43:04 +08:00
yah01 1a7912e300
Fix checkFullLoaded always returns all partitions as unloaded (#20514)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 16:17:04 +08:00