Commit Graph

5554 Commits (c4f32d44b526b1095c268a0240f2fa7d1dbeb1c8)

Author SHA1 Message Date
congqixia f0846fb79b
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-15 17:12:27 +08:00
Xiaofan 6d82ef8c20
fix garbage collector err handling (#18277)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-15 13:54:26 +08:00
bigsheeper d278213e4f
Check load request both in impl and task (#18276)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-15 10:24:28 +08:00
bigsheeper 73aef14820
Improve check of purge memory and change purge place (#18271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-15 10:22:27 +08:00
yah01 bb2ad23e55
GetQuerySegmentInfo returns sealed loaded segments (#18255)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-14 16:44:27 +08:00
cai.zhang 93d9dfad1a
Ignore task when IndexNode load empty index meta (#18266)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-14 15:08:28 +08:00
cai.zhang a47a414dce
Fix bug for IndexNode pod kill test (#18177)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-13 16:16:25 +08:00
xige-16 54d17bc5da
Fix query too slow when insert multi repeated pk data (#18231)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-13 10:22:26 +08:00
congqixia e5fe46124b
Fix isCompacting flag lost after segment clone (#18248)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-13 10:08:28 +08:00
Zach 84d73bd618
add package name in log contents (#18251)
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-12 23:02:26 +08:00
Jeng.Gwan a926a9eb66
Fix redundant string copy of PlaceholderGroup (#18236)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-12 15:48:25 +08:00
Cai Yudong 015a2f0866
Let growing segment call knowhere brute search API (#18227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-07-12 11:58:25 +08:00
bigsheeper 1da970af18
Remove useless statsService in QueryNode (#17395)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-11 15:12:25 +08:00
congqixia a9aff3a678
Allocate ID for each insertMsg (#18217)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-11 14:38:24 +08:00
yah01 08612ac56c
Fix QueryCoord unit test stucks (#18197)
Signed-off-by: yah <yang.cen@zilliz.com>
2022-07-11 12:44:25 +08:00
Xiaofan 653dce4948
Fix pulsar error check (#18207)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-11 10:56:25 +08:00
congqixia e61f61a9bd
Dedup insert msgs by MsgID in mqtt MsgPack (#18180)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-08 20:42:22 +08:00
bigsheeper 22508f36d3
Get search field id from search plan and log if loaded index when search segments (#18183)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-08 20:18:22 +08:00
cai.zhang 90faf4a212
Fix bug for IndexCoord recycles index files (#18168)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-08 16:54:22 +08:00
bigsheeper 0fb5e9c1a9
Remove load collection check in Proxy (#18166)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-08 16:12:25 +08:00
Ten Thousand Leaves ecc250c20e
Improve logs to better cover segment flush lifecycle (#18157)
/kind improvements

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-07-08 14:50:21 +08:00
zhenshan.cao 72910d65e0
Fix inconsistency in DataCoord (#18170) (#18171)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-08 13:48:21 +08:00
XuanYang-cn 53734bef58
Add seek msgID in DataNode (#17881)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-07-08 10:18:28 +08:00
wayblink 43ae6791e6
Make VChannelInfo read compatible with 2.0.2 (#17995)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-07-07 21:58:22 +08:00
codeman 5fda8261d0
Fix: Unable to list newly created credential users (#18117) (#18153)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-07-07 21:16:22 +08:00
cai.zhang 0c883b215b
Fix bug for IndexCoord ut (#18148)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 18:52:21 +08:00
cai.zhang 44e59d6318
Fix bug for clean etcd in QueryNCoord (#18145)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 18:32:21 +08:00
XuanYang-cn d9e8231728
Filter sealed segments (#18065)
- Remove FilterThreshold in DataNode
- Alter filter logic in flowgraph DDNode

See also: #17943

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-07-07 18:26:20 +08:00
cai.zhang 58a9a0b79a
Add license for new files (#18138)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 17:44:21 +08:00
cai.zhang c1a47c8941
Use struct channel instead of bool chan (#18140)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 16:20:22 +08:00
congqixia 543197c2be
Fix handoff segment unit test uses wrong node id (#18137)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-07 15:22:21 +08:00
cai.zhang 0ad15a22c8
IndexCoord handle events correctly (#17878)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 14:44:21 +08:00
congqixia 8f1ba6a0bb
Concurrent load segment stats log when initialize dataSyncService (#18125)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-07 14:32:21 +08:00
Jiquan Long 6df47c7faf
Change pulsar compression type to zstd-faster (#18121)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-07 11:16:22 +08:00
Enwei Jiao ca88e37c98
fix receive messages before waitToFinish (#18101)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-07-07 10:00:21 +08:00
Ten Thousand Leaves d4a1e94f32
Fix flush failure caused by empty stale segments (#18097)
/bug

issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-07-06 18:10:21 +08:00
SimFG 79523ff8d4
Fix the wrong log tag in the test case (#18103)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-07-06 15:38:20 +08:00
Zach 1c9647ff31
Merging multiple shard query/search requests into one rpc request if QueryNode is the leader of multiple shards of Collection (#17588)
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-06 15:06:21 +08:00
Xiaofan a9b1d71a8f
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-06 13:54:21 +08:00
Jiquan Long 44024c1b1d
Replace pulsar compression type zstd with lz4 (#18085)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-05 22:06:21 +08:00
bigsheeper 696d747afa
Check if loaded in Proxy when LoadCollection (#18074)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 21:16:20 +08:00
zhagnlu 257da153ce
Fix core dump when nq has no topk result (#17923) (#18051)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-07-05 19:48:20 +08:00
Cai Yudong 5edeeb5fcd
Define new SubSearchResult constructor to avoid memory copy for growing (#18000)
segment search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-07-05 17:14:20 +08:00
bigsheeper 7d6624fcad
Improve flow graph node name and log msgID in QueryCoord (#18043)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 16:46:23 +08:00
zhenshan.cao 749558d55b
Fix bug: get correct number of cpu (#17973) (#18030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-05 16:40:20 +08:00
congqixia 63230f0280
Fix data race in ShardCluster.SyncReplicas (#18054)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-05 13:16:20 +08:00
congqixia d652fa567a
Return NotShardLeader error code when dml channel is not watched (#18055)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-05 13:08:19 +08:00
Xiaofan b31f937301
Fix unsubscribe with subscription not exist (#18042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-05 10:12:20 +08:00
Bingyi Sun 1fd3ded815
Add querycoord v2 dir and proto (#18032)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-07-04 16:56:20 +08:00
xige-16 0702993106
Fix query not empty after delete string (#17953)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-04 16:54:20 +08:00