Commit Graph

5522 Commits (8f1ba6a0bb0121a32cd5e1f4dba4a0747d4513ec)

Author SHA1 Message Date
congqixia 8f1ba6a0bb
Concurrent load segment stats log when initialize dataSyncService (#18125)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-07 14:32:21 +08:00
Jiquan Long 6df47c7faf
Change pulsar compression type to zstd-faster (#18121)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-07 11:16:22 +08:00
Enwei Jiao ca88e37c98
fix receive messages before waitToFinish (#18101)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-07-07 10:00:21 +08:00
Ten Thousand Leaves d4a1e94f32
Fix flush failure caused by empty stale segments (#18097)
/bug

issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-07-06 18:10:21 +08:00
SimFG 79523ff8d4
Fix the wrong log tag in the test case (#18103)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-07-06 15:38:20 +08:00
Zach 1c9647ff31
Merging multiple shard query/search requests into one rpc request if QueryNode is the leader of multiple shards of Collection (#17588)
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-06 15:06:21 +08:00
Xiaofan a9b1d71a8f
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-06 13:54:21 +08:00
Jiquan Long 44024c1b1d
Replace pulsar compression type zstd with lz4 (#18085)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-05 22:06:21 +08:00
bigsheeper 696d747afa
Check if loaded in Proxy when LoadCollection (#18074)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 21:16:20 +08:00
zhagnlu 257da153ce
Fix core dump when nq has no topk result (#17923) (#18051)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-07-05 19:48:20 +08:00
Cai Yudong 5edeeb5fcd
Define new SubSearchResult constructor to avoid memory copy for growing (#18000)
segment search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-07-05 17:14:20 +08:00
bigsheeper 7d6624fcad
Improve flow graph node name and log msgID in QueryCoord (#18043)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 16:46:23 +08:00
zhenshan.cao 749558d55b
Fix bug: get correct number of cpu (#17973) (#18030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-05 16:40:20 +08:00
congqixia 63230f0280
Fix data race in ShardCluster.SyncReplicas (#18054)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-05 13:16:20 +08:00
congqixia d652fa567a
Return NotShardLeader error code when dml channel is not watched (#18055)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-05 13:08:19 +08:00
Xiaofan b31f937301
Fix unsubscribe with subscription not exist (#18042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-05 10:12:20 +08:00
Bingyi Sun 1fd3ded815
Add querycoord v2 dir and proto (#18032)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-07-04 16:56:20 +08:00
xige-16 0702993106
Fix query not empty after delete string (#17953)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-04 16:54:20 +08:00
yah01 39db27865f
Refine log, remove huge logs (#18036)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-04 16:34:20 +08:00
zhenshan.cao 1647bebaf4
Count growing segment number to estimate cpu usage (#17820) (#18027)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-04 15:10:20 +08:00
zhenshan.cao 9bd35dd84e
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-04 11:10:20 +08:00
Jiquan Long 6954a5ba3e
Fix search successfully with invalid metric type (#17977)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-01 22:28:23 +08:00
yah01 4def7047b4
Fix the scheduler enqueues concurrent load tasks (#17950)
Signed-off-by: yah01 <yang.cen@zilliz.com>

related to #17850
2022-07-01 19:54:19 +08:00
congqixia 566f5b5766
Make querynode handle segmentChangeInfo with multiple vchannel (#18009)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-01 19:20:20 +08:00
yah01 66a04450ad
Fix LoadBalance Sync all segments to shard leaders (#18002)
Signed-off-by: yah <yang.cen@zilliz.com>
2022-07-01 19:18:24 +08:00
yah01 27eca2881a
Clean segments as releasing collection (#17932)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-01 19:16:25 +08:00
zhenshan.cao f33b090819
Fix bug: datarace in proxy unittest (#17990)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-01 17:56:21 +08:00
Jiquan Long 47c9e77155
Fix querycoord ut data race (#17980)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-01 10:58:18 +08:00
bigsheeper 641fb96958
Return malloc_trim result and log if malloc_trim successfully (#17959)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-01 10:44:18 +08:00
codeman 6ab850bedf
Fix update credential failure (#17963) (#17970)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-30 21:34:18 +08:00
congqixia f4177f4434
Remove growing according to offline as well (#17968)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-30 20:14:19 +08:00
cai.zhang 01fc411566
Handle etcd compacted error (#17886)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-30 18:54:19 +08:00
bigsheeper cdbd75d4dd
Log delta channel timetick in DataNode (#17947)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-30 17:44:18 +08:00
zhenshan.cao 0baeb609dc
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-30 17:26:19 +08:00
Xiaofan a803f9e4b0
Fix Wait Group Race in Msgstream (#17931)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-30 10:38:18 +08:00
yah01 ef6859a4d6
Refactor handoff handler (#17806)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-29 23:26:19 +08:00
codeman 95a3830dc6
fix password comparison too slow (#17874) (#17897)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-29 20:02:18 +08:00
XuanYang-cn ff3c4ab2a8
Fix compaction panic (#17840)
See also: #17823

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-29 16:54:17 +08:00
Bingyi Sun 24b3ad22d7
Fix msgstream close block. (#17880)
issue: #17513
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-06-29 16:24:20 +08:00
congqixia c179986e6c
Fix shard cluster segments data race (#17903)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-29 16:20:19 +08:00
congqixia 106f19a7b8
Fix querycoord cannot update deltaChannel info (#17901)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-29 15:38:17 +08:00
Cai Yudong a001412e12
Replace faiss::MetricType with knowhere::MetricType (#17891)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-06-29 14:20:19 +08:00
jaime 762e3b78a6
support configurable sasl mechanisms for kafka (#17542)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-29 10:32:17 +08:00
Letian Jiang 4ae1ca2cac
Fix arrow builder nullptr check in FinishPayloadWriter (#17873)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-06-28 20:04:17 +08:00
Enwei Jiao ea901393ef
fix windows ldflags (#17807)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-06-28 19:58:25 +08:00
xing.zhao 3904a78211
Remove genReqID function in import manager bacause the request ID is useless (#17853)
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
2022-06-28 18:20:18 +08:00
bigsheeper b657e58370
Remove temporary variable to prevent memory fragmentation (#17728)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-28 16:30:23 +08:00
cai.zhang 899a9bf86d
IndexNode still writes finished state to ETCD when task was deleted (#17761)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 12:08:17 +08:00
cai.zhang b883d1f5dd
Make sure indexes are successfully dropped when DropCollection (#17780)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 11:24:21 +08:00
bigsheeper 6b79d4f7bc
Log segment type as possible in QueryNode (#17846)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-28 10:16:17 +08:00