milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
20,557 Commits
153 Branches
122 Tags
592 MiB
Commit Graph

1664 Commits (5c245d51c43cdb4a7f21eaeb13707639e208b071)

Author SHA1 Message Date
foxspy 370b6fde58
milvus support multi index engine (#27178) 
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-09-22 09:59:26 +08:00
SimFG 26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
congqixia 16b35e07b3
Fix `TestSessionSuite/TestKeepAliveRetryActiveCancel` unit test logic (#27231) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-20 18:59:23 +08:00
yah01 9baff1b81c
Rename error to match the nameing rules (#27214) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-20 10:59:24 +08:00
yah01 b4f86ea55e
Construct all success status with merr (#27226) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-20 10:57:23 +08:00
congqixia cc9974979f
Add staticcheck linter and fix existing problems (#27174) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-19 10:05:22 +08:00
PowderLi 4feb3fa7c6
support azure (#26398) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-09-19 10:01:23 +08:00
yihao.dai 4b2802033d
Fix datanode panic due to concurrent compaction and delete processing (#27167) 
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-09-18 19:35:29 +08:00
Enwei Jiao 8e17bc3013
Use merr to handle segcore errors (#27137) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-18 14:07:22 +08:00
yihao.dai bb6711f28c
Add ChunkCache: support get vector from storage (#26142) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-15 10:21:20 +08:00
yah01 168e82ee10
Fix panic while handling with the nil status (#27040) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-15 10:09:21 +08:00
yah01 7bb20fa394
Fix the double nil return values from RPC call (#27101) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-14 19:01:19 +08:00
congqixia c32a9a1d4a
Fix grpcclient use needReset as needRetry for cancel&timeout code (#27091) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-14 17:47:26 +08:00
congqixia f0d0651989
Do not reset connection immediately if grpc code is `Canceled` or `DeadlineExceeded` (#27014) 
We found lots of connection reset & canceled due to recent retry change
Current implementation resets connection no matter what the error code is
To sync behavior to previous retry, skip reset connection only if cancel error happens too much.

Also adds a config item for minResetInterval for grpc reset connection

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-13 15:01:18 +08:00
yihao.dai dd2cb1d44a
Flush by flush channels (#26859) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-12 21:07:19 +08:00
yah01 00c65fa0d7
Refine QueryNode errors (#27013) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 16:07:18 +08:00
Jiquan Long 802a6a86c0
Fix printing too many warnings (#27015) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-09-12 13:39:17 +08:00
aoiasd e107d0794c
support complex delete expression (#25752) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-09-12 10:19:17 +08:00
congqixia adfb5298c6
Refine `TestSessionProcessActiveStandBy` unit test logic (#26980) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-11 18:13:17 +08:00
Xu Tong 9166011c4a
Add float16 vector (#25852) 
Signed-off-by: Writer-X <1256866856@qq.com>
 2023-09-08 10:03:16 +08:00
XuanYang-cn 7f1ae35e72
Add timeout in dispatcher, AsConsumer and Seek (#26686) 
See also: #25309

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-09-08 09:51:17 +08:00
SimFG 0901b76732
Avoid the panic when the status of rpc response is nil (#26910) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-07 19:23:15 +08:00
yiwangdr 337edc321b
tikv integration (#26246) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-09-07 07:25:14 +08:00
SimFG 28681276e2
Improve the retry of the rpc client (#26795) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-06 17:43:14 +08:00
wei liu 0e2085b77f
fix dc standby to active (#26810) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-06 10:41:49 +08:00
Enwei Jiao fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
congqixia 1a8cf5c415
Organize all mockery generation commands in Makefile (#26826) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-04 21:19:48 +08:00
chyezh 0530fd80c9
[Fixup] remove nats from default (#26791) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-09-04 10:01:04 +08:00
yah01 3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
groot 1b1bafaff1
Bulkinsert read varchar by batch (#26199) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-08-30 14:23:06 +08:00
yah01 dd4bc5b6a0
Fix data race in gRPC client (#26574) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-28 18:26:28 +08:00
congqixia 145387fdcb
Bump proto go-api to v2.3.0 (#26561) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-23 20:18:23 +08:00
jaime b82fc8d6e7
[skip e2e] Add connection log for etcd and grpc (#26536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-08-22 21:20:24 +08:00
yah01 bed034a44b
Protect DataCoord from calculating segment lines by stale log entries num (#26523) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-08-22 14:16:22 +08:00
chyezh 85886f039e
[Fixup] msg context access data race when msgdispatcher (#26463) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-08-21 19:16:22 +08:00
XuanYang-cn 08fd28b30b
Only do gracefully stop when DN Stop (#26399) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-08-21 11:16:20 +08:00
wayblink 71133e5eaa
Check and reset if grpc client serverID mismatch with session (#26448) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-08-18 22:50:20 +08:00
yihao.dai 63b86b32a6
Add server id validation interceptor (#26395) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-17 20:20:20 +08:00
wei liu 74133a3996
refine retry on grpc (#26360) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-16 19:36:18 +08:00
SimFG 8b54914287
Add go.mod file for the milvus/pkg package (#26359) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-16 14:49:32 +08:00
Enwei Jiao 78bc688d16
Remove QueryMsgStream in MqFactory interface (#26374) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-16 10:29:33 +08:00
Gao b6fcbb0998
Support ScaNN index (#26099) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-08-11 14:21:29 +08:00
zhagnlu 411f9ac823
Upgrade minio-go and add region and virtual host config for segcore chunk manager (#26194) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-08-11 10:37:36 +08:00
congqixia 2b367b6bb0
Fix sessionutil Liveness check blcok in watch forever (#26248) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-10 14:07:16 +08:00
congqixia e13b6b88eb
Replace deprecated grpc WithInsecure option (#26226) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 13:37:16 +08:00
congqixia 767955ec6b
Reduce MQ buffer length and flowgraph wait queue length to 16 (#26179) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 10:05:14 +08:00
wei liu 0e103efc5d
disable retry in grpc connect and grpc sendMsg (#26095) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-03 15:23:07 +08:00
congqixia 7dfc8fbf0a
Fix data race on keepAliveCancel (#26087) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-02 18:55:07 +08:00
congqixia 8b11636e72
Cancel previous ctx for session retry keepalive (#26050) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-02 12:09:05 +08:00
groot c2693ea284
Fix a crash bug of bulkinsert for dynamic field (#25982) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-07-28 15:25:03 +08:00
XuanYang-cn 84253f255e
Fix datanode graceful stop panic (#25932) 
See also: #25925

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-07-28 10:11:08 +08:00
zhagnlu 833674c1cb
add glog configurable function and redirect aws log to segcore log (#25664) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-07-27 19:49:02 +08:00
groot a6808e6484
Fix bulkinsert row count error (#25869) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-07-25 11:29:00 +08:00
Cai Yudong 9a4761dcc7
Remove binary metrics TANIMOTO/SUPERSTRUCTURE/SUBSTRUCTURE (#25708) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-19 16:16:58 +08:00
SimFG 69d274d233
Improve the operation log (#25589) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-07-14 16:08:31 +08:00
Enwei Jiao 66fdc71479
Refactor logs in DataCoord & DataNode (#25574) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
wayblink 587237a3c9
Fix dead loop in session (#25451) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-07-13 18:02:29 +08:00
groot 96c987ed62
Bulkinsert supports partition keys (#25284) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-07-11 15:18:28 +08:00
yah01 cd29b863d0
Fix data race in session (#25354) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:52:25 +08:00
wayblink b7ecb7f56b
Disable retryKeepAlive when LivenessCheck's Context close (#25161) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-27 17:08:45 +08:00
xige-16 33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
wayblink b752a29995
Add timeout for keepalive in session (#25077) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-26 12:30:44 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
xige-16 04082b3de2
Migrate the ability to upload and download binlog to cpp (#22984) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-25 14:38:44 +08:00
yihao.dai 9f5756f16e
Add cluster validation interceptor to resolve the ip-reuse issue (#25001) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-21 11:36:46 +08:00
SimFG 0c3f92d7d7
Improve the panic code about the rootcoord/session/rocksmq (#24859) (#25024) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-06-21 11:24:42 +08:00
wayblink bfae6b49af
Remove datanode timetick mq, use rpc to report instead (#23156) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-14 14:16:38 +08:00
yiwangdr 4387f36897
make etcdKV private (#24778) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-13 10:52:38 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yah01 ebd0279d3f
Check error by Error() and NoError() for better report message (#24736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 15:36:36 +08:00
Enwei Jiao d3af451d92
Upgrade golangci-lint (#24707) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-07 19:34:36 +08:00
congqixia d0c2fa5d19
Fix retryKeepAlive assertion panic (#24667) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-07 10:08:36 +08:00
chyezh f97127ae55
add nats mq wrappers (#24445) 
bug fixup, configurable natsmq, add unittest, pass e2e.



move natsmq to pkg project

Signed-off-by: chyezh <ye.zhen@zilliz.com>
Co-authored-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-07 10:00:37 +08:00
xige-16 732fe54775
Support partition Key (#24047) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-06 10:24:34 +08:00
wayblink 5fb5b072ae
Retry keepalive when keepalive channel close (#24581) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-01 16:14:35 +08:00
groot 3022e37298
Fix bug of bulkinsert for dynamic field (#24569) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-06-01 14:14:31 +08:00
groot 5358da2a10
Fix a crash bug for backup/restore (#24529) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-31 14:45:30 +08:00
groot 0d0e97ab7f
Fix crash issue of bulkinsert by invalid numpy array file (#24480) (#24528) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-31 14:43:39 +08:00
groot 3cb75997a3
Fix a bug of bulkinsert dynamic schema (#24405) (#24527) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-31 14:41:41 +08:00
xige-16 fe18109aab
Clean tmp disk data when start milvus (#24404) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-26 15:07:26 +08:00
wei liu ce03248b1a
simplify logic circle in search (#24110) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
groot 97cd0409e4
Support dynamic field for bulkinsert (#24265) (#24304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-23 14:17:25 +08:00
Jiquan Long bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
MrPresent-Han 7744573d3d
support parms for import maxfilesize(#24191) (#24192) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-18 18:59:27 +08:00
groot b89f06dd19
Support JSON for bulkinsert (#24130) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-18 16:33:23 +08:00
congqixia 73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
congqixia 74bba2320a
Fix session stop/goingStop stuck after connection lost (#24131) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 14:51:22 +08:00
Enwei Jiao a933b595c4
Add trace log for grpc client (#23951) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-09 10:10:41 +08:00
wayblink 899702f13c
Implement GetIndexStatistics interface (#23603) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-05-06 10:34:39 +08:00
Enwei Jiao 967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
wei liu cbfe7a45ef
fix pull target (#23491) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-18 18:30:32 +08:00
cai.zhang 43a9e175a3
Exit component process when session key is deleted (#21658) (#22164) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-12 20:12:28 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
congqixia 424570b2b8
Remove annoy related unit tests (#23229) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-05 08:14:28 +08:00
Cai Yudong ef63e64ded
Remove ANNOY index type (#23189) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-04 16:30:27 +08:00
Cai Yudong 9ad6d9f1a0
Rename RAFT_IVF_FLAT/RAFT_IVF_PQ to GPU_IVF_FLAT/GPU_IVF_PQ (#23194) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-04 11:44:26 +08:00
yah01 7da870f512
Remove useCustomConfig and simpilify the session type (#23166) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-03 20:10:24 +08:00
smellthemoon ce91f61e5a
Pre-create topics (#21907) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-03 16:44:23 +08:00
MrPresent-Han afd874b736
enhance segment balance by considering global rowCount(##22914) (#23056) 
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-04-03 14:16:25 +08:00
Cai Yudong 7612c75c47
Let RAFT_IVF_PQ param accept m=0 (#23134) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-31 11:22:22 +08:00
yah01 75737c65ac
Refine error handle of QueryCoord (#23068) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-31 10:54:29 +08:00
yihao.dai a182594bf5
Add FlushAll support (#22942) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-30 11:28:25 +08:00
Xiaofan 653d9ecf91
Change RocksMQ page size to 64M (#23078) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-03-29 17:08:04 +08:00
Cai Yudong 3febb5e45a
Remove gpu mode param check (#23074) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-29 14:24:01 +08:00
smellthemoon 846de72fb3
fix to reduce memory (#23023) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-28 21:36:06 +08:00
Xiaofan d0510210df
Add config for disable BF load (#22996) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-03-28 20:06:10 +08:00
aoiasd 5d172d0f4f
Refine errors of datanode (#22852) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-28 19:04:00 +08:00
zhenshan.cao d55c860383
Align the maximum dim of the diskann index and collection (#23039) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-03-28 00:06:00 +08:00
yah01 081572d31c
Refactor QueryNode (#21625) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00
Xiaofan 5a914aedf3
Make Datacoord TT to be configurable (#22956) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-03-24 22:24:04 +08:00
Cai Yudong 8aebc6f3b7
Remove faiss GPU index support (#22966) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-24 17:53:58 +08:00
Jiquan Long 0be96ab610
Check if all columns aligned with same num_rows (#22968) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-24 17:09:58 +08:00
smellthemoon 3dae84f065
Use merr in proxy (#22904) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-24 15:27:58 +08:00
Gao 8b3e5189e1
Add querynode plugin (#22379) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-03-24 15:21:59 +08:00
congqixia 1b4e29e1ee
Fix copylocks for EnvSource (#22948) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-23 19:26:02 +08:00
SimFG e8f8c1b445
Check the collection num when creating the collection (#22946) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-03-23 16:47:57 +08:00
congqixia 31c22e5d24
Fix NodeID rw race (#22945) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-23 11:45:57 +08:00
yihao.dai f2ffb5db26
Use buffer size at memory sync policy (#22825) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-21 21:37:56 +08:00
Enwei Jiao fd974df09f
OTEL integration in cpp (#22175) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-21 16:31:57 +08:00
yah01 532d12c4cf
Fix the code lost with multi errors (#22877) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-21 14:07:57 +08:00
smellthemoon 4c603cd02c
Fix upsert msgid (#22839) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-21 14:06:01 +08:00
congqixia 0317e0458b
Use Set[string] instead of map[string]interface{} ServerType (#22853) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-20 16:21:57 +08:00
yihao.dai 1f718118e9
Dynamic load/release partitions (#22655) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-20 14:55:57 +08:00
MrPresent-Han 77c9e33e70
support dml channel balancer on datacoord (#22324) (#22377) (#22692) 
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-03-20 10:01:56 +08:00
Jiquan Long 8139106b51
Feat: count entities by expression (#22765) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-16 19:31:55 +08:00
yah01 3d8f0156c7
Refine scheduler & executor of QueryCoord (#22761) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-16 17:43:55 +08:00
Cai Yudong ab3cbdfc61
Partial change to prepare for GPU index type support (#22591) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-14 23:21:56 +08:00
congqixia 732986aa04
Remove fmt.Print from internal package (#22722) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-14 17:36:05 +08:00
groot 6f6bd98c27
Verify vector float data for bulkinsert and insert (#22728) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-03-14 14:03:58 +08:00
yah01 e1cb307690
Refine RootCoord services error handle (#22689) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 14:29:53 +08:00
congqixia af6f0d5aa5
Make merr.Error(status) read old error code (#22698) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-10 22:37:53 +08:00
yah01 e4120d1671
Upgrade proto to add error code field of Status (#22656) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 18:49:51 +08:00
shaoyue 32581e6452
Support aliyun oss as object storage with ak or IAM (#22376) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2023-03-09 16:33:52 +08:00
yah01 90a5aa6265
Refine errors, re-define error codes (#22501) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 15:47:52 +08:00
wei liu 1a1a5caafa
update shard leader cache periodically (#22595) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-08 15:13:51 +08:00
Enwei Jiao f1a60b295c
Support multi yaml files (#22583) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-07 18:23:51 +08:00
jaime d126f06946
Decouple mq module from internal proto definition (#22536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-03-04 23:21:50 +08:00
Enwei Jiao b21395f487
Forbid dmlChannelNum auto refresh (#22550) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-03 15:21:48 +08:00
congqixia ea4ab9e4a4
Replace ErrorList with multiErrors (#22532) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-03 14:59:49 +08:00
Gao aa19243c22
Fix diskann param parse bug (#22498) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-03-02 19:59:50 +08:00
congqixia 51cb8590a1
Use errors.Wrap and Combine so retry error could check `errors.Is` (#22520) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-02 17:25:48 +08:00
Ten Thousand Leaves 74d158e149
Fix enableAutoCompaction default value (#22254) 
/kind bug

issue: #22253

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2023-03-02 07:21:48 +08:00
yah01 7478e44911
Support using mmap to load data (#22052) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-01 18:07:49 +08:00
congqixia fa5c33975e
Fix reset connection data race (#22483) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-01 11:21:47 +08:00
yah01 21eea923cc
Add util to combine multiple errors so everyone checkable (#22473) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-28 19:35:47 +08:00
yah01 60cd548bf5
Rename concurrency package to conc (#22453) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-28 14:19:47 +08:00
congqixia 608615e5bd
Add background health check if ctx err returned (#22439) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-02-28 14:11:47 +08:00
Xiaofan 256aaa1944
Change Etcd session timeout to 20s (#22401) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-28 11:13:47 +08:00
Xiaofan fa101e9751
Change RockMQ page size to 256MB (#22432) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-28 10:45:47 +08:00
yah01 167581c08a
Refine Pool to improve the ease of use (#22412) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-27 18:07:48 +08:00
wayblink 416866e42f
Add memory usage too large sync policy (#22244) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-27 17:47:51 +08:00
yah01 b758c305a7
Make Future generic (#22411) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-27 12:07:47 +08:00
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
zhenshan.cao e768437681
Correct usage of Timer and Ticker (#22228) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-02-23 18:59:45 +08:00
SimFG bddda5bdb2
Only print the file content when log the hook.yaml (#22361) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-02-23 15:33:45 +08:00
Enwei Jiao 0851e05014
Gernate milvus.yaml by code (#22003) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-23 11:37:46 +08:00
SimFG 7e19a924b7
Add the rbac for the GetLoadingProgress and GetLoadState api (#22320) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-02-22 20:37:45 +08:00
Cai Yudong d4e0b6e91b
Remove unused index param check (#22271) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-02-21 17:36:26 +08:00
wayblink b7c0d12d82
Skip file with prefix '.' may exist in filesystem (#22138) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-21 10:54:29 +08:00
bigsheeper f4e7b246f2
Fix msgdispatcher concurrency issue and add prometheus metrics (#22174) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-02-16 14:58:34 +08:00
congqixia f2575e5fa8
Add unconvert & durationcheck linters and fix issues (#22161) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-02-15 17:22:34 +08:00
aoiasd 148a024e05
Add tickle for datacoord watch event (#21193) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-02-15 16:20:34 +08:00
wayblink 77a27c6dfc
Support print log to file and console at the same time (#21946) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-14 16:56:34 +08:00
SimFG c2a49d5a0b
Add error log and metrics for the hook and privilege interceptor (#22111) (#22137) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-02-13 16:50:33 +08:00
bigsheeper d2667064bb
Add msgDispatcher to support sharing msgs for different vChannel (#21917) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-02-13 16:38:33 +08:00
jaime a2435cfc4f
[Cherry-Pick]Add a segment metrics for count number of binlog files (#22103) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-02-13 10:24:33 +08:00
wei liu d078441522
support rg api rbac (#22097) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-02-10 10:54:33 +08:00
Xiaofan d3f8948c17
Fix embedded milvus (#22077) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-09 22:06:32 +08:00
wei liu d085abbd56
fix load collection with rg (#22083) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-02-09 16:24:31 +08:00
yah01 b1f31da77a
Fix activate standby server ignores all errors (#22073) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-09 15:24:31 +08:00
Enwei Jiao 44154a828c
Forbid updating some configs (#22047) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-09 14:28:31 +08:00
groot c21e11eb8a
Fix datanode crash bug for bulkinsert (#22041) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-02-08 14:06:31 +08:00
Jiquan Long a548ce1cf1
Change default max shards num to 64 (#22016) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-02-07 14:43:57 +08:00
jaime baa035885d
Modify default value of some configurations (#22013) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-02-07 10:05:56 +08:00
congqixia 73b6c13245
Expand singleflight to Get and make writeEvent sync (#21993) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-02-06 15:27:54 +08:00
cai.zhang ae305a54bd
Set scheduler duration of index task can be configurable (#21944) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-05 17:21:53 +08:00
jaime 748a935a11
Modify segment seal policy with number of statslog files (#21957) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-02-03 17:07:52 +08:00
wayblink d41cc0b21b
Revoke session to only delete session key created by this node (#21935) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-02 16:37:52 +08:00
Enwei Jiao 53ae40b8c6
Make ratelimiter's config refreshable (#21757) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-01 16:03:51 +08:00
congqixia ec282b1958
Apply lifetime control for indexnode (#21892) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-31 18:37:50 +08:00
cai.zhang a04238c25f
Keep the configuration of indexCoord (#21879) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-31 12:07:50 +08:00
congqixia 8af2aebb66
Fix msg channel prefix config priority for backward compatibility (#21871) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-31 10:09:51 +08:00
jaime 5ed6ae2f27
Remove repeated etcd endpoint configuration (#21860) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-30 12:07:48 +08:00
wei liu 73c44d4b29
resource group impl (#21609) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-30 10:19:48 +08:00
congqixia 66027790a2
Implement detailed lifetime control for querynode (#21851) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-29 17:45:49 +08:00
Xiaofan 949d5d078f
Fix memory calculation in dataCodec (#21800) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-28 11:09:52 +08:00
Xiaofan 9258f7059d
Fix Bulkload ut print too much result (#21821) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-19 21:31:44 +08:00
congqixia 54ec22e879
Allow empty AK/SK for minio cfg (#21815) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-19 15:49:44 +08:00
congqixia 5986106037
Make paramtable init only once (#21782) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-19 14:53:44 +08:00
jaime 1dcd9eeb79
Support rename collection (#21693) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-19 14:13:43 +08:00
Enwei Jiao cecd59d940
Disable time-travel by default (#21775) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-18 13:57:43 +08:00
Xiaofan 3e21d25de5
Add slow gc warning log (#21734) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-18 11:41:43 +08:00
wayblink de584b508e
Fix active-standby switch fail bug (#21755) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-01-17 11:43:43 +08:00
groot c0e7a122d4
Fix bulkinsert progress bug (#21680) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2023-01-13 16:25:40 +08:00
Enwei Jiao 90d9e165d4
Fix some configs not shown (#21653) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-13 15:31:41 +08:00
Xiaofan f8e1566b24
Support zstd compression in grpc (#21689) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-13 10:55:41 +08:00
wayblink 6a722396bd
Integration test framework (#21283) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-01-12 19:49:40 +08:00
Enwei Jiao fb42466c65
Use opentelemetry (#21509) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-12 16:09:39 +08:00
Jiquan Long 9fd9bed2b9
Remove collection meta after GC finished (#21595) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-12 09:55:42 +08:00
Jiquan Long 6d09bbed68
[skip e2e] Fix load meta migration (#21584) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-11 19:31:39 +08:00
groot 9f8095996b
Report bulkinsert progress (#21612) (#21638) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2023-01-11 17:37:44 +08:00
cai.zhang e127cf7b99
Reset indexpb for upgrade (#21620) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-11 14:35:40 +08:00
congqixia c550427e81
Use singleflight in localCache.load (#21606) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-10 16:21:39 +08:00
groot aab20a4031
Streaming read numpy (#21579) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-01-10 14:53:38 +08:00
Xiaofan dc2bfb0901
Add stack trace for core dump (#21555) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-06 16:53:35 +08:00
Xiaofan 4b4944ecee
Support sync all segments while close (#21421) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-06 14:49:36 +08:00
cai.zhang aa203acfb3
Low IndexCoord weight (#21548) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-06 14:21:37 +08:00
Ten Thousand Leaves b3da554705
Increase bulk insert file size limit (#21526) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2023-01-06 13:09:36 +08:00
Enwei Jiao 24d5faf7aa
Fix show configuration bug (#21544) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-06 09:55:36 +08:00
cai.zhang e5f408dceb
Merge IndexCoord and DataCoord (#21267) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-04 19:37:36 +08:00
Jiquan Long ff2a68e65a
Fix collection not exist when tried to do recovery (#21471) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-04 16:37:35 +08:00
Ten Thousand Leaves 3f6d139ad2
Fix bad import task expiration default (#21235) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2023-01-04 14:11:33 +08:00
wei liu e735485bb8
fix empty auth config unmarshal (#21473) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-03 10:11:34 +08:00
congqixia 8b4d60b073
Add guarantee and serviceable lag too large check (#21441) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-29 15:17:30 +08:00
SimFG 2aed48c433
Fix query node panic when watching dm channels (#21402) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-28 10:19:31 +08:00
smellthemoon cded2ce77c
Fix offset panic (#21292) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-12-27 11:11:29 +08:00
Enwei Jiao 264f08953d
Refactor Rocksmq's config (#21304) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-26 19:11:30 +08:00
jaime d401608899
Add a segment seal policy by number of binlog files (#21263) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-12-20 14:09:25 +08:00
Enwei Jiao 166e9f0da5
Refactor GrpcConfig (#21142) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-16 15:59:23 +08:00
SimFG 4df91ddf60
Support the graceful stop for the indexnode (#21021) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-16 10:03:27 +08:00
jaime 0954014c6d
[skip e2e] Fix broken default parameters for seal segment policy (#21207) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-12-15 18:31:23 +08:00
Enwei Jiao e6374901f9
Make TopK Limit configurable (#21151) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-15 14:03:22 +08:00
aoiasd 0011b65338
Fix unit test of local cache cause data race (#21237) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-12-15 13:41:22 +08:00
Ten Thousand Leaves 9d8f422cb8
Reduce maxFieldNum from 256 to 64 (#21104) 
issue: #21077

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-14 10:39:22 +08:00
SimFG f31d5facff
Fix the unsafe casbin `Model` (#21129) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-14 10:29:22 +08:00
XuanYang-cn b850c4ae2c
Refine search logs in querynode (#21134) 
- Make sure all logs logging with ctx
- Add an info log for searching on not-indexed segments
- Separate log prefix of shardleader and non-shardleaders

See also: #20975

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-12-12 14:33:22 +08:00
Xiaofan e977e014a9
Fix flush didn't respect binaryvector and other schemas (#21120) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-12 10:33:26 +08:00
SimFG 4a5c282b62
Add the superuser config (#21090) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-09 16:13:20 +08:00
Ten Thousand Leaves d67db2ed9b
Make compaction target able to exceed segment max size by a bit (#21068) 
issue: #21053
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-09 16:03:20 +08:00
aoiasd de0ab9e2cf
Refactor showConfigurations to allow return global config rather than only return config of this component (#21063) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-12-09 14:31:21 +08:00
aoiasd 60abe08f85
Add retention for access log on minio (#20681) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-12-08 19:39:19 +08:00
yah01 9ebaa10dec
Add more logs for GetShardLeaders (#21046) 
Also increase the heartbeatAvailableInterval from 2.5s to 10s

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-08 19:09:18 +08:00
Jiquan Long 6709ccf690
Fix empty retrieve result (#21032) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-08 10:15:19 +08:00
Enwei Jiao 89b810a4db
Refactor all params into ParamItem (#20987) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-07 18:01:19 +08:00
Jiquan Long dee426a7a5
Fix group checker ut (#21038) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-07 16:11:22 +08:00
Ji Bin 6692c9999e
Using first unicastable address as local ip (#20674) 
Signed-off-by: Ji Bin <matrixji@live.com>

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-12-07 15:03:19 +08:00
groot 33a102c6fc
Refine bulkinsert (#20986) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-12-07 14:53:18 +08:00
Xiaofan e131915207
Support 64M Rpc Limit (#20845) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-07 10:07:18 +08:00
SimFG f8cff79804
Support the graceful stop for the query node (#20851) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-06 22:59:19 +08:00
Ten Thousand Leaves 2f5b03fef7
Split small segment proportion and small segment compactable proportion (#20996) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-06 14:37:18 +08:00
jaime 039e9ce4bb
Refine msgstream interface (#20832) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-12-05 20:55:17 +08:00
jaime 548e90ec68
Support an analogous Java Guava cache implementation (#20831) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-12-05 20:29:18 +08:00
yah01 aec347e591
Check last heartbeat response time while fetching shard leaders (#20968) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-05 15:09:20 +08:00
congqixia 4238b5dbab
Make datanode unittest use embed etcd server (#20948) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-02 16:05:16 +08:00
yah01 ec3aef1f3e
Add time records for search path (#20924) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-02 11:39:17 +08:00
zhenshan.cao 9724ae5e27
Refine log level (#20904) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-12-01 20:07:15 +08:00
Ten Thousand Leaves c373b44c2c
Verify and adjust segment # of rows before saving and passing SegmentInfo (#20837) 
issue: #18120

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-01 16:31:16 +08:00
smellthemoon f7d603f947
Fix Group Checker test fail (#20911) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-12-01 13:39:15 +08:00
Enwei Jiao 2ecdb4ba4a
Etcd config source support TLS (#20874) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-30 18:23:15 +08:00
yah01 060649b8aa
Refactor task scheduler and executor (#20828) 
Make the performance able to scale out

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-11-30 13:57:15 +08:00