milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
18,688 Commits
141 Branches
117 Tags
565 MiB
Commit Graph

361 Commits (e17775a20f7c7c97fb95837d70c1bb63f0b8e573)

Author SHA1 Message Date
chyezh 21c944beaa
enhance: add basic information of milvus into metrics (#29666) 
add basic build information and runtime component dependency into
metrics.

issue: #29664
pr: #29665

Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2024-01-29 15:49:04 +08:00
chyezh 77e123762f
enhance: add graceful stop timeout to avoid node stop hang under extreme cases (#30320) 
1. add coordinator and proxy graceful stop timeout to 5s.
3. add other work node graceful stop timeout to 900s, and we should
potentially change this to 600s when graceful stop is smooth
4. change the order of datacoord component while stop.
5. `LivenessCheck` do not perform graceful shutdown now. 

issue: https://github.com/milvus-io/milvus/issues/30310
pr: #30317
also see: https://github.com/milvus-io/milvus/pull/30306

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-01-27 08:45:02 +08:00
Jiquan Long 7a373bec46
enhance: print total memory when milvus starts (#29351) (#29352) 
issue: #29349 
pr: #29351

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-12-31 17:42:47 +08:00
SimFG 74e72ce27e
enhance: [2.3] Support to get the param value in the runtime (#29298) 
pr: #29297
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-12-21 20:36:43 +08:00
congqixia 4e8409e7dc
enhance: [cherry-pick] ignore proto generated files (#29250) 
Cherry-pick from master
pr: #28537
ignore proto generated files
issue: #28566

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: sunby <sunbingyi1992@gmail.com>
 2023-12-15 22:46:39 +08:00
MrPresent-Han 5f4ac437b2
enhance: [Cherry-pick] Moving etcd client into session (#27069) (#28996) 
relate: #26694
pr: https://github.com/milvus-io/milvus/pull/27069

Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Co-authored-by: Filip Haltmayer <81822489+filip-halt@users.noreply.github.com>
 2023-12-07 16:22:34 +08:00
jaime 618c58db4e
Fix delete session key with prefix (#28267) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-11-08 17:04:22 +08:00
wei liu 76b06abc29
refine stop order (#28016) (#28089) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-11-02 09:00:25 +08:00
wayblink aa1fba79b1
Register metrics before component start (#27744) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-10-19 17:14:10 +08:00
jaime ac2d1bb5c2
Support receive signals from parent process (#27756) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-18 20:20:11 +08:00
congqixia 2f201c25e2
Remove deprecated io/ioutil usage (#27747) 
`io/ioutil` package is deprecated, use `io`,`os` package replacement
also added golangci-lint rule to block future reference

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-10-17 20:32:09 +08:00
jaime ec1fe3549e
Add a stop hook to clean session (#27564) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-16 10:24:10 +08:00
SimFG 26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
yihao.dai bb6711f28c
Add ChunkCache: support get vector from storage (#26142) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-15 10:21:20 +08:00
congqixia f7b2ad6650
Fix component pointer to `component` interface never be nil caused panic (#27072) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-14 13:37:18 +08:00
cai.zhang 4fa878d03c
Remove unused log (#27032) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-09-13 16:07:18 +08:00
Enwei Jiao fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
yah01 3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
congqixia 4bf26dd4ed
Refine standalone components stop order (#26742) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-31 16:51:02 +08:00
congqixia 073ac8350b
Refine signal handler for whole milvus role lifetime (#26642) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-29 19:28:28 +08:00
jaime c603f1c244
Remove mysql metastore (#26633) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-08-29 14:36:26 +08:00
Enwei Jiao 533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-18 18:32:19 +08:00
SimFG 8b54914287
Add go.mod file for the milvus/pkg package (#26359) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-16 14:49:32 +08:00
Jiquan Long fb5d809599
Fix components' setup (#26182) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-08-09 14:33:15 +08:00
xige-16 33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
SimFG 31c08a8135
Improve the panic code about the milvus component #24783 (#24919) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-06-17 10:32:39 +08:00
congqixia 561021ec5a
Refine sigpipe handling (#24872) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-14 10:10:38 +08:00
yiwangdr 4387f36897
make etcdKV private (#24778) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-13 10:52:38 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
chyezh f97127ae55
add nats mq wrappers (#24445) 
bug fixup, configurable natsmq, add unittest, pass e2e.



move natsmq to pkg project

Signed-off-by: chyezh <ye.zhen@zilliz.com>
Co-authored-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-07 10:00:37 +08:00
xige-16 fe18109aab
Clean tmp disk data when start milvus (#24404) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-26 15:07:26 +08:00
cai.zhang 43a9e175a3
Exit component process when session key is deleted (#21658) (#22164) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-12 20:12:28 +08:00
Cai Yudong 55202ce7d9
Support show knowhere prometheus metrics (#23102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-04-07 15:34:29 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
aoiasd 1a485044a9
fix NumConsumers metric not work (#23167) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-04-05 08:18:28 +08:00
yah01 7da870f512
Remove useCustomConfig and simpilify the session type (#23166) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-03 20:10:24 +08:00
congqixia 8f847884c2
Fix misc copylocks and remove exclude rule (#22962) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-24 11:17:58 +08:00
congqixia 0317e0458b
Use Set[string] instead of map[string]interface{} ServerType (#22853) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-20 16:21:57 +08:00
jaime d126f06946
Decouple mq module from internal proto definition (#22536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-03-04 23:21:50 +08:00
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
Enwei Jiao 0851e05014
Gernate milvus.yaml by code (#22003) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-23 11:37:46 +08:00
Xiaofan d3f8948c17
Fix embedded milvus (#22077) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-09 22:06:32 +08:00
cai.zhang d09d1e835a
Reset indexcoord flag for running (#21898) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-02 15:49:51 +08:00
wayblink e9f99081e4
Start management API before roles run (#21874) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-02 12:03:58 +08:00
Enwei Jiao fb42466c65
Use opentelemetry (#21509) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-12 16:09:39 +08:00
Jiquan Long 6d09bbed68
[skip e2e] Fix load meta migration (#21584) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-11 19:31:39 +08:00
Xiaofan dc2bfb0901
Add stack trace for core dump (#21555) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-06 16:53:35 +08:00
cai.zhang aa203acfb3
Low IndexCoord weight (#21548) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-06 14:21:37 +08:00
cai.zhang e5f408dceb
Merge IndexCoord and DataCoord (#21267) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-04 19:37:36 +08:00