milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,045 Commits
133 Branches
115 Tags
559 MiB
Commit Graph

208 Commits (2a6a7a5177b67d7de7eee3355fbd88ecb43d6335)

Author SHA1 Message Date
zhenshan.cao 08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-23 16:41:58 +08:00
Ten Thousand Leaves 4855ba6fa3
Optimize Mac M1 support some tweaks to embedded Milvus (#16650) 
issue: #16500
issue: #16621

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-26 14:21:46 +08:00
Ten Thousand Leaves f93862fa2b
Fix build and tests for Mac M1, also enabled more tests for OSX systems (#16552) 
issue: #16500

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 23:03:41 +08:00
Ten Thousand Leaves 6f75d02c65
Disable knowhere logging for embedded Milvus and some other tweaks (#16496) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 17:23:46 +08:00
Ten Thousand Leaves e76a8c5ec2
Update compile options and config for embedded Milvus (#16472) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-14 19:57:34 +08:00
zhenshan.cao 7a3384734a
Add test coverage target in Makefile (#16439) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-04-11 09:49:34 +08:00
congqixia 4cb7c28bfa
Fix ReplicaInfo package name (#16400) 
Fix #16399
PR 16373 breaks the build after ReplicaInfo moved from querypb to milvuspb
Also fix  problem in Makefile
Limit action/setup-go version to ~1.17.1(>=1.17.1 <1.18.0)

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-06 19:47:31 +08:00
Jiquan Long fd589baca7
Integrates marisa trie index (#16192) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-01 15:31:29 +08:00
Ji Bin 3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
Ten Thousand Leaves a3a29fed06
Add entry point for embedded Milvus. (#16008) 
/kind feature

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-16 16:51:22 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
zhenshan.cao dff08dbf47
Refactor querynode unittest (#15929) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-08 17:39:58 +08:00
Nemo dc65b1aeea
Switch to knowhere v1.0.1. Also switch to forked gorocksdb v0.0.1 (#15603) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-02-17 19:05:49 +08:00
jaime 61d2063d5a
Fix make clean can't remove build directories (#15507) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-02-10 17:03:48 +08:00
jaime 307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
zhenshan.cao 6bc2efe429
Fixbug: IndexNode should panic when save meta failed to MetaKV (#15347) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-24 17:18:46 +08:00
Jiquan Long 30abe860fe
[skip e2e] Support to build Milvus in debug mode (#15342) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-21 19:51:38 +08:00
Bingyi Sun 9a564a7a5e
Upgrade pulsar client (#15175) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-14 17:13:35 +08:00
zhenshan.cao b10c361822
Fix bug: should use Lock instead of RLock (#14797) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-04 23:33:24 +08:00
shaoyue 1c6b1f81e7
[skip e2e] Fix typo in Makefile rpm related sections (#14602) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-30 16:59:20 +08:00
shaoyue d5b8ae7a00
[skip e2e] Add RPM build spec (#14153) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-28 09:52:10 +08:00
dragondriver 9051d64f47
Print build env infomation (#13300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-15 10:21:10 +08:00
congqixia 5c19eef8ce
Add rocksdb compile step for ut (#13156) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-10 14:01:07 +08:00
Cai Yudong 255c45fb8e
Update test-cpp and test-go to run unittest only (#12903) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-08 10:55:04 +08:00
Xiangyu Wang ad4c808207
Upgrade the golangci-lint version in Dockerfile (#12878) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-07 17:59:02 +08:00
Xiangyu Wang c641e66f98
Upgrade golangci-lint to support more linters (#12784) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-06 18:26:08 +08:00
Xiangyu Wang a37a1062e1
Remove unused dependency (#12534) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-02 10:53:32 +08:00
bigsheeper 921ef0f2ea
Fix seek query channel error (#10723) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-27 23:00:24 +08:00
zhenshan.cao 40750f03c7
Enhance querycoord log (#10523) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-24 15:16:00 +08:00
groot c53f3b56fb
Gen cpp codecov info (#10072) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-18 12:32:35 +08:00
Xiangyu Wang 2eabcd8ebe
Update the target docker in Makefile (#9469) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-08 19:30:58 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
edward.zeng 7b955548a2
[skip ci] Refine makefile comments (#8841) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-09-29 14:41:58 +08:00
groot 77e88144fc
Update code coverage script (#8280) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-22 16:01:53 +08:00
groot 2847c0a135
[skip ci] Add codecov command (#8204) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-18 14:19:51 +08:00
groot b2bd0b7149
[skip ci]Prepare for cpp coverage (#8125) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-17 14:21:50 +08:00
groot f12fa50f6f
Prepare for cpp codecoverage (#7900) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-14 19:05:52 +08:00
Xiaofan 104843e283
[skip ci]fix make clean error (#7584) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-08 16:32:00 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
sunby 4d56d53c0b
Add a tool to move binlog path to SegmentInfo (#7243) 
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-24 15:51:51 +08:00
XuanYang-cn d432bbba1c
Add build-cpp as a dependency of verifiers (#7207) 2021-08-20 17:45:17 +08:00
congqixia 9b7c782016
Comment non-exists tests/go path (#7190) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-20 14:04:12 +08:00
紫晴 4c7b57ffc5
Upload codecov report in GitHub Actions (#6565) 
* Upload codecov report in GitHub Actions

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-07-16 14:52:21 +08:00
quicksilver da628863bc
Update main.yaml for Github Action (#6381) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-07-09 11:59:09 +08:00
quicksilver 7d920e9c9c
Fix compile error on CentOS (#6359) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-07-08 15:43:45 +08:00
Cai Yudong 1d9c10bead
Keep soft link to save docker image size (#6124) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-25 18:10:09 +08:00
Cai Yudong 64d1fa2de2
Banner use UTC time (#6102) 
* banner use UTC time

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-25 10:24:11 +08:00
Cai Yudong 438e7fb4da
Print Milvus banner when start service (#5953) 
* print Milvus banner when start service

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update banner

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update messages

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 11:34:04 +08:00
Cai Yudong 3b0951e3e6
Combine standalone binary into milvus (#5866) 
* rename service to coord for cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update variable name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize roles.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support milvus run standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove cmd/standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for compoments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* set helm chart branch

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 15:20:08 +08:00
zhenshan.cao f74ea3beee [skip ci] Remove ProxyService (#5738) 
* [skip ci] Remove ProxyService

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Change helm branch

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: paramstable crashed

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:36:35 +08:00
yukun c63524deb9
Add dablooms (#5440) 
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-28 10:23:30 +08:00
neza2017 a124568664
fix makefile (#5236) 
just remove standalone and milvus from $GOPATH/bin,
not every thing, on command of make clean

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-15 02:02:48 +00:00
Cai Yudong 4cec3924cc
rename all singlenode to standalone (#5051) 
* rename all singlenode to standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docker image name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix merge conflict

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Rename all singlenode to standalone (#1)

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-04-26 10:35:57 +00:00
Xiangyu Wang 746fc556a0
[skip ci]Add go code coverage (#5024) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-04-24 15:10:24 +08:00
Cai Yudong e4256a4400 Combine all service/node binaries into one binary with named 'milvus' 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2021-04-15 09:28:46 +08:00
Cai Yudong 687d48b75e Improve code readibility 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2021-04-12 14:11:06 +08:00
Cai Yudong 952f70af2a Clean makefile 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2021-04-09 14:07:03 +08:00
XuanYang-cn 32660d547b Add endPositions in datanode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-03-16 17:55:42 +08:00
XuanYang-cn 7dd531d159 Fix release collection bug 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-03-11 18:42:25 +08:00
Xiangyu Wang c875fdf913 Add logs in rocksmq 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-03-10 10:02:55 +08:00
zhenshan.cao b3891ca199 Correct docker file 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-20 10:15:37 +08:00
XuanYang-cn 90d471b133 Refactor main of queryservice and querynode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-02-02 09:52:42 +08:00
neza2017 854accf95b Remove master and writenode 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-30 16:41:47 +08:00
dragondriver f660caca0c Refactor the client interface of proxy service 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-29 17:29:31 +08:00
Xiangyu Wang 99cef4b5c8 Add Distributed main entrypoint 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-01-29 17:08:31 +08:00
zhenshan.cao ee0faddb07 Refactor proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-29 09:27:26 +08:00
bigsheeper 4f914a2c30 Add docker file and main function of query node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-27 09:50:52 +08:00
neza2017 d1b23cb8c5 Add debug info 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-26 19:24:09 +08:00
sunby f632ed0272 Fix data service init 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-26 18:45:12 +08:00
zhenshan.cao e83ac41bca Add component for index 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-26 18:01:32 +08:00
XuanYang-cn 0b1c4f0420 Add building datanode cmd in Makefile 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-26 17:40:26 +08:00
sunby b4997a37a2 Add make dataservice in Makefile 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-26 16:36:26 +08:00
XuanYang-cn b445587e11 Add datanode main 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-26 14:46:54 +08:00
cai.zhang 346bb1ba49 Delete some unused code and some debug logs 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-26 14:31:31 +08:00
dragondriver c6a6b1436c Add soft time tick in proxy service 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-26 13:41:41 +08:00
cai.zhang f940cc455a Add dockerfile for index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-26 09:38:40 +08:00
neza2017 7f3aa92d10 Add docker file for masterservice 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-25 15:58:04 +08:00
dragondriver cd52adc18b Add proxy service to ci workflow 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 12:57:23 +08:00
dragondriver eba6bb288c Refactor the sructure of proto file 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 09:36:18 +08:00
cai.zhang 7619d968fd Generate random node port for indexService 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-20 18:26:20 +08:00
yukun 527c0c49df Add rocksmq unittest with goroutines 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-20 16:46:58 +08:00
cai.zhang c35079d7e7 Update registerNode in indexservice 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-20 10:15:43 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-18 19:32:08 +08:00
XuanYang-cn fb63983eb2 Modify rocksdb compilation 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-14 15:12:08 +08:00
yukun 51ca741a49 Add singlenode launch main 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-14 09:52:03 +08:00
cai.zhang 3d885742ee Reopen ruleguard and format code 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-13 13:36:27 +08:00
bigsheeper 2d2af1505a Improve mutex usage in query node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-12 18:03:24 +08:00
GuoRentong f3d2afa4f4 Update doc:detailed interface definition 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-11 18:35:54 +08:00
quicksilver a6690dbc99 Fix syntax error: Bad fd number 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-11 15:25:19 +08:00
yukun 18cfd31d40 Fix Load and Remove with prefix 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-11 15:17:06 +08:00
sunby 5dfe9448ae Modify test_index 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-08 16:00:16 +08:00
yukun d11f00cd9f Add rocksdb in kv 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-08 19:07:57 +08:00
GuoRentong 82ad488555 Update doc: rocksmq 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 18:37:24 +08:00
XuanYang-cn 65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-08 17:20:59 +08:00
GuoRentong c4599e26de Update doc: node api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 16:59:19 +08:00
bigsheeper e13822043d Fix search test when partition not exists, add binary vector search validation 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-08 16:41:27 +08:00
godchen fa73f17f94 Add opentracing doc 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-08 15:32:38 +08:00
cai.zhang d17442d5be Disable ruleguard 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-08 12:44:11 +08:00
dragondriver ced56c84f8 Add support to build binary vector index 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-07 14:56:17 +08:00
godchen 8f1f118b26 Add query opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-07 14:24:35 +08:00