847586eb95
Add rocksmq retention ( #6617 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:46:10 +08:00
d2cbcb92ec
[skip ci]Fix proxy figures ( #6560 )
...
Resolves : #6549
Signed-off-by: Yang Xuan <jumpthepig@gmail.com>
2021-07-15 21:18:36 +08:00
3387b07dfd
Optimize code under storage ( #6335 )
...
* rename AddOneStringToPayload/GetOneStringFromPayload to AddStringToPayload/GetStringFromPayload
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename print_binglog_test to print_binlog_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update chap08_binlog.md
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* use SetEventTimestamp() to replace SetStartTimestamp() and SetEndTimestamp()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename AddStringToPayload/GetStringFromPayload to AddOneStringToPayload/GetOneStringFromPayload
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-07 19:10:07 +08:00
39614aa8eb
Add rocksmq_path in config and paramtable ( #6099 )
...
* Add rocksmq_path in config and paramtable
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add rocksdbPath in NewRmsFactory
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change rdb default path to /vat/lib/milvus/rdb_data
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-25 19:44:11 +08:00
17303bf4d3
Change session doc ( #6022 )
...
* change session doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 17:14:10 +08:00
a09a3a1905
rename service to coord ( #6020 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
2af1c27811
Rename queryservice to querycoordinator ( #5931 )
...
* Rename queryservice to querycoordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix param table
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix unittest
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* service to coordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set querycoord in ci
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
d5f4ee6f44
Rename proto master/index_service/proxy_service ( #5973 )
...
* rename proto proxy_service to proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proto index_service to index_coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proto master to root_coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
c863a193de
Rename filename from dataservice to datacoordinator ( #5946 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00
e3fe706045
Update figures in developer guides ( #5941 )
...
Signed-off-by: Yang Xuan <jumpthepig@gmail.com>
2021-06-21 19:22:15 +08:00
5a178fec04
update datanode design docs ( #5939 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-21 18:32:12 +08:00
0300b682f8
Remove deprecated interfaces in data coordinator ( #5929 )
...
* Remove derecated interfaces in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove RegisterNode in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 17:40:05 +08:00
45dade553d
[skip ci] update doc of RootCoordinator ( #5908 )
...
* [skip ci]rename master serice to RootCoordinator
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* rename chap06_master.md to chap06_root_coordinator.md
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* root coord
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* create index
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* [skip ci]udpate doc
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* [skip ci] update doc
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* update doc
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* [skip ci] update doc
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* [skip ci] update doc
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-21 16:24:07 +08:00
36fd713a68
Update data service docs ( #5924 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 16:02:11 +08:00
d0d0260b4c
[skip ci] Add container name in docker-compose.yml ( #5909 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-21 11:44:05 +08:00
668d32552e
[skip ci] removey entrypoint.md, the content of this file has been move to file appendix_c_system_configurations.md ( #5899 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-21 09:58:06 +08:00
3b0951e3e6
Combine standalone binary into milvus ( #5866 )
...
* rename service to coord for cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update docs
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update variable name
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize roles.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support milvus run standalone
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* remove cmd/standalone
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proxynode to proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for compoments
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add comments for codacy check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* set helm chart branch
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 15:20:08 +08:00
e9a8d1c404
Add vChannels in proxy for query results ( #5802 )
...
* Fix proxynode for new retrieve logic
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove querynodenum from proxynode and querynode
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove QueryNodeIDList from proxy
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-16 20:15:59 +08:00
7dbe737061
add server type of mixture, enable the services run on progress ( #5451 )
...
Resolves : #5450
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-27 06:06:13 +00:00
907106f752
Update milvus system configuration ( #5448 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 03:40:23 +00:00
dd736ee8ba
Change session doc ( #5355 )
...
Change session doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 03:53:07 +00:00
ccc0130bb4
Add exclusive parameter ( #5278 )
...
Add exclusive parameter.
Issue #5174
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 11:07:27 +00:00
cca75583a6
Add session util ( #5269 )
...
Add session util.
Issue #5174
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 03:39:21 +00:00
168b917f5b
Add session util doc ( #5229 )
...
Add session util doc.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-14 09:09:14 +00:00
3b529f3b5d
Update milvus project name ( #5032 )
...
* Update milvus project name
2021-04-26 13:59:28 +08:00
4f7e393bfd
Remove useless config ( #4997 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-23 10:10:46 +08:00
e281f6a4a1
Remove useless configs in config files
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-13 10:04:39 +08:00
ec01e140f8
Refactor code and doc
...
update docs:
1. formating
2. remove the docs related with deprecated components
3. some minor fixes
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 12:45:38 +08:00
0341a38ee5
Update doc :typo
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-22 15:54:30 +08:00
8e3ca57fde
Update doc : add index_service graph
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-11 10:36:29 +08:00
b2b39f5720
Add field position to watchDmChannelRequest’s porto
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-11 10:08:46 +08:00
aeb3038545
Remove GetCount in data service
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 10:49:44 +08:00
f6a4bacbeb
Delete field fieldIDs from ReleaseSegmentRequest’s photo
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-05 20:47:43 +08:00
037bd59eac
Update appendix_c_system_configurations.md
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-04 17:18:51 +08:00
3ba0dc2f44
Change doc
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-04 10:35:28 +08:00
4c491471ee
Add release collection and release partition interface for query node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-24 15:58:55 +08:00
fd562f9f9c
Update doc: add proxy graph
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-24 09:48:17 +08:00
ea1d9ea99a
Replace log in dataservice
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-23 09:58:06 +08:00
f62078c027
Fix crash error when search
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 10:14:03 +08:00
cdcf006690
Fix loadCollection error when query service assign insert channels and query nodes
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-07 09:30:48 +08:00
1cc994dea8
Refactor entry point
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-06 12:18:15 +08:00
61b7d45fdd
Update entrypoint.md
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-05 20:53:54 +08:00
c2ca2c276f
Fix response check error
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 19:34:35 +08:00
c6c99ef32b
Implement getSegmengInfo function
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-04 11:40:14 +08:00
1b616fb874
Add persistent_segmentinfo
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-03 18:55:00 +08:00
32c5a92449
Update interface in msgstream
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-02 16:32:15 +08:00
99cef4b5c8
Add Distributed main entrypoint
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
067c30c422
Add sealedSegment cgo unittest, fix growingSegment field id check
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-22 15:41:54 +08:00
ef79b8d8c7
Add client and grpc service
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 11:07:07 +08:00
c83a91eb1e
Update doc of rocksmq
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-22 10:50:05 +08:00
9828a52999
Add create index
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-21 10:01:29 +08:00
7f044fff82
Enable search for sealed
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-21 15:29:52 +08:00
be6775671b
Add error returned by Init,Start,Stop functions
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 17:38:01 +08:00
527c0c49df
Add rocksmq unittest with goroutines
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-20 16:46:58 +08:00
7ee8623e1a
Refactor msgstream
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-20 10:02:59 +08:00
2ec573d2f9
Recover delete docs
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-20 09:36:50 +08:00
fb493cc235
Update interface name of GetIndexStates
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-19 18:32:57 +08:00
918e279869
Set msg stream
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 16:14:13 +08:00
4e5df50a39
Update doc:Component interface
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-19 16:19:35 +08:00
7e8162a79e
Add dd handler
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 15:35:40 +08:00
d5e53aa28a
Add Meta table implementation
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 14:13:49 +08:00
48821690b3
Rename Service interface to Component, and update segmentLoad strategy
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-18 10:38:41 +08:00
dd6c4bfb75
Update doc:interface definitions related to LoadCollection
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-18 10:09:17 +08:00
4af3914836
add segmengt statistics message in datanode and Update documentation
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-16 15:47:33 +08:00
bfe720bfec
Update doc
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 18:03:16 +08:00
7fe061b846
Raneme init_devcontainer.sh to devcontainer.sh
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
56ab2bda2d
Update proto:add partition id
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
9038521aa3
Update doc: msgstream
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-15 14:02:12 +08:00
63b21321d6
Refactor indexservice and update doc
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
04e2062750
Update proto
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-14 20:30:27 +08:00
fb63983eb2
Modify rocksdb compilation
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-14 15:12:08 +08:00
4303fc0334
Rename channelID to channelNames in documents
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-14 15:03:26 +08:00
6e36f10a26
Fix rocksdb illegal instruction in some machine
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-14 14:24:14 +08:00
52bd6abdf8
Change RocksMQ interface
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-13 17:26:57 +08:00
1104f059ee
Update doc:module interfaces
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-13 11:08:03 +08:00
2d2af1505a
Improve mutex usage in query node
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
b6e1713044
Change int to MessageID
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-12 10:52:57 +08:00
f3d2afa4f4
Update doc:detailed interface definition
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
a6690dbc99
Fix syntax error: Bad fd number
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
18cfd31d40
Fix Load and Remove with prefix
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
5dfe9448ae
Modify test_index
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
d11f00cd9f
Add rocksdb in kv
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00
82ad488555
Update doc: rocksmq
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
65089ea362
Fix flush sync test bug and remove unecessary lock in meta_table
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
c4599e26de
Update doc: node api
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
c82565bd5c
Update doc: service api
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-04 14:16:43 +08:00
1abc69277b
Update doc: service api
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-29 18:02:44 +08:00
e8ec0424d8
Update doc: service api
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-27 09:05:24 +08:00
9d5c93744c
Fix figure path
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-22 14:47:55 +08:00
6fddb992f4
Add binlog desgin to chap08_binlog.md
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-03 10:16:22 +08:00
7bbbc14637
Fix bug: address already used
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
37d7526d31
Fix search test failure
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
aeca8f85a5
Run cwrapper unittest in ci
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
806a97505c
Add query node for CI progress
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
70710dee47
Add parquet payload
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
63c8f60c6e
Enable term parser and executor
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 09:51:27 +08:00
6412ebc0d4
Add support of metric type in schema, enable binary vector, fix segfault
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
0b6fe0a8cf
Refactor paramtable
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-04 14:18:17 +08:00
7ab5b5d80d
Add MinIO kv implements
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
cec903da19
Add parquet payload
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
yukun
XuanYang-cn
Cai Yudong
godchen
xige-16
sunby
neza2017
quicksilver
FluorineDog
bigsheeper
zhenshan.cao
Xiangyu Wang
cai.zhang
GuoRentong