Commit Graph

6970 Commits (b0b8f58192ad098ba1eadaca598148099af4bc20)

Author SHA1 Message Date
zhenshan.cao b0b8f58192
Fix bug: search timeout (#5557)
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
ThreadDao c47b157511
Regress and fix issues (#5550)
* add case of insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* add insert cases

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert data

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* fix codacy

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* regress and fix issues

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* [skip ci] add binary not match dim case

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-06-03 10:52:32 +08:00
Cai Yudong 4018dfc5b7
Support data segment channel seek to the break point when system start (#5540)
* add DecodeDdOperation

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* reload MsgPosition from etcd and seek when system start

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename const string

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize master unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add msg into dataSegmentChannel to test seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix seek test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* roll back distributed/masterservice/masterservice_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-02 22:36:41 +08:00
紫晴 176109065e
[skip ci] Update codes of connection (#5542)
* Update codes of connection

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* [skip ci] Update log for test

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-06-02 19:21:33 +08:00
yukun dcb4161c9f
Fix retrieve_service (#5531)
* Fix retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix retrieve_collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-02 19:18:33 +08:00
紫晴 56da071cce
Add test cases of connection (#5517)
* Add test cases of connection

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* Update code

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-06-01 18:49:31 +08:00
quicksilver cc517570ab
Load variables into shell scripts (#5518)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-01 14:52:31 +08:00
Cai Yudong d5cd561449
Add metrics for master (#5515)
* metric

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* metric

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add MasterDDChannelTimeTick for metrics

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add metrics for all master grpc

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* register metrics

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add metrics register

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix format issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-01 11:04:31 +08:00
Xiangyu Wang f3fb0f8b00
Change partition_tag to partition_name (#5514)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 20:02:30 +08:00
ThreadDao 316b6fbd43
Add test cases of insert data (#5512)
* add case of insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* add insert cases

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert data

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* fix codacy

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-05-31 19:23:31 +08:00
yukun 48f35ffa97
Add publishRetrieveResult (#5501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-31 18:08:32 +08:00
godchen 918458a1be
Add msgstream seek (#5483)
* Add msgstream seek

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change test name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove file

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* resolve conversation

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-31 17:46:30 +08:00
quicksilver 9e91860ae9
Fix install dependencies scripts file bug (#5511)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 16:33:30 +08:00
Xiangyu Wang e412cb14c7 Update Mergify
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 15:24:38 +08:00
quicksilver fca8760486
Update mergify (#5504)
* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 15:13:32 +08:00
Cai Yudong 5ac726b7b9
use NewTicker instead of NewTimer (#5503)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 14:44:30 +08:00
Xiangyu Wang 88b32316db
[skip ci]Update mergify (#5497)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 14:08:30 +08:00
Cai Yudong c468481a36
Optimize MqTtMsgStream and unittest (#5498)
* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add getTsMsgFromConsumerMsg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename some variables for better readability

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add chanWaitGroup

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add chanTtMsgTime

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename lastTimeStamp to currTimeStamp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support unsynced ttMsg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add TestStream_PulsarTtMsgStream_3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change ttMsg logic back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix ci block issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix codacy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 11:31:30 +08:00
zhenshan.cao 4af2cacb28
Refactor IndexService and IndexNode: remove redundant serviceID (#5491)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-31 10:32:30 +08:00
Xiangyu Wang ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
Cai Yudong b414800d49
Update Seek interface (#5492)
* update Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update Seek for mqTtMsgStream

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use Retry in Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-29 23:21:34 +08:00
zhenshan.cao 67c4c915b7
Move debugging code of index query to a separate module (#5490)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-29 17:07:29 +08:00
Xiangyu Wang 95e762bb21
Add logs in retrieve request process (#5460)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-29 11:19:30 +08:00
yukun cd549f812d
Add retrieve_service (#5481)
* Add retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for tSafeReplica

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-29 11:16:29 +08:00
bigsheeper 03f90ff28c
refactor collection replica and add tsafe replica in querynode (#5475)
* refactor collection replica and add tsafe replica in querynode

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check2

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* code format

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
shengjun.li 6b5954bf7b
[skip ci] fix badge (#5479)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-28 15:16:42 +08:00
quicksilver 177bdb485d
Update the conditions that trigger GitHub actions (#5473)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-28 14:25:08 +08:00
del-zhenwu 9b07959e3a
Add utility cases (#5464)
* Add utility cases

Signed-off-by: zw <zw@milvus.io>
2021-05-28 11:50:31 +08:00
quicksilver ca49e1a7f0
Fix extract log files bug (#5471)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-28 11:27:30 +08:00
FluorineDog b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
xige-16 fce792b8bf
Add historical and streaming module in querynode (#5469)
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
yukun c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
Xiangyu Wang 16839f6796
[skip ci]Update code owners (#5467)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-28 09:56:11 +08:00
yanliang567 c7f8129c1a
[skip ci] update partition tests for #5373 and #5392 (#5458)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-28 09:45:59 +08:00
cai.zhang a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395)
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
2021-05-27 14:24:29 +00:00
Cai Yudong dde74e2165
Support launch multiple services in one process (#5446)
Resolves: #5450 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-27 14:02:58 +00:00
godchen 6e3a0d2a8e
Add queryservice grpc retry (#5437)
Add queryservice grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 10:44:36 +00:00
del-zhenwu c6aee9b4a3
Index case update (#5455)
Signed-off-by: zhenwu <zhenwu@zilliz.com>
2021-05-27 08:58:11 +00:00
zhenshan.cao 5ac8b8acc6
Add comments to proto (#5452)
Specify which fields must be set by SDK

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-27 08:34:31 +00:00
godchen 220c12e12f
Add indexservice grpc retry (#5425)
Add indexservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:12:13 +00:00
godchen 279d77020a
Change proxy grpc retry (#5431)
Change proxy grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:10:39 +00:00
neza2017 7dbe737061
add server type of mixture, enable the services run on progress (#5451)
Resolves: #5450 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-27 06:06:13 +00:00
quicksilver 907106f752
Update milvus system configuration (#5448)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 03:40:23 +00:00
xige-16 3630eec92c
Fix receving wrong msg after seek (#5441)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-27 02:38:37 +00:00
godchen 9aa1fd25fa
Add indexnode grpc retry (#5418)
Add indexnode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 02:30:11 +00:00
yanliang567 74ea346e7c
Add New Partition Tests (#5412)
add new testcases for partition.

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-27 02:26:35 +00:00
quicksilver 198cc0dcc3
Adjust the directory structure for archived Logs (#5442)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 09:51:22 +08:00
quicksilver 63399f5ccd
Extract Milvus log files from KinD logs (#5434)
Extract Milvus log files from KinD logs

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-26 22:28:10 +08:00
neza2017 f80dbab6ec
watch proxynode (#5424)
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
2021-05-26 12:14:30 +00:00
godchen 5fd92ec80c
Add querynode grpc retry (#5428)
Add querynode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-26 11:37:34 +00:00