006dae35c3
fix retrieve bug ( #5727 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-11 00:06:55 +08:00
e97936ba1c
Fix query hang bug ( #5709 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-10 14:33:49 +08:00
8aae0f7cc9
Refactor flow graph and load/watchDML in query node ( #5682 )
...
* Refactor flow graph and load/watchDML in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-09 11:37:55 +08:00
313658767d
Add field_name and type in retrieve result ( #5665 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-08 16:26:36 +08:00
68f703f983
Add Query impl in proxynode ( #5644 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-07 17:21:36 +08:00
50b3d39370
Add GetRecoveryInfo interface and proto ( #5598 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-07 14:16:36 +08:00
bc46e4780d
Fixbug:index is not loaded in some cases ( #5633 )
...
* Fixbug:index is not created in some cases
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Delete unecessary print
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* fix create index
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-06 09:41:35 +08:00
8ead67ef95
IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs ( #5624 )
...
* IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* index created by std::make_shared
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-06-05 17:19:34 +08:00
7dac20c35c
Add log for poxynode transform data and querynode segment insert ( #5627 )
...
* Add log for poxynode transform data and querynode segment insert
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Decrease print times
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-05 16:21:36 +08:00
5037646cbd
Check dsl whether is None ( #5616 )
...
* Check dsl whether is None
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Format code
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-06-05 14:57:34 +08:00
45e7d26b01
Fix retrieve when output_fields is nil ( #5623 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-05 10:57:34 +08:00
1ff4764ba6
Fix wrong primary key ( #5604 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 18:35:36 +08:00
03e3b4beb4
Add log to startup process ( #5594 )
...
* Add log to startup process
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: avoid ctx exceed deadline
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fmt code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: wrong time unit
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: datanservice client reconnect use time ctx
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-04 16:29:35 +08:00
2ba93deb5e
Support master get segment info channel name from config file ( #5606 )
...
* optimize msgstream unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* get data service segment info channel name from config file directly
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-04 16:28:34 +08:00
afa5da7df0
Add query rpc into proto ( #5592 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-04 12:02:34 +08:00
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs ( #5563 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
e80f06c030
Add retrieve process log ( #5561 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 20:56:33 +08:00
f791ccb246
Update OWNERS file
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 20:01:24 +08:00
57ece4a771
Fix retrieve_collection bugs ( #5575 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-03 19:41:33 +08:00
99699b2021
Support to show collections which are loaded into memory ( #5567 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 19:09:33 +08:00
0610ceb3dc
Fix ut error ( #5573 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-03 18:44:33 +08:00
e76830ab09
Support column-based insert request in proxy ( #5560 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 15:03:34 +08:00
b0b8f58192
Fix bug: search timeout ( #5557 )
...
* Fix bug: search timeout
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Add log and fix unittest bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
4018dfc5b7
Support data segment channel seek to the break point when system start ( #5540 )
...
* add DecodeDdOperation
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* reload MsgPosition from etcd and seek when system start
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename const string
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize master unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add msg into dataSegmentChannel to test seek
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix seek test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back distributed/masterservice/masterservice_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-02 22:36:41 +08:00
dcb4161c9f
Fix retrieve_service ( #5531 )
...
* Fix retrieve_service
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix retrieve_collection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-02 19:18:33 +08:00
d5cd561449
Add metrics for master ( #5515 )
...
* metric
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* metric
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add MasterDDChannelTimeTick for metrics
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add metrics for all master grpc
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* register metrics
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add metrics register
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add comments for codacy check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-01 11:04:31 +08:00
48f35ffa97
Add publishRetrieveResult ( #5501 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-31 18:08:32 +08:00
918458a1be
Add msgstream seek ( #5483 )
...
* Add msgstream seek
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change test name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove file
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* resolve conversation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-31 17:46:30 +08:00
5ac726b7b9
use NewTicker instead of NewTimer ( #5503 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 14:44:30 +08:00
c468481a36
Optimize MqTtMsgStream and unittest ( #5498 )
...
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add getTsMsgFromConsumerMsg
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename some variables for better readability
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add chanWaitGroup
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add chanTtMsgTime
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename lastTimeStamp to currTimeStamp
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add comments
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support unsynced ttMsg
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add TestStream_PulsarTtMsgStream_3
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* remove debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change ttMsg logic back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix ci block issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix codacy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 11:31:30 +08:00
4af2cacb28
Refactor IndexService and IndexNode: remove redundant serviceID ( #5491 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-31 10:32:30 +08:00
ca0993c274
Update OWNERS
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
b414800d49
Update Seek interface ( #5492 )
...
* update Seek
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update Seek for mqTtMsgStream
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* use Retry in Seek
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-29 23:21:34 +08:00
67c4c915b7
Move debugging code of index query to a separate module ( #5490 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-29 17:07:29 +08:00
95e762bb21
Add logs in retrieve request process ( #5460 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-29 11:19:30 +08:00
cd549f812d
Add retrieve_service ( #5481 )
...
* Add retrieve_service
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix for tSafeReplica
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-29 11:16:29 +08:00
03f90ff28c
refactor collection replica and add tsafe replica in querynode ( #5475 )
...
* refactor collection replica and add tsafe replica in querynode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* static check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* static check2
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* code format
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
b1a9aea6a6
support get entity by ids in segcore ( #5456 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
fce792b8bf
Add historical and streaming module in querynode ( #5469 )
...
* add historical and streaming
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix GetSegmentInfo
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* pass regression test
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
c63524deb9
Add dablooms ( #5440 )
...
* Add dablooms cwrapper
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix undefined reference bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add cwrapper_dablooms_build shell script
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
a606ab9c67
Add power-off restart logic for IndexService and IndexNode ( #5395 )
...
Add power-off restart logic for IndexService and IndexNode
Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
2021-05-27 14:24:29 +00:00
6e3a0d2a8e
Add queryservice grpc retry ( #5437 )
...
Add queryservice grpc retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 10:44:36 +00:00
5ac8b8acc6
Add comments to proto ( #5452 )
...
Specify which fields must be set by SDK
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-27 08:34:31 +00:00
220c12e12f
Add indexservice grpc retry ( #5425 )
...
Add indexservice grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:12:13 +00:00
279d77020a
Change proxy grpc retry ( #5431 )
...
Change proxy grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:10:39 +00:00
3630eec92c
Fix receving wrong msg after seek ( #5441 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-27 02:38:37 +00:00
9aa1fd25fa
Add indexnode grpc retry ( #5418 )
...
Add indexnode grpc retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 02:30:11 +00:00
f80dbab6ec
watch proxynode ( #5424 )
...
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Resolves : #5423
2021-05-26 12:14:30 +00:00
5fd92ec80c
Add querynode grpc retry ( #5428 )
...
Add querynode grpc retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-26 11:37:34 +00:00
bfa683ce79
Change dataservice grpc retry ( #5411 )
...
Change dataservice grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:55:05 +00:00
FluorineDog
yukun
bigsheeper
Xiangyu Wang
sunby
zhenshan.cao
shengjun.li
cai.zhang
Cai Yudong
dragondriver
godchen
xige-16
neza2017