Commit Graph

215 Commits (370562b4ec3078e58a574c33e1cf7e4012af7cb3)

Author SHA1 Message Date
Jeng.Gwan 638f6c36e9
Support to get real row count of segment (#18115)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-18 09:58:28 +08:00
SimFG f4c6a6734e
Fix rpc retry policy not taking effect (#17673)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-22 22:22:13 +08:00
congqixia c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-30 19:50:04 +08:00
zhenshan.cao b0d54ed0af
Rename Client to GrpcClient in mock package (#17230)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-30 17:16:08 +08:00
Xiaofan 333b439a6c
Support config grpc log level (#16618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-05 10:35:50 +08:00
congqixia 0bf176a7e1
Add SyncReplicaSegments interface for QueryNode (#16672)
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 10:41:46 +08:00
XuanYang-cn fbc7fe1cdc
Fix proxy unable to update cache (#16646)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-26 11:27:53 +08:00
congqixia 69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470)
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
godchen bb7a0766fe
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
Letian Jiang 028c5cb882
Modify grpc interface for replica Search/Query in QueryNode (#16326)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-02 14:15:31 +08:00
congqixia 18a3e9f265
Add grpc interface for replica Search/Query in QueryNode (#16197)
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
xige-16 55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
zhenshan.cao 1601a61b78
Move logic of checking available port to service (#15222)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-14 21:17:34 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Cai Yudong a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong 966119526a
Rename Params to ClientParams for all component clients (#13743)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:25:25 +08:00
Cai Yudong cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
zhenshan.cao af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
jaime d58daf06cf
[skip ci]Add comment when stop rpc server in querynode service (#12602)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-02 18:11:52 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-30 10:59:42 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
xige-16 1a8e2e5e85
Establish a grpc connection When init queryNode client (#12236)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-24 19:27:15 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-18 11:17:12 +08:00
bigsheeper 94d516bc61
[skip ci] Fix golint error for MockRootCoord (#11857)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:29:29 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
cai.zhang 8d38adc7a3
[skip ci]Fix golint error for GetMetrics in QueryNode (#10555)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:07:24 +08:00
cai.zhang 96e89a9d4c
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10554)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:05:34 +08:00
cai.zhang fb7d1271a4
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10553)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:59:30 +08:00
cai.zhang 6ea7340dd5
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10510)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:27:27 +08:00
cai.zhang 7669075ae3
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10509)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:21:38 +08:00
cai.zhang dc4ea15339
[skip ci]Fix golint error for LoadSegments in QueryNode (#10508)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:19:45 +08:00
cai.zhang bf10fc6e7c
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10476)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:37:30 +08:00
cai.zhang ebd7b4eee1
[skip ci]Fix golint error for AddQueryChannel in QueryNode (#10474)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:33:40 +08:00
cai.zhang edf0d0bb27
[skip ci]Fix golint error for RemoveQueryChannel in QueryNode (#10475)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:31:42 +08:00
XuanYang-cn 64d0a2d37e
[skip ci]Update license for distributed qn.client (#10420)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:15:33 +08:00
XuanYang-cn a219026142
[skip ci]Update license for distributed qn (#10419)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:03:30 +08:00
cai.zhang ecfca29adb
[skip ci] Fix golint for GetTimeTickChannel in QueryNode (#10395)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:59:23 +08:00
cai.zhang 51b9a9cd5c
[skip ci] Fix golint for GetComponentStates in QueryNode (#10394)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:57:33 +08:00
cai.zhang 331c630947
[skip ci] Fix golint for GetStatisticsChannel in QueryNode (#10396)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:49:25 +08:00
cai.zhang e27c5357db
[skip ci]Fix golint error for Stop in QueryNode (#10306)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-20 19:58:49 +08:00
cai.zhang 505d3a51df
[skip ci]Fix golint error for Start in QueryNode (#10305)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-20 19:56:55 +08:00
cai.zhang 063c7859f5
[skip ci]Fix golint error for Init in QueryNode (#10304)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-20 19:55:07 +08:00
cai.zhang a6ce06de6f
[skip ci]Fix golint error for NewClient in QueryNode (#10220)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-19 20:42:35 +08:00
cai.zhang 1d0e9dc6d7
[skip ci]Fix golint error for Client in QueryNode (#10219)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-19 20:40:40 +08:00
cai.zhang 9585aaa188
[skip ci]Fix golint error for GetMetrics in QueryNode (#10218)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-19 20:38:47 +08:00
cai.zhang cbb8236c05
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10064)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-18 20:20:53 +08:00
cai.zhang aba26a888a
[skip ci]Fix golint error for ReleasePartitions in QueryNode (#10063)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-18 20:19:01 +08:00
cai.zhang 62446f63d4
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10065)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-18 20:17:03 +08:00
cai.zhang b8d37034e7
[skip ci]Fix golint error for LoadSegments in QueryNode (#10004)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-16 17:16:45 +08:00
cai.zhang 3b13111280
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10003)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-16 17:14:51 +08:00
cai.zhang ea24a10dca
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10005)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-16 17:12:46 +08:00
cai.zhang ac7bacbbcc
[skip ci]Fix golint error for QueryNode (#9969)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-15 18:10:54 +08:00
cai.zhang 148b26cf40
[skip ci]Fix golint error for QueryNode (#9968)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-15 17:57:07 +08:00
cai.zhang af40606037
[skip ci]Fix golint error for QueryNode (#9970)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-15 17:52:56 +08:00
cai.zhang 971e0ea91f
[skip ci]Fix golint for GetStatisticsChannel in distributed/querynode/service.go (#9909)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-14 19:38:36 +08:00
cai.zhang f054c82f7c
[skip ci]Fix golint for GetTimeTickChannel in distributed/querynode/service.go (#9908)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-14 19:36:41 +08:00
cai.zhang 02b65f7179
[skip ci]Fix golint for SetIndexCoord in distributed/querynode/service.go (#9907)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-14 19:34:51 +08:00
groot 95502ce0ca
Rename test object (#9887)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 18:48:56 +08:00
groot 7205fd3d9b
Remove unused interface (#9877)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 17:42:35 +08:00
cai.zhang 711dad2eae
[skip ci]Fix golint for SetRootCoord in distributed/querynode/service.go (#9814)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-13 19:36:33 +08:00
cai.zhang ba6ea3df7e
[skip ci]Fix golint for Run in distributed/querynode/service.go (#9816)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-13 19:30:34 +08:00
cai.zhang 0d03a2066e
[skip ci]Fix golint for Stop in distributed/querynode/service.go (#9815)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-13 19:24:41 +08:00
cai.zhang 3437761108
[skip ci]Fix golint for UniqueID in distributed/querynode/service.go (#9730)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-12 19:29:22 +08:00
cai.zhang aae7e978af
[skip ci]Fix golint for init in distributed/querynode/service.go (#9729)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-12 19:27:30 +08:00
cai.zhang 806973fe83
[skip ci]Fix golint for Server in distributed/querynode/service.go (#9728)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-12 19:21:08 +08:00
cai.zhang 62c65d234a
[skip ci]Fix golint error in distributed/querynode/client/param_table.go (#9645)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 21:38:49 +08:00
cai.zhang f73c04915b
[skip ci]Fix golint error in distributed/querynode/param_table.go (#9639)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 21:33:11 +08:00
groot 0d49316103
Add unittest for distributed/querynode (#9608)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 17:16:30 +08:00
groot b17d253db1
Add unittest for distributed/querynode (#8834)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-30 10:02:02 +08:00
groot cd03da2a9d
Add unittest for distributed/querynode (#8648)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-27 14:12:08 +08:00
Xiaofan 34157a4943
Unify Param Table name (#8491)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-24 21:35:57 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
groot 8fb961a0b0
Add unittest for distributed querynode (#7996)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:15:53 +08:00
xige-16 af574d17d5
Fix querycoord panic when stop nil conn of querynoClient (#7346)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-28 12:51:57 +08:00
xige-16 055d94ede1
Add ut for queryCoord (#7212)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-26 14:17:54 +08:00
godchen bf2c427609
Fix connection timeout (#7203)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-20 17:52:11 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-17 10:06:11 +08:00
dragondriver b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-12 16:16:09 +08:00
godchen 7557616fea
Change client timeout (#6982)
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-06 14:09:26 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
xige-16 2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351)
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
neza2017 8b89744c6b
search with exp (#6409)
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
godchen 2a07124885
Change default grpc retry config (#6233)
* Change default grpc retry config

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add retry code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-01 15:24:17 +08:00
xige-16 f146d3825f
Fix search hang after querynode restart (#6212)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-30 17:48:19 +08:00
godchen 1c1ffc8b32
Add connect err log (#6186)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-29 14:30:17 +08:00
godchen 73996aba91
Change client init timeout (#6107)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-25 15:50:23 +08:00
godchen 3785bb6330
Change retry times (#6083)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 19:05:06 +08:00
xige-16 5417fee45f
fix releasePartition not work after loadCollection (#6025)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-23 17:44:12 +08:00
godchen fd07a44dba
Fix error in retry refactor (#6000)
* Fix error in retry refactor

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 11:48:06 +08:00
godchen 99be4c09a5
change retry (#5996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00