milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,986 Commits
153 Branches
123 Tags
550 MiB
Commit Graph

508 Commits (ad0cce8f7058ae18d9a95af8b51880be384b4e53)

Author SHA1 Message Date
congqixia 0bf176a7e1
Add SyncReplicaSegments interface for QueryNode (#16672) 
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-27 10:41:46 +08:00
groot bc5e9ec929
Add list import tasks api (#16605) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-25 17:37:46 +08:00
Ten Thousand Leaves e66ac6a77c
Resolve an issue with bulk load where segments in flow graph replica are not updated (#16609) 
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-25 11:07:47 +08:00
Aivin V. Solatorio 04fffb08ef
Support arithmetic operations on numerical fields for scalar filtering (#16520) 
Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
 2022-04-24 16:43:45 +08:00
yah01 804fbb6e27
Fix panic: Set Base of GetReplicas request (#16578) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-22 14:47:42 +08:00
congqixia 69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470) 
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-20 16:15:41 +08:00
Ten Thousand Leaves 289e468a7a
Make bulk load fully work (#16512) 
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 14:03:40 +08:00
codeman f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
Ten Thousand Leaves 442c73a544
Support passing channel names to DataNode (#16424) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-12 13:25:34 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-11 19:49:34 +08:00
Ten Thousand Leaves 1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-06 15:33:32 +08:00
XuanYang-cn 78200009a3
Impl GetReplicas in Proxy (#16390) 
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-04-06 14:57:31 +08:00
xige-16 99984b88e1
Support delete varChar value (#16229) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-04-02 17:43:29 +08:00
Letian Jiang 028c5cb882
Modify grpc interface for replica Search/Query in QueryNode (#16326) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-04-02 14:15:31 +08:00
yah01 c005f07ccc
Modify proto to add GetReplicas() interface (#16328) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-01 16:15:29 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-01 11:33:28 +08:00
XuanYang-cn 58addbf9f4
Add GetShardLeaders rpc in querycoord proto (#16299) 
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-03-31 16:39:29 +08:00
Ten Thousand Leaves 0d54697d42
Implement ReportImport related logic. (#16312) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-31 13:51:28 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
yah01 0f53989f17
Modify proto to support replicas (#16289) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-30 17:57:28 +08:00
congqixia 18a3e9f265
Add grpc interface for replica Search/Query in QueryNode (#16197) 
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-30 12:03:27 +08:00
yah01 178eb8cce1
Modify proto to support replicas (#16218) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-28 16:43:27 +08:00
yah01 0d16ecf0dd
Add protobuf messages to support multi memory replica (#16153) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-25 11:13:25 +08:00
Ten Thousand Leaves a23ca745bb
Add Etcd support for Import Tasks. (#16164) 
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-25 11:03:25 +08:00
groot 478890a700
modify import proto (#16155) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-23 19:29:25 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-22 15:11:24 +08:00
groot 2078b24dca
Prepare for import (#16083) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-21 15:47:23 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-21 14:23:24 +08:00
xige-16 09b2c46b61
Support create collection with VarChar field (#15904) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-14 23:20:02 +08:00
congqixia 6a66faa2fb
Explictly specify Load operation meta (#16027) 
Fix #15996

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-14 09:50:01 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-11 17:13:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import (#15930) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-09 18:33:59 +08:00
Jiquan Long f71651e294
Support column-based insert data in message stream (#15802) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-04 15:09:56 +08:00
congqixia 54862a31b0
Extend ChannelWatchState in protobuf (#15847) 
Related #15846
/kind enhancement

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-03 18:43:56 +08:00
congqixia 5751759c85
Implement mix compaction logic (#15542) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-02-18 14:51:49 +08:00
Filipe Caixeta dee1961b4d
Make SearchResults and QueryResults return collectionID (#15377) 
* Make SearchResults and QueryResults return collectionID

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* add return collection name from QueryRequest and SearchRequest

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* remove comment

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
 2022-01-27 22:55:41 +08:00
xige-16 dfc6670f0f
Unsubscribe channel after query node down (#15230) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-17 17:37:37 +08:00
Jiquan Long 675e6d352b
QueryNodes send search/query results by rpc (#15223) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-17 14:41:35 +08:00
xige-16 cc5bee4684
Stop handoff if segment has been compacted (#15181) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-13 21:49:35 +08:00
xige-16 b063bfda8f
Add index info in loadSegmentRequest (#14524) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-30 19:09:33 +08:00
congqixia ef3b71f22b
Use indexInfo SerializedSize when estimating segment size (#13969) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-22 20:27:34 +08:00
Jiquan Long 8a63dba149
Add consistency level field in collection meta (#13766) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-21 19:49:02 +08:00
xige-16 4e4ff54d98
Watch query channel to near the latest position (#13682) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-21 13:50:54 +08:00
xige-16 11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta (#13543) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-21 11:57:39 +08:00
congqixia 1dcd06cc78
Add log file info for all kind of segment binlogs (#13606) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-19 20:00:42 +08:00
bigsheeper 1ca08d9138
Simplify flow graph in QueryNode (#13613) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-17 20:12:42 +08:00
xige-16 97d5231a0a
Reorganize querycoord proto (#13181) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-15 16:53:12 +08:00
Bingyi Sun 0c39e0370c
Move segment statistics update to datanode tt loop (#13233) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 10:53:16 +08:00
xige-16 6f8ea8cc7b
Fix querycoord panic at getRecoveryInfo (#12983) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-13 10:29:27 +08:00
cai.zhang 342200ce13
Estimate the memory size of the index before building the index (#12973) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-09 14:19:40 +08:00
bigsheeper 214f40b209
Add timeout ts for search and query (#12890) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-08 14:15:03 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column (#12630) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-03 11:29:33 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 22:35:41 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts (#12247) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 14:25:15 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method (#12220) 
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-23 22:57:17 +08:00
congqixia 8e0c8febe9
Add dropped segment ids in vchaninfo (#12230) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-23 18:59:15 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170) 
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 10:55:14 +08:00
xige-16 8a0ee27799
Estimate segment size according index and binlog file header (#11875) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-17 09:47:12 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
congqixia 7e43b568ee
Add dropped ts and apply when gc scan dropped segments (#11838) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-16 14:23:21 +08:00
nameczz be18922a19
[skip ci] Add GetIndexBuildProgressRequest comments in milvus.proto (#10652) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-11-15 11:25:09 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-11 00:54:45 +08:00
congqixia e5f599b616
Add dropped flag in SaveBinlogPathRequest (#11519) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-09 22:27:37 +08:00
congqixia 85af0b571d
Add dropped segment state (#11499) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-09 18:41:37 +08:00
Bingyi Sun 50791765d5
Add GetCompactionStateWithPlans rpc interface in milvus.proto (#11491) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 15:47:00 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 14:47:02 +08:00
xige-16 fcbe46ba75
Remove sealed segemnt from query node after compaction (#11430) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-08 21:00:02 +08:00
bigsheeper 38375ee1d3
Add LoadBalance (#9945) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-06 16:54:59 +08:00
xige-16 82c199227c
Add execute logic for balancing sealed segments (#11343) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-06 15:22:56 +08:00
sunby c26cd79532
Add compaction (#9906) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-11-05 22:25:00 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-05 14:47:19 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-04 10:58:11 +08:00
Xiangyu Wang c29dc0be6a
[skip ci]Update OWNERS file (#11077) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-02 15:22:33 +08:00
xige-16 80215eb2f0
Retruen segment state when get query segment info (#10730) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-27 19:28:21 +08:00
xige-16 0cedd9d47e
Compaction multiSegmentChangeInfo to a single info (#10587) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-26 15:18:22 +08:00
godchen 6a0a5cf274
Add delete request hash values proto (#10601) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-25 21:20:44 +08:00
nameczz 80f1eb8356
[skip ci] Add IndexDescription comments in milvus.proto (#10246) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-10-25 19:58:18 +08:00
sunby 98be39bada
Add compaction field in querycoord segment info (#10565) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-25 18:09:15 +08:00
xige-16 9ebabdac79
Add handoffTask (#10330) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-24 22:39:09 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-22 19:07:15 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 14:31:13 +08:00
bigsheeper 2d984ba0d1
Fix getSegmentInfo in query node (#9549) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 19:47:35 +08:00
congqixia 7ce7cb7a5e
Add a timed flush trigger mechanism (#10197) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 15:02:36 +08:00
congqixia fc22537774
Fix static-check fail due to proto (#10258) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 13:12:35 +08:00
sunby 54459ac3b3
Add compaction proto (#9874) 
issue: #9873
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-20 11:58:35 +08:00
nameczz 86a7378492
[skip ci] Add DescribeIndexRequest comments in milvus.proto (#9984) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-10-19 11:16:34 +08:00
congqixia a7f7bff651
Modify SaveBinlogPaths proto to support delete logs (#10080) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-19 00:26:35 +08:00
XuanYang-cn 40d3562ec0
Fix comment on SegmentInfo message (#10066) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-18 21:27:09 +08:00
bigsheeper ae5d2ee9ba
Init global sealed segments and seek query channel when AddQueryChannel (#9543) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-15 20:35:05 +08:00
XuanYang-cn 98ed253e2c
Update SegmentInfo proto to support deltalogs (#9925) 
Resolves: #9922
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-15 18:24:39 +08:00
nameczz c992640176
[skip ci] Add create index comments in milvus.proto (#9852) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-10-14 18:46:59 +08:00
yukun 92815f4542
Change timestamp to timestamps in internalproto.DeleteRequest (#9802) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-14 14:48:34 +08:00
nameczz 7d49a48b47
[skip ci] Add ShowPartitionsResponse comments in milvus.proto (#9712) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-10-13 19:05:12 +08:00
nameczz 3cb286400f
[skip ci] Improve milvus.proto comments (#8885) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-10-11 21:23:50 +08:00
xige-16 7aa0942b11
Add init info for AddQueryChannelRequest (#9606) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-11 18:48:29 +08:00
bigsheeper d567b21fd4
Add globalSegmentManager and consume changeInfoMsg (#9575) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-11 15:40:38 +08:00
bigsheeper 3a4df03b70
Add SealedSegmentsChangeInfo and changeInfoMsg (#9479) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-09 14:45:00 +08:00
godchen 937dbf4279
Add flushed segments (#9476) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-08 19:09:12 +08:00
elfisworking d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574) 
Signed-off-by: elfisworking <zymustb@126.com>
 2021-10-08 17:39:55 +08:00
Cai Yudong d18c3bc5fd
Add db_name for alias proto (#9010) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-01 21:40:21 +08:00
nameczz da9228769c
[skip ci] Improve comments in milvus.proto (#8352) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-28 22:32:13 +08:00
congqixia ffbfaf7f76
Apply collection start position when open segment (#8697) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 20:34:03 +08:00
Cai Yudong 6ab00add27
Change expr_plan to primary_keys in internal proto DeleteRequest (#8655) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-27 14:17:58 +08:00
congqixia c17f845ab3
Add StartPositions fields in proto (#8657) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 14:13:58 +08:00
zhenshan.cao b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-27 10:01:59 +08:00
Cai Yudong 4fba738bec
Update internal proto DeleteRequest (#8466) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-24 15:21:55 +08:00
Cai Yudong 340f92ab16
Update querycoord proto (#8342) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 00:41:53 +08:00
nameczz b6cea6539b
[skip ci] Improve ShowCollections in milvus.proto (#8200) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-22 20:14:08 +08:00
bigsheeper 11a4109747
[skip ci] Add comment for query coord proto (#8325) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 20:06:09 +08:00
bigsheeper f8ca5dbf55
[skip ci] Add comment for query coord proto (#8322) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 20:04:13 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
nameczz d5d063df7c
[skip ci] improve milvus.proto comments (#8063) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-18 09:33:51 +08:00
nameczz 8ee55aad0a
[skip ci] improve DescribeCollection comments (#7882) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-16 10:21:53 +08:00
nameczz 87460665e0
improve HasCollectionRequest and DropCollectionRequest comments (#7693) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-14 09:53:21 +08:00
nameczz a392f1005c
improve CreateCollectionRequest comment in milvus.proto (#7590) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-10 10:06:00 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
bigsheeper b7103357fd
Load failed if collection beyonds the memory limit (#7434) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 11:35:18 +08:00
yukun 94272bba87
Support query by expression (#7386) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-03 17:12:55 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 10:13:15 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
groot 8701c477e2
Add delete api into proto (#7304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-26 12:15:52 +08:00
sunby 4d56d53c0b
Add a tool to move binlog path to SegmentInfo (#7243) 
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-24 15:51:51 +08:00
Cai Yudong 0ab70271a6
correct empty search result handle (#7244) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-24 11:13:52 +08:00
sunby 4f7c3e7d3a
Save binlog path in SegmentInfo (#6590) 
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-19 13:00:12 +08:00
dragondriver 648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-19 10:28:10 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
yukun 671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 17:06:10 +08:00
congqixia e1b3273d1c
Add Datanode watch etcd channel (#6965) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-13 10:50:09 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
xige-16 87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935) 
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-02 22:39:25 +08:00
cai.zhang d51fec6678
Enhance log when create index failed (#6871) 
* Enhance log when create index failed

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for repeatedly drop index

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-29 14:47:22 +08:00
xaxys e43b43e7d8
Refactor `RangeExpr` & `CompareExpr` (#6786) 
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-25 10:23:19 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
Cai Yudong a992dcf6a8
Support query return vector output field (#6570) 
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-16 17:19:55 +08:00
cai.zhang f469a315d6
Refactor the logic of assign tasks in IndexCoord (#6328) 
* Refactor the logic of assign tasks in IndexCoord

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bugs

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unittest

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add lock for map

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Improve code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix unittest bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reduce duriation for timetick

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Update orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset sdk version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset test ip

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unissued

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Rename some variables

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Use break instead of continue in select::case

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-14 14:15:55 +08:00
Cai Yudong 1c29b42434
change output_fields to out_fields_id for RetrieveRequest (#6506) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-14 13:11:54 +08:00
xaxys e5f8a77a2d
Extend grammar of boolean expression (#6460) 
* Extend grammar of boolean expression

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-13 14:37:03 +08:00
Cai Yudong 21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305) 
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-06 09:16:03 +08:00
Cai Yudong bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo (#6289) 
* add collectionID and partitionID into SegmentIndexInfo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add partID2SegID into meta table

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DropIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-03 20:00:40 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 14:36:18 +08:00
sunby 07b0989628
Add GetFlushedSegments in data coordinator (#6253) 
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-07-02 11:16:20 +08:00
groot a364d7303b
Implement calculate vectors distance in server (#6219) 
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-01 18:56:17 +08:00
neza2017 6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted (#6247) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-01 14:58:17 +08:00
zhenshan.cao ff4c6c7ff4
Fix travel timestamp and guarantee timestamp (#6234) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-30 21:02:13 +08:00
yukun b87baa108a
Add topks in searchResult (#6168) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-28 15:28:11 +08:00
yukun eb818d05ab
Remove vector fields from output fields (#6112) 
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 16:52:11 +08:00
xige-16 5417fee45f
fix releasePartition not work after loadCollection (#6025) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-23 17:44:12 +08:00
sunby 46f86a0354
Return sealed segments when calling flush (#6011) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-23 16:56:11 +08:00