Commit Graph

380 Commits (ca45e0bd00dd3a6eaa0e609985965806ed672f37)

Author SHA1 Message Date
xige-16 09b2c46b61
Support create collection with VarChar field ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-14 23:20:02 +08:00
congqixia 6a66faa2fb
Explictly specify Load operation meta ()
Fix 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-14 09:50:01 +08:00
groot 89356ebcb9
Modify import rpc interfaces ()
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import ()
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-09 18:33:59 +08:00
Jiquan Long f71651e294
Support column-based insert data in message stream ()
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-04 15:09:56 +08:00
congqixia 54862a31b0
Extend ChannelWatchState in protobuf ()
Related 
/kind enhancement

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-03 18:43:56 +08:00
congqixia 5751759c85
Implement mix compaction logic ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-18 14:51:49 +08:00
Filipe Caixeta dee1961b4d
Make SearchResults and QueryResults return collectionID ()
* Make SearchResults and QueryResults return collectionID

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* add return collection name from QueryRequest and SearchRequest

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* remove comment

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
xige-16 dfc6670f0f
Unsubscribe channel after query node down ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
Jiquan Long 675e6d352b
QueryNodes send search/query results by rpc ()
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
xige-16 cc5bee4684
Stop handoff if segment has been compacted ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-13 21:49:35 +08:00
xige-16 b063bfda8f
Add index info in loadSegmentRequest ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 19:09:33 +08:00
congqixia ef3b71f22b
Use indexInfo SerializedSize when estimating segment size ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 20:27:34 +08:00
Jiquan Long 8a63dba149
Add consistency level field in collection meta ()
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
xige-16 4e4ff54d98
Watch query channel to near the latest position ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 13:50:54 +08:00
xige-16 11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 11:57:39 +08:00
congqixia 1dcd06cc78
Add log file info for all kind of segment binlogs ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
bigsheeper 1ca08d9138
Simplify flow graph in QueryNode ()
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
xige-16 97d5231a0a
Reorganize querycoord proto ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
Bingyi Sun 0c39e0370c
Move segment statistics update to datanode tt loop ()
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-15 10:53:16 +08:00
xige-16 6f8ea8cc7b
Fix querycoord panic at getRecoveryInfo ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-13 10:29:27 +08:00
cai.zhang 342200ce13
Estimate the memory size of the index before building the index ()
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
bigsheeper 214f40b209
Add timeout ts for search and query ()
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 14:15:03 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column ()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 22:35:41 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts ()
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 14:25:15 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method ()
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-23 22:57:17 +08:00
congqixia 8e0c8febe9
Add dropped segment ids in vchaninfo ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-23 18:59:15 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface ()
issue: 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
xige-16 8a0ee27799
Estimate segment size according index and binlog file header ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files ()
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
congqixia 7e43b568ee
Add dropped ts and apply when gc scan dropped segments ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 14:23:21 +08:00
nameczz be18922a19
[skip ci] Add GetIndexBuildProgressRequest comments in milvus.proto ()
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-11-15 11:25:09 +08:00
godchen 5357e301f4
Fix retrieve search error ()
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
congqixia e5f599b616
Add dropped flag in SaveBinlogPathRequest ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-09 22:27:37 +08:00
congqixia 85af0b571d
Add dropped segment state ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-09 18:41:37 +08:00
Bingyi Sun 50791765d5
Add GetCompactionStateWithPlans rpc interface in milvus.proto ()
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 15:47:00 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy ()
issue: 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
xige-16 fcbe46ba75
Remove sealed segemnt from query node after compaction ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
bigsheeper 38375ee1d3
Add LoadBalance ()
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
xige-16 82c199227c
Add execute logic for balancing sealed segments ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
sunby c26cd79532
Add compaction ()
issue: 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
godchen 09f8fa1040
Add query coord watch delta channel ()
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-04 10:58:11 +08:00
Xiangyu Wang c29dc0be6a
[skip ci]Update OWNERS file ()
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 15:22:33 +08:00
xige-16 80215eb2f0
Retruen segment state when get query segment info ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-27 19:28:21 +08:00
xige-16 0cedd9d47e
Compaction multiSegmentChangeInfo to a single info ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 15:18:22 +08:00
godchen 6a0a5cf274
Add delete request hash values proto ()
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 21:20:44 +08:00
nameczz 80f1eb8356
[skip ci] Add IndexDescription comments in milvus.proto ()
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-25 19:58:18 +08:00
sunby 98be39bada
Add compaction field in querycoord segment info ()
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 18:09:15 +08:00