Commit Graph

58 Commits (7ff15490c9166955feed6716b43b49efca75681f)

Author SHA1 Message Date
godchen 48bdeb56d8
Merge watch delta channel positions (#12309)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-26 22:47:17 +08:00
godchen ad83090925
Merge delta channels when load partition (#12274)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 18:49:16 +08:00
godchen 88012acb86
Clear useless segments info. (#12262)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 17:37:15 +08:00
godchen d7cc1c1e36
Check load segments length before watch delta channel (#12200)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 11:21:15 +08:00
xige-16 d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 19:35:15 +08:00
XuanYang-cn 3acb73ebe6
[skip ci]Update license for qc task (#12016)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:49:32 +08:00
xige-16 55d162356b
Fix wrong set of segmentLoadInfo.enableIndex (#11964)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 14:37:11 +08:00
xige-16 8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
godchen 4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
xige-16 d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
xige-16 dba0ae4421
Refactor segment allocate policy on querycoord (#11181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-11 12:56:42 +08:00
xige-16 fcbe46ba75
Remove sealed segemnt from query node after compaction (#11430)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
xige-16 82c199227c
Add execute logic for balancing sealed segments (#11343)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16 6d43ac4a6e
Fix load segment request too large (#10812)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-28 17:26:28 +08:00
xige-16 2f53a57814
Fix too large request when load collection (#10768)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-27 19:32:21 +08:00
xige-16 a414d16c06
Fix remove segment when querynode receive segmentChangeInfo (#10619)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 13:04:18 +08:00
xige-16 9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
zhenshan.cao 40750f03c7
Enhance querycoord log (#10523)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 15:16:00 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 14:31:13 +08:00
congqixia f9408259b4
Add comment for shuffleSegmentsToQueryNode (#10336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 11:08:37 +08:00
xige-16 ef6de3e122
Comment MaxSendSizeToEtcd (#10165)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 10:53:09 +08:00
xige-16 1103ca8fca
Fix golint error in condition of queryCoord (#10230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 10:51:14 +08:00
xige-16 c5bba3ec2d
Fix assign load segment req error (#10310)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-20 22:32:36 +08:00
congqixia e8a7c482c8
Use proto Size to calculate req size (#10294)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 19:27:27 +08:00
xige-16 f467260208
Split large loadSegmentReq to multi small reqs (#10125)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 10:40:35 +08:00
zhenshan.cao d6f95f49e8
Fix golint error in querycoord (#10127)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:34:47 +08:00
xige-16 759603671c
[skip ci] Add comment for loadPartitionTask (#10028)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 22:01:15 +08:00
xige-16 59764d17bf
[skip ci] Add comment for ReleasePartitionTask (#10027)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 21:55:24 +08:00
xige-16 1b50695a40
[skip ci] Add comment for ReleaseCollectionTask (#10026)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 21:43:32 +08:00
xige-16 da5195aab8
[skip ci] Add comment for LoadCollectionTask (#9989)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:29:15 +08:00
xige-16 56466508cc
[skip ci] Add comment for maxRetryNum (#9988)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:25:08 +08:00
xige-16 e80fbd1f19
Fix golint error in the task of querycoord (#9866)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-14 20:18:33 +08:00
zhenshan.cao 609cc24309
Fix golint error in querycoord (#9836)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 21:46:32 +08:00
xige-16 e481a2775a
[skip ci] Add comment for set child task (#9837)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:26:33 +08:00
xige-16 c84600a496
[skip ci] Add comment for set taskID (#9835)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:24:41 +08:00
xige-16 ddf0cd2174
[skip ci] Add comment for taskID (#9833)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:22:47 +08:00
xige-16 c2731dddff
[skip ci] Add comment for task state (#9757)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:40:36 +08:00
xige-16 235d736a49
Add max number of retries for interTask in querycoord (#8215)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 09:54:37 +08:00
godchen 937dbf4279
Add flushed segments (#9476)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:09:12 +08:00
xige-16 9400694867
Add ut for querycoord's meta (#7968)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-29 09:56:04 +08:00
xige-16 85c2b4d0f6
Add log for releasePartion task (#8222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:06:02 +08:00
xige-16 e75693e1a3
Add log for release collection task (#8226)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 18:45:51 +08:00
xige-16 c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
bigsheeper b7103357fd
Load failed if collection beyonds the memory limit (#7434)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-07 11:35:18 +08:00
xige-16 c8a1f780c1
Use proto marshal instead of MarshalTextString in querycoord (#6958)
* use proto marshal instead of marshalToText

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* don't retry after init meta/cluster/scheduler failed

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix return err

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log inconsistent task info

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 22:03:25 +08:00
xige-16 87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935)
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-02 22:39:25 +08:00
xige-16 2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351)
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
xige-16 ddb027fb9e
clear proxy sarchStream when releaseCollection (#6258)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-02 10:40:13 +08:00