Commit Graph

750 Commits (64e04ecc568147ffc0ff86dccf98dfd00d158282)

Author SHA1 Message Date
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
bigsheeper 62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-24 11:27:15 +08:00
Xiaofan 0aaa87a79a
Fix MsgStream inconsistent seek (#12042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method (#12220)
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-23 22:57:17 +08:00
godchen 3fa5b4a9ce
Delete for segment indexing (#12197)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 17:17:16 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204)
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
Cai Yudong dd0b36f3fb
Clean debug log (#12205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 14:25:15 +08:00
yukun 7a0d5ed6c4
Fix delete after create index (#12174)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 23:11:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
godchen 02bf77aabf
Close reader stream (#12167)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 16:17:14 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-21 07:33:14 +08:00
bigsheeper d4254f876a
[skip ci] Add comment for msgQueryNodeIsUnhealthy (#12111)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:45:12 +08:00
bigsheeper 98b0f73c46
[skip ci] Add comment for deleteNode (#12110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:43:20 +08:00
bigsheeper b35c2f60ea
[skip ci] Add comment for errQueryNodeIsUnhealthy (#12109)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:41:27 +08:00
bigsheeper be1602f769
[skip ci] Add comment for dataSyncService close (#12028)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 09:25:17 +08:00
bigsheeper 152d55dbfa
Fix the deadlock of the querycoord cluster (#11796)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 23:37:11 +08:00
bigsheeper 7df9600e5d
[skip ci] Add comment for removePartitionFlowGraph (#12027)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-17 20:27:24 +08:00
bigsheeper f07b3ff8cb
[skip ci] Add comment for startPartitionFlowGraph (#12026)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-17 20:25:29 +08:00
Xiaofan f654621650
Remove the etcd deletion of segment data path on querynode (#11863)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
congqixia 5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
Bingyi Sun e3e4dc7153
Improve GetVChanPosistion and fix unit tests (#11888)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
bigsheeper 77b6dc2081
[skip ci] Add comment for getPartitionFlowGraphs (#11930)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:39:49 +08:00
bigsheeper b79bf56226
[skip ci] Add comment for addPartitionFlowGraph (#11929)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:37:57 +08:00
bigsheeper 6e22d079ee
[skip ci] Add comment for removeCollectionDeltaFlowGraph (#11928)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:36:03 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
bigsheeper 698071de6f
[skip ci] Fix golint error for segmentInsert (#11856)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:27:36 +08:00
bigsheeper fc0a34f40d
[skip ci] Fix golint error for segmentDelete (#11855)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:25:40 +08:00
Cai Yudong b0054f1b48
Update C API NewSegment (#11809)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:57:09 +08:00
Cai Yudong 1f28dba497
Use API HandleCStatus to handle CStatus returned by CGo in querynode (#11789)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:13:10 +08:00
Cai Yudong 34ae61d8e2
Move HandleCProto into query node (#11763)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 11:05:09 +08:00
zhenshan.cao 8c6c031e80
FixBug:update serviceableTime incorrectly (#11769)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-15 10:31:09 +08:00
Cai Yudong ad2572d0ef
Remove useless MarshalForCGo (#11698)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 10:13:09 +08:00
godchen 4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
bigsheeper be20567852
[skip ci] Add comment for removeCollectionFlowGraph (#11737)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 19:19:50 +08:00
bigsheeper 3f9c5baf63
[skip ci] Add comment for startCollectionFlowGraph (#11735)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 19:17:50 +08:00
bigsheeper 6d11f45b37
[skip ci] Add comment for startCollectionDeltaFlowGraph (#11736)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 19:09:16 +08:00
xige-16 d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Cai Yudong 5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-12 10:04:49 +08:00
bigsheeper b261e89a92
[skip ci] Add comment for getCollectionDeltaFlowGraphs (#11689)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-11 22:14:57 +08:00
bigsheeper c782a05c2f
[skip ci] Add comment for getCollectionFlowGraphs (#11688)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-11 22:13:05 +08:00
bigsheeper c7286e8233
[skip ci] Add comment for loadType (#11687)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-11 21:14:46 +08:00
Cai Yudong ca356d2811
Use API HandleCStatus to handle CStatus returned by CGo in query node (#11559)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-11 10:18:42 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
xige-16 98ad823666
[skip ci] Fix golint for GetMetrics (#11596)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-10 23:56:10 +08:00
bigsheeper fa77e14884
[skip ci] Add comment for printReplica (#11592)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-10 23:54:05 +08:00
bigsheeper 2ff913024f
[skip ci] Add comment for freeAll (#11591)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-10 23:52:06 +08:00
bigsheeper b9f2616108
[skip ci] Add comment for queryRUnlock (#11590)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-10 23:50:14 +08:00
xige-16 b6c7bc19d1
[skip ci] Add comments for VectorFieldInfo (#11595)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-10 23:48:06 +08:00
bigsheeper 64e86c5461
[skip ci] Add comment for queryUnlock (#11527)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-10 19:19:00 +08:00
Cai Yudong c5f566357a
Remove debug code (#11556)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:31:37 +08:00
Cai Yudong b5bc9b26d7
Rename getEntityByIds to retrieve (#11548)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:15:37 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
bigsheeper 9601a5ebfe
[skip ci] Add comment for queryLock (#11526)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-09 21:07:48 +08:00
bigsheeper 27771817ed
[skip ci] Add comment for queryRLock (#11528)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-09 20:25:38 +08:00
godchen 863f1bb34e
Fix multi delete data not effect (#11422)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 15:01:17 +08:00
Xiangyu Wang 0eb71f7ee5
Logging traceID in process of processing delete request (#11374)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-09 11:01:02 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
bigsheeper e29322a66b
[skip ci] Add comment for getSegmentsMemSize (#11457)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-08 21:07:17 +08:00
bigsheeper 4e1f42ab86
[skip ci] Add comment for queryRUnlock (#11456)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-08 21:05:30 +08:00
bigsheeper 40d199bac6
[skip ci] Add comment for queryRLock (#11455)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-08 21:03:45 +08:00
Cai Yudong 021f4c0f8a
Update query reduce log (#11401)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 16:05:51 +08:00
bigsheeper 436d530432
[skip ci] Add comment for queryUnlock (#11377)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 19:58:58 +08:00
bigsheeper b51fc9efa9
[skip ci] Add comment for queryLock (#11376)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 19:57:10 +08:00
bigsheeper dc1dc199a2
[skip ci] Add comment for getExcludedSegments (#11375)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 19:55:18 +08:00
bigsheeper 38375ee1d3
Add LoadBalance (#9945)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
xige-16 82c199227c
Add execute logic for balancing sealed segments (#11343)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
yukun 4e5c8811da
Add flow_graph for delta channel in querynode (#11293)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-06 11:02:58 +08:00
xige-16 b7644c0c03
[skip ci] Add comments for GetMetrics (#11347)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 22:01:03 +08:00
bigsheeper a756fc78c1
[skip ci] Add comment for addExcludedSegments (#11336)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 19:57:35 +08:00
bigsheeper 3ba797fffc
[skip ci] Add comment for removeExcludedSegments (#11335)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 19:55:45 +08:00
bigsheeper 85ba05e7f3
[skip ci] Add comment for getSegmentStatistics (#11334)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 19:53:54 +08:00
xige-16 1aa8bf404a
Fix querynode ut panic on getSegmentInfo (#11323)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 17:33:34 +08:00
xige-16 9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster (#11247)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 16:00:55 +08:00
Xiaofan d81b15163f
Seek Query/Query Result channel to Latest (#10985)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:57:44 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16 c216c5a387
[skip ci] Add comments for MarshaledHits (#11284)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 09:23:11 +08:00
xige-16 fdb32445f2
[skip ci] Add comments for SearchResult (#11283)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 09:21:21 +08:00
xige-16 4a8d1991b7
[skip ci] Add comments for InitSegCore (#11282)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 09:19:31 +08:00
bigsheeper e21068ffbc
Fix release collection block in query node (#11249)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 19:51:07 +08:00
bigsheeper 4f03f27633
[skip ci] Add comment for getSegmentNum (#11252)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 19:02:04 +08:00
bigsheeper b028e58c8f
[skip ci] Add comment for hasSegment (#11251)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 18:59:29 +08:00
bigsheeper 3f2455d03f
[skip ci] Add comment for getSegmentByID (#11250)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 18:56:42 +08:00
Cai Yudong 0fac38000c
Correct empty retrieve result handling (#11219)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-04 18:08:32 +08:00
zhenshan.cao 34c4ef06fc
[skip ci]Fix golint error in segment.go (#11203)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:50:14 +08:00
zhenshan.cao 59277d6edc
[skip ci]Fix golint error in querynode (#11202)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:48:17 +08:00
bigsheeper a1106181c3
[skip ci] Add comment for setSegment (#11196)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-03 23:18:57 +08:00
bigsheeper d6fa46cfbb
[skip ci] Add comment for addSegment (#11194)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-03 23:17:02 +08:00
xige-16 7ea6b773e6
[skip ci] Add comments for Init (#11193)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-03 23:15:16 +08:00
xige-16 48fb8174fa
[skip ci] Add comments for ReleaseSegments (#11192)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-03 23:13:26 +08:00
bigsheeper 1ba39c61c9
[skip ci] Add comment for removeSegment (#11195)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-03 23:09:06 +08:00
xige-16 4df2c23780
[skip ci] Add comments for WatchDmChannels (#11119)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 22:00:38 +08:00
xige-16 7c588e5652
[skip ci] Add comments for LoadSegments (#11118)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 21:58:22 +08:00
xige-16 aa64b64214
[skip ci] Add comments for GetSegmentInfo (#11117)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 21:56:34 +08:00
bigsheeper 2bcaaa83a1
[skip ci] Add comment for getSegmentIDsByVChannel (#11101)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-02 21:54:48 +08:00
bigsheeper 29a2a15820
[skip ci] Add comment for getSegmentIDs (#11100)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-02 21:52:51 +08:00
bigsheeper 06607f6955
[skip ci] Add comment for getPartitionNum (#11099)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-02 21:50:42 +08:00
godchen 0d97549d84
Remove useless log (#11105)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 19:20:29 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00