Commit Graph

3380 Commits (a72effda7666cdecaa9226c43f5d777f1111b2ef)

Author SHA1 Message Date
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204)
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
bigsheeper 18463ebde4
Reduce memory cost when load from minio (#12055)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-23 14:49:15 +08:00
Cai Yudong dd0b36f3fb
Clean debug log (#12205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 14:25:15 +08:00
Bingyi Sun 3be9442c0f
Clear dropped segment meta on etcd (#12191)
issue: #9613
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 11:23:15 +08:00
godchen d7cc1c1e36
Check load segments length before watch delta channel (#12200)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 11:21:15 +08:00
yukun adf9530ed7
Bool expr not support numerica (#12184)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-23 10:57:16 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
dragondriver 73f18c564f
Refine logs when search with unsupported metric type (#12185)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-23 10:13:14 +08:00
yukun 7a0d5ed6c4
Fix delete after create index (#12174)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 23:11:14 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 20:11:14 +08:00
yukun 835451e331
Update rocksmq consume slowly log (#12179)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 18:51:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
yukun e9585625e6
Add error return with invalid bool expr (#12168)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 16:57:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
godchen 02bf77aabf
Close reader stream (#12167)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 16:17:14 +08:00
Cai Yudong 99b3c56b3e
Update rootcoord debug log (#12160)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-22 16:01:14 +08:00
zhenshan.cao 0f2b7d1790
Fix deadlock caused by not releasing the lock in time (#12161)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-22 12:19:14 +08:00
yukun f5bb180adb
Support multiple readers on one topic (#12155)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 10:35:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066)
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-22 10:05:14 +08:00
edward.zeng 3cfc740a05
Refine minio kv FGetObject function (#12078)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-21 22:53:13 +08:00
Cai Yudong d4c297b1a8
Enhance dml channel operations (#12143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-21 21:33:13 +08:00
yukun ac175b6f00
Add rocksmq produce slowly hint log (#12156)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-21 15:33:13 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-21 07:33:14 +08:00
dragondriver bf391f2449
Make indexparamcheck thread-safe (#11916)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-21 00:39:13 +08:00
yukun 2147507e89
Add reader implementation in rocksmq (#12137)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 20:57:13 +08:00
xige-16 03f63b7ec1
Start querycoord after root/datacoord healthy (#12145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-20 08:23:13 +08:00
yukun 8c947109a9
Add log in rocksmq (#12138)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 00:11:13 +08:00
congqixia 8a9fb9b287
Fix CMakeLists.txt comment error (#12141)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-19 19:33:13 +08:00
xige-16 e66537f9c9
Parallel estimate segment size (#12136)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-19 18:09:13 +08:00
shaoyue cec1b0cb77
[skip ci] Add comments for exported items (#12127)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 18:07:18 +08:00
shaoyue 6777d24c65
[skip ci] Add comment for exported items (#12126)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 18:05:25 +08:00
shaoyue 888aad120c
[skip ci] Fix comment typo (#12122)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 17:59:39 +08:00
jaime 11110906a4
[skip ci] Add a TODO for a faiss cpp file (#12117)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-19 17:57:46 +08:00
jaime c6fea64aa7
[skip ci] Add a comment to faiss CMakeLists (#12116)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-19 17:55:40 +08:00
Cai Yudong 3aca73969f
Optimize segcore API arrangement (#12135)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 17:23:12 +08:00
godchen 51b353b52c
Add msgstream reader (#12130)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-19 15:57:12 +08:00
congqixia 7e91bcf115
Normalize datanode dminput node log (#12128)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-19 14:21:13 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
Cai Yudong 074687e32e
Unify rootcoord debug log (#12080)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 12:11:12 +08:00
congqixia 27715c15f4
Fix 0 len slice declaration for dml_channels.go (#12094)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:33:26 +08:00
congqixia dfc70108c4
Add load collection for AssignSegmentID (#12077)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:31:34 +08:00
congqixia b99164f43d
Add datacoord GC configuration (#12061)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:29:40 +08:00
xige-16 38afc63c16
Add ut for loadbalanceTask when index created (#11981)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 22:21:55 +08:00
dragondriver e00976fddb
[skip ci] Add comment for GetPersistentSegmentInfo (#12097)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-18 22:13:28 +08:00
bigsheeper d4254f876a
[skip ci] Add comment for msgQueryNodeIsUnhealthy (#12111)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:45:12 +08:00
bigsheeper 98b0f73c46
[skip ci] Add comment for deleteNode (#12110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:43:20 +08:00
bigsheeper b35c2f60ea
[skip ci] Add comment for errQueryNodeIsUnhealthy (#12109)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:41:27 +08:00
dragondriver 951d9a2f96
[skip ci] Add comment for GetDdChannel (#12096)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-18 21:26:28 +08:00
dragondriver 5dc85727a7
[skip ci] Add comment for CalcDistance (#12095)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-18 21:24:38 +08:00
xige-16 d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 19:35:15 +08:00