Commit Graph

3399 Commits (858e95f377c44f67b8c3a21c913d17ab691863cb)

Author SHA1 Message Date
Cai Yudong 858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 10:07:15 +08:00
XuanYang-cn 8a8ebed23d
Fix DN GC bug (#12258)
Fixes: #12249

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-25 09:43:15 +08:00
xige-16 1a8e2e5e85
Establish a grpc connection When init queryNode client (#12236)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-24 19:27:15 +08:00
congqixia 59d19384dc
Fix flush manager injection logic with multiple segments (#12260)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-24 18:41:16 +08:00
godchen e3f49858c5
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 17:47:15 +08:00
godchen f07ac99438
Add calc distance log (#12253)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 16:09:15 +08:00
godchen 927f72d588
Add delete task channel stats interface (#12250)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 16:01:17 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
XuanYang-cn e72c5b9351
Filter dropped segments in DN (#12242)
See also: #12131, #12230

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-24 14:11:15 +08:00
bigsheeper 62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-24 11:27:15 +08:00
Xiaofan 0aaa87a79a
Fix MsgStream inconsistent seek (#12042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
xige-16 99397535be
Fix update rollBackTask after triggerTask fail (#12228)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-24 10:19:15 +08:00
congqixia 7b870e3392
Limit datacoord gc scan prefixes (#12231)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-24 09:55:15 +08:00
Cai Yudong 1f27eb604e
Remove all index when drop collection (#12227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 23:01:15 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method (#12220)
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-23 22:57:17 +08:00
dragondriver 653369ee63
[skip ci] Refine the log of GetPersistentSegmentInfo (#12234)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-23 21:07:16 +08:00
yukun 6a167f8579
Fix rocksmq produce hang when do search repeatedly (#12225)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-23 19:15:22 +08:00
congqixia 8e0c8febe9
Add dropped segment ids in vchaninfo (#12230)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-23 18:59:15 +08:00
godchen 3fa5b4a9ce
Delete for segment indexing (#12197)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 17:17:16 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204)
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
bigsheeper 18463ebde4
Reduce memory cost when load from minio (#12055)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-23 14:49:15 +08:00
Cai Yudong dd0b36f3fb
Clean debug log (#12205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 14:25:15 +08:00
Bingyi Sun 3be9442c0f
Clear dropped segment meta on etcd (#12191)
issue: #9613
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 11:23:15 +08:00
godchen d7cc1c1e36
Check load segments length before watch delta channel (#12200)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 11:21:15 +08:00
yukun adf9530ed7
Bool expr not support numerica (#12184)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-23 10:57:16 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
dragondriver 73f18c564f
Refine logs when search with unsupported metric type (#12185)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-23 10:13:14 +08:00
yukun 7a0d5ed6c4
Fix delete after create index (#12174)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 23:11:14 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 20:11:14 +08:00
yukun 835451e331
Update rocksmq consume slowly log (#12179)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 18:51:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
yukun e9585625e6
Add error return with invalid bool expr (#12168)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 16:57:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
godchen 02bf77aabf
Close reader stream (#12167)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 16:17:14 +08:00
Cai Yudong 99b3c56b3e
Update rootcoord debug log (#12160)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-22 16:01:14 +08:00
zhenshan.cao 0f2b7d1790
Fix deadlock caused by not releasing the lock in time (#12161)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-22 12:19:14 +08:00
yukun f5bb180adb
Support multiple readers on one topic (#12155)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 10:35:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066)
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-22 10:05:14 +08:00
edward.zeng 3cfc740a05
Refine minio kv FGetObject function (#12078)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-21 22:53:13 +08:00
Cai Yudong d4c297b1a8
Enhance dml channel operations (#12143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-21 21:33:13 +08:00
yukun ac175b6f00
Add rocksmq produce slowly hint log (#12156)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-21 15:33:13 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-21 07:33:14 +08:00
dragondriver bf391f2449
Make indexparamcheck thread-safe (#11916)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-21 00:39:13 +08:00
yukun 2147507e89
Add reader implementation in rocksmq (#12137)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 20:57:13 +08:00
xige-16 03f63b7ec1
Start querycoord after root/datacoord healthy (#12145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-20 08:23:13 +08:00
yukun 8c947109a9
Add log in rocksmq (#12138)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-20 00:11:13 +08:00
congqixia 8a9fb9b287
Fix CMakeLists.txt comment error (#12141)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-19 19:33:13 +08:00
xige-16 e66537f9c9
Parallel estimate segment size (#12136)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-19 18:09:13 +08:00
shaoyue cec1b0cb77
[skip ci] Add comments for exported items (#12127)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 18:07:18 +08:00
shaoyue 6777d24c65
[skip ci] Add comment for exported items (#12126)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-19 18:05:25 +08:00