milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,142 Commits
152 Branches
122 Tags
588 MiB
Commit Graph

3690 Commits (6bdbe23e9f9327c98d78ce2a8b7f2138d9a9d8ce)

Author SHA1 Message Date
shaoyue ffda2e5945
[skip ci] Fix comment for PayloadReader (#12621) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-02 18:07:33 +08:00
shaoyue 9e70cb6ac4
[skip ci] Fix golint for metricinfo/cache.go (#12620) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-02 18:05:34 +08:00
congqixia 8f9e62fa18
Apply DropVirtualChannel and FlushManager drop mode (#12563) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-02 16:39:33 +08:00
Cai Yudong 147fc41a67
Update proxy debug log (#12591) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-02 12:41:32 +08:00
Cai Yudong cbb01051f0
Update Search return type (#12578) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-02 11:45:32 +08:00
Xiangyu Wang a37a1062e1
Remove unused dependency (#12534) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-02 10:53:32 +08:00
yukun 764cf1a53e
Add rocksmq server close when standalone exit (#12255) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-12-02 10:27:32 +08:00
congqixia 73705333b4
Fix zero length slice declaration in rocksmq_impl.go (#12577) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-01 23:45:32 +08:00
congqixia 2bd32353cf
Fix zero length slice declaration in util/retry/retry.go (#12576) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-01 23:43:37 +08:00
xige-16 6dd7afd1a4
[skip ci]Add comment for getOnlineNodes (#12575) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-01 22:41:33 +08:00
Bingyi Sun 0778e6f715
Fix alloc segment with dropped segment (#12572) 
issue: #12465
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-01 22:39:37 +08:00
yukun 777dd95071
[skip ci]Add comment for rocksmq reader (#12570) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-12-01 22:37:42 +08:00
yukun fa4372a597
[skip ci]Add comment for rocksmq reader (#12569) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-12-01 22:35:47 +08:00
cai.zhang 79f1216f9d
[skip ci]Fix golint error for indexcoord (#12567) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-01 22:33:51 +08:00
bigsheeper 88b53f6381
[skip ci] Add comment for filterDeleteNode filter func (#12566) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-01 22:31:55 +08:00
bigsheeper 87251ce295
[skip ci] Add comment for filterDeleteNode Operate (#12565) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-01 22:30:06 +08:00
XuanYang-cn 3d4084be48
[skip ci]Update license for qn fg querynode (#12557) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-01 22:28:08 +08:00
cai.zhang deaf4a642c
Use write lock when writing the var (#12528) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-01 22:26:10 +08:00
bigsheeper 3e46c2a523
[skip ci] Add comment for filterDeleteNode Name (#12564) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-01 22:22:07 +08:00
cai.zhang 518b9fe9ea
[skip ci]Fix golint error for initPort in indexnode (#12568) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-01 22:19:52 +08:00
godchen 5e3e3b3b41
Remove grpc returned error (#12537) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 22:17:46 +08:00
godchen a76f490f12
Remove querycoord grpc error (#12535) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 22:15:37 +08:00
godchen 3f060f4028
Remove querynode grpc error (#12532) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 22:13:37 +08:00
xige-16 e6d9be3dfa
[skip ci]Add comment for stopNode (#12574) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-01 22:01:33 +08:00
xige-16 d9af522af5
[skip ci]Add comment for removeNodeInfo (#12573) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-01 21:59:31 +08:00
edward.zeng 5db458a44e
[skip ci] Add license for data coord compaction (#12561) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-01 19:33:32 +08:00
edward.zeng 271aaa7537
[skip ci] Refine data node param table comment (#12560) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-01 19:31:36 +08:00
edward.zeng 446b5a3a48
[skip ci] Refine datacoord cluster comment (#12562) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-01 19:29:31 +08:00
XuanYang-cn 62e3f68c79
[skip ci]Update license for qn fg message (#12556) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-01 18:45:32 +08:00
XuanYang-cn 16c1fe8098
[skip ci]Update license for qn fg insert (#12555) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-01 18:43:32 +08:00
Cai Yudong bbc341a87a
Fix thread safe issue when search (#12546) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-01 18:13:32 +08:00
jingkl 8a71aa7b09
[skip ci] add client notes (#12543) 
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
 2021-12-01 17:11:31 +08:00
jingkl d68142de86
[skip ci] add notes to client.go (#12542) 
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
 2021-12-01 17:09:36 +08:00
Ji Bin 26b9d0e9f7
Support cpu/qemu only support SSE42 (#12337) 
Compiler options for compiling faiss updated:
- for common objs using -mss4.2 for tunning, remove -mf16c, which may
  need newer CPU.
- for avx2 objs using -mavx2 and -mf16c
- for avx512 objs using -mavx512* and -mf16c

Issue: #12335

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-12-01 17:05:32 +08:00
godchen b45d7baf97
Add logs for add delta channels (#12347) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 16:39:31 +08:00
congqixia 0e7f24491f
Fix zero length slice declaration in proxy/channels_mgr.go (#12499) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-01 16:33:31 +08:00
shaoyue 5d21e91213
[skip ci] Add comments for distributed/datanode/client/client.go (#12525) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-01 15:47:36 +08:00
shaoyue 0d92f61d56
[skip ci] Add comment for storage.ChunManger methods (#12524) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-01 15:45:40 +08:00
dragondriver 6bfb4f8196
Refine log of HasCollection (#12523) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:43:44 +08:00
dragondriver e2f9eacd5c
Add ut for DropAlias when proxy is unhealthy (#12521) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:41:51 +08:00
shaoyue ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go (#12520) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-01 15:39:57 +08:00
dragondriver 05e210e83b
Add ut for CreateAlias when dd queue is full (#12484) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:36:03 +08:00
dragondriver a44c00b0d0
Format test_c_api.cpp (#12515) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:28:00 +08:00
dragondriver 1db1cf2104
Fix similarity correlation (#12511) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:26:02 +08:00
dragondriver b08e28abc1
Refine log of DropCollection (#12522) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:23:52 +08:00
dragondriver aa154e023c
Add ut for CreateAlias when ctx is short (#12485) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 10:13:34 +08:00
congqixia e813867652
Implement Drop mode for flush manager (#12469) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-01 10:11:39 +08:00
Bingyi Sun 7ff15490c9
[skip ci]Add comment for GetVChanPosition (#12495) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-30 23:15:33 +08:00
xige-16 60831cae99
[skip ci]Add comment for getNodeInfoByID (#12493) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-30 21:23:34 +08:00
xige-16 0abc0ecf20
[skip ci]Add comment for registerNode (#12492) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-30 21:21:39 +08:00
xige-16 300027b0d2
[skip ci]Add comment for getNumDmChannels (#12491) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-30 21:19:43 +08:00
dragondriver 6d92b8499c
Revert #11901, Fix wrong jaccard distance (#12487) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:31:35 +08:00
bigsheeper 37e6398ed6
[skip ci] Add comment for filterDeleteNode (#12490) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 20:15:35 +08:00
bigsheeper 6d93beb57f
[skip ci] Add comment for newDeleteNode (#12489) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 20:13:41 +08:00
bigsheeper c749427bca
[skip ci] Add comment for flowGraph delete (#12488) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 20:09:37 +08:00
dragondriver f86bf2c2eb
Add ut for CreateAlias when proxy is unhealthy (#12483) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:07:34 +08:00
dragondriver 4056b414f5
Refine the log of CreateCollection (#12385) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:05:40 +08:00
dragondriver 36ef91f412
Refine log of Insert (#12380) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:03:35 +08:00
edward.zeng bd6b4807cc
[skip ci] Refine connection manager comment (#12486) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-30 19:47:35 +08:00
edward.zeng 566de56131
[skip ci] Refine logutil comment (#12482) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-30 19:45:41 +08:00
yukun fea1126946
[skip ci]Fix golint (#12481) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-30 19:43:46 +08:00
edward.zeng f90e75d19d
[skip ci] Refine metrics comment (#12479) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-30 19:41:50 +08:00
jaime 90a1d016a0
Refine return value (#11730) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-30 19:32:17 +08:00
congqixia 4dd3dc7aa9
Improve rocksmq CreateConsumerGroup log (#12473) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 19:09:33 +08:00
Cai Yudong 7f9a41496d
Reorder header files for segcore/SegmentSealedImpl.h (#12439) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:45:35 +08:00
Cai Yudong f899644e88
Update header files for segcore/SegmentSealedImpl.cpp (#12438) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:43:40 +08:00
Cai Yudong 97c2d2aec2
Reorder header files for segcore/SegmentSealed.h (#12435) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:41:44 +08:00
Cai Yudong d24cc8f846
Reorder header files for segcore/SegmentInterface.h (#12434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:39:49 +08:00
Cai Yudong 8f1e75718c
Clean code (#12433) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:37:41 +08:00
shaoyue bbdd1dbef9
[skip ci] Add comment for etcd_kv.go (#12449) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 16:58:14 +08:00
shaoyue f00ee2a3b1
[skip ci] Add comment for mem_kv.go (#12448) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 16:08:59 +08:00
shaoyue 2b3762fa63
[skip ci] Add comments for pulsar_consumer.go (#12446) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 16:05:59 +08:00
shaoyue 2a0d646196
[skip ci] Add comment for datacoord methods (#12367) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 14:28:20 +08:00
yukun 7bb9ae8802
Deleted data could not be searched using timestamp before delete time (#12437) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-30 12:39:41 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-30 10:59:42 +08:00
dragondriver 074c36de2d
[skip ci] Fix golang format error (#12432) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 10:37:44 +08:00
bigsheeper 496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 10:29:43 +08:00
congqixia 001752eb91
Fix zero length slice declaration in storage/util.go (#12412) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 09:57:44 +08:00
Cai Yudong 486ceca7fb
Remove useless type (#12375) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 09:53:52 +08:00
congqixia f834e220c1
Fix zero length slice declaration in flowgraph/node.go (#12393) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 09:51:51 +08:00
cai.zhang d54a6a408b
[skip ci]Fix golint error for SegmentFlushCompleted in rootcoord (#12377) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-30 09:47:47 +08:00
congqixia dd134e02d9
[skip ci] Add comment in types.go for DataCoord.GetCompactionStateWithPlans (#12422) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 00:03:43 +08:00
jaime 2576cf796f
[skip ci] Add comments for Task interface (#12418) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-30 00:01:49 +08:00
yukun 47f1f51bca
[skip ci]Add comment for rocksmq reader (#12403) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 23:59:53 +08:00
jaime 832b771dcd
[skip ci] Add comments for Task interface (#12420) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-29 23:57:45 +08:00
yukun 6439887eb7
[skip ci]Add license in reader.go in mqclient (#12402) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 23:19:42 +08:00
shaoyue f796bce1ed
[skip ci] Fix golint for rocketsmq_impl.go (#12363) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-29 23:15:41 +08:00
Bingyi Sun fb2e8b0870
[skip ci]Add comment for WatchChannels in client.go (#12416) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:13:41 +08:00
Bingyi Sun b790f1fe0c
[skip ci]Add comment for WatchChannels in types.go (#12415) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:11:49 +08:00
Bingyi Sun 27898928b0
[skip ci]Modify WatchChannels comment in services.go (#12417) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:09:41 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 22:35:41 +08:00
godchen c4f0837d84
Fix insert pks overwrite (#12365) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-29 22:01:41 +08:00
xige-16 b1da696767
[skip ci]Add comment for getSegmentInfoByNode (#12411) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-29 21:21:41 +08:00
xige-16 a4cfd1cb46
[skip ci]Add comment for releasePartitions (#12410) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-29 21:17:46 +08:00
xige-16 fa26804279
[skip ci]Add comment for releaseCollection (#12409) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-29 21:15:49 +08:00
yukun 9ae7e19b82
[skip ci]Add comment for rocksmq reader seek (#12405) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 21:10:01 +08:00
congqixia 9af7e179f2
Fix zero length slice declaration in timeticksync.go (#12372) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 20:21:41 +08:00
XuanYang-cn 5797e6b3ac
[skip ci]Update license for qn fg filterdm node (#12398) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-29 20:17:41 +08:00
XuanYang-cn 37ae8e4283
[skip ci]Update license for qn fg deletenode (#12397) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-29 20:15:45 +08:00
XuanYang-cn 84f7f90f06
[skip ci]Update license for qn collection (#12396) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-29 20:13:50 +08:00
bigsheeper 65608836e6
Remove vChannel for collection in historical (#12359) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 20:11:49 +08:00
bigsheeper ed4660b7de
[skip ci] Add comment for deleteNode Operate (#12388) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 20:01:49 +08:00
bigsheeper 1e92ac48d5
[skip ci] Add comment for getSegmentInfosByColID (#12386) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 19:59:54 +08:00
shaoyue 8bd7365172
[skip ci] Add Comments for exported items in proxy/service.go (#12376) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-29 19:57:57 +08:00
bigsheeper f79e85cb36
[skip ci] Add comment for deleteNode Name (#12387) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 19:45:49 +08:00
cai.zhang 015bf4585d
[skip ci]Fix golint error for GetMetrics in rootcoord (#12379) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-29 19:27:45 +08:00
edward.zeng c9d31f0b73
[skip ci] Refine etcd kv comment (#12374) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-29 19:25:49 +08:00
cai.zhang f3de0ca2e7
[skip ci]Fix golint error for ReleaseDQLMessageStream in rootcoord (#12378) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-29 19:23:45 +08:00
dragondriver d90aeafa79
Refine the log of CalcDistance (#12371) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 19:21:41 +08:00
dragondriver 6cd3427805
Refine the log of Search (#12333) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 18:07:42 +08:00
edward.zeng 772857d9c1
[skip ci] Refine minio kv comment (#12369) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-29 17:55:41 +08:00
Bingyi Sun a05a74fca2
Improve proxy manager in rootcoord (#12303) 
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-29 17:33:41 +08:00
Cai Yudong 365b5a5d01
Rename SubSearchResult fields for better readability (#12341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 17:07:40 +08:00
Cai Yudong cb952d6036
Rename SearchResult fields for better readability (#12327) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 14:57:18 +08:00
zhenshan.cao bdd39c0623
Fix bug: check message payload before unmarshaling (#12315) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-29 14:31:18 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 14:29:24 +08:00
dragondriver 243af903c4
Refine the log of ShowCollections (#12300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 14:27:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-29 14:25:17 +08:00
bigsheeper cad61ea47e
Fix tSafe replica unit test (#12325) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 14:17:17 +08:00
godchen 8cd1fccfb1
Return rocksdb reader timeout error (#12317) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-29 13:27:17 +08:00
Cai Yudong 45fac75889
Fix segcore unittest fail (#12326) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:27:17 +08:00
Cai Yudong 74a4a4e15b
Fix golint warnings for proxy (#11895) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:25:17 +08:00
Cai Yudong 33bfd96d9f
Fix golint warnings for proxy (#11894) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:23:17 +08:00
Cai Yudong e62e7bb801
Fix golint warnings for proxy (#11892) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 11:57:17 +08:00
cai.zhang 2c484c7c7d
Parallel execution between segments (#12199) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-27 20:05:16 +08:00
Cai Yudong cbbeb2a383
Add debug log when proxy idle for a long time (#12319) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-27 13:57:16 +08:00
godchen 48bdeb56d8
Merge watch delta channel positions (#12309) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-26 22:47:17 +08:00
godchen f31ed089b5
Add timeout for reader next (#12308) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-26 22:45:24 +08:00
XuanYang-cn 48b45d82e5
Add ut for binlog_io to 100 coverage (#12283) 
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-26 17:43:17 +08:00
bigsheeper dbcb153687
Fix delete failed in query node (#12302) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-26 16:15:16 +08:00
dragondriver b6d0150dc5
Fix health check when disconnect to etcd (#12292) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-26 11:39:16 +08:00
yukun 080eaa9a5c
Add isClosed for rocksmq (#12267) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-26 11:27:16 +08:00
bigsheeper 58964621a5
Remove tSafeWatcher and vChannel when release (#12264) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-26 01:33:16 +08:00
godchen ad83090925
Merge delta channels when load partition (#12274) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-25 18:49:16 +08:00
Cai Yudong 6188ac280b
Fix drop alias error (#12281) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-25 18:03:17 +08:00
bigsheeper db3ad2bc5f
Disable log print in GetSgementInfo (#12139) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 17:49:19 +08:00
godchen 88012acb86
Clear useless segments info. (#12262) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-25 17:37:15 +08:00
congqixia eb48013042
Set start position for compact result segment (#12280) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-25 17:19:17 +08:00
congqixia 2ee0c7c074
Add compacted segment into check list when drop collection (#12272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-25 15:13:15 +08:00
bigsheeper d2dae89f4c
Return success if query node is unhealthy in GetComponentStates (#12202) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 15:03:16 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts (#12247) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 14:25:15 +08:00
Cai Yudong 858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-25 10:07:15 +08:00
XuanYang-cn 8a8ebed23d
Fix DN GC bug (#12258) 
Fixes: #12249

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-25 09:43:15 +08:00
xige-16 1a8e2e5e85
Establish a grpc connection When init queryNode client (#12236) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-24 19:27:15 +08:00
congqixia 59d19384dc
Fix flush manager injection logic with multiple segments (#12260) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-24 18:41:16 +08:00
godchen e3f49858c5
Add subscription prefix (#12251) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 17:47:15 +08:00
godchen f07ac99438
Add calc distance log (#12253) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 16:09:15 +08:00
godchen 927f72d588
Add delete task channel stats interface (#12250) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 16:01:17 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-24 15:43:15 +08:00
XuanYang-cn e72c5b9351
Filter dropped segments in DN (#12242) 
See also: #12131, #12230

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-24 14:11:15 +08:00
bigsheeper 62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-24 11:27:15 +08:00
Xiaofan 0aaa87a79a
Fix MsgStream inconsistent seek (#12042) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-24 10:25:15 +08:00
xige-16 99397535be
Fix update rollBackTask after triggerTask fail (#12228) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-24 10:19:15 +08:00
congqixia 7b870e3392
Limit datacoord gc scan prefixes (#12231) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-24 09:55:15 +08:00
Cai Yudong 1f27eb604e
Remove all index when drop collection (#12227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-23 23:01:15 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method (#12220) 
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-23 22:57:17 +08:00
dragondriver 653369ee63
[skip ci] Refine the log of GetPersistentSegmentInfo (#12234) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-23 21:07:16 +08:00
yukun 6a167f8579
Fix rocksmq produce hang when do search repeatedly (#12225) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-23 19:15:22 +08:00
congqixia 8e0c8febe9
Add dropped segment ids in vchaninfo (#12230) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-23 18:59:15 +08:00
godchen 3fa5b4a9ce
Delete for segment indexing (#12197) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-23 17:17:16 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204) 
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-23 17:09:15 +08:00
bigsheeper 18463ebde4
Reduce memory cost when load from minio (#12055) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-23 14:49:15 +08:00
Cai Yudong dd0b36f3fb
Clean debug log (#12205) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-23 14:25:15 +08:00
Bingyi Sun 3be9442c0f
Clear dropped segment meta on etcd (#12191) 
issue: #9613
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 11:23:15 +08:00
godchen d7cc1c1e36
Check load segments length before watch delta channel (#12200) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-23 11:21:15 +08:00
yukun adf9530ed7
Bool expr not support numerica (#12184) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-23 10:57:16 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170) 
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 10:55:14 +08:00
dragondriver 73f18c564f
Refine logs when search with unsupported metric type (#12185) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-23 10:13:14 +08:00
yukun 7a0d5ed6c4
Fix delete after create index (#12174) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 23:11:14 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 20:11:14 +08:00
yukun 835451e331
Update rocksmq consume slowly log (#12179) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 18:51:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
yukun e9585625e6
Add error return with invalid bool expr (#12168) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 16:57:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 16:23:17 +08:00
godchen 02bf77aabf
Close reader stream (#12167) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 16:17:14 +08:00
Cai Yudong 99b3c56b3e
Update rootcoord debug log (#12160) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-22 16:01:14 +08:00
zhenshan.cao 0f2b7d1790
Fix deadlock caused by not releasing the lock in time (#12161) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-22 12:19:14 +08:00
yukun f5bb180adb
Support multiple readers on one topic (#12155) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 10:35:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066) 
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-22 10:05:14 +08:00
edward.zeng 3cfc740a05
Refine minio kv FGetObject function (#12078) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-21 22:53:13 +08:00
Cai Yudong d4c297b1a8
Enhance dml channel operations (#12143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-21 21:33:13 +08:00
yukun ac175b6f00
Add rocksmq produce slowly hint log (#12156) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-21 15:33:13 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-21 07:33:14 +08:00
dragondriver bf391f2449
Make indexparamcheck thread-safe (#11916) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-21 00:39:13 +08:00
yukun 2147507e89
Add reader implementation in rocksmq (#12137) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-20 20:57:13 +08:00
xige-16 03f63b7ec1
Start querycoord after root/datacoord healthy (#12145) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-20 08:23:13 +08:00
yukun 8c947109a9
Add log in rocksmq (#12138) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-20 00:11:13 +08:00
congqixia 8a9fb9b287
Fix CMakeLists.txt comment error (#12141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-19 19:33:13 +08:00
xige-16 e66537f9c9
Parallel estimate segment size (#12136) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-19 18:09:13 +08:00
shaoyue cec1b0cb77
[skip ci] Add comments for exported items (#12127) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 18:07:18 +08:00
shaoyue 6777d24c65
[skip ci] Add comment for exported items (#12126) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 18:05:25 +08:00
shaoyue 888aad120c
[skip ci] Fix comment typo (#12122) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 17:59:39 +08:00
jaime 11110906a4
[skip ci] Add a TODO for a faiss cpp file (#12117) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-19 17:57:46 +08:00
jaime c6fea64aa7
[skip ci] Add a comment to faiss CMakeLists (#12116) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-19 17:55:40 +08:00
Cai Yudong 3aca73969f
Optimize segcore API arrangement (#12135) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-19 17:23:12 +08:00
godchen 51b353b52c
Add msgstream reader (#12130) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-19 15:57:12 +08:00
congqixia 7e91bcf115
Normalize datanode dminput node log (#12128) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-19 14:21:13 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-19 13:57:12 +08:00
Cai Yudong 074687e32e
Unify rootcoord debug log (#12080) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-19 12:11:12 +08:00
congqixia 27715c15f4
Fix 0 len slice declaration for dml_channels.go (#12094) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:33:26 +08:00