milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,006 Commits
133 Branches
115 Tags
559 MiB
Commit Graph

750 Commits (64e04ecc568147ffc0ff86dccf98dfd00d158282)

Author SHA1 Message Date
bigsheeper bad8a41494
[skip ci] Add comment for removeExcludedSegments (#10463) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-22 19:01:29 +08:00
yukun f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 18:51:14 +08:00
godchen ffc0c07610
Change delete data primary key to int64 (#10438) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 15:37:12 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 14:31:13 +08:00
groot 70eb275ef4
[skip ci] Fix typo (#10412) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-22 14:11:52 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 13:11:11 +08:00
bigsheeper c7aea829d9
[skip ci] Add comment for getSegmentNum (#10372) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-21 19:54:17 +08:00
bigsheeper fd95ad8e4a
[skip ci] Add comment for hasSegmentPrivate (#10371) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-21 19:48:06 +08:00
bigsheeper f35d342426
[skip ci] Add comment for getSegmentStatistics (#10373) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-21 19:22:50 +08:00
bigsheeper 132f57f5b7
Set gracefulTime to 0 (#10114) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-21 10:55:12 +08:00
yukun 5c1733de26
Remove insertpks log in flow_graph_insert_node (#10302) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-20 19:51:23 +08:00
bigsheeper 2d984ba0d1
Fix getSegmentInfo in query node (#9549) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 19:47:35 +08:00
bigsheeper 455172202a
[skip ci] Add comment for hasSegment (#10293) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 19:25:29 +08:00
bigsheeper ff4cd4925f
[skip ci] Add comment for getSegmentByID (#10291) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 19:23:28 +08:00
bigsheeper 31c222b723
[skip ci] Add comment for getSegmentByIDPrivate (#10292) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 19:05:04 +08:00
bigsheeper c18fa9b785
Watch changeInfo in query node (#10045) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 17:54:43 +08:00
yukun e91eafd871
Fix Bitsetview bug in segcore (#10272) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-20 16:34:36 +08:00
congqixia f39e06b24e
Filters out nil BF stats (#10279) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 16:14:36 +08:00
sunby db53eccec9
Add binlog iterators (#10173) 
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-20 11:52:35 +08:00
bigsheeper 26fe0d850e
[skip ci] Add comment for removeSegmentPrivate (#10203) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-19 20:30:56 +08:00
bigsheeper dc42fdb2f0
[skip ci] Add comment for removeSegment (#10202) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-19 20:28:59 +08:00
bigsheeper 24f6834192
[skip ci] Add comment for setSegment (#10201) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-19 20:27:09 +08:00
godchen 8daeb0d519
Change bloom filter use pk (#10193) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-19 20:18:47 +08:00
zhenshan.cao dd24ea3737
[skip ci]Fix golint error in querynode (#10136) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-18 21:36:39 +08:00
bigsheeper f8e7f3f549
[skip ci] Add comment for addSegmentPrivate (#10112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-18 20:26:59 +08:00
bigsheeper 93ec046ef2
[skip ci] Add comment for addSegment (#10111) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-18 20:24:55 +08:00
bigsheeper 9ec4105a85
[skip ci] Add comment for getSegmentIDsPrivate (#10110) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-18 20:22:56 +08:00
godchen 24a6fc096b
Update query node bloom filter (#10109) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-18 20:08:42 +08:00
bigsheeper a4a66341da
[skip ci] Add comment for getSegmentIDsByVChannel (#10022) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-16 21:51:32 +08:00
bigsheeper db534419f9
[skip ci] Add comment for getPartitionNum (#10021) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-16 21:47:44 +08:00
bigsheeper 9f958f4b00
[skip ci] Add comment for getSegmentIDs (#10020) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-16 21:45:40 +08:00
bigsheeper 4c420dac21
Update excluded segments info when receive changeInfo (#10011) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-16 17:00:33 +08:00
bigsheeper ae5d2ee9ba
Init global sealed segments and seek query channel when AddQueryChannel (#9543) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-15 20:35:05 +08:00
bigsheeper 14b77405f4
[skip ci] Add comment for collectionReplica (#9980) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-15 18:38:36 +08:00
bigsheeper 0f1de9757b
[skip ci] Add comment for hasPartition (#9979) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-15 18:36:42 +08:00
bigsheeper 3cff929be3
[skip ci] Add comment for getPartitionByIDPrivate (#9978) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-15 18:34:51 +08:00
yukun 55f148f17e
Add deleteMessage in flow_graph_filter_dm_node (#9504) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-15 16:54:43 +08:00
yukun 997e88d8c6
Add deleteMessage in flow_graph_insert_node (#9505) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-15 11:02:32 +08:00
bigsheeper c92706c75d
[skip ci] Add comment for getPartitionByID (#9892) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-14 18:54:34 +08:00
bigsheeper d59bb7dd29
[skip ci] Add comment for removePartitionPrivate (#9891) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-14 18:52:41 +08:00
bigsheeper 5ffe605865
[skip ci] Add comment for removePartition (#9890) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-14 18:50:51 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 16:40:35 +08:00
zhenshan.cao 9eacfe719a
[skip ci]Fix golint error in querynode (#9849) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-14 14:02:41 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-14 11:12:38 +08:00
bigsheeper 59daccf67c
Fix get memory info in getSystemInfoMetrics (#9809) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-13 21:20:33 +08:00
bigsheeper 4b77e6e047
[skip ci] Add comment for addPartitionPrivate (#9808) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-13 19:14:33 +08:00
bigsheeper 1a72d05a1b
[skip ci] Add comment for addPartition (#9807) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-13 19:12:39 +08:00
bigsheeper 71a6c5a7e6
[skip ci] Add comment for getFieldsByCollectionIDPrivate (#9806) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-13 19:10:46 +08:00
zhenshan.cao 0da7ed96f7
[skip ci]Fix golint error in querynode (#9747) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-12 20:25:02 +08:00
dragondriver 63ae5bd90c
Expose created time and updated time to querynode metrics (#9738) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-12 19:56:34 +08:00
zwd1208 d5e179e70b
[skip ci]Change uppercase for minio (#9734) 
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
 2021-10-12 19:35:14 +08:00
bigsheeper 55193ec75a
[skip ci] Add comment for getVecFieldIDsByCollectionID (#9721) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-12 19:11:04 +08:00
bigsheeper de14446286
[skip ci] Add comment for getPartitionIDs (#9720) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-12 19:07:12 +08:00
bigsheeper 8a4a232eff
[skip ci] Add comment for getCollectionNum (#9719) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-12 19:05:17 +08:00
bigsheeper dd77e08b9e
[skip ci] Add comment for hasCollection (#9660) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-11 19:04:37 +08:00
bigsheeper 1b128c3fbf
[skip ci] Add comment for getCollectionByIDPrivate (#9659) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-11 19:02:45 +08:00
bigsheeper ba998b1673
[skip ci] Add comment for hasCollectionPrivate (#9661) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-11 18:56:37 +08:00
groot 0d49316103
Add unittest for distributed/querynode (#9608) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-11 17:16:30 +08:00
bigsheeper d567b21fd4
Add globalSegmentManager and consume changeInfoMsg (#9575) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-11 15:40:38 +08:00
bigsheeper 8c510a52b2
Use replica memory size and cacheSize in getSystemInfoMetrics (#9579) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-11 15:06:43 +08:00
zhenshan.cao a7dc9bdf15
Fix golint error in querynode (#9597) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-09 22:52:59 +08:00
dragondriver dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 19:27:02 +08:00
bigsheeper cc1801fa98
Add comment for removeCollectionPrivate (#9584) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-09 18:41:32 +08:00
bigsheeper 1b3a7b129b
Add comment for removeCollection (#9583) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-09 18:39:48 +08:00
bigsheeper 5865ead978
[skip ci] Add comment for getCollectionByID (#9585) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-09 18:33:32 +08:00
bigsheeper edea91ae6e
[skip ci] Add comment for addColllection (#9523) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-08 23:53:25 +08:00
bigsheeper ce17e12819
Fix data race in query service (#9454) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-08 17:41:49 +08:00
elfisworking d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574) 
Signed-off-by: elfisworking <zymustb@126.com>
 2021-10-08 17:39:55 +08:00
bigsheeper d7b29c059c
[skip ci] Add comment for getCollectionIDs (#9435) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-08 06:47:15 +08:00
bigsheeper 8696a37fe6
[skip ci] Add comment for printReplica (#9434) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-08 06:45:25 +08:00
bigsheeper 44622622f6
[skip ci] Add comment for getSegmentsMemSize (#9433) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-08 06:43:26 +08:00
bigsheeper 8ab25a1bb1
[skip ci] Add comment for deleteCollection (#9367) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-06 23:38:00 +08:00
bigsheeper c86193fb7b
[skip ci] Add comment for newCollection (#9366) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-06 23:36:13 +08:00
bigsheeper 0e4ee6d420
[skip ci] Add comment for getLoadType (#9365) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-06 23:34:24 +08:00
bigsheeper 12dcbe3d78
[skip ci] Add comment for setLoadType (#9299) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-05 22:44:00 +08:00
bigsheeper eab57af117
[skip ci] Add comment for checkReleasedPartitions (#9297) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-05 22:40:34 +08:00
bigsheeper 8b30d9aeb5
[skip ci] Add comment for deleteReleasedPartition (#9296) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-05 22:38:44 +08:00
zhenshan.cao d835adb442
[skip ci] Fix golint error in querynode (#9289) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 21:38:16 +08:00
zhenshan.cao a4cddd950b
[skip ci] Fix golint error in querynode (#9288) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 21:36:24 +08:00
congqixia 1891adb7e3
Add QueryNode implementation Assertion (#9259) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-05 12:42:04 +08:00
bigsheeper 040618187b
[skip ci] Add comment for addReleasedPartition (#9244) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-05 11:19:23 +08:00
bigsheeper 4427b24171
[skip ci] Add comment for setReleaseTime (#9242) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-05 11:17:29 +08:00
bigsheeper c1b9f4303f
[skip ci] Add comment for getReleaseTime (#9243) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-05 11:15:14 +08:00
bigsheeper be9ab19b7e
[skip ci] Add comment for getPChannels (#9174) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-04 08:22:51 +08:00
bigsheeper 91e4adff15
[skip ci] Add comment for addPChannels (#9173) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-04 08:18:59 +08:00
bigsheeper 358d2e1e07
[skip ci] Add comment for getVChannels (#9172) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-04 08:16:44 +08:00
zhenshan.cao 83b19a559f
[skip ci] Fix golint error in type_def.go (#9161) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 21:09:56 +08:00
bigsheeper 02b2f3c88b
[skip ci] Add comment for addVChannels (#9103) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-03 00:52:02 +08:00
bigsheeper 0b545efa4a
[skip ci] Add comment for removePartitionID (#9102) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-03 00:40:03 +08:00
bigsheeper 5b074732f5
[skip ci] Add comment for addPartitionID (#9101) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-03 00:38:13 +08:00
bigsheeper a9a4b89b0e
[skip ci] Add comment for Schema (#9045) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-01 23:44:33 +08:00
bigsheeper 66eac49c49
[skip ci] Add comment for HandleCProtoResult (#9044) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-01 23:44:10 +08:00
bigsheeper 4323b5dc98
[skip ci] Add comment for HandleCStatus (#9043) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-01 23:43:21 +08:00
bigsheeper a5a85f75bd
[skip ci] Add comment for newDataSyncService (#8962) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-01 09:53:43 +08:00
bigsheeper 4cf5843516
[skip ci] Add comment for newHistorical (#8963) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-01 09:45:12 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
bigsheeper e7d92e4e79
Add streaming segments memory to used memory when checkLoadMemory (#8940) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-30 21:54:08 +08:00
groot b17d253db1
Add unittest for distributed/querynode (#8834) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-30 10:02:02 +08:00
bigsheeper 6f2f09db3a
[skip ci] Add comment for MarshalForCGo (#8870) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-29 23:38:20 +08:00
bigsheeper 954e01aed8
[skip ci] Add comment for protoCGo.destruct (#8871) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-29 23:24:36 +08:00
dragondriver a10f421c14
Get SIMD type used in faiss (#8849) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 20:50:19 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
congqixia db944cd09c
Refactor flowgraph and related invocation (#8770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-29 20:19:59 +08:00
dragondriver cf8600077f
Refactor the index file format (#8514) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 09:52:12 +08:00
bigsheeper 2417a5da69
[skip ci] Add comment for search in streaming (#8805) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-28 22:42:05 +08:00
bigsheeper 243ee06660
[skip ci] Add comment for collection id (#8806) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-28 22:40:05 +08:00
bigsheeper 2515452ea5
[skip ci] Add comment for search in historical (#8804) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-28 22:38:13 +08:00
bigsheeper 9d6c95bf25
Add cacheSize to prevent OOM in query node (#8765) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-28 22:24:03 +08:00
Xiaofan e0e7042b5e
Add test for tsafe (#8626) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-28 12:28:03 +08:00
bigsheeper f7eaff5145
[skip ci] Add comment for queryNodeFlowGraph (#8700) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-27 19:06:07 +08:00
bigsheeper 5490b84e77
[skip ci] Add comment for NewQueryNode func (#8699) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-27 19:02:09 +08:00
bigsheeper 692ceb32a3
[skip ci] Add comment for indexLoader (#8698) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-27 18:58:21 +08:00
Xiaofan 585989935a
Revert the logger change (#8677) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-27 17:37:57 +08:00
zhenshan.cao b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-27 10:01:59 +08:00
Xiaofan 8465d03dec
Make tsafe close not elegant (#8582) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:20:10 +08:00
Xiaofan d38adda8c2
Rename log file based on node id (#8517) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:18:11 +08:00
bigsheeper 057c7cb591
[skip ci] Add comment for historical (#8607) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-26 20:19:58 +08:00
bigsheeper 4b68be2d36
[skip ci] Add comment for addCollectionFlowGraph (#8606) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-26 20:18:03 +08:00
bigsheeper 78604cc1e1
[skip ci] Add comment for query node (#8605) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-26 20:16:12 +08:00
congqixia de3fd15aee
Fix tsafe close deadlock (#8567) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-26 14:29:57 +08:00
groot a20a9c71e2
Reduce go unittest time cost (#8556) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-26 12:56:07 +08:00
congqixia 6f7f71fdc0
Add lock before reading tSafeWatcher map (#8562) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-26 12:37:56 +08:00
congqixia c72f074009
Add waitgroup for tsafe close logic (#8545) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-26 11:07:56 +08:00
zhenshan.cao 2d9b4fedc9
[skip ci] Add comments for flow_graph_message.go (#8523) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-24 21:37:57 +08:00
bigsheeper e61bafc6f5
Init query node once (#8086) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-24 21:03:56 +08:00
bigsheeper d7f311a208
[skip ci] Add comment for streaming (#8498) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-24 20:54:01 +08:00
bigsheeper 977d55b66c
[skip ci] Add comment for task (#8497) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-24 20:53:49 +08:00
bigsheeper 6bc4379de5
[skip ci] Add comment for tSafe replica (#8495) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-24 20:52:13 +08:00
bigsheeper 52126f2d5a
Dynamic add tSafe watcher, use sync.Cond instead of selectCase, add ref count (#8050) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-24 13:57:54 +08:00
bigsheeper 1b7056d3c2
[skip ci] Add comment for dataSyncService in query node (#8418) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-23 21:48:12 +08:00
bigsheeper a6060e4481
[skip ci] Add comment for errors in query node (#8417) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-23 21:46:16 +08:00
bigsheeper 322f4ec80f
[skip ci] Add comment for type def in query node (#8415) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-23 21:44:17 +08:00
congqixia da6d93527d
Add session liveness check (#8408) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-23 18:29:55 +08:00
dragondriver b3f6bd2088
Expose simd type to query node metrics (#8299) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:27:54 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-23 10:53:53 +08:00
bigsheeper 220d17500c
[skip ci] Add comment for query node flow graph (#8326) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 20:10:09 +08:00
bigsheeper 0e2b4a7cd8
Add comment for queryCoordMock (#8223) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 11:30:07 +08:00
bigsheeper 36dd794986
Add comment for type def in query node (#8220) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 11:28:04 +08:00
bigsheeper 1f1c738016
Add loadFieldData unittest for query node (#8219) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 18:32:07 +08:00
Xiangyu Wang c314b2b4a8
Remove unused label rules (#7929) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 18:19:51 +08:00
bigsheeper 11c65dc2b3
Add comment for collection replica (#8147) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 18:15:51 +08:00
bigsheeper 223044a7ca
Rename name of unittests in query node (#8225) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 18:05:51 +08:00
congqixia bdfb8768d4
Enable gosec (#8202) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-18 14:45:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
Cai Yudong 83bf9c5efb
Add knowhere.yaml to support knowhere configuration (#7967) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 10:37:51 +08:00
bigsheeper 338e32362b
Return error if setSegment failed when loadSegment (#8075) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 10:03:50 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
bigsheeper ee3ab7a783
Add comment for dataSyncService (#8157) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 21:55:53 +08:00
bigsheeper 9601cb2ee6
Add failed streming unittest for query node (#7960) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 11:37:49 +08:00
bigsheeper c9b6a92366
Add release failed case unittest for query node (#7971) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 11:35:49 +08:00
bigsheeper b465e8f9a4
Remove redundant check and add addQueryChannel unittest for query node (#7944) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-16 09:47:48 +08:00
bigsheeper 18431c1549
Add historical failed unittest for querynode (#7941) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 15:25:49 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 15:15:52 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 12:57:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:35:52 +08:00
bigsheeper 0b849d3089
Add insert node failed unittests for query node (#7914) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:11:48 +08:00
bigsheeper bc1f39bb55
Remove deprecated replica interface in query node (#7908) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:09:53 +08:00
bigsheeper dfc2535aaa
Use different schema generation functions (#7884) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:07:56 +08:00
bigsheeper 691e4c5bc9
Use definitional type instead of raw type (#7797) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:25:26 +08:00
bigsheeper 27beb033de
Add task unittest for query node (#7820) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:24:48 +08:00
bigsheeper 664d4ca923
Fix index loader test (#7805) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:21:08 +08:00
bigsheeper 73ab06c628
Decrease unittests execution time in query node (#7791) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-13 16:37:01 +08:00
bigsheeper ab7ded2202
Add loader and streaming unittests for query node (#7762) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:56:01 +08:00
bigsheeper 44bc0af063
Add node and queryCollection unittests for query node (#7719) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:26:01 +08:00
bigsheeper 3c01839d0d
Add impl and plan unittests for query node (#7712) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:22:01 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
bigsheeper 0e81c62031
Check collection and plan before calling cgo functions (#7733) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 18:12:01 +08:00
bigsheeper cb5cd1cf12
Add index unittests for query node (#7674) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 17:11:09 +08:00
sunby db01040b53
Fix query request lost bug (#7715) 
Issue: #7633
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-10 16:34:44 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
bigsheeper 8216478b3d
Add replica and insertNode unittests for query node (#7638) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 09:33:43 +08:00
bigsheeper 1a5e5989c8
Add segment unittests for query node (#7632) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-09 17:36:02 +08:00
bigsheeper 5906551f41
Add task unittest for query node (#7599) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-09 10:10:00 +08:00
bigsheeper d3a18a66b5
Add tSafeReplica and task scheduler unittests (#7587) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-08 20:50:00 +08:00
bigsheeper 50c677f72b
Remove useless message and add service time node unittest (#7565) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-08 17:10:15 +08:00
bigsheeper bcccd767ac
Add unittests for querynode (#7510) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 15:45:59 +08:00
bigsheeper b7103357fd
Load failed if collection beyonds the memory limit (#7434) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 11:35:18 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
yukun 94272bba87
Support query by expression (#7386) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-03 17:12:55 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
Cai Yudong f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376) 
This reverts commit e6de86a433.
 2021-08-31 11:07:58 +08:00
Cai Yudong e6de86a433
Apply for msgstream from pool when creating collection (#7323) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 09:47:58 +08:00
godchen c333af0dcf
Add query node segment filter (#7303) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-28 10:12:00 +08:00
godchen 2dc2cb1a28
Fix collection nil when add query collection (#7311) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-27 17:51:56 +08:00
bigsheeper 14391fe9a2
Release flowgraphs properly (#7266) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-27 17:03:56 +08:00
bigsheeper 1e60cccaf9
Set inMemoryPercentage to 0 when releasing partition (#7310) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-27 16:51:11 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
bigsheeper 653ec6cedb
Remove service time check in streaming search (#7253) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-24 15:07:52 +08:00
Cai Yudong 0ab70271a6
correct empty search result handle (#7244) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-24 11:13:52 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
godchen 8cc24e09c9
Make users get vectors without using local storage (#7134) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-18 16:30:11 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
xige-16 b035ec5c7b
Enable search when querynode only load segment (#7104) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-16 12:24:09 +08:00
Cai Yudong e771bda92f
optimize retrieve output vector code structure (#7102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-14 11:18:10 +08:00
XuanYang-cn 6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
Cai Yudong 6c75301c70
optimize search reduce logic (#7066) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-12 18:00:11 +08:00
congqixia 3f21e3d062
Fix querynode tt producer leak (#7059) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-12 14:16:08 +08:00
bigsheeper b9d3897deb
Return error when any failed detected in loadSegment (#7005) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-12 14:14:08 +08:00
godchen 7fc7623b92
Add vector data memroy existence check (#7044) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-11 19:50:09 +08:00
bigsheeper 4123deef9e
Return error message in grpc.LoadSegment in query node (#6908) 
* return load error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* init streaming meta in loadSegment

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix excluded init

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* improve impl

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-03 22:01:27 +08:00
Xiaofan aba234fa3f
Fix Msgstream exponential retry (#6807) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-03 10:39:24 +08:00
Cai Yudong fe50f97726
Use id to tell search result validation in proxy reduce stage (#6905) 
* use id to tell search result validation

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable test_search_binary_hamming_flat_index

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix merge retrieve result issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-02 10:25:49 +08:00
bigsheeper e8ea8b51d5
improve query node log (#6897) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-31 10:47:22 +08:00
bigsheeper eee0f1e077
Add mutex for segment of segCore in querynode (#6870) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-29 16:03:22 +08:00
godchen db94d7771f
Read vector from disk (#6707) 
* Read vector from disk

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix git action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix test error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix caculate error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change var name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix len error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change bytes to float method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change float to bytes method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-24 09:25:22 +08:00
bigsheeper 21bc5810c0
remove redundant log of query node (#6768) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-23 20:09:33 +08:00
bigsheeper 2f44fc40a3
fix historical unittest (#6705) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-23 19:55:07 +08:00
Cai Yudong cbb4052fdb
Support search and query output fields using wildcard (#6671) 
* update wildcard polocy for search and query

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-21 14:52:12 +08:00
FluorineDog 234954931f
remove deprecated (#6623) 
* remove deprecated

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix timeout

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-20 15:18:08 +08:00
Cai Yudong a7b27db63e
update fillRetrieveResults parameter (#6598) 
* update fillRetrieveResults parameter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize fillVectorFieldData process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-17 15:17:30 +08:00
Cai Yudong a992dcf6a8
Support query return vector output field (#6570) 
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-16 17:19:55 +08:00
Cai Yudong 1c29b42434
change output_fields to out_fields_id for RetrieveRequest (#6506) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-14 13:11:54 +08:00
bigsheeper e50d39dfe1
Query result get global sealed segments from ETCD (#6377) 
* get global sealed segments from ETCD

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix race error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-14 11:15:54 +08:00
Cai Yudong 724f10b9a0
Unify the usage of query and search (#6467) 
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-13 22:20:33 +08:00
xige-16 2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351) 
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-07-13 14:16:00 +08:00
dragondriver bd317a5461
Check if field data is empty (#6404) 
* Check if field data is empty

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* FixBug: fast fail when output_fields contain fields that are not in schema

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-07-11 19:39:52 +08:00
neza2017 8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
Cai Yudong 21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305) 
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-06 09:16:03 +08:00
FluorineDog bf8b2be4a7
Deprecate num_groups to simplify search API (#6230) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-01 10:32:15 +08:00
zhenshan.cao ff4c6c7ff4
Fix travel timestamp and guarantee timestamp (#6234) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-30 21:02:13 +08:00
Cai Yudong a7a9eeeffe
Add time record for build index and search process (#6231) 
* add timerecord for build index process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add timerecord for query process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-30 19:46:14 +08:00
xige-16 ff93d1611f
merge retrive and search code in query node (#6227) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-30 17:50:15 +08:00
xige-16 f146d3825f
Fix search hang after querynode restart (#6212) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-30 17:48:19 +08:00
Cai Yudong 95135c1681
fix blob file sort error (#6184) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-29 13:24:15 +08:00
xige-16 6b65529086
Fix search error after releasePartition (#6135) 
* fix search error after releasePartition

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-26 16:08:11 +08:00
xige-16 8db95a63f6
Return error when search limit equal 0 or grater than 16384 (#6115) 
* return error when search limit equal 0 or grater than 16384

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-26 11:44:11 +08:00
bigsheeper 0d0c1901dd
Fix service time check of search in streaming (#6068) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-25 20:18:09 +08:00
yukun 39614aa8eb
Add rocksmq_path in config and paramtable (#6099) 
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 19:44:11 +08:00
yukun eb818d05ab
Remove vector fields from output fields (#6112) 
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 16:52:11 +08:00
bigsheeper e87372761a
Remove tSafe in release partition task and return max timestamp (#6078) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-24 19:06:34 +08:00
congqixia 10e5fc3382
Fix query node crash when retrieved 0 result (#6087) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-24 19:04:34 +08:00
yukun c8bf9078ae
Change pchannels to vchannel in retrieveResults (#6054) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-24 13:40:03 +08:00
yukun b72e4c6372
Merge search_collection and retrieve_colletion into query_collection (#6037) 
* Merge search_collection and retrieve_colletion into query_collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix static-check

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-23 20:26:10 +08:00
bigsheeper dca24f313a
fix search timeout error (#6027) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-23 18:04:22 +08:00
bigsheeper 0f89f40488
Use virtual channel in search result and retrieve result (#6030) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-23 18:00:37 +08:00
xige-16 5417fee45f
fix releasePartition not work after loadCollection (#6025) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-23 17:44:12 +08:00
bigsheeper 47d89abaa0
get channels by static converting (#6015) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-23 17:26:09 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00
godchen fd07a44dba
Fix error in retry refactor (#6000) 
* Fix error in retry refactor

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 11:48:06 +08:00
godchen 99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
bigsheeper b31bae351d
fix empty search result (#5979) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-22 16:52:08 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
xige-16 7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error (#5960) 
* delete nodeInfo after nodeDown

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load balance can's stop

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load field data error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* contiue task loop after error in queryService

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 14:10:09 +08:00
yukun b2eb596c23
Change search result to columnBased and return target_entry (#5896) 
* Change search result to columnBased and return target_entry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fluorinedog <fluorinedog@gmail.com>

* synchronize the latest pymilvus-orm version

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change pymilvus-orm version to 40

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-21 20:18:13 +08:00
bigsheeper 2e615907ca
fix test_search_after_index_different_metric_type (#5921) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-21 18:46:15 +08:00
sunby 7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
zhenshan.cao 958280ebb8
Add support for time travel (#5897) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-21 10:42:10 +08:00