891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
e8ebd926e0
[skip e2e] Add comment for internal/proxy/task.go ( #14031 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 11:05:09 +08:00
8eb4d9a2b4
[skip e2e] Add comment to proxy task ( #14003 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-22 20:29:29 +08:00
bdb001b20d
Add log of query to record time spent in mq ( #13526 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-22 10:11:02 +08:00
8a63dba149
Add consistency level field in collection meta ( #13766 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
dc7fb594af
[skip e2e]Improve log for QueryNode spell ( #13809 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-20 23:10:51 +08:00
22e0fc8701
[skip e2e] Add comment for DropAliasTask ( #13626 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-17 18:46:38 +08:00
bfdf6eb402
[skip e2e]Fix datarace in proxy ( #13607 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 16:32:52 +08:00
00c9797d91
Add log of insert to record time spent in mq ( #13527 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-16 22:27:42 +08:00
cb51df5985
Add log of search to record time spent in mq ( #13525 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-16 22:22:06 +08:00
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
b5d639a1ab
Use typeutil.ProxyRole instead of Params.RoleName in proxy ( #13217 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-13 10:01:18 +08:00
214f40b209
Add timeout ts for search and query ( #12890 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 14:15:03 +08:00
a2a1f9d08c
Disable multiple vector fields ( #12691 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-06 10:03:34 +08:00
147fc41a67
Update proxy debug log ( #12591 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-02 12:41:32 +08:00
1db1cf2104
Fix similarity correlation ( #12511 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:26:02 +08:00
6d92b8499c
Revert #11901 , Fix wrong jaccard distance ( #12487 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 20:31:35 +08:00
74a4a4e15b
Fix golint warnings for proxy ( #11895 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:25:17 +08:00
927f72d588
Add delete task channel stats interface ( #12250 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 16:01:17 +08:00
b231965e15
[skip ci] Add comments for exported funcs in internal/proxy/task.go ( #11980 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-17 16:13:17 +08:00
8c951217ee
Fix wrong distances caused by metric type ( #11901 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:11:10 +08:00
27d711e5d2
Insert task hash by primarykeys ( #11819 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 14:21:27 +08:00
99894e451d
[skip ci]Update license for proxy task ( #11611 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-10 23:55:48 +08:00
e27283abbf
Update query reduce log ( #11402 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 16:07:34 +08:00
d32c77e99b
Update search reduce log ( #11400 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 16:03:30 +08:00
88c9067873
Add hashvalue warning ( #10668 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:20:55 +08:00
c99d1a56bf
Refactor proxy ticker to fix guarantee_time not work ( #11248 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 09:14:02 +08:00
0fac38000c
Correct empty retrieve result handling ( #11219 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-04 18:08:32 +08:00
a0a3a889e7
Add common endian for global use ( #11092 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
70188990dc
Remove primary key duplicated query result on proxy ( #10967 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 10:27:56 +08:00
da0cb4a702
Use primary key only to check search result duplicate ( #10949 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 10:06:03 +08:00
0049837dc4
Add utils API AppendFieldData ( #10910 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-29 18:06:43 +08:00
5ad4cdda25
Clean search result duplicates removal debug log ( #10769 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-27 20:02:26 +08:00
24f9411249
Optimize queryTask PostExecute ( #10739 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-27 17:34:35 +08:00
c51155a542
Optimize decodeSearchResults ( #10728 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-27 14:10:27 +08:00
3734ff49ac
Add default value for the parameter roundDeciaml ( #9626 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 18:24:23 +08:00
bb08df28f3
Fix golint error in proxy ( #10620 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 10:38:41 +08:00
4b0fd28de7
Fix golint error in proxy ( #10621 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:42:29 +08:00
daaa9428ea
Fix delete msg hash error ( #10599 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:20:20 +08:00
d2e0943f21
Fix delete node flush error ( #10549 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 18:49:20 +08:00
c3cce20413
Reset the msgstream threshold to PulsarMaxMessageSize ( #10186 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:57:14 +08:00
880e375b00
[skip ci] Remove comments ( #10541 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 15:25:12 +08:00
f6802589eb
Optimize proxy reduce code readability ( #10537 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:29:12 +08:00
3af852eafb
Fix golint error in proxy ( #10488 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 23:17:11 +08:00
51d82fc71d
Fix golint error in proxy ( #10487 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:25:37 +08:00
169359448f
Fix golint error in proxy ( #10486 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:23:44 +08:00
43ef5d5eb9
Fix golint error in proxy ( #10485 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 10:53:12 +08:00
824005115a
Remove duplicated search results in proxy ( #10355 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-21 19:52:28 +08:00
b099179ac0
Optimize proxy reduce search result data ( #10327 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-21 10:46:36 +08:00
b40513b211
Use timerecord to calculate time span ( #10287 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 17:56:38 +08:00
24a6fc096b
Update query node bloom filter ( #10109 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-18 20:08:42 +08:00
dc0269cf4c
Optimize proxy getChannels ( #9964 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 20:37:04 +08:00
92815f4542
Change timestamp to timestamps in internalproto.DeleteRequest ( #9802 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 14:48:34 +08:00
8f5bf46705
Fix golint warning of plan_parser.go ( #9827 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-13 20:30:32 +08:00
84e568ee32
Support Delete in datanode ( #8505 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:31:44 +08:00
bd3a8ed3cf
Support delete in proxy ( #9588 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 07:48:55 +08:00
75716e0deb
Update partition name validation in DeleteTask ( #9560 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-09 22:50:39 +08:00
302ca04d6c
Describe collection by collection ID ( #9471 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:10:56 +08:00
d4232f88a2
For search funtion adding a round_decimal paramter to precision control ( #8574 )
...
Signed-off-by: elfisworking <zymustb@126.com>
2021-10-08 17:39:55 +08:00
827a18a7c1
Fix Assigner typo ( #9075 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-02 18:43:56 +08:00
4bfa85eda3
Fix searchTask result nil ( #8844 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-29 15:48:00 +08:00
a662c62880
Fix golint error of segment.go in proxy package ( #8629 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-28 23:06:15 +08:00
6065bb50c4
Fix golint warning of funcutil ( #8652 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-27 23:18:02 +08:00
b71bffe26f
Replace ChannelID with ShardName in DML Request ( #8539 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-27 10:01:59 +08:00
3938d68034
Optimize proxy query execute ( #8479 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-25 00:21:57 +08:00
ee3eaa2966
Rename CreateQueryExprPlan to CreateExprPlan ( #8438 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 10:27:54 +08:00
4ee8275b88
Fix master compile error ( #8333 )
...
Resolves : #8336
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-22 20:31:54 +08:00
729d409a32
Add trace log for search ( #8302 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:36:00 +08:00
79b7dcc75a
Add trace log for insert ( #8301 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:33:54 +08:00
b2e8ba7b33
Fix reduce algorithm in proxy search task ( #8206 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 10:15:54 +08:00
bdfb8768d4
Enable gosec ( #8202 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
ccb57ba4b2
add collection alias ( #7255 )
...
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
46871fcaec
Remove unused code in queryTask ( #8077 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-17 21:57:58 +08:00
4fe22bcaaa
Fix query task panicking ( #8060 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 20:03:50 +08:00
5f3b961502
Add test case for delete task ( #7939 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 14:04:54 +08:00
d0667b58d7
Change Error Msg When dimension of vector field not exist ( #7931 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-15 10:01:30 +08:00
2382be82a5
Add test case for the workflow of insert task ( #7912 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 19:07:48 +08:00
ec776a30dc
Add test case for the workflow of query task ( #7886 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 16:19:08 +08:00
f122e93383
Proxy ut cover case that search task process the fields data ( #7874 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 14:09:05 +08:00
e5e4b24954
Fix bug: describe collection return wrong shard number ( #7841 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-14 11:59:47 +08:00
bcf9b4e240
Coverage error case of searchTask.PreExecute ( #7826 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 10:24:00 +08:00
8d239b6473
Add test cases for search task ( #7796 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-13 17:12:19 +08:00
619c4393f3
Refine logs in proxy search path( #7357 ) ( #7753 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-12 17:54:01 +08:00
5a3fc37584
Add test cases for create collection ( #7759 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 18:06:02 +08:00
a872a4357c
Add more test cases for proxy implementation ( #7685 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 11:36:22 +08:00
596357dc85
Add more data definition test cases ( #7623 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 19:02:08 +08:00
b0524adbd8
Support specified shard number when create collection ( #7482 )
...
Add shards_num to CollectionInfo
Modify dmlChannelNum config
Compatible with old meta
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-08 15:00:00 +08:00
42b687bf48
Add unittest for task scheduler ( #7508 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-06 20:49:04 +08:00
94272bba87
Support query by expression ( #7386 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-03 17:12:55 +08:00
8701c477e2
Add delete api into proto ( #7304 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-26 12:15:52 +08:00
0ab70271a6
correct empty search result handle ( #7244 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-24 11:13:52 +08:00
8405d90f5e
proxy add illegal check for search result ( #7227 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-23 17:03:51 +08:00
671b2737d2
Remove RetrieveRequest and RetrieveTask ( #6848 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 17:06:10 +08:00
e771bda92f
optimize retrieve output vector code structure ( #7102 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
87c5a49d9a
Refactor showCollection/showPartition to get load state in memory ( #6935 )
...
* refactor showCollection/showPartition to get load state in memory
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* update proto
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* update proto
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* update milvus.proto
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add show result log to debug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix wrong err message
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* update pymilvus-orm version
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix repeated load error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* update proto
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix status nil error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-02 22:39:25 +08:00
fe50f97726
Use id to tell search result validation in proxy reduce stage ( #6905 )
...
* use id to tell search result validation
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable test_search_binary_hamming_flat_index
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix merge retrieve result issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-02 10:25:49 +08:00
d51fec6678
Enhance log when create index failed ( #6871 )
...
* Enhance log when create index failed
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug for repeatedly drop index
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-29 14:47:22 +08:00
8a1a841011
FixBug: Incorrect handling of time synchronization ( #6814 )
...
* FixBug: proxy send wrong sync timetick and DataCoord did not filter channel
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-27 14:34:48 +08:00
3cc8ee298e
Filter NaN when reducing search results ( #6806 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-27 10:19:21 +08:00
2962d31a5f
Fixbug: segment allocate but return value incorrect ( #6788 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-24 20:49:20 +08:00
Cai Yudong
shaoyue
edward.zeng
Jiquan Long
xige-16
zhenshan.cao
Xiangyu Wang
bigsheeper
godchen
yukun
XuanYang-cn
cai.zhang
elfisworking
congqixia
Yusup
Xiaofan
groot