milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
19,111 Commits
153 Branches
122 Tags
589 MiB
Commit Graph

355 Commits (16b4c9a79e3f6227cde93e5289f124240b970dec)

Author SHA1 Message Date
congqixia 8b5e276361
Use different cgo pool for SQ and other operations () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-01 09:19:05 +08:00
yah01 39b00b97a6
Add more logs for committed resources () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-31 19:27:03 +08:00
yah01 8245e078c0
Add max segment size log () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-31 14:37:04 +08:00
zhagnlu 833674c1cb
add glog configurable function and redirect aws log to segcore log () 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-07-27 19:49:02 +08:00
congqixia 5fbe6e99fd
Remove debug log from segment loader () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-26 18:51:01 +08:00
wei liu 302897f866
refine look aside balance logic () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 18:51:01 +08:00
yah01 3735a097e6
Refine the memeory usage prediction () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-25 17:41:01 +08:00
congqixia 0bc03ede0d
Add eventlog pkg and support grpc streaming event observation () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 17:23:01 +08:00
wei liu a132122370
fix time unit in insert/delete cost metrics value () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 15:07:01 +08:00
aoiasd b533c68632
Forbid update checkpoint without msgID () 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-07-25 10:43:04 +08:00
wei liu 0e26486abc
fix segment num in log () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 09:13:00 +08:00
yah01 168f346620
Remove deprecated interface () 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-07-24 17:47:00 +08:00
wei liu fc19b85a40
fix count(*）retrieve redundant growing segment () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 14:09:00 +08:00
wei liu 32827f538a
add metrics for delegator insert/delete cost () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-21 15:30:59 +08:00
yah01 361db51337
Create dir if mmap enabled for validating path () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 18:48:58 +08:00
Cai Yudong 9a4761dcc7
Remove binary metrics TANIMOTO/SUPERSTRUCTURE/SUBSTRUCTURE () 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-19 16:16:58 +08:00
yah01 079cd9dc70
Add caller skip to improve the log for segcore error () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-18 19:54:57 +08:00
congqixia cc71e065e3
Support load index after segment loaded () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-18 10:51:19 +08:00
congqixia c490b30db7
Fix segment loader skip wait if all segments are loading () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-17 19:51:18 +08:00
MrPresent-Han 49655d2f13
fix panic due to lack of indexInfo on querynode() () 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-17 19:23:19 +08:00
yah01 948d1f1f4a
Handle errors by merr for QueryCoord () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-17 14:59:34 +08:00
Zhihong Yu a7023ab3cc
Narrow the scope of deleteMut lock in loadStreamDelete () 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2023-07-17 09:30:34 +08:00
wei liu b62c82af22
fix set target version in loading sealed segment () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 20:00:31 +08:00
congqixia f2b14b43de
Add log field for local worker call () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:34:31 +08:00
congqixia a7e6f08183
Fix DeleteCollection not protected () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:04:31 +08:00
Enwei Jiao 66fdc71479
Refactor logs in DataCoord & DataNode () 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
yah01 d216f9abda
Clear collection meta after all channels/segments released () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-14 10:28:30 +08:00
yiwangdr b9189b9f41
Organize mocks from types.go () 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
wei liu b72809db15
fix release sealed segment on unwatch channel () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-13 14:30:29 +08:00
yah01 205a7c430a
Fix QueryNode panic while inserting to released segment () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-12 19:48:29 +08:00
SimFG f9e2d00f91
Prevent `exclusive consumer` exception in pulsar () 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-07-12 17:26:30 +08:00
yihao.dai 4c93495587
Add segment size metric in querynode () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-12 14:26:28 +08:00
congqixia bcd3abf644
Separate segments/shards reduce latency metrics () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 18:18:28 +08:00
congqixia 5aec6036dc
Add index info in GetDataDistribution response () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
cai.zhang 81278f4aea
Fix bug of missing JSON type when sorting retrieve results () () 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-10 20:02:28 +08:00
congqixia 9e3a591bda
Fix segment released early in case of balancing () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-10 18:58:28 +08:00
wei liu cc730c1ee5
fix consume growing from dml after release () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-10 17:36:28 +08:00
wei liu d4704ab9b6
fix set shard unservicable when sync target version () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 19:32:25 +08:00
wei liu a47fc28023
fix querynode panic in get distribution () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 18:26:25 +08:00
congqixia f07c934558
Fix querynodev2 grace stop condition reversed () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-07 17:28:25 +08:00
wei liu b7740835fe
fix metric label for sq count metrics () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 14:06:25 +08:00
chyezh dc1cb54404
[Fixup] unexpected read_task_ready_len metric () 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-06 20:02:29 +08:00
wei liu d5ec7dda80
fix metric label in search/query count () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 17:48:26 +08:00
congqixia 3f9384b515
Fix exclude segment info dml position for flushed segments () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 17:30:26 +08:00
yah01 3d2283415f
Fix delegator leaked () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:18:26 +08:00
yah01 dd5f896dc8
Load batch by batch () 
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 13:58:27 +08:00
yah01 4c0e36d28c
Stop blocking until all channels & segments released () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 10:04:25 +08:00
wei liu c84496a1ba
fix sq count metrics () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:46:26 +08:00
congqixia efdd71c640
Make cgo pool size larger than worker pool size () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-05 16:56:26 +08:00
Enwei Jiao 816158e4af
Remove outdated searchplan () 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-04 18:30:25 +08:00
Gao 4a87b9f60a
Fix queryHook ut data race () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-07-04 15:34:25 +08:00
yihao.dai c56a26a556
Add SetMetricType and set metric only for shard leader () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00
chyezh d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy () 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-03 18:24:25 +08:00
Gao de6e4817a2
Support dynamic tuning config () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-07-03 15:18:24 +08:00
yah01 7b5013664d
Support graceful stop () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-30 17:28:23 +08:00
yah01 f7ecbff986
Make merged task channel buffered () 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-06-30 14:58:22 +08:00
Gao 8750be1e97
Set receive searchRequest log to debug level () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-29 14:04:22 +08:00
congqixia 1357ef7043
Merge get worker process for same nodeID () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-28 18:34:24 +08:00
Jiquan Long 8d193a3e56
Skip unnecessary reduce phase during search () 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-27 19:22:45 +08:00
wei liu 9b91519c88
fix search cost metrics on replica selection () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 19:02:44 +08:00
congqixia b3362c297a
Make snapshot.expired atomic () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-27 18:12:45 +08:00
yihao.dai 29b9b26de8
Improve get vector error msg () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-27 16:34:45 +08:00
wei liu 68ae199a9f
load segment with target version, avoid read redundant segment () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 11:48:45 +08:00
xige-16 33c2012675
Add more metrics () 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database () 
Support Database()
Fix db nonexists error for FlushAll ()
Fix check collection limits fails ()
backward compatibility with empty DB name ()
Fix GetFlushAllState with DB ()
Remove db from global meta cache after drop database ()
Fix db name is empty for describe collection response ()
Add RBAC for Database API ()
Fix miss load the same name collection during recover stage ()

RBAC supports Database validation ()
Fix to list grant with db return empty ()
Optimize PrivilegeAll permission check ()
Add the default db value for the rbac request ()

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
xige-16 04082b3de2
Migrate the ability to upload and download binlog to cpp () 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-25 14:38:44 +08:00
congqixia a3630e17a0
Refine grpc Status handling: retry legacy only for Unimplemented () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-25 10:30:43 +08:00
congqixia d51e1379fe
Move loadDelta operation after needTransfer check () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-19 17:14:41 +08:00
wei liu 46f7d903a3
enable look aside balancer on replica selection () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-16 18:38:39 +08:00
yah01 a413842e38
Fix deleted data is still visible () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 17:16:41 +08:00
yihao.dai c7dc1c067a
Assign metric type in load segment request () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 16:50:41 +08:00
yah01 9250423288
Fix QueryNode metrics () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 16:02:39 +08:00
wei liu 75adf1df98
fix group nq metrics () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-15 19:50:39 +08:00
wei liu e40d95e093
add search/query request cost metrics on qn () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-15 14:24:38 +08:00
yihao.dai e7125672d4
Check metric type at watchChannelTask () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-13 22:08:38 +08:00
Gao 1f8af0596e
Fix autoindex filter bug () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-09 18:18:36 +08:00
yihao.dai e81eb56b92
Add metric of waiting for tSafe latency () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-09 11:26:35 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
aoiasd 44e5daae3a
Fix querynode read quota () 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-08 17:24:36 +08:00
congqixia 54306a10b3
Fix confusing log while plugin is not enabled () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 15:40:35 +08:00
yiwangdr 37c02c9927
clean up meta interface () 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-08 14:18:35 +08:00
Enwei Jiao d3af451d92
Upgrade golangci-lint () 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-07 19:34:36 +08:00
yihao.dai 711bbd6373
Check metric type before search () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-07 15:58:36 +08:00
yihao.dai 5f7099a9bd
Fix search failed due to metric type mismatch () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-06 21:40:35 +08:00
Gao ea62922829
Disable search params rewrite while searching with filter () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-06 14:28:35 +08:00
yah01 fb66924c90
Set metric type while init the collection () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-06 13:24:36 +08:00
yihao.dai b0ce4cff83
Assign metric type in search request when user has not explicitly assigned () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
congqixia 31880ab427
Use conc.PoolOption instead of ants.Option () 
- Add conc.PoolOption to setup conc.Pool
- Change panic default behavior
- Make future has error when job panicks

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-01 15:52:31 +08:00
yah01 1c64d0618c
Revert "Consume threads of the number of nq ()" () 
This reverts commit 71a7fef5c5.

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-31 16:41:33 +08:00
congqixia 48dff300db
Fix Get segment returns ambiguous result () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-30 12:25:28 +08:00
aoiasd c84bdcea49
merge stats log when segment flushing or compacting () 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-29 10:21:28 +08:00
yah01 71a7fef5c5
Consume threads of the number of nq () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-26 17:33:27 +08:00
xige-16 fe18109aab
Clean tmp disk data when start milvus () 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-26 15:07:26 +08:00
yihao.dai 5f84923bfa
Fix search/query unloaded data () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-26 15:01:26 +08:00
congqixia 165734de4e
Add unit test for invoking method after segment released () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-26 10:03:27 +08:00
yihao.dai 014387fd94
Forbid to get quantized vector from ChunkManager () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 23:03:27 +08:00
Bingyi Sun 0c8045d66c
Fix crash caused by segment function concurrency () 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-24 19:23:27 +08:00
yihao.dai e49df11942
Fix QueryNode is not able to recovery () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 14:29:29 +08:00
yah01 abd250da09
Fix QueryNode is not able to recovery () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-23 17:17:26 +08:00
wei liu ce03248b1a
simplify logic circle in search () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
yihao.dai 45aa9779e0
Retrieve segments concurrently () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-19 18:19:24 +08:00
yihao.dai 1a3dca9b5e
Fix dynamic partitions loading () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
MrPresent-Han b74770b636
support try-best query reducer methods() () 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-17 16:23:23 +08:00
yihao.dai 7384d83d2c
Support rate limit based on growing segments size () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-17 09:57:22 +08:00
congqixia 73a181d226
Fix get vector it timeout and improve some string const usage () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
yah01 3ea4a39078
Fix insert node doesn't handle JSON data while merging () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-16 16:09:23 +08:00
congqixia a960cc2a1b
Fix data race in pipeline/manager () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 15:17:23 +08:00
congqixia df7848cf79
Fix querynode consume ts lag metrics () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 09:59:26 +08:00
congqixia eb27a8a8c0
Fix integration test not wait for index built () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-12 09:51:25 +08:00
yah01 400364483d
Improve predict the resource usage () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 15:33:24 +08:00
smellthemoon 146050db82
Fix some wrong ut () 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 09:31:19 +08:00
yihao.dai 7e0d1492c7
Load delete from channel checkpoint () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 19:10:41 +08:00
yihao.dai 426ed30d2d
Log optimized search params () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 10:12:42 +08:00
yihao.dai f0eb5e8563
Fix partition released but can be searched () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-06 17:42:39 +08:00
congqixia 884f7904a1
Re-calculate segment entry num when binlog field is zero () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-06 14:24:39 +08:00
yihao.dai 02734d9eb0
Fix ignoring error when loading segment () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-04 15:10:39 +08:00
yihao.dai 4b26c0afb3
Add collection in querynode when sync new partitions () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-01 16:36:38 +08:00
Gao e467e0d451
Seperate reading build and load params for diskann () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-04-27 20:30:35 +08:00
yah01 eab94489ba
Refine the merge algorithm () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-27 18:26:35 +08:00
smellthemoon f0ababb420
Use merr in querynodev2 () 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-26 17:06:34 +08:00
foxspy 6f4ed517de
add growing segment index () 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-04-26 10:14:41 +08:00
yah01 f8ff97fe29
Fix travel timestamp set unique leads to disable task merge () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-25 19:04:34 +08:00
yihao.dai 092d743917
Add support for getting vectors by ids () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-23 09:00:32 +08:00
yah01 546080dcdd
Support to retrieve json () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-21 11:46:32 +08:00
yah01 71364056f9
Fix QueryNode may report succeeded to unsubscribe channel early () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 19:30:33 +08:00
LeoReeYang a2ab94ec3d
remove unused code. () 
Signed-off-by: LeoReeYang <LeoReeYang@outlook.com>
 2023-04-20 17:56:32 +08:00
Enwei Jiao 967a97b9bd
Support json & array types () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
congqixia 4fe363c4b2
Add KNN cgo pool () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-19 23:56:31 +08:00
yah01 c7c89511b6
Fix data race of timerecord () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-19 14:18:30 +08:00
congqixia eb690ef033
Fix querynodev2 stop logic () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-18 17:56:30 +08:00
wei liu 3ad9ff7a9a
fix release segment failed () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-17 18:46:30 +08:00
cqy123456 7ff6a3a246
Set query node thread pool size in milvus.yaml () 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-04-17 10:44:29 +08:00
yah01 7c4cafc83c
Fix task merge doesn't work () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-14 18:18:29 +08:00
congqixia a9a5f76f74
Fix AddDistribution unit test () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-13 20:46:29 +08:00
yah01 dc0eb433ae
Add IoPoolSize config () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-13 14:50:28 +08:00
cai.zhang 43a9e175a3
Exit component process when session key is deleted () () 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-12 20:12:28 +08:00
congqixia 6cd73d4e2a
Wait safe signal before release growing () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-11 17:56:31 +08:00
Jiquan Long ad7f3d4c3e
Support Count(*) on querynodev2 () 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-11 15:40:31 +08:00
congqixia 0527d2706c
Fix offline set always nil () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-11 14:42:30 +08:00
MrPresent-Han ba02e70301
fix bug when syncing distribution without schema and remove unused logic() () 
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-04-07 19:32:29 +08:00
jaime c9d0c157ec
Move some modules from internal to public package () 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
congqixia 8db24e0a83
Support queryHook in querynodev2 () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-06 14:32:29 +08:00
congqixia 424570b2b8
Remove annoy related unit tests () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-05 08:14:28 +08:00
congqixia 3af3fe52d8
Remove partition target check in querynodev2 () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-04 13:36:32 +08:00
congqixia 42168f67fc
Add OWNERS file for qnv2 () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-03 16:22:24 +08:00
congqixia e3e3ac1525
Use peek segment info in querynodev2 () 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-03 16:10:24 +08:00
yah01 2a760c108c
Add metrics for QueryNodeV2 () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-03 15:24:24 +08:00
yihao.dai b6f69fe7f2
Check if loaded before delegator search/query () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-03 14:26:23 +08:00
yihao.dai 9cecdc4f4e
Fix querynode panic () 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-03 14:18:24 +08:00
smellthemoon 22aeb72eba
Fix LoadSegment req don't fill in collection id () 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-31 11:28:23 +08:00
Enwei Jiao 50dab2d394
Add tracing for retrieve () 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-29 18:10:02 +08:00
aoiasd 970dcb3161
Fix panic because timestamp was nil () 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-29 17:20:04 +08:00
wei liu e2096965c7
fix leader view () 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-29 14:06:02 +08:00
yah01 826c1fb850
Support mmap on QueryNodeV2 () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-28 21:30:05 +08:00
yah01 081572d31c
Refactor QueryNode () 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00