e1b52b0583
Add unittest for IndexCoord and IndexNode ( #6698 )
...
* Add unittest for IndexCoord and IndexNode
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix verifiers
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-23 10:44:12 +08:00
9aa56cd7b8
Add log for IndexCoord and IndexNode ( #6597 )
...
* Add log for IndexCoord and IndexNode
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Make verifier
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Delete unused script
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-22 11:40:11 +08:00
a3c662c7bf
Add watchWithVersion interface for etcdKV ( #6663 )
...
* Add watchWithVersion interface for etcdKV
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Add unittest
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Add LoadWithVersion interface
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-21 18:20:11 +08:00
67c1fdd2c0
Show/Describe collections/partitions with created timestamp ( #6700 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-21 18:00:14 +08:00
cbb4052fdb
Support search and query output fields using wildcard ( #6671 )
...
* update wildcard polocy for search and query
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* mark xfail cases
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* mark xfail cases
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-21 14:52:12 +08:00
26f890b5f5
Remove too frequent timetick log ( #6682 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-21 11:26:11 +08:00
9b1708f6e5
Fix proxy crashes when retrieve task is called ( #6656 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-07-20 22:33:09 +08:00
744f2c7f51
optimize test_c_api.cpp ( #6637 )
...
* optimize test_c_api.cpp
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* clean redundant file
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change DIM to const
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize test_c_api.cpp
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update reduce testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-20 17:13:21 +08:00
234954931f
remove deprecated ( #6623 )
...
* remove deprecated
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* fix timeout
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-20 15:18:08 +08:00
b9f5949680
Add vector chunk manager ( #6613 )
...
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add vector file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* rename
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix ut error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix memory error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-20 15:06:09 +08:00
99249a0224
Fix bug: override the compare function of SearchResultPair ( #6628 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-20 14:38:11 +08:00
ab5a7cbf44
Remove timesync package ( #6619 )
...
issue: #6618
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-19 18:53:09 +08:00
b98b30b96f
Fix datacoord_test.go failed ( #6558 )
...
Create a mock rootcoord when testing datacoord to hide the network layer
issue: #6557
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-19 10:41:15 +08:00
0e2329c7ad
Refactor snapshot of timestamp statistics ( #6600 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-17 16:31:29 +08:00
a7b27db63e
update fillRetrieveResults parameter ( #6598 )
...
* update fillRetrieveResults parameter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize fillVectorFieldData process
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-17 15:17:30 +08:00
2d9361e0ba
Fix bug: remove duplicated primary field id when retrieve entities ( #6577 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-17 10:53:30 +08:00
a992dcf6a8
Support query return vector output field ( #6570 )
...
* improve code readibility
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add offset in RetrieveResults
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add VectorFieldInfo into Segment struct
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add new interface for query vector
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fill in field name in query result
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add FieldId into FieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add fillVectorOutputFieldsIfNeeded
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update data_codec_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add DeserializeFieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* realize query return vector output field
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable query vector case
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
4c7b57ffc5
Upload codecov report in GitHub Actions ( #6565 )
...
* Upload codecov report in GitHub Actions
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-07-16 14:52:21 +08:00
2a42244ff6
fix watchQueryChannelTask's info can't be deleted from etcd ( #6568 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-16 10:21:55 +08:00
84b9791221
Fix snapshot of timestmap statistics ( #6543 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-15 17:47:55 +08:00
ee38d14f5d
Fix channel lost after data node crash ( #6545 )
...
If we start up 2 data nodes and one of them crashes. We expect that all
channels of crashed node will be allcoated to the alive node. But now we
discover that these channels are lost after data node crash. The reason
is we pass a NodeInfo with empty channel info. We fix it and improve log
print.
issue: #6501
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-15 16:38:31 +08:00
7b9f0d398f
update flowgraph unittest ( #6537 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-15 14:51:55 +08:00
6b001fd76a
fix debug error in IDE ( #6539 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-07-15 14:27:54 +08:00
dca6c6afde
Add unittest for BackGroundGC in DataNode ( #6522 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-07-15 10:05:55 +08:00
5016e509be
Support wildcard match on search/query output fields ( #6510 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-14 18:51:54 +08:00
fac350cc58
fix tso ( #6500 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-14 17:11:54 +08:00
7f99d9d714
Loose the limit of dimension when searching on a binary vector field ( #6503 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-14 14:33:54 +08:00
f469a315d6
Refactor the logic of assign tasks in IndexCoord ( #6328 )
...
* Refactor the logic of assign tasks in IndexCoord
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bugs
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug for unittest
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Add lock for map
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Improve code
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix unittest bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reduce duriation for timetick
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Update orm version
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reset sdk version
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reset orm version
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reset test ip
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug for unissued
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Rename some variables
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Use break instead of continue in select::case
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-14 14:15:55 +08:00
1c29b42434
change output_fields to out_fields_id for RetrieveRequest ( #6506 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-14 13:11:54 +08:00
e50d39dfe1
Query result get global sealed segments from ETCD ( #6377 )
...
* get global sealed segments from ETCD
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix race error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-14 11:15:54 +08:00
f3a5b46288
Fix bug for repeatedly create bucket in minio ( #6477 )
...
* Fix bug for repeatedly create bucket in minio
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Simplify code
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Add log
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-14 09:55:46 +08:00
724f10b9a0
Unify the usage of query and search ( #6467 )
...
Unify the usage of query and search
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-13 22:20:33 +08:00
b66157358c
add more log for create collection ( #6478 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-13 22:19:55 +08:00
d896e3119e
Fix 6419, check if num_rows is greater than zero in proxy ( #6439 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-13 16:33:55 +08:00
25b8c37383
Fix 6421, split raw vectors to serveral smaller one ( #6449 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-13 16:05:36 +08:00
bc15b74244
Handle datasorter edge cases ( #6465 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-07-13 14:37:54 +08:00
e5f8a77a2d
Extend grammar of boolean expression ( #6460 )
...
* Extend grammar of boolean expression
Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-13 14:37:03 +08:00
2b720fd2f7
Fix load hang when restart querynode many time in short time ( #6351 )
...
* fix load hang when restart querynode many time in short time
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add multi queryNode ut
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add ut for restart querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set queryCoord contex to load collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
d4239f0cd8
masterservice -> rootcoord ( #6447 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-13 09:37:40 +08:00
83be910baa
Refactor segment manager ( #6441 )
...
issue: #6440
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-12 17:24:25 +08:00
a8e5fd2024
Refactor cluster in dataservice ( #6356 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-12 11:03:52 +08:00
bd317a5461
Check if field data is empty ( #6404 )
...
* Check if field data is empty
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* FixBug: fast fail when output_fields contain fields that are not in schema
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-11 19:39:52 +08:00
8b89744c6b
search with exp ( #6409 )
...
* process float vector and binary vector field
on the search result
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add more debug info on etcd
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add debug info when grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
99ed122d11
Remove Dead Code, use signed type ( #6398 )
...
* make type signed
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* remove dead code
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* remove code
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-09 18:25:11 +08:00
2ff072ea7b
Use larger dim for binary test to avoid false positive test failed ( #6416 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-09 18:12:40 +08:00
19fc42c9eb
calc_distance typo ( #6380 )
...
* calc_distance typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* calc_distance typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-07-09 14:53:52 +08:00
346e9cba4a
Add minio FGet method ( #6386 )
...
* Add minio FGet method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change el append
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-09 11:44:40 +08:00
6b4b71bf03
Fixbug: remove wrong check code ( #6372 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-08 20:17:43 +08:00
b53699b846
Fixbug: distinguish the name of the subscription based on ProxyID ( #6333 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-08 19:52:39 +08:00
f0a68704e2
Add unittests for getChannelName in DataNode ( #6346 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-07-08 15:52:40 +08:00
cai.zhang
dragondriver
Cai Yudong
congqixia
FluorineDog
godchen
sunby
紫晴
xige-16
bigsheeper
groot
XuanYang-cn
neza2017
xaxys
zhenshan.cao