Commit Graph

1888 Commits (c982e368dd2763ef875b78d402d5b6425a3cf26b)

Author SHA1 Message Date
yukun 82e48fb379
Add more error messages in segcore visitors (#8195)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 15:53:51 +08:00
xige-16 5046cbe5d8
Fix logic error in release collection (#8188)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 15:51:51 +08:00
groot 334297b49d
[skip ci] Update OWNERS files (#8211)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 15:30:37 +08:00
congqixia bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 14:41:50 +08:00
XuanYang-cn 46c72c57c2
Add BufferData in insertbufferNode (#8138)
Optimize bufferInsertMsg param to avoid a second transfer
of endposition

See also: #8058, #7741

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-18 14:25:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
cai.zhang a6b6d16381
Delete unused code in indexnode (#8169)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 11:05:50 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:49:51 +08:00
Cai Yudong 83bf9c5efb
Add knowhere.yaml to support knowhere configuration (#7967)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 10:37:51 +08:00
godchen c8c10bb3d6
Remove performanceTest (#8164)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:13:52 +08:00
bigsheeper 338e32362b
Return error if setSegment failed when loadSegment (#8075)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 10:03:50 +08:00
nameczz d5d063df7c
[skip ci] improve milvus.proto comments (#8063)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-18 09:33:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
cai.zhang 8d5dc5ba07
Add comment for CreateIndex in indexnode (#8168)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 00:01:51 +08:00
godchen 74bb712527
[skip ci]Add minio comment (#8165)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 23:59:47 +08:00
congqixia 266db4c883
Add readme for datacoord (#8141)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 23:57:55 +08:00
Xiangyu Wang 8b21a4b596
Add unit tests for msg.go (#8150)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 23:55:50 +08:00
yukun 46871fcaec
Remove unused code in queryTask (#8077)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-17 21:57:58 +08:00
bigsheeper ee3ab7a783
Add comment for dataSyncService (#8157)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 21:55:53 +08:00
dragondriver c3eb6f9761
Expose created time and updated time to rootcoord metrics (#8174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:52:00 +08:00
dragondriver daf001f683
Expose created time and updated time to datanode metrics (#8173)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:32:47 +08:00
cai.zhang 57e46c5f2c
Start once for indexcoord (#8026)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-17 20:17:53 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
Xiangyu Wang b7b28abd77
Remove mem_msgstream that is no longer needed (#8155)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 18:43:54 +08:00
congqixia a972fafb5f
Fix proxy ut may hang with dn graceful stop (#8124)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 17:49:58 +08:00
sunby b84f017dde
Add comment for CreatePartition (#8031)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 17:35:53 +08:00
godchen 9e1b4dcd6f
Make init private (#8104)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 16:29:51 +08:00
XuanYang-cn 6c434b4801
Improve codes in insertbuffernode (#8054)
Add error handling in insertbuffernode

See also: #7624, #7684

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:27:56 +08:00
XuanYang-cn 82d4d19337
Remove not in use segmentCheckPoints (#8039)
Resolves: #8037

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:25:55 +08:00
Xiangyu Wang 422b7dcf3e
Add unit tests for mq_factory (#8140)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 16:23:51 +08:00
congqixia 05efb3a029
Fix use address of loop var (#7433)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 16:21:50 +08:00
godchen 31df0faaf5
[skip ci]Add chunk manager comment (#7833)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
Xiangyu Wang 1ee17464e8
Fix possible datarace in rootcoord (#8120)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 12:37:50 +08:00
bigsheeper 9601cb2ee6
Add failed streming unittest for query node (#7960)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:37:49 +08:00
bigsheeper c9b6a92366
Add release failed case unittest for query node (#7971)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:35:49 +08:00
godchen 295ee49472
Add trace comment (#7994)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:17:57 +08:00
sunby c0ede30c6e
Add comment for ShowCollections (#8032)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 11:15:53 +08:00
godchen 96539f02d8
Add data codec comment (#7998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
Xiaofan d6f0c5069f
[skip ci] Add comments for memory message queue (#8018)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-16 23:41:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
congqixia 4fe22bcaaa
Fix query task panicking (#8060)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 20:03:50 +08:00
cai.zhang fa00f1f48a
It is also correct to get the failed index status in indexcoord ut (#8059)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 19:56:41 +08:00
congqixia 01c8341a2e
[skip ci]Add comments for SegmentManager (#8087)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 19:55:49 +08:00
dragondriver ca2d09a167
Fix data race of proxy grpc client (#8091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 19:31:59 +08:00
dragondriver 9bbff86c81
Fix data race of rootcoord grpc client (#8078)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 18:15:49 +08:00
groot 1fd0e79add
Add unittest for distributed datacoord (#7982)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 14:17:49 +08:00
dragondriver 10321e0a1a
Cover error cases that timeout is too small (#8038)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 14:09:49 +08:00
groot c40cdb599a
Add unittest for distributed rootcoord (#7997)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:33:49 +08:00
groot e6450b0d96
Add unittest for distributed indexnode (#7991)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:31:53 +08:00
groot 75c80c12cb
Add unittest for distributed datanode (#7987)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:29:53 +08:00
dragondriver bf2ebc794d
Cover error cases that task queue is full (#8033)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 11:29:49 +08:00
yukun 8b3893e030
Add more error messages in segcore (#8012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-16 10:23:53 +08:00
nameczz 8ee55aad0a
[skip ci] improve DescribeCollection comments (#7882)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-16 10:21:53 +08:00
cai.zhang 4814f9cb1c
Add opentrace log for index component (#7946)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 10:07:48 +08:00
bigsheeper b465e8f9a4
Remove redundant check and add addQueryChannel unittest for query node (#7944)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-16 09:47:48 +08:00
yukun e0761271dd
[skip ci]Add rocksmq_retention comment (#8016)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 23:29:48 +08:00
Xiangyu Wang 0aa65f559a
Rename unit tests to meet new naming conventions (#8017)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-15 23:11:49 +08:00
xige-16 2bcb3f4916
Modify querycoord's log info (#8005)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 22:17:49 +08:00
groot 8fb961a0b0
Add unittest for distributed querynode (#7996)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:15:53 +08:00
groot 0404e3c243
Add unittest for distributed querycoord (#7993)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:13:57 +08:00
groot ed322cfd8e
Add unittest for distributed indexcoord (#7990)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:12:02 +08:00
cai.zhang 130817d8c6
Add comment for indexcoord (#7950)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-15 22:09:50 +08:00
congqixia 675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 22:05:49 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 22:04:39 +08:00
XuanYang-cn 3db76e8e59
[skip-ci]Add comment in data sync service (#8002)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 21:25:49 +08:00
congqixia 2bca69596e
Add some comment for SegmentsInfo (#7995)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:07:53 +08:00
congqixia c76f91233f
Put errors together (#7958)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:05:52 +08:00
xige-16 c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
godchen 863444cc45
Delete performance (#8000)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-15 20:29:48 +08:00
dragondriver 7f048ea8c8
Support to set max task number of task queue (#7974)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 19:09:50 +08:00
XuanYang-cn ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909)
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 18:13:49 +08:00
dragondriver 502cb68c08
Fix the logic of waiting for collection to be loaded (#7978)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 17:34:02 +08:00
yukun 13f9b32452
Improve global_rmq code coverage (#7928)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 17:31:49 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 17:29:49 +08:00
dragondriver d2e18fd53b
Cover error cases that proxy is unhealthy (#7951)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 15:46:06 +08:00
bigsheeper 18431c1549
Add historical failed unittest for querynode (#7941)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 15:25:49 +08:00
congqixia 55c47ab508
Add suffixSnapshot implementing SnapshotKV (#7948)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 15:23:49 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong ab84f95e66
[skip ci] Update debug log (#7956)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 14:39:48 +08:00
dragondriver 5f3b961502
Add test case for delete task (#7939)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 14:04:54 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
sunby 095b7c12c1
Add insert codec comment (#7891)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
XuanYang-cn 376d39fa02
[skip-ci]Add comment for Cache and allocator (#7924)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 10:33:37 +08:00
dragondriver cf1d773259
Add test cases for metrics info of proxy (#7927)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 10:13:49 +08:00
bigsheeper 0b849d3089
Add insert node failed unittests for query node (#7914)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:11:48 +08:00
bigsheeper bc1f39bb55
Remove deprecated replica interface in query node (#7908)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:09:53 +08:00
bigsheeper dfc2535aaa
Use different schema generation functions (#7884)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:07:56 +08:00
Cai Yudong c16ab5b35c
Use better segcoe variable name (#7869)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:06:00 +08:00
Xiaofan c72cff2dc2
[skip ci] Remove Unnecessary logs in pickCanDoFunc (#7932)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-15 10:01:48 +08:00
Xiaofan d0667b58d7
Change Error Msg When dimension of vector field not exist (#7931)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-15 10:01:30 +08:00
dragondriver 2382be82a5
Add test case for the workflow of insert task (#7912)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 19:07:48 +08:00
yukun 80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 18:43:48 +08:00
congqixia 7d53e44f3b
Depress gosec false positive (#7899)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 18:37:48 +08:00
congqixia 06d4faf771
Fix G109 from gosec, prevents overflow (#7896)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 18:35:48 +08:00
sunby eed856d626
Change error message to lower case (#7890)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-14 17:33:48 +08:00
sunby 9c2fb0bccb
Recorrect comment for Allocation (#7887)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-14 17:27:55 +08:00
congqixia 98732b3d43
Remove duplicated code in msgs (#7801)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 17:07:48 +08:00
dragondriver ec776a30dc
Add test case for the workflow of query task (#7886)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 16:19:08 +08:00
yukun 4bf3c6889c
Support bool field filter in search and query expression (#7814)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 16:15:47 +08:00
Cai Yudong 4dc9a64f01
Improve segcore code readability (#7868)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 16:07:48 +08:00
cai.zhang b965767e5c
Increase code coverage rate for indexcoord (#7857)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 14:09:48 +08:00
dragondriver f122e93383
Proxy ut cover case that search task process the fields data (#7874)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 14:09:05 +08:00
zhenshan.cao e5e4b24954
Fix bug: describe collection return wrong shard number (#7841)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-14 11:59:47 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 10:53:04 +08:00
cai.zhang 63a83f027f
Reduce running unit test time for indexcoord (#7779)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 10:41:21 +08:00
cai.zhang 8a458b7a38
Add log for building index about num rows (#7811)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 10:27:06 +08:00
bigsheeper 691e4c5bc9
Use definitional type instead of raw type (#7797)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:25:26 +08:00
bigsheeper 27beb033de
Add task unittest for query node (#7820)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:24:48 +08:00
dragondriver bcf9b4e240
Coverage error case of searchTask.PreExecute (#7826)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 10:24:00 +08:00
bigsheeper 664d4ca923
Fix index loader test (#7805)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:21:08 +08:00
yukun 5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 10:06:40 +08:00
yukun f1366b9451
Rename rocksmq unittests (#7846)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 09:55:00 +08:00
Xiaofan 00a5c39c2f
Remove unnecessary variables in allocator (#7849)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-14 09:54:31 +08:00
nameczz 87460665e0
improve HasCollectionRequest and DropCollectionRequest comments (#7693)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-14 09:53:21 +08:00
Xiangyu Wang 60c11c85ad
[skip ci]Rename unit tests (#7844)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-13 21:24:58 +08:00
dragondriver 8d239b6473
Add test cases for search task (#7796)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-13 17:12:19 +08:00
congqixia 85d73358cc
Remove ctx from LongTermChecker (#7792)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-13 16:50:57 +08:00
bigsheeper 73ab06c628
Decrease unittests execution time in query node (#7791)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-13 16:37:01 +08:00
groot c242b8bb25
Rename unittest for flowgraph (#7794)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:34:26 +08:00
groot 203010524d
Rename unittest for metricsinfo (#7795)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:33:27 +08:00
groot a953c912b2
Add unittest for timeticksync (#7793)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:32:44 +08:00
congqixia e2c15d5b01
[skip ci]Add comment for ClusterStore (#7785)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-13 15:59:55 +08:00
cai.zhang b1805d980c
Reduce running unit test time for indexnode (#7773)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-13 12:00:08 +08:00
cai.zhang 9b0aacd07a
Increase code coverage rate for proxy (#7727)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-13 11:58:11 +08:00
sunby 4c18910acd
Improve log print in rootcoord (#7354)
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-13 11:56:42 +08:00
zhenshan.cao db7fdefcd0
Add unittest for proxy (#7764)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-13 10:56:03 +08:00
Xiaofan 619c4393f3
Refine logs in proxy search path(#7357) (#7753)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-12 17:54:01 +08:00
dragondriver 5a3fc37584
Add test cases for create collection (#7759)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 18:06:02 +08:00
bigsheeper ab7ded2202
Add loader and streaming unittests for query node (#7762)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-11 17:56:01 +08:00
bigsheeper 44bc0af063
Add node and queryCollection unittests for query node (#7719)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-11 17:26:01 +08:00
bigsheeper 3c01839d0d
Add impl and plan unittests for query node (#7712)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-11 17:22:01 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
dragondriver a872a4357c
Add more test cases for proxy implementation (#7685)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 11:36:22 +08:00
yukun 92295b77a1
Add DestroyTopic and DestroyConsumerGroup for CloseRocksMQ (#7730)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 20:54:01 +08:00
xige-16 15a6f30ac4
Add ut for querycoord's impl (#7728)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-10 19:14:01 +08:00
bigsheeper 0e81c62031
Check collection and plan before calling cgo functions (#7733)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-10 18:12:01 +08:00
groot c8f860dcfb
Add unittest for proxy_client_manager (#7729)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 18:10:00 +08:00
yukun d60ea8bc21
Change prefix length to FixedChannelNameLen + 1 (#7717)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 17:42:10 +08:00
bigsheeper cb5cd1cf12
Add index unittests for query node (#7674)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-10 17:11:09 +08:00
groot 020f109dd8
Add unittest for rootcoord util (#7688)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 16:41:48 +08:00
sunby db01040b53
Fix query request lost bug (#7715)
Issue: #7633
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-10 16:34:44 +08:00
XuanYang-cn ce33855652
[skip-ci]Fix datanode comment typo (#7689)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-10 14:46:00 +08:00
Xiangyu Wang 494600c37c
Add unit tests for msg.go (#7691)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-10 14:24:02 +08:00
cai.zhang be9427e8b9
Increase covd coverage for paramtable (#7583)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-10 14:14:12 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-10 13:00:00 +08:00
congqixia d3be316bc2
Add Comment for datacoord cluster (#7676)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-10 11:26:00 +08:00
Xiangyu Wang 6b86a18a7e
Comments unused msg from msg.go (#7686)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-10 11:12:05 +08:00
groot 16a6afa9bd
Fix build version typo (#7639)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 11:10:00 +08:00
yukun 5a303e7672
Fix rocksmq load with prefix (#7678)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 10:22:01 +08:00
yukun 34228eb74b
Add topic lock for DestroyConsumerGroup (#7636)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 10:20:00 +08:00
nameczz a392f1005c
improve CreateCollectionRequest comment in milvus.proto (#7590)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-10 10:06:00 +08:00
bigsheeper 8216478b3d
Add replica and insertNode unittests for query node (#7638)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-10 09:33:43 +08:00
Xiangyu Wang 42aafdc407
Remove unused msg from msg.go (#7612)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-09 19:56:00 +08:00
sunby 49b6c3101d
Remove datacoord useless code (#7673)
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-09 19:08:03 +08:00
Xiangyu Wang 624ea2f676
Add unit tests for msg.go (#7659)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-09 19:03:40 +08:00
dragondriver 596357dc85
Add more data definition test cases (#7623)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 19:02:08 +08:00
Cai Yudong d5f7e358aa
Let dml tolerant physical channels generated by old version (#7644)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-09 18:08:02 +08:00
zwd1208 02d5397c6f
[skip ci] Remove useless commets (#7662)
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-09-09 18:00:19 +08:00
zhenshan.cao 29e5138274
Fix unittest: timeout caused by excessive use of resources (#7653)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-09 17:39:30 +08:00
bigsheeper 1a5e5989c8
Add segment unittests for query node (#7632)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-09 17:36:02 +08:00
groot 314eed2172
Update storage unittest (#7637)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:55 +08:00
congqixia 8e814a2972
Make flowgraph Close only once (#7631)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 17:12:38 +08:00
groot a3666c843f
Add unittest for chunk manager (#7628)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:15 +08:00
cai.zhang f6621dc847
Increase code coverage for indexnode component (#7520)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Co-authored-by: edward.zeng <jie.zeng@zilliz.com>
2021-09-09 17:09:08 +08:00
sunby 06cee85a39
Add data node unit tests (#7622)
Issue: #6357
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-09 16:40:00 +08:00
XuanYang-cn 64aad49959
Add ut in datasync service to 88% (#7615)
See also: #6357

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-09 15:36:01 +08:00
congqixia 69794fd32d
Refactor insertBufferNode and add unit tests (#7621)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 15:00:00 +08:00
groot dbd2a02462
Add unittest for VectorChunkManager (#7610)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 14:34:00 +08:00
zhenshan.cao 89358ad91e
Deep copy rocksdb data to byte slice (#7605)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-09 10:56:00 +08:00
congqixia c96b19a640
Add datacoord metricsinfo unit test (#7595)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 10:16:00 +08:00
XuanYang-cn 762060e670
Add ut for segmentReplica to 100% (#7589)
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-09 10:14:00 +08:00
bigsheeper 5906551f41
Add task unittest for query node (#7599)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-09 10:10:00 +08:00
dragondriver 9b21b3b5fd
Initialize test framework of proxy (#7563)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 10:06:29 +08:00
godchen 3c2821e5e2
Add rmq consumer close (#7596)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-08 21:49:59 +08:00
bigsheeper d3a18a66b5
Add tSafeReplica and task scheduler unittests (#7587)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-08 20:50:00 +08:00
XuanYang-cn 074b610811
Add ut for dmstream_input_node to 100% (#7593)
See also: #6357

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 19:12:00 +08:00
groot 159d3702a0
Rename unittest for indexparamcheck (#7580)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 19:10:03 +08:00
bigsheeper 50c677f72b
Remove useless message and add service time node unittest (#7565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-08 17:10:15 +08:00
Xiangyu Wang 2224099f22
Add unit tests for msg.go (#7577)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-08 16:54:00 +08:00
groot ae3a43cf37
Rename unittest for funcutil (#7581)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 16:53:30 +08:00
groot 618fef0a43
Add unittest for mqclient (#7578)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 16:52:35 +08:00
sunby 79516dacd2
Add log unit tests (#7561)
Issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-08 15:03:59 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482)
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-08 15:00:00 +08:00
cai.zhang e1081b6783
Increase indexcoord component code coverage (#7558)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-08 14:23:59 +08:00
yukun a560aefc36
Fix search result is wrong when the term content in expression is not in order (#7557)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-08 11:49:59 +08:00
congqixia 664aeb09c6
Add ut and comments for datacoord meta (#7560)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-08 11:35:59 +08:00
groot 58700dedbc
Update unittest name of distance (#7537)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 11:28:25 +08:00
yukun fbc352263c
Improve rocksmq client code coverage (#7540)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-08 11:03:59 +08:00
XuanYang-cn 4785e452be
Fix Arrow unable to find Boost error (#7552)
Resolve: #7549

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:59:59 +08:00
sunby bbb6051cdc
Remove time-consuming test (#7551)
issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-08 10:59:52 +08:00
XuanYang-cn a5767e05c6
Add ut for flowgraph_delete_node to 100% (#7550)
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:41:59 +08:00
congqixia 76f5264e79
Fix MqMsgStream Seek logic (#7536)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-07 16:35:59 +08:00
sunby 62f4cb5e1b
Remove stats watcher (#7501)
issue: #7500
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-07 16:11:07 +08:00
sunby 668d10d1da
Add log unit tests (#7524)
issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-07 16:07:58 +08:00
bigsheeper bcccd767ac
Add unittests for querynode (#7510)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-07 15:45:59 +08:00
XuanYang-cn 29756c6ce8
Add ut for flow_graph_dd_node to 100% (#7511)
This PR:
- Change mutex to sync.Map
- Add ut for flow_graph_dd_node.go to 100%

See also: #6357

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-07 15:41:59 +08:00
groot 89815a64d7
Update unittest name of paramtable (#7526)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-07 15:20:40 +08:00
xige-16 468bef4478
Fix dataset's memory leak in knowWhere when search (#7527)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-07 14:25:59 +08:00
congqixia 5b22697ec4
Add segment manager unit tests (#7525)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-07 13:59:58 +08:00
bigsheeper b7103357fd
Load failed if collection beyonds the memory limit (#7434)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-07 11:35:18 +08:00
Cai Yudong d15d3fa0ac
Improve rootcoord codecov (#7518)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-07 11:16:37 +08:00
groot 1401ed516d
Add unittest for flowgraph (#7512) 2021-09-07 09:39:47 +08:00
dragondriver 42b687bf48
Add unittest for task scheduler (#7508)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-06 20:49:04 +08:00
yukun 7025a6e925
Improve rocksmq code coverage (#7483)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-06 19:36:42 +08:00
cai.zhang e6e03fc93f
Add unittest for index component (#7475)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-06 17:54:41 +08:00
congqixia fb4e23bc79
Add datacoord server unit tests (#7499)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-06 17:02:41 +08:00
sunby 5e0d724738
Add log unit tests (#7492)
issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-06 16:50:42 +08:00
Xiangyu Wang 79a0a5482f
Add unit test for mq_factory (#7477)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-06 14:59:21 +08:00
zhenshan.cao 86afde4598
Fix unittest for rootcoord, should filter out timetick msg first (#7490)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-06 11:52:41 +08:00
groot af7b7537f0
Update unittest for calc_distance (#7488) 2021-09-06 11:35:02 +08:00
congqixia 1f590d6c26
Add datacoord services related unit tests (#7467)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-06 11:12:42 +08:00
groot ccfb350bd1
Unittest for funcutil (#7473)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-04 12:13:25 +08:00
Cai Yudong 5a16236768
Improve codecov for paramtable and typeutil (#7471)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-04 10:22:41 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 19:35:47 +08:00
dragondriver 1db573731b
Cache the system information metrics (#7436)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 17:15:26 +08:00
yukun 94272bba87
Support query by expression (#7386)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-03 17:12:55 +08:00
godchen db8067d61c
Add trace ut (#7445)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-03 15:41:25 +08:00
groot 229965a9bb
Unittest for indexparamcheck (#7464)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-03 14:22:17 +08:00
Xiangyu Wang acf4354b83
Add logs in rootcoord (#7457)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-03 14:10:10 +08:00
dragondriver 9b87da1ee8
Fix deadlock of channels time ticker (#7444)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 11:53:29 +08:00
godchen 8b1ae98fa9
Add id allocator ut (#7440)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-03 09:44:10 +08:00
Cai Yudong 7edd96989f
Improve codecov for paramtable and typeutil (#7451)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-02 22:18:10 +08:00
yukun d5d73833b2
Add some logs in rocksmq retention (#7403)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-02 20:04:10 +08:00
congqixia d3027c0d28
Fix possible deadlock (#7428)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-02 14:56:10 +08:00
Cai Yudong bd3056fcbe
Improve tso codecov (#7407)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-01 18:29:59 +08:00
dragondriver 3721cbfea1
Proxy metrics integrates with other coordinators (#7400)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 17:35:00 +08:00
yukun 71aa300499
Fix rocksmq retention panic when delete by message size (#7393)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-01 12:03:58 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 18:35:58 +08:00
godchen 08a31010e9
Change log (#7366)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-31 12:07:58 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 11:45:59 +08:00
sunby 8f660ae4e6
Add log print in proxy (#7369)
issue: #7316
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-31 11:17:59 +08:00
Cai Yudong f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376)
This reverts commit e6de86a433.
2021-08-31 11:07:58 +08:00
dragondriver 5b354313df
Add unittest for timestamp allocator (#7367)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 10:33:58 +08:00
dragondriver 84bddd0a03
Add unittest cases for proxy (#7364)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 10:25:59 +08:00
Cai Yudong e6de86a433
Apply for msgstream from pool when creating collection (#7323)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 09:47:58 +08:00
congqixia 1c88c8b0a5
Clean fmt.Println in util/flowgraph (#7355)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-30 15:29:57 +08:00
congqixia 65f168eac1
Fix datanode corner cases (#7336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-30 10:03:58 +08:00
xige-16 af574d17d5
Fix querycoord panic when stop nil conn of querynoClient (#7346)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-28 12:51:57 +08:00
zhenshan.cao cc99bae250
Add unittest for proxy (#7342)
Fix unittest data race

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-08-28 10:21:57 +08:00
cai.zhang 880aa540e6
Fix bug for expression boundary (#7339)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-28 10:13:57 +08:00
godchen c333af0dcf
Add query node segment filter (#7303)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-28 10:12:00 +08:00
godchen 2dc2cb1a28
Fix collection nil when add query collection (#7311)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-27 17:51:56 +08:00
bigsheeper 14391fe9a2
Release flowgraphs properly (#7266)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-27 17:03:56 +08:00
bigsheeper 1e60cccaf9
Set inMemoryPercentage to 0 when releasing partition (#7310)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-27 16:51:11 +08:00
congqixia 0281bd8d22
Change context to correct package (#7331)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-27 15:37:56 +08:00