5f0f840782
Remove datanode client code ( #5427 )
...
Remove datanode client code.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:41:37 +00:00
a3fb1356de
Fix rocksmq seek error ( #5432 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to
notify the consumer to consume.
2021-05-26 09:31:09 +00:00
e021f5e670
Support to use json to construct dummy request ( #5430 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-26 08:57:32 +00:00
5feb9ae9c4
Add cases for invalid DataFrame data and binary collection ( #5426 )
...
- test invalid DataFrame data
- test binary create and data
- add test_insert
Cover: #5404 #5405 #5407 #5414 #5421
Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-26 08:10:57 +00:00
200801271d
Fix GetSession error ( #5401 )
...
Fix GetSession error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 12:15:46 +00:00
6766169878
Refactor repack logic for insertion ( #5399 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
1c49ddc86a
Add test cases for Index in sdk-orm ( #5410 )
...
Signed-off-by: zw <zw@milvus.io>
2021-05-25 11:09:31 +00:00
17cabfbed3
Add datanode client retry ( #5394 )
...
Add datanode client retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
c28c34e852
let master use session.ServerID as nodeID ( #5385 )
...
let master use session.ServerID as nodeID
also see #5386
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
88b42304ef
Add dummy RPC ( #5376 )
...
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last.
At this time, this is helpful for debugging.
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
dab536a6cf
Rename some field names in master for better code readability ( #5389 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
4058350e30
update AddIndex not return error when fail ( #5372 )
...
Resolves : #5332
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
4caf3051dd
Update the version of pymilvus to 2.0a1.dev2 ( #5388 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-25 02:32:48 +00:00
49443e8a33
Add retrieve taskscheduler implementation ( #5353 )
...
See also: #5257
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-24 10:19:43 +00:00
bfc057d56d
Change pymilvus-distributed to pymilvus ( #5369 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-24 18:14:57 +08:00
6da1c66357
Add test cases for collection primary and data ( #5371 )
...
1. update case for collection desc
2. test collection with primary
3. test collection with data
See also: #5345 #5349 #5350 #5367
Signed-off-by:ThreadDao yufen.zong@zilliz.com
2021-05-24 09:44:56 +00:00
042a061123
Fix session util error ( #5370 )
...
Fix session util error.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 08:31:06 +00:00
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream ( #5364 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
b688cc5f51
Improve IVF query on GPU when no entity deleted ( #5359 )
...
Not to call getListIndex() if bitset is empty.
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-24 07:38:56 +00:00
39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex ( #5358 )
...
Resolves : #5332
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-24 06:19:52 +00:00
3f42a9ed12
reduce unittest time ( #5363 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00
dd736ee8ba
Change session doc ( #5355 )
...
Change session doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 03:53:07 +00:00
4e1b12269b
Fix bug: rand.Seed reset and generate duplicate number ( #5361 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 02:50:37 +00:00
457e964e41
Add channelsTimeTicker to proxy ( #5339 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-24 01:49:28 +00:00
e326eaad1e
master client,reconnect if grpc failed ( #5360 )
...
master client,reconnect if grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
d189bf4d33
Change pulsar version ( #5352 )
...
Change pulsar version.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
6204e4546a
Update devcontainer.sh ( #5351 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-22 01:20:41 +00:00
7d49096e8c
Add prometheus metrics ( #5342 )
...
Add prometheus metrics for components
Resolves : #5325
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-05-21 13:48:04 +00:00
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair ( #5348 )
...
Dataservice use lastest grpc design and saves ddl/dml pos pair
* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)
See also #5220
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 11:38:58 +00:00
0eee7e5252
Change session ( #5329 )
...
Change session.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
1bc1fad81d
Add DataNode scales flowgraph design docs ( #5346 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-21 11:15:58 +00:00
02f2348500
Save segment allocation status to meta ( #5184 )
...
To ensure segments being flushed correctly, we need to load
the segment allocation status from meta after starting the service.
2021-05-21 10:30:41 +00:00
7a82462da8
DataService publishes flush-completed message into its channel ( #5320 )
...
DataService publishes flush-completed message into related msgstream
See also: #5220
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:54:29 +00:00
156d5b9f73
Add RetrieveTask PostExecute function ( #5336 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
See also: #5257
2021-05-21 08:39:28 +00:00
46790d9c68
Fix issue 5333 uninitialized return value ( #5338 )
...
Fix uninitialized named value `meta` caused crash
Resolves #5333
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:21:08 +00:00
761350e44d
Refactor timetick msg handling between proxy node and master ( #5321 )
...
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.
Resolves : #5276
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-21 08:08:12 +00:00
04eb594d5e
test collection with fields ( #5334 )
...
- test collection with fields
- test collection dup drop
Resolves : #5312 #5317 #5331
Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-21 07:58:22 +00:00
7c5b1ae5ca
Add todo list to dataservice desgin doc ( #5341 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 07:57:15 +00:00
c1efa53779
Remove redundant fields in SegmentInfo and related structure ( #5280 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00
70241a8bf9
Cancel local timestamp caching logic ( #5327 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-21 05:11:21 +00:00
ac0b878531
Update describe_index in python tests ( #5328 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 02:12:52 +00:00
f6ab3c81df
Add channelsMgr to proxy ( #5323 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-21 01:52:20 +00:00
23c4de0eb8
Flush statistics for all int64 fields ( #5318 )
...
Resolves : #5262
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-20 10:38:45 +00:00
913712fbea
Improve session manager ( #5310 )
...
Improve session manager.
Issue #5174
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-20 07:07:25 +00:00
f18dfb4ff6
Add RetrieveTask implementation ( #5313 )
...
Resolves : #5257
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-20 07:02:31 +00:00
c0daf8e41d
set timestamp on dd requests ( #5298 )
...
- set dd request's time tick on master
- send time tick into dd channel
See also: #5291
Signed-off-by: yefu.chen yefu.chen@zilliz.com
2021-05-20 06:14:14 +00:00
38f5b0826f
Add SaveBinlogPaths grpc in dataservice ( #5277 )
...
* Add SaveBinlogPaths grpc in dataservice
* fix merged compile error
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-20 11:34:45 +08:00
613cf21950
add cases for collection with data ( #5305 )
...
- add cases for collection with data
- cancel import *
See also: #5302 #5304
Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-20 03:03:45 +00:00
1c779f3efd
Refactor ddl binlog flush ( #5303 )
...
DDL won't auto-flush now
See also: #5289 , #5220
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-19 11:42:07 +00:00
a7bb701f73
Add Retrieve method grpc definition ( #5294 )
...
See also: #5253
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-19 10:45:15 +00:00
godchen
yukun
Xiangyu Wang
ThreadDao
zhenshan.cao
del-zhenwu
neza2017
Cai Yudong
dragondriver
shengjun.li
FluorineDog
quicksilver
zwd1208
congqixia
XuanYang-cn
sunby