milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,997 Commits
133 Branches
115 Tags
559 MiB
Commit Graph

357 Commits (e08dbb16579c59a1a478683958a707a7013fa9ca)

Author SHA1 Message Date
congqixia 38f5b0826f
Add SaveBinlogPaths grpc in dataservice (#5277) 
* Add SaveBinlogPaths grpc in dataservice

* fix merged compile error

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-20 11:34:45 +08:00
yukun a7bb701f73
Add Retrieve method grpc definition (#5294) 
See also: #5253 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-19 10:45:15 +00:00
neza2017 d68ee3fbc2
query base on timeline (#5279) 
query base on timeline, add timestamp on these queries:
- ShowCollections
- HasCollection
- DescribeCollection

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-18 09:12:17 +00:00
Cai Yudong e8ceb37f81
Add ShardsNum when create collection (#5245) 
Updata PhysicalChannelNames and VirtualChannelNames based
on ShardsNum when create collection, and update collVChan2Chan
map.

Resolves: #5240 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-17 11:15:01 +00:00
XuanYang-cn 9151e13480
Remove not using dependence and proto (#5226) 
- FlushMsg proto message is no longer in use

- We don't depend on "github.com/prometheus/common/log"

Signed-off-by: yangxuan xuan.yang@zilliz.com
 2021-05-14 08:50:55 +00:00
dragondriver b7977698a8
Change the codec style of expr plan from text to binary (#5129) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-05-07 11:27:17 +00:00
dragondriver e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118) 
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-05-07 07:20:47 +00:00
FluorineDog 396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096) 
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-04-30 07:19:52 +00:00
FluorineDog 88f5642603
Add plan proto and support basic boolean expr parser (#5088) 
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
 2021-04-29 08:48:06 +00:00
godchen 060f7ca0d2
Add get index build progress proto (#5049) 
Add get index build progress proto.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-27 07:46:45 +00:00
neza2017 262c484cec
the return struct of "DescribeIndex" should contain "filed_name" (#5055) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-04-27 02:30:55 +00:00
Xiangyu Wang 82ccd4cec0
Rename module (#4988) 
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-04-22 14:45:57 +08:00
cai.zhang a54097708d Adjust the DropIndex logic of the indexservice 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-04-16 15:37:13 +08:00
sunby 751c9d4e81 Refactor meta.go 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-04-09 09:55:04 +08:00
xige-16 a48d46cfaf Alter msgID’s type to bytes 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-27 09:46:54 +08:00
zhenshan.cao c2734fa55f Fix bug and enchance system 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-22 16:36:10 +08:00
XuanYang-cn 4c98f4efbf Update binlog meta proto 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-03-20 09:50:42 +08:00
XuanYang-cn 32660d547b Add endPositions in datanode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-03-16 17:55:42 +08:00
godchen f3649f0419 Refactor interface and proto 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-03-12 14:22:09 +08:00
ThreadDao ca916a5c47 Add ci nightly 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2021-03-11 14:14:29 +08:00
xige-16 b2b39f5720 Add field position to watchDmChannelRequest’s porto 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-11 10:08:46 +08:00
xige-16 09ae985daa Fix wrong error code in master_service_test.go 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-10 22:06:22 +08:00
del-zhenwu b1763c3690 Disable xdist in test cases 
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
 2021-03-10 15:27:26 +08:00
neza2017 7b2d67242d Fix describe segment if index not exist 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-03-10 14:45:35 +08:00
quicksilver 455cc59dbb Update publish-test-images.yaml 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-03-09 13:55:35 +08:00
Cai Yudong c795cdbe2a Change minSegmentSizeToEnableIndex default to 1024 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2021-03-07 13:37:25 -06:00
neza2017 014c4fe8ce Add config of minSegmentSizeToEnableIndex 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-03-08 15:46:51 +08:00
sunby aeb3038545 Remove GetCount in data service 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-03-08 10:49:44 +08:00
xige-16 f6a4bacbeb Delete field fieldIDs from ReleaseSegmentRequest’s photo 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-05 20:47:43 +08:00
neza2017 2835bcdc4e Update masterservice unittest 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-03-05 20:41:34 +08:00
dragondriver 801396e3ef Disable register link logic, use proxy node directly 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-03-04 22:27:12 +08:00
xige-16 50a5f97421 Delete componentStateResponse in queryService.proto 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-26 15:26:21 +08:00
neza2017 d5631b09e8 Describe collection by id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-25 16:08:56 +08:00
bigsheeper 08a020798e Release collection and partitions 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-24 17:24:51 +08:00
dragondriver b506754364 Add workflow of drop index in index service 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-02-23 11:57:18 +08:00
neza2017 1d3fdebcf4 Add drop index for proxy 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-20 15:38:44 +08:00
cai.zhang 4c5a898e9a Add masterservice docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-02-20 11:15:19 +08:00
xige-16 f62078c027 Fix crash error when search 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-20 10:14:03 +08:00
neza2017 85c1404393 Refactor master:index ids 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-11 08:41:59 +08:00
neza2017 e2d8358cb4 Refactor master:index ids 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-09 13:11:55 +08:00
neza2017 4035083188 Support Index name 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-08 14:49:12 +08:00
zhenshan.cao faa23fde86 Fix getindexstate failed to fetch indexstate 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-08 14:20:29 +08:00
xige-16 cdcf006690 Fix loadCollection error when query service assign insert channels and query nodes 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-07 09:30:48 +08:00
xige-16 a12b184e02 Add field schema to LoadCollection and LoadPartition photo 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-06 17:37:10 +08:00
dragondriver e0e8e1605e Implement the release-related task and load-related task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-02-04 17:47:19 +08:00
sunby 7270d18c98 Fix timesync startup bugs 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-04 17:31:02 +08:00
xige-16 aaac839075 Joint debug query service success with other components 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-04 17:09:18 +08:00
cai.zhang 55634dc5f3 Add interface of load and release collection and partition 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-02-04 15:31:02 +08:00
zhenshan.cao b89e5a3240 Add GetQuerySegmentInfo 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-04 14:37:12 +08:00
bigsheeper c6c99ef32b Implement getSegmengInfo function 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-04 11:40:14 +08:00
XuanYang-cn 1aafe86ffe Change MsgPosition Logic 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-02-04 11:19:48 +08:00
zhenshan.cao 1b616fb874 Add persistent_segmentinfo 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-03 18:55:00 +08:00
Xiangyu Wang fd9e42d3ed Update msgstream/unmarshal interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-02-03 17:30:10 +08:00
bigsheeper abffdbff62 Remove partition tag 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-03 16:44:38 +08:00
zhenshan.cao b853020ef9 Remove redudent ctx and openTracing logic 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-03 16:34:56 +08:00
bigsheeper 01e9dc8e3f Remove collection name 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-03 11:52:19 +08:00
sunby f3aad3a71c Change SegmentInfo 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-02 18:53:10 +08:00
zhenshan.cao bfa14d40a8 Rename indexID to indexBuildID and add IndexID and IndexName 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-02 19:56:04 +08:00
sunby ca9c2f5c12 Add GetCount and implement GetCollectionStatistics 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-02 14:25:58 +08:00
zhenshan.cao 3afa7dd50d Fix GetSegmentStates 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-02 10:58:39 +08:00
neza2017 5de89422ed Support multi index 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-02 10:09:10 +08:00
zhenshan.cao ee0faddb07 Refactor proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-29 09:27:26 +08:00
neza2017 3a866dab3d Update proto 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-28 17:25:43 +08:00
bigsheeper 68cd15af63 Get index info from master 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-27 14:41:56 +08:00
sunby dbfe68512d Add dbID to data service proto 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-27 10:33:17 +08:00
neza2017 d1b23cb8c5 Add debug info 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-26 19:24:09 +08:00
sunby f632ed0272 Fix data service init 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-26 18:45:12 +08:00
zhenshan.cao e83ac41bca Add component for index 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-26 18:01:32 +08:00
xige-16 7c210310dc Add load function for query service 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-26 15:13:20 +08:00
dragondriver d972b75aaa Add GetTimeTickChannel, GetComponentStates to proxy service 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-26 14:55:57 +08:00
cai.zhang f940cc455a Add dockerfile for index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-26 09:38:40 +08:00
neza2017 1fe099775d Refactor data service 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-25 15:17:17 +08:00
neza2017 e89e89b894 Add main for masterservice 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-25 12:03:44 +08:00
sunby 54fcd486bb Refactor data service. 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-25 13:45:56 +08:00
XuanYang-cn 5d9d35b733 Add Supplementary statistics 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-25 13:36:40 +08:00
XuanYang-cn 9fe672ab86 Enchance datanode interface 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-24 21:20:11 +08:00
neza2017 5aec8bc5e6 Refactor masterservice 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-24 20:26:35 +08:00
bigsheeper 445675a588 Refactor loadSegment request and load strategy 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-24 18:02:08 +08:00
XuanYang-cn b794921b7e Add enum Role in internal.proto 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-23 18:56:08 +08:00
XuanYang-cn 50e2369000 Change name and tag to ID 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 19:36:09 +08:00
bigsheeper 067c30c422 Add sealedSegment cgo unittest, fix growingSegment field id check 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-22 15:41:54 +08:00
xige-16 511aa419fa Refactor query service 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-22 14:28:06 +08:00
neza2017 2d2dbd7d19 Add logic of segment flush complete 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-22 11:06:12 +08:00
dragondriver cd52adc18b Add proxy service to ci workflow 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 12:57:23 +08:00
neza2017 90a0b8b2f5 Update proto 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-22 11:44:02 +08:00
bigsheeper 46a0a6133a Implement distributed api, delete partition states api 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-22 11:17:18 +08:00
sunby ef79b8d8c7 Add client and grpc service 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-22 11:07:07 +08:00
XuanYang-cn 377ee8687d Modify flush logic 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 09:36:40 +08:00
dragondriver eba6bb288c Refactor the sructure of proto file 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 09:36:18 +08:00
neza2017 9828a52999 Add create index 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-21 10:01:29 +08:00
sunby be6775671b Add error returned by Init,Start,Stop functions 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-19 17:38:01 +08:00
cai.zhang 83c60fd84f Update proto about index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-21 15:20:23 +08:00
XuanYang-cn ec27788628 Add segment statistics updates logic for datanode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-21 09:55:25 +08:00
yukun 527c0c49df Add rocksmq unittest with goroutines 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-20 16:46:58 +08:00
BossZou 4588342fa1 Add IdAlocator service 
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
 2021-01-20 15:02:23 +08:00
sunby 2af61fc196 Change ComponentStates in proto 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-20 11:08:04 +08:00
sunby 3602376a10 Rename GetServiceStates to GetComponentStates and reconstruct NodeStates and ServiceStates 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-20 11:02:29 +08:00
zhenshan.cao 2ec573d2f9 Recover delete docs 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-20 09:36:50 +08:00
cai.zhang fb493cc235 Update interface name of GetIndexStates 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-19 18:32:57 +08:00
neza2017 918e279869 Set msg stream 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-19 16:14:13 +08:00
sunby 7e8162a79e Add dd handler 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-19 15:35:40 +08:00
neza2017 d5e53aa28a Add Meta table implementation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-19 14:13:49 +08:00
bigsheeper 2064b014a1 Add loadFieldData, use partition id instead of tag 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-19 14:44:03 +08:00
sunby 76a7684d96 Add data service 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-19 12:10:49 +08:00
XuanYang-cn 6a13386393 Add DataNode package 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-19 11:37:16 +08:00
neza2017 1ce32d8775 Add master service 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-19 09:45:42 +08:00
zhenshan.cao 76d92e73d1 Replace old proto with new proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-18 21:39:56 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-18 19:32:08 +08:00
xige-16 0164e78bb5 Add query service module 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-16 15:31:10 +08:00
XuanYang-cn 37688559f1 Fix multi rowdata writenode crash bug 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-16 15:06:19 +08:00
yukun 44c75bdd2a Add consume function in rocksmq 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-15 20:12:26 +08:00
sunby 67e6ea8051 Add data service 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-15 17:09:41 +08:00
dragondriver e6225a7030 Add service interface to milvus.proto 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-15 16:51:21 +08:00
bigsheeper b98b226d8c Refactor query node and implement channelRemove, channelAdd 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-15 15:28:54 +08:00
godchen 0971cf65b2 Remove opentracing stdlog 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-15 15:28:27 +08:00
quicksilver 7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017 56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
zhenshan.cao 63b21321d6 Refactor indexservice and update doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-15 13:50:27 +08:00
zhenshan.cao 04e2062750 Update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-14 20:30:27 +08:00
yukun 6e36f10a26 Fix rocksdb illegal instruction in some machine 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-14 14:24:14 +08:00
cai.zhang f5ea46b1a3 Simplify proto and fix logic bug of checking vector type 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-07 16:13:28 +08:00
neza2017 4015d7245d Merge operation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-06 14:45:50 +08:00
cai.zhang 1cfc2ff0a5 Add make clean in Makefile 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-06 13:50:48 +08:00
zhenshan.cao b06e01f523 Initmate querynode collection manager 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-06 11:31:36 +08:00
XuanYang-cn 03b5d32569 Add default fields when create collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-04 12:03:29 +08:00
cai.zhang 7a28cfb9e7 Fix bug of sdk : unnecessary is_primary_key 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-04 10:58:51 +08:00
dragondriver e61903ea36 Add query interface for cgo index wrapper 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-04 10:42:51 +08:00
bigsheeper 5b9e8c4f60 Add write node client segment flushing 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-28 15:25:16 +08:00
GuoRentong e8ec0424d8 Update doc: service api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-12-27 09:05:24 +08:00
XuanYang-cn e316533a3a Add Flush Sync service 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-26 16:28:55 +08:00
bigsheeper 5acc9681d6 Fix search error about metric type 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-26 15:29:48 +08:00
XuanYang-cn c0797333ce Add ddl binlog metaTable in writenode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-24 20:55:40 +08:00
neza2017 4dbf4ade41 Add test for master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-24 16:19:42 +08:00
xige-16 f5198bcaee Add LoadIndexService in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-24 14:51:55 +08:00
sunby 5d58606349 Move Status to SegIDAssignment 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-24 10:11:34 +08:00
cai.zhang a8b78f11c3 Update proto about index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-23 19:06:11 +08:00
sunby 0b9cffaf87 Remove index_name in IndexRequest and remove indexType in FieldIndexMeta 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-23 11:34:35 +08:00
sunby 2aa483c922 Add index meta to meta table 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-22 20:16:32 +08:00
cai.zhang 05918f55d2 Impl CreateIndex interface for proxy server 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-22 15:39:10 +08:00
cai.zhang b582cf7b8e Add the interface of index in proto 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-21 19:28:54 +08:00
dragondriver d023c1afba Refactor index wrapper, use protobuf instead of json to pass data 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-21 16:36:07 +08:00
sunby 06620935ab Move expire timestamp to SegIDAssignment 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-21 10:51:37 +08:00
zhenshan.cao 9694203f8b Add writer client and metatable for writer 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-21 10:06:46 +08:00
zhenshan.cao 3f6e926aef Refactor indexbuilder 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-13 06:48:05 +08:00
XuanYang-cn d64aa37db3 Add KFlush msg type 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-11 12:01:20 +08:00
xige-16 0067e2d989 Add load index client in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-11 11:29:54 +08:00
zhenshan.cao fc054874d3 Add index_builder 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-10 17:55:55 +08:00
bigsheeper 762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-10 16:31:09 +08:00
zhenshan.cao 7bbbc14637 Fix bug: address already used 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 15:22:20 +08:00
xige-16 37d7526d31 Fix search test failure 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-07 14:37:42 +08:00
neza2017 aeca8f85a5 Run cwrapper unittest in ci 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 17:39:58 +08:00
cai.zhang 806a97505c Add query node for CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-05 16:12:45 +08:00
FluorineDog 6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 06:46:01 +08:00
zhenshan.cao 0b6fe0a8cf Refactor paramtable 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-04 14:18:17 +08:00
neza2017 cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
zhenshan.cao 23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
neza2017 17cc7bc337 Use MetaRootPath instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-01 17:03:39 +08:00
neza2017 d3858500c6 Add static check 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-30 19:38:23 +08:00
quicksilver 86573d0053 Create Jenkins pipeline 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-30 10:07:04 +08:00
FluorineDog 77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
cai.zhang 85a544b79b Add dockerfile for each component 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 19:06:48 +08:00
cai.zhang 115d0732af Update docker-compose file for unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 16:43:39 +08:00
dragondriver eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 15:57:49 +08:00
godchen 92bf09c7e6 Add ddstream and scheduler implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-28 15:26:39 +08:00
dragondriver 568cef0730 Fix InsertTask and SearchTask 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 10:48:29 +08:00
FluorineDog c9fb34142c Enable primary_key switch 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-28 09:16:00 +08:00
dragondriver 235e723eb6 Read proxy id from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-27 11:17:12 +08:00
XuanYang-cn 3e605ae25f Rename reader to querynode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-27 10:56:53 +08:00
neza2017 32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang 57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
zhenshan.cao 045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn 0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
dragondriver 8ce0deca4e Add default partition tag to InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 11:38:04 +08:00
xige-16 ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-26 11:12:33 +08:00
zhenshan.cao 50d59d91ee Add segmentIDAssigner for proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-19 21:02:31 +08:00
neza2017 c3de667bf5 Implement segment management in master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-18 19:46:18 +08:00
bigsheeper 99ea7e9f05 Update param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-18 19:33:56 +08:00
sunby 9e4ce8454e Implement segment management in master 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-18 15:04:17 +08:00
cai.zhang 0b478b614a Change Id to ID in go files according to golint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-13 15:17:18 +08:00
sunby e541041b28 Add QueryNodeSegStats proto 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-13 14:20:51 +08:00
XuanYang-cn 88cb274644 Refactor master scheduler: drop_collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-13 12:46:24 +08:00
FluorineDog f0ec7a8c78 Support Placeholder Parser and refine CreatePlan on predicate-less 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-12 12:18:07 +08:00
cai.zhang 1cd2fd9954 Add the standard of golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 12:04:12 +08:00
zhenshan.cao 87a4495c59 Fix proxy bug 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-09 17:52:47 +08:00
bigsheeper b441685635 Refactor segment, partition and collection, refactor search and services 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-09 16:27:11 +08:00
bigsheeper 88a3fa31fa Refactor query node and services 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-05 10:52:50 +08:00
zhenshan.cao e9122921b9 Use type alias 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 17:58:43 +08:00
neza2017 d18c17e786 Add Meta table implementation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-04 16:28:14 +08:00
godchen bade037fb2 Add meta_table implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-04 16:01:28 +08:00
zhenshan.cao 2e2e059f8a Add msgheader and change ReqType to MsgType 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 15:13:42 +08:00
zhenshan.cao da18bc4952 Update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 16:38:16 +08:00
zhenshan.cao e962b57fbb Add timestamp allocator 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 14:53:36 +08:00
GuoRentong fbdc5df96f Update docs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-11-03 12:40:13 +08:00
zhenshan.cao 3e596fa474 Update proto and doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-02 16:01:04 +08:00
GuoRentong 15b6963be0 Replace pdf figs with png figs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-31 15:11:47 +08:00
zhenshan.cao 27b9a51938 Add logic of allocate id 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-30 16:27:58 +08:00
GuoRentong f7bd6ebfad Add docs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-29 20:42:47 +08:00
zhenshan.cao 6eee7d1342 Fix bug and update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 19:55:57 +08:00
zhenshan.cao f0cc9c8ad3 Add tso for master and add timestamp 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 09:31:08 +08:00
GuoRentong 1cfc6c7f86 Add docs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-28 10:09:35 +08:00