Commit Graph

6821 Commits (eb557b289b52ce50ae67b12a806df1c133362c8d)

Author SHA1 Message Date
XuanYang-cn eb557b289b
Add docs in package datanode (#5117)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-08 07:24:12 +00:00
Cai Yudong 5f0006d0f9
Improve code coverage for distributed/datanode (#5133)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-08 06:07:04 +00:00
yukun ecaef24fea
Change should_not to must_not in dsl (#5131)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-07 11:52:24 +00:00
FluorineDog b1974aede2
Merge knowhere unittests (#5139)
Re-enable knowhere unittests and merge them all together. 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-07 11:50:13 +00:00
dragondriver b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
godchen 895037889e
Upgrade grpc version from 1.26 to 1.27 (#5128)
Upgrade grpc version from 1.26 to 1.27
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-07 18:30:11 +08:00
zhenshan.cao dab38f6c3d
Change cron job schedule (#5130)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-07 08:56:32 +00:00
Cai Yudong d66a5acca3
improve code coverage for distributed/dataservice (#5123)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
improve code coverage for distributed/dataservice
2021-05-07 07:43:52 +00:00
dragondriver e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
quicksilver eed04f6c0f
Update hadolint to v1 (#5125)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-07 15:07:02 +08:00
xige-16 1e7205fa03
fix querynode's port not set correctly when conflict with other node (#5066)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-07 12:03:53 +08:00
LocoRichard 172f416e8f
Update README.md (#5114)
Signed-off-by: <LocoRichard> <lichen.wang@zilliz.com>
2021-05-06 06:29:45 +00:00
LocoRichard 9a15a4fce5
Update README.md (#5104)
**What type of PR is this?**

- [ ] API-change
- [ ] BUG
- [ ] Improvement
- [x] Documentation
- [ ] Feature
- [ ] Test and CI
- [ ] Code Refactoring

**Which issue(s) this PR fixes:**

Fixes #

**What this PR does / why we need it:**

New readme doc
2021-05-06 02:41:24 +00:00
Xiangyu Wang 220cc30875
Update pull request template (#5103)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-03 11:21:35 +08:00
dragondriver 56dbbfe4cb
Add simple test case to search_with_expression (#5094)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-30 15:56:01 +08:00
FluorineDog 396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096)
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-04-30 07:19:52 +00:00
shengjun.li b46ae44087
Zero size allocation in StackDeviceMemory (#5100)
When the remaining space is empty, the zero size allocation will
get the pointer `end_`. However, `cudafree` the pointer `end_` will
cause to crash.

Fix: #5078 #4770 #4412 #4340 #3646

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-30 04:21:02 +00:00
quicksilver ad1c889824
Upload Milvus images to internal mirror repository when Push triggered (#5092)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

**What type of PR is this?**

- [x] enhancement

**What this PR does / why we need it:**

Upload Milvus images to internal mirror repository when Push triggered
2021-04-29 09:47:44 +00:00
FluorineDog 88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
quicksilver 136cd7a704
Run KinD Inside A Kubernetes Cluster For Continuous Integration (#5085)
**What type of PR is this?**

- [x] Improvement

**Which issue(s) this PR fixes:**

Fixes #5038

**What this PR does / why we need it:**

Run KinD Inside A Kubernetes Cluster For Continuous Integration
2021-04-29 08:45:17 +00:00
bigsheeper 88e1d651cb
Remove partition and segment ids properly in query node (#5090)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

**What type of PR is this?**

- [ ] API-change
- [x] BUG
- [ ] Improvement
- [ ] Documentation
- [ ] Feature
- [ ] Test and CI
- [ ] Code Refactoring

**Which issue(s) this PR fixes:**

Fixes #

**What this PR does / why we need it:**

Not Available
2021-04-29 07:59:08 +00:00
quicksilver 7a188a8ae5
Update openblas images (#5082)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:28:27 +08:00
quicksilver a042090b86
Fix publish pytest image bug (#5084)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:21:35 +08:00
Xiangyu Wang d82f6d2764
[skip ci]Update mergify rules (#5083)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-29 10:39:28 +08:00
Xiangyu Wang 409564909e
[skip ci]Update mergify (#5074)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-29 10:19:41 +08:00
XuanYang-cn cebdfb34f7
Enable multiple datanode (#5068)
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:

While registering, dataservice need to return different insert channels for different datanode.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
godchen 004598f796
Remove field in desc index interface. (#5080)
* remove field in desc index interface

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 09:48:38 +00:00
quicksilver eb338d4620
Provide install dependencies for Ubuntu and CentOS (#5076)
* Provide install dependencies for Ubuntu and CentOS

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update scripts/install_deps.sh

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-28 14:46:18 +08:00
godchen 584051b2bf
Fix trace unavailable on distributed version (#5072)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 11:48:44 +08:00
godchen 94f0966225
Add get index build progress interface implementation (#5067)
Add get index build progress interface implementation.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 03:15:28 +00:00
quicksilver 27af87e4d8
Used for local development or CI in Kubernetes in Docker (#5061)
* Used for local development or CI in Kubernetes in Docker
2021-04-27 19:27:50 +08:00
godchen c64f3a2a52
Fix the version of protobuf in go.mod not consistence with MakeFile (#5047)
Fix the version of protobuf in go.mod not consistence with MakeFile

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-04-27 18:18:04 +08:00
godchen 060f7ca0d2
Add get index build progress proto (#5049)
Add get index build progress proto.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-27 07:46:45 +00:00
shengjun.li a3e4339027
improve rhnsw (#5059)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-27 06:17:52 +00:00
zhenshan.cao 5a89b2668e
Update CODEOWNERS (#5062)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-04-27 12:01:57 +08:00
neza2017 262c484cec
the return struct of "DescribeIndex" should contain "filed_name" (#5055)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-27 02:30:55 +00:00
quicksilver 521f423326
Update milvus builder image version (#5058)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-27 02:11:50 +00:00
Cai Yudong 28f636151c
remove tests/python (#5057)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-26 20:54:54 +08:00
XuanYang-cn 6ad2252f2d
Fix panic bug when server stop with alias (#5054)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-26 12:45:16 +00:00
Cai Yudong 4cec3924cc
rename all singlenode to standalone (#5051)
* rename all singlenode to standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docker image name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix merge conflict

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Rename all singlenode to standalone (#1)

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-26 10:35:57 +00:00
neza2017 d7c0a72611
index name is unique in collection scope (#5046)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-26 15:53:47 +08:00
quicksilver 3b529f3b5d
Update milvus project name (#5032)
* Update milvus project name
2021-04-26 13:59:28 +08:00
Cai Yudong d4e7b4d1a4
remove .env and update docker-compose yml (#5048)
* remove .env and update docker-compose yml
2021-04-26 11:31:23 +08:00
Cai Yudong 74f457bd14
add more testcase to improve code coverage for data service (#5041)
* fix TestChannel run error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* comment validateAllocRequest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add test APIs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-26 01:45:54 +00:00
neza2017 0d68c3f2fd
fix flock, lock the pid file during the processing is running (#5037)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-26 01:28:23 +00:00
Xiangyu Wang 53b5092b3a
[skip ci]Update mergify rules (#5035)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-25 17:38:48 +08:00
bigsheeper 4197b094bf
Use internal dsl and placeholder group (#5033)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-25 06:08:28 +00:00
Cai Yudong 7c14682c89
update docker-compose configuration (#5029)
remove pulsar from docker-compose.standalone.yml
2021-04-25 11:16:07 +08:00
sunby 4d03da9c4f
Remove `SetSegmentState` and seal segment in segment allocator (#4994)
Segment should be sealed once it exceeds the limited size. This operation
should be done in segment allocator. Watcher only check the status to
decide whether the segment will be flushed.

Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-25 01:51:57 +00:00
neza2017 ada58b5bde
add unit test for master's grpc server, the coverage of package "internal/distributed/masterservice" increase from 46.6% to 82.9% (#5019)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-24 09:23:35 +00:00