63843dce33
fix: Fix conan gdal building problem ( #37338 )
...
issue:https://github.com/milvus-io/milvus/issues/27576
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-10-31 21:04:16 +08:00
67c4340565
feat: Geospatial Data Type and GIS Function Support for milvus server ( #35990 )
...
issue:https://github.com/milvus-io/milvus/issues/27576
# Main Goals
1. Create and describe collections with geospatial fields, enabling both
client and server to recognize and process geo fields.
2. Insert geospatial data as payload values in the insert binlog, and
print the values for verification.
3. Load segments containing geospatial data into memory.
4. Ensure query outputs can display geospatial data.
5. Support filtering on GIS functions for geospatial columns.
# Solution
1. **Add Type**: Modify the Milvus core by adding a Geospatial type in
both the C++ and Go code layers, defining the Geospatial data structure
and the corresponding interfaces.
2. **Dependency Libraries**: Introduce necessary geospatial data
processing libraries. In the C++ source code, use Conan package
management to include the GDAL library. In the Go source code, add the
go-geom library to the go.mod file.
3. **Protocol Interface**: Revise the Milvus protocol to provide
mechanisms for Geospatial message serialization and deserialization.
4. **Data Pipeline**: Facilitate interaction between the client and
proxy using the WKT format for geospatial data. The proxy will convert
all data into WKB format for downstream processing, providing column
data interfaces, segment encapsulation, segment loading, payload
writing, and cache block management.
5. **Query Operators**: Implement simple display and support for filter
queries. Initially, focus on filtering based on spatial relationships
for a single column of geospatial literal values, providing parsing and
execution for query expressions.
6. **Client Modification**: Enable the client to handle user input for
geospatial data and facilitate end-to-end testing.Check the modification
in pymilvus.
---------
Signed-off-by: tasty-gumi <1021989072@qq.com>
2024-10-31 20:58:20 +08:00
3107701fe8
enhance: optimize retrieve on dynamic field ( #35580 )
...
#35514
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-08-22 14:24:56 +08:00
e1d725b938
fix: rollback grpc to 1.50.1 ( #35385 )
...
issue: #35298
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
2024-08-09 14:08:17 +08:00
7420115b5e
enhance: pinpoint revision of 3thirdparty package ( #35325 )
...
issue: https://github.com/milvus-io/milvus/issues/35340
---------
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-08 09:46:22 +08:00
1d5bf34e38
fix: init telemetry fails when set otlp as trace exporter ( #35301 )
...
issue: #35298
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
2024-08-07 14:20:21 +08:00
e83ecd5074
enhance: fix not find arrow::parquet lib ( #33928 )
...
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
2024-06-18 00:22:01 +08:00
d669fbcf46
enhance: support bitmap index for scalar type ( #32902 )
...
#32900
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-05-19 21:49:38 +08:00
cb1dbf20c7
enhance:remove openblas from conan ( #32002 )
...
issue: #30683
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
2024-04-28 20:13:25 +08:00
29922829da
fix: [restful v2] parameters of create collection ( #32485 )
...
issue: #31176
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-04-24 09:43:29 +08:00
e2541f04eb
fix: crash on arm64 ( #31951 ) ( #31980 )
...
issue: #31953
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
2024-04-17 18:03:20 +08:00
0d849a6c0a
fix: fix collectionInfo leak in datacoord ( #32175 )
...
issue: #32029
lack of logic to clean collection info in datacoord's meta, This PR
clean collection info after drop channel, to avoid collection info leak
in datacoord
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-04-15 16:33:19 +08:00
038c570ef3
enhance: upgrade folly to run on arm ( #31284 )
...
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2024-03-15 15:39:03 +08:00
600f6eff06
enhance: Upgrade gtest to 1.13.0 ( #29805 )
...
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2024-01-10 13:16:57 +08:00
a602171d06
enhance: Refactor runtime and expr framework ( #28166 )
...
#28165
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-12-18 12:04:42 +08:00
9d54d6f590
fix: change Abseil to shared library to solve macos compilation issue ( #28986 )
...
fix the compilation error on macos 14.0 with x86 arch processor
related to #28985
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2023-12-11 21:54:37 +08:00
36f69ea031
feat: integrate storagev2 in building index of segcore ( #28768 )
...
issue: https://github.com/milvus-io/milvus/issues/28655
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2023-12-05 16:48:54 +08:00
c8b1a4618a
enhance: Resolve libunwind requirement conflict using 1.7.2 ( #28929 )
...
Try to resolve libunwind dependency requirement conflict between glog &
folly
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-12-04 14:06:40 +08:00
7206795e91
fix: update folly to resolve simd issue ( #28878 )
...
related #27552 , after this, milvus could run successfully on sse4.2
only machine
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-12-01 13:50:32 +08:00
cc713931e9
fix: Fix rocksdb compile failed ( #28484 )
...
Fix : #27675
/kind improvement
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-16 16:36:19 +08:00
8ae9c947ae
Use OpenDAL to access object store ( #25642 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 09:00:14 +08:00
4faba61647
Upgrade conan to 1.61.0 ( #27870 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
8d3069b1db
update openssl to 3.1.2 ( #27399 )
...
deal with root path's normalization
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-08 19:17:31 +08:00
dc88ef0399
Fix failure while connect kafka with SASL_SSL ( #26617 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-08-29 13:58:25 +08:00
bc6b376c13
Fix arrow compile error ( #26626 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-28 18:04:26 +08:00
533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image ( #26368 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
d2649b63db
Delete the user-role mapping info when deleting the user ( #25988 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-08-04 18:37:08 +08:00
f97d5a7d08
Fix compile failed with llvm16 ( #26112 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-03 17:29:07 +08:00
833674c1cb
add glog configurable function and redirect aws log to segcore log ( #25664 )
...
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-07-27 19:49:02 +08:00
e0064a7bdc
Add zstd support for librdkafka ( #25792 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-21 13:21:00 +08:00
e418ab2f49
fix folly compile error on amazon linux ( #25546 )
...
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2023-07-19 21:46:58 +08:00
4aed32ff61
Use librdkafka for all platform ( #25538 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-13 15:34:33 +08:00
aaac1e27d1
Fix aws-c-event-stream not found ( #25437 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-10 14:04:31 +08:00
de78fe719d
Fix aws-c-http missing ( #25055 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-21 15:58:42 +08:00
af1d84e5e1
Support sync when cp is lagged ( #24989 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-06-20 10:00:41 +08:00
4d8d34e370
Refine Rocksdb option ( #24394 ) ( #24503 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-06-15 15:12:39 +08:00
e538540d0d
Fix aws-c-io not found ( #24777 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-10 19:08:35 +08:00
6b1712e07d
Fix aws-c-cal lib missing ( #24610 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-02 14:56:32 +08:00
0fe8342648
Support google cloud for C++ chunk manager ( #21100 ) ( #24418 )
...
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-05-29 01:05:28 +08:00
eed5f87901
update lib arrow ( #24397 )
...
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2023-05-26 09:41:27 +08:00
152acb3a76
fix fmt lib conflict when compile with raft suppport ( #24266 )
...
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2023-05-24 13:05:26 +08:00
8bfb42827e
Fix aws-c-sdkutils ( #24085 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-05-13 13:47:20 +08:00
2969c80c6c
Change aws-c-compression version ( #24006 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-05-10 15:55:19 +08:00
6415ee8cd9
Use boost 1.79 to avoid queue memory leak ( #23977 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-05-10 10:01:19 +08:00
e172f3e8dc
Fix dependency conflict ( #23847 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-05-04 19:46:38 +08:00
288582b2d9
Optimize mac build time ( #23390 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-14 17:56:29 +08:00
4d2e379b09
Add prometheus-cpp ( #23199 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-03 19:22:23 +08:00
ef57ba3bac
Remove easylogging and replace by GLog ( #22979 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-27 18:22:02 +08:00
fd974df09f
OTEL integration in cpp ( #22175 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-21 16:31:57 +08:00
ac6e879811
[skip e2e] fix etcd image for healthcheck ( #22294 )
...
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-20 17:08:25 +08:00
zhenshan.cao
Hao Tan
zhagnlu
Patrick Weizhi Xu
yellow-shine
presburger
PowderLi
wei liu
Gao
Cai Yudong
Xiaofan
Bingyi Sun
congqixia
Enwei Jiao
jaime
SimFG
aoiasd
Bennu