84c7701126
#2689 Construct Knowhere Index Without Data ( #2704 )
...
* Offset for IVFFlat
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* modify segment reader
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add index_flat_nm
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix compilation issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix segment reader
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Fix issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix hnsw_nm
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix nsg
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* NSG
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix NSG issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* client test
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix index size
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* remove unnecessary things
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix clang format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix compile error
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix compile error
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix compile error
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix compile error
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix issues
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Change data to shared_ptr
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix hnsw and nsg ut
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* clang-format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* not to insert cache immediately
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Fix macro issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-03 11:27:11 +00:00
f0abfa2c6c
Web fix 2690 ( #2691 )
...
* Remove body parser in show partitions endpoints (fix #2690 )
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus output and comments
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus output and comments
Signed-off-by: yhz <413554850@qq.com>
* Remove space line
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus ut
Signed-off-by: yhz <413554850@qq.com>
* laten sleep time in case test_delete_vector_collection_count_no_flush
Signed-off-by: yhz <413554850@qq.com>
2020-07-02 15:34:37 +00:00
a4b2c2b829
(db/snapshots): Integration and Enhancement ( #2673 )
...
* (db/snapshot): integrate stage 1
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): integrate stage 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): integrate stage 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): integrate stage 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): integrate stage 5
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): integrate stage 6
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): integrate stage 7
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add params for some resources
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add field type
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): implement iterate framework for Snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint errors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add SnapshotHandlers
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add SnapshotVistor
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add SizeField for all resource commit
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add SegmentsToSearch collector
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Iterate handler update
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Update IterateHandler
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some hooks for IterateHandler
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Small code refactor
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add const for some snapshot APIs
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add const for some snapshots APIs
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Update create collection
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): merge to new ssdb
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint errors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add test_db in ssdb
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update test_ssdb
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-01 11:45:34 +00:00
cfa5b14e73
add SSDBImpl and ssdb for ut ( #2683 )
...
* rename StatusField to StateField
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix typo
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable GC in OnNoRefCallBack
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SSDBimpl and unittest/ssdb
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-29 10:08:25 +08:00
39c7e8a4e8
(db/snapshot): Add SoftDeleteOperation and related test ( #2647 )
...
* (db/snapshot): add soft delete operation and related test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): more readable error msg in snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix clang format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix clang format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-22 08:35:01 +00:00
5c833ca688
snapshot gc ( #2634 )
...
* opt test_snapshot
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename BaseHolders to ResourceHolder
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename DBBaseResource to BaseResource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* remove ResourceHolder.inl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add GarbageCollector.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* combine ReferenceProxy.cpp into ReferenceProxy.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* reorg Resources.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename GarbageCollector to EventExecutor
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_snapshot
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* opt executor
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-21 02:40:08 +00:00
f1a1ee8678
Snapshot improve ( #2608 )
...
* Format code style
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix bug && Format code style
* Format code style
* Format code style
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update merge config
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-19 23:09:30 +08:00
b3e8856a34
move all APIs in utils into namespace milvus ( #2614 )
...
* move APIs in util into namespace milvus
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* combine BlockingQueue.h and src/utils/BlockingQueue.inl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-19 15:53:36 +08:00
2bc9c0cf25
snapshot code opt ( #2609 )
...
* opt test_snapshot
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename BaseHolders to ResourceHolder
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename DBBaseResource to BaseResource
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* remove ResourceHolder.inl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-19 11:35:25 +08:00
ecc52d365c
(db/snapshot): fix ut errors ( #2605 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-19 10:37:41 +08:00
b6b56a0852
Support IVF_PQ on GPU with using metric_type IP ( #2593 )
...
* Support IVF_PQ on GPU with using metric_type IP
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* remove useless code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-18 08:56:34 +00:00
a12ce5bf6b
(db/snapshot): update ut ( #2588 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-18 01:55:46 +00:00
4ce1e6b2fc
optimize unittest build ( #2589 )
...
* optimize test_storage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize test_metrics
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize test_server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optmize test_server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize test_schedule
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move test_rpc and test_web to db
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-17 17:22:54 +08:00
c131fbe3ae
fix random crash of INSERT_DUPLICATE_ID case ( #2557 )
...
* fix random crash of INSERT_DUPLICATE_ID case
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* cahnge ver
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* sdk readme
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix ut failure
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-17 03:50:19 +00:00
df8e64ea42
Structured index support ( #2573 )
...
* Add ValidateBooleanQuery check
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add test_hybrid_collection cases
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* CreatedStructuredIndex implementation
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add attr_type in DefaultAttrIndexFormat
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add CreateHybridIndex sdk
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix LoadAttr
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Reconstruct CreateStructuredIndex code
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix CreateStructuredIndex bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix merge problems
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* add changelog
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix gpu version compile bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix RpcHandlerTest.HYBRID_TEST bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix test_web bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove hybrid test cases
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-06-17 02:00:39 +00:00
aa31b0c251
(db/snapshot): fix bugs and enhance unit test ( #2562 )
...
* (db/snapshot): add ToString for Snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bugs and enhance CompoundTest1
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in operations
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): some code refactor
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-16 15:05:55 +08:00
b26ce06463
remove secondary path ( #2560 )
...
* config code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* remove slave_paths_ from db options
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update version
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable all db unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update some comments
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update comments
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-15 23:23:10 +08:00
95d970cf62
count up query statistics for debug ease ( #2528 )
...
* clean duplicated code in SearchTask
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update Search interface and add SearchJob::time_stat()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-15 07:13:25 +00:00
9d9a453a5b
Upgrade config ( #2511 )
...
* enable cron test on 0.10.0
Signed-off-by: zw <zw@milvus.io>
* fix merge result
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* import test_during_creating_index_restart
Signed-off-by: zw <zw@milvus.io>
* config cluster
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config general
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config network
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config storage
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config wal
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config cache
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config gpu and metrics
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config logs
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update server_config.template
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update changelog
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config with unit
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix clang-format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update unittests
Signed-off-by: wxyu <xy.wang@zilliz.com>
* disable restart case
Signed-off-by: zw <zw@milvus.io>
* fix gpu compile failed
Signed-off-by: wxyu <xy.wang@zilliz.com>
* Fix lint and comments
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix wal unittest failed
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix some unittests
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update config test cases
Signed-off-by: zw <zw@milvus.io>
* Fix config error
Signed-off-by: yhz <413554850@qq.com>
* remove unused code
Signed-off-by: wxyu <xy.wang@zilliz.com>
* Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* [skip-ci] fix test cases
Signed-off-by: zw <zw@milvus.io>
* fix config storage
Signed-off-by: wxyu <xy.wang@zilliz.com>
* make -j3 on ci
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update python test
Signed-off-by: wxyu <xy.wang@zilliz.com>
* remove unused code
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix ut
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix ut
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update status message
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix set config bug
Signed-off-by: wxyu <xy.wang@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: yhz <413554850@qq.com>
2020-06-15 14:00:09 +08:00
2ee3b60e76
Fix test_hybrid_db and test_rpc error ( #2552 )
...
* Fix test_hybrid_db and test_rpc error
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* CI retry
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* CI retry
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-06-14 23:18:44 +08:00
5727cd139e
(db/snapshot): Fix bugs and more unit test ( #2538 )
...
* (db/snapshot): refactor CompoundBaseOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): some refactor for CompoundOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove one of Operations constructor
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add DropPartition API and related test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bugs for multi threads
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add some print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): some bug fix
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): some bug fix 1
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bugs
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add build worker for unittest
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
(db/snapshot): update ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
(db/snapshot): update ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
(db/snapshot): update ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in ReferenceProxy
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-13 15:46:17 +08:00
c079804b81
Improve ut coverage ( #2516 ) ( #2522 )
...
* Improve ut coverage
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Delete unused code
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add fiu in HybridSearchRequest
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Update helm config
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change BinaryQuery validation check
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* code format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* code format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* code format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-13 15:40:45 +08:00
9fda27ff93
Improve ut coverage ( #2516 ) ( #2517 )
...
* Improve ut coverage (#2516 )
Signed-off-by: yhz <413554850@qq.com>
* Improve ut coverage
Signed-off-by: yhz <413554850@qq.com>
* CI retry
Signed-off-by: yhz <413554850@qq.com>
* Update helm config
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* CI retry
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* CI retry
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-13 14:20:11 +08:00
f6928f7282
Add exception throw on mysql meta error ( #2490 )
...
* Add exception throw on mysql meta error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* [skip ci] update changelog
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix Unit test
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-13 14:12:06 +08:00
4f8c4cacda
fix merge result ( #2463 )
...
* fix merge result
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix tests
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-12 11:18:18 +08:00
f64e4e77f0
#2394 Drop collection timeout if too many partitions created on colle… ( #2477 )
...
* #2349 Drop collection timeout if too many partitions created on collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-12 11:18:09 +08:00
e2b23e9cf2
performance issues ( #2438 )
...
* performance issues
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix bugs
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* preload collection issue
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* uncomment boring log
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* reduce unittest time
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* reduce metric test time cost
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-11 11:53:36 +08:00
166b83a098
Wal lsn issue ( #2412 )
...
* set wal lsn after all mem files serialized
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* return status
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-06-10 15:07:29 +08:00
01cab6f365
#2378 ( #2388 )
...
* return partition lsn
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix wal lsn
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix wal issue
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* all collection include partition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix build error
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix flush
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-10 15:01:01 +08:00
295105ff40
Snapshot code update ( #2497 )
...
* (db/snapshot): Add LSN in Resource
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add AddStepWithLsn
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add Lsn related logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add operator << for Operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint errors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add more test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): operation rollback api placeholder
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove hard code status code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): support more printable dump for some operations
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add ToString for Context
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): more friendly context print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): rename some apis
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-06 05:03:02 +00:00
530ee76a76
(db/snapshot): Add new features for Snapshot Impl ( #2483 )
...
* (db/snapshot): Add new features for Snapshot Impl
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update changelog
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Small changes to remove some dummy code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Small changes to remove some dummy code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-03 03:55:40 +00:00
9b2fd331fc
Add CreateCollection and DropCollection for Snapshot ( #2454 )
...
* (db/snapshot): add merge opration test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add UpdatedOnField
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add Utils.h
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor Snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 5
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 6
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add CreateCollectionOperation and related test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): changes for code style and clang format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): improve ut coverage 1
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): improve ut coverage 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): improve ut coverage 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add soft delete collection operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update drop collection 1
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update drop collection 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update drop collection 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update drop collection 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-06-01 06:36:56 +00:00
2fe4cc10de
Snapshot code optimization 1 ( #2440 )
...
* (db/snapshot): add merge opration test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add UpdatedOnField
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add Utils.h
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor Snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 5
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor snapshot 6
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-05-28 02:25:14 +00:00
2264aab084
Add new hybrid search api ( #2445 )
...
* Add json-string-dsl hybrid search api
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add C++ sdk for json-string-dsl hybrid search
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add C++ examples for new hybrid search api
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add unittest for new hybrid search api
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-28 02:01:28 +00:00
96166e1a5b
Metadata Snapshot Implementation Phase I ( #2414 )
...
* (db/snapshot): migrate code from milvus_metatdata_design repo
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add license info
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add namespace snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add test_snapshot unit test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add ScopedResourceTest
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): refactor
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add ResourceHodlersTest
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update ResourceHodlersTest
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add Operation Test and fix some bug
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Update Operation Test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Update Operation Test to test build
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add Reset API for static instance
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix snapshot bug
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix dead lock bug
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix bug in concurrent mode
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix lint error in ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix lint error in snapshot 1
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix lint error in snapshot 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix lint error in snapshot 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix lint error in snapshot 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix lint error in snapshot 5
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-05-25 10:50:34 +08:00
110d4d066a
TargetEntry implementation ( #2391 )
...
* Add GetEntitiesByID in DBImpl
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add operator overload functions in ConcurrentBitset
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add GetEntityByID interface
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change format of Attributes
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change hybrid search for new rules
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix C++ sdk for new format of hybrid interfaces
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix compile bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix GetEntityByID
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix unittest bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix WebControllerTest:test_hybrid bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix field names bug in HybridSearch
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HYBRID_SEARCH_TEST caused by const auto&
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add ConvertRowToColumnJson in WebRequestHandler
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Return target entry in WebServer
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change ValidateBinaryQuery
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add GetEntityByID in WebServer
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* [skip ci]Removed unused code in C++ sdk
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-23 14:25:24 +08:00
5e777450b3
fix #2264 ( #2323 )
...
* fix #2264
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-13 21:01:50 +08:00
5293607359
Caiyd support disable sptag ( #2308 )
...
* remove KNOWHERE_GPU_VERSION
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add MILVUS_SUPPORT_SPTAG
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix SPTAG build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-13 16:52:48 +08:00
fb49e580c5
rewrite HasPartition ( #2289 )
...
* rewrite HasPartition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* miss file
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* use layered merge
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* sdk HasPartition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* rename sdk api
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: groot <yihua.mo@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 09:27:58 +08:00
1516d71a55
Add attributes to mysql and wal ( #2229 )
...
* Add hybrid operation into mysql
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add Hybrid into wal
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add unittest for hybrid wal
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix wal unittest bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix hybrid_insert unittest bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix codacy/PR quality
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change test_rpc port to 19531
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-07 06:14:58 +00:00
ac8e9ff020
write error ( #2184 )
...
* write error
Signed-off-by: groot <yihua.mo@zilliz.com>
* out of storage
Signed-off-by: groot <yihua.mo@zilliz.com>
* clang format
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix #1955
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* compact threashold
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* search by id for hnsw/pq/annoy
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-06 16:52:37 +08:00
ebb01aa9b2
Fix failed to open file ( #2138 )
...
* file reference
Signed-off-by: groot <yihua.mo@zilliz.com>
* print info
Signed-off-by: groot <yihua.mo@zilliz.com>
* avoid metric crash
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* refine code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* apply delete bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* has partition check
Signed-off-by: groot <yihua.mo@zilliz.com>
* duplicate id search
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-28 21:10:01 +08:00
7ecafbd93a
rename the variable name collection_schema ( #2126 )
...
Signed-off-by: DanielHuang1983 <huanghe888@hotmail.com>
2020-04-26 08:03:52 +00:00
777c36a0ac
#1997 index file missed after compact ( #2108 )
...
* #1997 index file missed after compact
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-25 22:06:26 +08:00
82f4c289eb
New api HasPartition, SearchByID, GetVectorsByID ( #2056 )
...
* modify proto
Signed-off-by: groot <yihua.mo@zilliz.com>
* modify c sdk
Signed-off-by: groot <yihua.mo@zilliz.com>
* rewrite search by id
Signed-off-by: groot <yihua.mo@zilliz.com>
* change cases
Signed-off-by: zw <zw@zilliz.com>
* fix cases
Signed-off-by: zw <zw@zilliz.com>
* fix wal case
Signed-off-by: zw <zw@zilliz.com>
* fix search by id
Signed-off-by: groot <yihua.mo@zilliz.com>
* modify sdk
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* add search_by_ids case
Signed-off-by: zw <zw@zilliz.com>
* disable test_search)by_ids
Signed-off-by: zw <zw@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
2020-04-25 14:49:32 +08:00
ff9697b184
Change input format for attributes ( #1990 )
...
* Change input of attributes
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix unittest for new attrs format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix float type for new format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Use new HEntity
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add sdk_hybrid
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add metric_type assign in CreateHybridCollection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix for clang-format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Read engine_type from extra_params
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove todo annotation
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove some comments
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add DescribeHybridCollection request
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove unused code
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-22 06:12:46 +00:00
ba191b263a
rename table_schema_array ( #2024 )
...
Signed-off-by: HesterG <hestergong@gmail.com>
2020-04-22 12:01:01 +08:00
68f7a0fa77
rename table_schema to collection_schema ( #2023 )
...
Signed-off-by: HesterG <hestergong@gmail.com>
2020-04-22 10:02:19 +08:00
e8f759c22b
code optimize ( #1986 )
...
Signed-off-by: bigbraver <bigbraver@qq.com>
2020-04-19 03:54:23 +00:00
3e1b2ab4a0
Filtering by numeric scalar fields prototype ( #1919 )
...
* Add hybrid request handler
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add C++ sdk for createcollection and insertentities
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add RequestHandler
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add test case for hybrid insert
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix sqlite bug for createcollection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridQuery Handler DBImpl and ExecBinaryQuery
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridSearch sdk
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridSearch test case
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HybridSearch bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HybridSearch crash bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change void* to vector<uint8_t> in Attr codec
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add context and new search task
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add merge for Hybrid
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add AST validation
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add unittest for hybrid
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix hybrid search nq bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix bugs after merge master
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix clang format
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix unittest bugs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix Codacy
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix compact unittest bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove grpc request in hybridsearchcontext
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix some codacy quality issue
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix HYBRID_DB_TEST bug
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Annotate new search task
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add Hybrid RPC handler unittest
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix logs
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Add HybridSearch unittest
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-16 14:54:12 +08:00
Xiaohai Xu
BossZou
XuPeng-SH
Cai Yudong
Jin Hai
shengjun.li
groot
yukun
Wang XiangYu
DanielHuang1983
HesterG
bigbraver