milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
milvus/internal/storage
History
wei liu 5038036ece
enhance: Reuse hash locations during access bloom fitler (#32642) 
issue: #32530 

when try to match segment bloom filter with pk, we can reuse the hash
locations. This PR maintain the max hash Func, and compute hash location
once for all segment, reuse hash location can speed up bf access

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 		2024-05-07 06:13:47 -07:00
..
aliyun Identify service providers based on addresses (#27907) 2023-10-25 17:28:10 +08:00
gcp Format the code (#27275) 2023-09-21 09:45:27 +08:00
tencent feat: Support tencent cloud object storage for milvus (#30163) 2024-01-23 11:28:56 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
azure_object_storage.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
azure_object_storage_test.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
binlog_iterator.go enhance: Enable binlog deserialize reader in datanode compaction (#31036) 2024-03-08 18:25:02 +08:00
binlog_iterator_test.go enhance: add helpers to parse sparse float vector in JSON (#32543) 2024-04-25 14:47:24 +08:00
binlog_reader.go Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
binlog_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
binlog_util.go Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
binlog_util_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
binlog_writer.go enhance: Unify data type check APIs for go (#31887) 2024-04-07 14:27:22 +08:00
binlog_writer_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
data_codec.go feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
data_codec_test.go enhance: add helpers to parse sparse float vector in JSON (#32543) 2024-04-25 14:47:24 +08:00
data_sorter.go feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
data_sorter_test.go enhance: add helpers to parse sparse float vector in JSON (#32543) 2024-04-25 14:47:24 +08:00
event_data.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
event_header.go Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
event_reader.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
event_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
event_writer.go enhance: Unify data type check APIs for go (#31887) 2024-04-07 14:27:22 +08:00
event_writer_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
factory.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
field_stats.go feat: Define FieldValue, FieldStats and PartitionStats (#30286) 2024-03-06 20:42:37 -08:00
field_stats_test.go feat: Define FieldValue, FieldStats and PartitionStats (#30286) 2024-03-06 20:42:37 -08:00
field_value.go feat: Define FieldValue, FieldStats and PartitionStats (#30286) 2024-03-06 20:42:37 -08:00
field_value_test.go feat: Define FieldValue, FieldStats and PartitionStats (#30286) 2024-03-06 20:42:37 -08:00
index_data_codec.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
index_data_codec_test.go Check error by Error() and NoError() for better report message (#24736) 2023-06-08 15:36:36 +08:00
insert_data.go feat: Support sparse float vector bulk insert for binlog/json/parquet (#32649) 2024-05-07 18:43:30 +08:00
insert_data_test.go feat: Support sparse float vector bulk insert for binlog/json/parquet (#32649) 2024-05-07 18:43:30 +08:00
local_chunk_manager.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
local_chunk_manager_test.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
minio_object_storage.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
minio_object_storage_test.go fix: Removed minio bucket after use in test (#32624) 2024-04-28 13:51:26 +08:00
options.go enhance: Support MinIO TLS connection (#31311) 2024-03-21 11:15:20 +08:00
partition_stats.go feat: support segment pruner (#31003) 2024-03-22 13:57:06 +08:00
partition_stats_test.go feat: Define FieldValue, FieldStats and PartitionStats (#30286) 2024-03-06 20:42:37 -08:00
payload.go feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
payload_reader.go enhance: Unify data type check APIs for go (#31887) 2024-04-07 14:27:22 +08:00
payload_reader_test.go Update arrow version to v12 (#28425) 2023-11-15 10:36:19 +08:00
payload_test.go enhance: add helpers to parse sparse float vector in JSON (#32543) 2024-04-25 14:47:24 +08:00
payload_writer.go enhance: add type info for payload writer error message and add log when querynode find new collection (#32522) 2024-05-07 14:45:29 +08:00
payload_writer_test.go enhance: add type info for payload writer error message and add log when querynode find new collection (#32522) 2024-05-07 14:45:29 +08:00
pk_statistics.go enhance: Reuse hash locations during access bloom fitler (#32642) 2024-05-07 06:13:47 -07:00
primary_key.go fix: delegator filter out all partition's delete msg when loading segment (#31585) 2024-04-09 15:21:24 +08:00
primary_key_test.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
primary_keys.go enhance: Add PrimaryKeys interface to reduce memory usage (#30405) 2024-02-01 09:57:11 +08:00
primary_keys_test.go enhance: Add PrimaryKeys interface to reduce memory usage (#30405) 2024-02-01 09:57:11 +08:00
print_binlog.go fix: fix fp16/bf16 some code missing and add more fp16/bf16 test (#31612) 2024-03-28 14:11:10 +08:00
print_binlog_test.go fix: fix fp16/bf16 some code missing and add more fp16/bf16 test (#31612) 2024-03-28 14:11:10 +08:00
remote_chunk_manager.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
remote_chunk_manager_test.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
serde.go feat: adding binlog streaming writer (#31537) 2024-04-11 10:33:20 +08:00
serde_test.go feat: adding binlog streaming writer (#31537) 2024-04-11 10:33:20 +08:00
stats.go feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
stats_test.go Add retry time when lazy load BF (#25096) 2023-06-25 11:32:43 +08:00
storage_test.go enhance: Remove vector chunk manager (#28569) 2023-11-30 18:00:33 +08:00
types.go enhance: use WalkWithPrefix api for oss, enable piplined file gc (#31740) 2024-04-25 20:41:27 +08:00
unsafe.go [skip e2e]Update license for storage unsafe (#14452) 2021-12-28 20:03:56 +08:00
unsafe_test.go [skip e2e]Update license for storage unsafe (#14452) 2021-12-28 20:03:56 +08:00
utils.go fix: fix fp16/bf16 some code missing and add more fp16/bf16 test (#31612) 2024-03-28 14:11:10 +08:00
utils_test.go enhance: add helpers to parse sparse float vector in JSON (#32543) 2024-04-25 14:47:24 +08:00