milvus/internal/util
wei liu 46dfe260da
enhance: Add timestamp filtering support to L0Reader (#43747)
issue: #43745
Add timestamp filtering capability to L0Reader to match the
functionality available in the regular Reader. This enhancement allows
filtering delete records based on timestamp range during L0 import
operations.

Changes include:
- Add tsStart and tsEnd fields to l0Reader struct for timestamp
filtering
- Modify NewL0Reader function signature to accept tsStart and tsEnd
parameters
- Implement timestamp filtering logic in Read method to skip records
outside the specified range
- Update L0ImportTask and L0PreImportTask to parse timestamp parameters
from request options and pass them to NewL0Reader
- Add comprehensive test case TestL0Reader_ReadWithTsFilter to verify ts
filtering functionality using mockey framework

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-08-06 16:49:39 +08:00
..
analyzecgowrapper enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
bloomfilter enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
cgo enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
cgoconverter enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
clustering enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
componentutil enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
credentials enhance: Add search post pipeline (#43065) 2025-07-21 11:10:52 +08:00
ctokenizer enhance: support set lindera dict build dir and download url in yaml (#43541) 2025-08-04 09:47:38 +08:00
dependency enhance: remove support of embeded nats mq (#41565) 2025-04-28 23:06:49 +08:00
exprutil fix: OR binary expr is prunable only when both children are prunable (#42912) 2025-06-24 09:38:24 +08:00
flowgraph fix: flow graph should free function resource after all node close (#42731) 2025-06-13 22:14:37 +08:00
function fix: Fix weighted rerank (#43503) 2025-07-23 14:54:53 +08:00
funcutil fix: Update logging context and upgrade dependencies (#41318) 2025-04-23 10:52:38 +08:00
grpcclient fix: Update logging context and upgrade dependencies (#41318) 2025-04-23 10:52:38 +08:00
hookutil feat: [CMEK] Add utils to load plugins (#42986) 2025-07-29 17:17:36 +08:00
idalloc fix: Update logging context and upgrade dependencies (#41318) 2025-04-23 10:52:38 +08:00
importutilv2 enhance: Add timestamp filtering support to L0Reader (#43747) 2025-08-06 16:49:39 +08:00
indexcgowrapper enhance: enable stlsort with mmap support (#43359) 2025-07-28 15:32:55 +08:00
indexparamcheck feat: support json for ngram (#43170) 2025-07-25 10:28:54 +08:00
initcore feat: Supports tracing services that require header-based authentication. (#43211) 2025-07-10 17:32:48 +08:00
metrics fix: Fix ineffective log level setting in ThreadWatcher (#41886) 2025-05-20 21:22:24 +08:00
mock enhance: Check loaded segments before gc (#42639) 2025-06-13 17:44:38 +08:00
nullutil enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
pipeline fix: pipeline/delegator leak (#42582) 2025-06-06 22:00:32 +08:00
proxyutil fix: Update logging context and upgrade dependencies (#41318) 2025-04-23 10:52:38 +08:00
quota feat: add DDLDB rate type and related quota configurations (#40651) 2025-03-14 15:38:09 +08:00
ratelimitutil feat: support to deny dll according to database property (#40764) 2025-03-23 11:18:28 +08:00
reduce fix: iterator cursor progress too fast(#36179) (#36180) 2024-09-24 11:45:13 +08:00
searchutil fix: Fix ants.Pool goroutine leak (#41892) 2025-05-19 17:56:22 +08:00
segcore feat: make storagev1 to support eviction (#43219) 2025-07-19 02:02:52 +08:00
segmentutil enhance: Pooling for data tasks (#41256) 2025-05-20 21:06:24 +08:00
sessionutil enhance: use multi-process framework in integration test (#42976) 2025-06-30 14:22:43 +08:00
streamingutil enhance: use recovery+shardmanager, remove segment assignment interceptor (#41824) 2025-05-14 23:00:23 +08:00
streamrpc enhance: cleanup lint check exclusions (#40829) 2025-03-21 18:12:14 +08:00
testutil enhance: bulkinsert handle nullable/defaultValue/functionOutput fields (#42956) 2025-07-04 14:20:44 +08:00
tokenizerapi enhance: support run anayser return detaild token (#40458) 2025-03-19 15:48:15 +08:00
tsoutil enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
typeutil feat: Storage v2 compaction (#40667) 2025-03-21 10:16:12 +08:00
vecindexmgr enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
wrappers enhance: support run analyzer by loaded collection field (#42113) 2025-05-29 10:54:30 +08:00