milvus/internal/datanode/importv2
wei liu 46dfe260da
enhance: Add timestamp filtering support to L0Reader (#43747)
issue: #43745
Add timestamp filtering capability to L0Reader to match the
functionality available in the regular Reader. This enhancement allows
filtering delete records based on timestamp range during L0 import
operations.

Changes include:
- Add tsStart and tsEnd fields to l0Reader struct for timestamp
filtering
- Modify NewL0Reader function signature to accept tsStart and tsEnd
parameters
- Implement timestamp filtering logic in Read method to skip records
outside the specified range
- Update L0ImportTask and L0PreImportTask to parse timestamp parameters
from request options and pass them to NewL0Reader
- Add comprehensive test case TestL0Reader_ReadWithTsFilter to verify ts
filtering functionality using mockey framework

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-08-06 16:49:39 +08:00
..
hash.go enhance: bulkinsert handles nullable/default (#42127) 2025-05-28 18:02:28 +08:00
hash_test.go fix: Fix no candidate segments error for small import (#41771) 2025-05-14 15:30:21 +08:00
memory_allocator.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
memory_allocator_test.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
mock_task.go fix: Prevent import from generating small binlogs (#43132) 2025-07-07 21:32:47 +08:00
mock_task_manager.go fix: Prevent import from generating small binlogs (#43132) 2025-07-07 21:32:47 +08:00
pool.go fix: Prevent import from generating small binlogs (#43132) 2025-07-07 21:32:47 +08:00
pool_test.go fix: Prevent import from generating small binlogs (#43132) 2025-07-07 21:32:47 +08:00
scheduler.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
scheduler_test.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
task.go fix: Prevent import from generating small binlogs (#43132) 2025-07-07 21:32:47 +08:00
task_import.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
task_l0_import.go enhance: Add timestamp filtering support to L0Reader (#43747) 2025-08-06 16:49:39 +08:00
task_l0_import_test.go enhance: ChunkManager is no longer created during datanode initialization (#42791) 2025-06-17 17:06:38 +08:00
task_l0_preimport.go enhance: Add timestamp filtering support to L0Reader (#43747) 2025-08-06 16:49:39 +08:00
task_manager.go enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
task_manager_test.go enhance: Use v2 package name for pkg module (#39990) 2025-02-22 23:15:58 +08:00
task_preimport.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
util.go fix: Improve import memory management to prevent OOM (#43568) 2025-07-28 21:25:35 +08:00
util_test.go enhance: bulkinsert handle nullable/defaultValue/functionOutput fields (#42956) 2025-07-04 14:20:44 +08:00