enhance: increate tantivy index worker and memory budget for json key stats for buliding index (#40912)

issue: #40897

This PR, combined with https://github.com/milvus-io/milvus/pull/40898,
makes tantivy total duration decrease roughly
from 6.3s to 1.68s for the case in the issue.

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
pull/41052/head
Spade A 2025-04-02 08:23:08 +08:00 committed by GitHub
parent 28c1ab8a16
commit 7945ff8784
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 2 deletions

View File

@ -280,8 +280,9 @@ JsonKeyStatsInvertedIndex::JsonKeyStatsInvertedIndex(
path_.c_str(),
false,
false,
1,
json_stats_tantivy_memory_budget);
// To speed up index building process.
4,
4 * 64 * 1024 * 1024);
}
}