Skip to content

Commit

Permalink
Merge pull request #4290 from vespa-engine/vekterli/use-weakand-rank-…
Browse files Browse the repository at this point in the history
…profile

Implicitly prune away stop words with weakAnd instead of using explicitly preprocessed queries
  • Loading branch information
geirst authored Nov 22, 2024
2 parents 6771985 + 80fbb2c commit 61ca9f3
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions tests/performance/mmap_vs_directio/mmap_vs_directio.rb
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,6 @@ def test_wikipedia_corpus_search_performance
@profile = benchmarking_profile

@query_file_name = 'squad2-questions.fbench.141k.txt'
@no_stop_words_query_file_name = 'squad2-questions.max-df-20.fbench.141k.txt'

report_io_stat_deltas do
feed_file('enwiki-20240801-pages.1M.jsonl.zst', @profile[:doc_count])
Expand Down Expand Up @@ -98,7 +97,7 @@ def deploy_and_run_queries(search_io_mode:, cache_size_mb: 0)
end
puts "Search using BM25 rank profile (queries without stop-words)"
report_io_stat_deltas do
benchmark_queries(@no_stop_words_query_file_name, "#{run_type}_no_stop_words", clients, false, @profile[:query_runtime])
benchmark_queries(@query_file_name, "#{run_type}_no_stop_words", clients, false, @profile[:query_runtime], 'weakand_stop_word')
end
puts "Search using simple filter rank profile that uses bit vectors"
report_io_stat_deltas do
Expand Down

0 comments on commit 61ca9f3

Please sign in to comment.