Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wait longer for services to come up #4191

Merged
merged 1 commit into from
Sep 6, 2024
Merged

Wait longer for services to come up #4191

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 13 additions & 9 deletions tests/search/embedding/embedding.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ def test_default_embedding
sd(selfdir + 'app_one_embedder/schemas/doc.sd').
components_dir(selfdir + 'app_one_embedder/model').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_default_embedder
end
Expand All @@ -102,7 +102,7 @@ def test_embedding
sd(selfdir + 'app_two_embedders/schemas/doc.sd').
components_dir(selfdir + 'app_two_embedders/model').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_tokens
verify_embedding
Expand All @@ -118,7 +118,7 @@ def test_huggingface_embedding
jvmoptions('-Xms4g -Xmx4g')).
sd(selfdir + 'app_huggingface_embedder/schemas/doc.sd').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_huggingface_tokens
verify_huggingface_embedding
Expand All @@ -133,7 +133,7 @@ def test_huggingface_embedding_binary_quantization
jvmoptions('-Xms4g -Xmx4g')).
sd(selfdir + 'app_huggingface_embedder_binarization_matryoshka/schemas/doc.sd').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_huggingface_embedding_binary_quantization
end
Expand All @@ -147,7 +147,7 @@ def test_colbert_embedding
jvmoptions('-Xms4g -Xmx4g')).
sd(selfdir + 'app_colbert_embedder/schemas/doc.sd').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_colbert_embedding
end
Expand All @@ -161,7 +161,7 @@ def test_colbert_embedding_fp16
jvmoptions('-Xms4g -Xmx4g')).
sd(selfdir + 'app_colbert_embedder_fp16/schemas/doc.sd').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_colbert_embedding_fp16
end
Expand All @@ -175,7 +175,7 @@ def test_colbert_multivector_embedding
jvmoptions('-Xms4g -Xmx4g')).
sd(selfdir + 'app_colbert_multivector_embedder/schemas/doc.sd').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "multivector-docs.json")
verify_colbert_multivector_embedding
end
Expand All @@ -190,7 +190,7 @@ def test_splade_embedding
sd(selfdir + 'app_splade_embedder/schemas/doc.sd').
components_dir(selfdir + 'app_splade_embedder/models').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "docs.json")
verify_splade_embedding
end
Expand All @@ -205,7 +205,7 @@ def test_splade_multivector_embedding
sd(selfdir + 'app_splade_multivector_embedder/schemas/doc.sd').
components_dir(selfdir + 'app_splade_embedder/models').
indexing_cluster('default').indexing_chain('indexing'))
start
start_vespa
feed_and_wait_for_docs("doc", 1, :file => selfdir + "multivector-docs.json")
verify_splade_multivector_embedding
end
Expand Down Expand Up @@ -429,6 +429,10 @@ def verify_splade_multivector_embedding
assert(relevance > 0, "#{relevance} is 0, which is not expected.")
end

def start_vespa
start(300) # Wait longer than default, download of models sometimes takes > 3 minutes
end

def teardown
stop
end
Expand Down