You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Tensorizer is a great tool for load transformer models very quickly, however loading sentence transformers models isn't supported natively. I could load the sentence transformers models through AutoModel and then run the forward pass in torch to get embeddings, but using SentenceTransformers, model.encode() method is very convenient, would love to use that instead.
Thanks !
The text was updated successfully, but these errors were encountered:
Tensorizer is a great tool for load transformer models very quickly, however loading sentence transformers models isn't supported natively. I could load the sentence transformers models through AutoModel and then run the forward pass in torch to get embeddings, but using SentenceTransformers, model.encode() method is very convenient, would love to use that instead.
Thanks !
The text was updated successfully, but these errors were encountered: