v2.2.1 - Update huggingface_hub & fixes
Version 0.8.1
of huggingface_hub
introduces several changes that resulted in errors and warnings. This version of sentence-transformers
fixes these issues.
Further, several improvements have been added / merged:
util.community_detection
was improved: 1) It works in a batched mode to save memory, 2) Overlapping clusters are no longer dropped but removed by overlapping items, 3) The parameterinit_max_size
was removed and replaced by a heuristic to estimate the max size of clusters- #1581 the training dataset names can be saved in the model card
- #1426 fix the text summarization example
- #1487 Rekursive sentence-transformers models are now possible
- #1522 Private models can now be loaded
- #1551 DataLoaders can now have workers
- #1565 Models are just checked on the hub if they don't exist in the cache. Fixes issues with connectivity issues
- #1591 Example added how to stream encode larger datasets