ERROR:hf-to-gguf:Model Wav2Vec2ForCTC is not supported

[raphael10-collab]

Hi!

I'm trying to convert pytorch model to gguf:

I tried with :
https://huggingface.co/jonatasgrosman/wav2vec2-large-xlsr-53-italian
but get this strange error: hf-to-gguf:Model Wav2Vec2ForCTC is not supported :

(.venv) raphy@raohy:~/whisper.cpp/models$ python3 ./llama.cpp/convert_hf_to_gguf.py ./italian/ --outtype f16
INFO:hf-to-gguf:Loading model: italian
ERROR:hf-to-gguf:Model Wav2Vec2ForCTC is not supported

And I tried with dbdmg/wav2vec2-xls-r-300m-italian-robust and got the same kind of error:

(.venv) raphy@raohy:~/whisper.cpp/models$ python3 ./llama.cpp/convert_hf_to_gguf.py ./italianwave2vec2/ --outtype f16
INFO:hf-to-gguf:Loading model: italianwave2vec2
ERROR:hf-to-gguf:Model Wav2Vec2ForCTC is not supported

What am I doing wrong and/or am I missing?
How to make it work?

[danbev]

You can list the models that are supported by using the --print-supported-models option which was added recently to convert_hf_to_gguf.py:

$ ./convert_hf_to_gguf.py --print-supported-models
Supported models:
- ArcticForCausalLM
- BaiChuanForCausalLM
- BaichuanForCausalLM
- BertForMaskedLM
- BertModel
- BitnetForCausalLM
- BloomForCausalLM
- BloomModel
- CamembertModel
- ChameleonForCausalLM
- ChameleonForConditionalGeneration
- ChatGLMForConditionalGeneration
- ChatGLMModel
- CodeShellForCausalLM
- Cohere2ForCausalLM
- CohereForCausalLM
- DbrxForCausalLM
- DeciLMForCausalLM
- DeepseekForCausalLM
- DeepseekV2ForCausalLM
- DeepseekV3ForCausalLM
- ExaoneForCausalLM
- FalconForCausalLM
- FalconMambaForCausalLM
- GPT2LMHeadModel
- GPTBigCodeForCausalLM
- GPTNeoXForCausalLM
- GPTRefactForCausalLM
- Gemma2ForCausalLM
- GemmaForCausalLM
- GraniteForCausalLM
- GraniteMoeForCausalLM
- GrokForCausalLM
- InternLM2ForCausalLM
- JAISLMHeadModel
- JinaBertForMaskedLM
- JinaBertModel
- LLaMAForCausalLM
- LlamaForCausalLM
- LlavaStableLMEpochForCausalLM
- MPTForCausalLM
- MT5ForConditionalGeneration
- MambaForCausalLM
- MambaLMHeadModel
- MiniCPM3ForCausalLM
- MiniCPMForCausalLM
- MistralForCausalLM
- MixtralForCausalLM
- NemotronForCausalLM
- NomicBertModel
- OLMoForCausalLM
- Olmo2ForCausalLM
- OlmoForCausalLM
- OlmoeForCausalLM
- OpenELMForCausalLM
- OrionForCausalLM
- Phi3ForCausalLM
- PhiForCausalLM
- PhiMoEForCausalLM
- PlamoForCausalLM
- QWenLMHeadModel
- Qwen2ForCausalLM
- Qwen2MoeForCausalLM
- Qwen2VLForConditionalGeneration
- RWForCausalLM
- RWKV6Qwen2ForCausalLM
- RobertaModel
- Rwkv6ForCausalLM
- StableLMEpochForCausalLM
- StableLmForCausalLM
- Starcoder2ForCausalLM
- T5EncoderModel
- T5ForConditionalGeneration
- T5WithLMHeadModel
- UMT5ForConditionalGeneration
- WavTokenizerDec
- XLMRobertaForSequenceClassification
- XLMRobertaModel
- XverseForCausalLM

The Wav2Vec2ForCTC has not been added (not supported yet) which is the reason for the error you are seeing.

[raphael10-collab]

Thank you. Ironically it seems that the models I would like to deploy, ASR for Italian language, are not supported

For example....

I get this different error message :

#11230

By the way, I do not understand why also whisper-german is not supported:

https://huggingface.co/primeline/whisper-large-v3-german :
WhisperForConditionalGeneration is not supported