How to run LMDeploy gradio but for vision models

[bks5881]

I can run lmdeploy serve MODEL_NAME gradio, but this only launches text only gradio server. How to launch gradio server with UI for multimodel, for example llava?

[lvhan028]

@AllentDan could you do the favor?

[AllentDan]

Just launch the vl model with the exact same command as the llm models. For example: lmdeploy serve gradio deepseek/deepseek-vl-1.3b-chat

[bks5881]

will this also support adding images to the prompt?

[AllentDan]

there is a button there for you to upload images.

[BigWhiteFox]

will this also support adding images to the prompt?
U can use the api_serve command to deploy llm. Create an ui what u want and then convey message in Openai format between user and llm. This may be more flexible with the help of gradio package.