Hugging Face's logo

llava-hf
/
llava-1.5-7b-hf

Image-Text-to-Text
Transformers
Safetensors
English
llava
vision
conversational
Model card Files Community
54

how to lora this model

#54
by jinhong22 - opened
Discussion
jinhong22

I would like to learn how to perform LoRA fine-tuning on this model. Are there any tutorials or reference materials available?

nielsr
 Llava Hugging Face org

Yes, here! https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LLaVa/Fine_tune_LLaVa_on_a_custom_dataset_(with_PyTorch_Lightning).ipynb.

However note that this model is pretty outdated, I'd recommend Qwen2.5-VL nowadays (and this will be outdated again in a few weeks).

Sign up or log in to comment