Add README

README.md

@@ -1,62 +1,50 @@
 ---
+license: apache-2.0
 base_model: Qwen/Qwen2-VL-7B-Instruct
-library_name: peft
-model_name: adalora_weather_model
 tags:
-- base_model:adapter:Qwen/Qwen2-VL-7B-Instruct
-- lora
-- sft
-- transformers
-- trl
-licence: license
-pipeline_tag: text-generation
+- qwen2-vl
+- weather
+- satellite
+- morocco
+- meteorology
+- adalora
+- fine-tuned
 ---
 
-# Model Card for adalora_weather_model
+# Qwen2-VL Weather Analysis - AdaLoRA
 
-This model is a fine-tuned version of [Qwen/Qwen2-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct).
-It has been trained using [TRL](https://github.com/huggingface/trl).
+Fine-tuned using **AdaLoRA** technique for weather satellite imagery analysis.
 
-## Quick start
+## Model Details
 
-```python
-from transformers import pipeline
-
-question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
-generator = pipeline("text-generation", model="None", device="cuda")
-output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
-print(output["generated_text"])
-```
-
-## Training procedure
+- **Base Model:** Qwen/Qwen2-VL-7B-Instruct
+- **Technique:** AdaLoRA
+- **Domain:** Weather satellite imagery analysis
+- **Dataset:** Weather satellite images with meteorological metadata
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/azdinsahir11-university-mohamed-v/qwen2vl-adalora-weather/runs/6q7w54jc) 
+## Usage
 
+```python
+from transformers import Qwen2VLForConditionalGeneration, Qwen2VLProcessor
+import torch
 
-This model was trained with SFT.
-
-### Framework versions
-
-- PEFT 0.16.0
-- TRL: 0.19.1
-- Transformers: 4.53.2
-- Pytorch: 2.6.0+cu124
-- Datasets: 4.0.0
-- Tokenizers: 0.21.2
+# Load base model
+model = Qwen2VLForConditionalGeneration.from_pretrained(
+    "Qwen/Qwen2-VL-7B-Instruct",
+    torch_dtype=torch.bfloat16,
+    device_map="auto"
+)
+processor = Qwen2VLProcessor.from_pretrained("Qwen/Qwen2-VL-7B-Instruct")
 
-## Citations
+# Load fine-tuned adapter
+model.load_adapter("azdin/qwen2-vl-weather-adalora")
 
+# Use for weather analysis...
+```
 
+## Training Details
 
-Cite TRL as:
-    
-```bibtex
-@misc{vonwerra2022trl,
-	title        = {{TRL: Transformer Reinforcement Learning}},
-	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
-	year         = 2020,
-	journal      = {GitHub repository},
-	publisher    = {GitHub},
-	howpublished = {\url{https://github.com/huggingface/trl}}
-}
-```
+- **Technique:** AdaLoRA
+- **Quantization:** 4-bit NF4
+- **Training Data:** Weather satellite imagery with metadata
+- **Target Modules:** Attention layers