Delta-Vector
/

Pascal-Base-12B

Image-Text-to-Text

text-generation-inference

Model card Files Files and versions

Hparams:

LR: 1e-5
Weight Decay: 0.02
grad-clip: 0.2
R64, A32, Rslora, 0.1 drop out, 16bit lora (qlora is cope.)

pretrained on a buncha LNs, books, etc. Used for a base for Pascal.

Downloads last month: 1

Safetensors

Model size

12B params

Tensor type

BF16

·

Model tree for Delta-Vector/Pascal-Base-12B

Delta-Vector/Pascal-Base-Lora

unsloth/gemma-3-12b-it

Merge model

this model

Finetunes

Quantizations

Collection including Delta-Vector/Pascal-Base-12B

Daichi & Pascal

Finetunes made for Roleplaying, Created with a new dataset stack aswell as new training/merging methods • 4 items • Updated 4 days ago