masx-openchat-llm / model_loader.py

Commit History

formatting + removed cpu parralism
e6a07cc

ateetvatan commited on

fixed bug
6b456ee

ateetvatan commited on

changed model to openchat-3.5-0106.Q8_0.gguf
8dd6602

ateetvatan commited on

swiched to 4-bit AWQ‑quantized version of OpenChat 3.5 7B as openchat 3.5 requires more then 16gn RAM
62d49a1

ateetvatan commited on

Hf cache issue
dc24051

ateetvatan commited on

hf cache dir fixs
a0d9a38

ateetvatan commited on

defining model cache directories
e2e640c

ateetvatan commited on

formatting
5ee2484

ateetvatan commited on

openchat-llm init
2289445

ateetvatan commited on