doberst's picture
Upload 3 files
636ded2 verified
metadata
license: apache-2.0
inference: false
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
base_model_relation: quantized
tags:
  - green
  - llmware-chat
  - p14
  - gguf
  - emerald

deepseek-qwen-14b-gguf

deepseek-qwen-14b-gguf is a GGUF Q4_K_M int4 quantized version of deepseek-qwen-14b-gguf, providing a very fast inference implementation, optimized for AI PCs.

Model Description

  • Developed by: deepseek-ai / qwen
  • Model type: qwen2.5
  • Parameters: 14 billion
  • Model Parent: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Chat, general-purpose LLM
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website