---
title: WizardLM Doc Chat
emoji: 📓🪄
colorFrom: purple
colorTo: gray
sdk: docker
app_file: app.py
port: 7860
pinned: false
---

# WizardLM Doc Chat (WIP)

Goal:

Benchmark/dog fooding document chat with local LLM models. Demo document is the bitcoin pdf. Ignore other features.

Technical features:

* New: Optimized for GPU `n_layers`
* Hugging Face embeddings
* WizardLM 7B quantized ggml model
* Bleeding edge llama.cpp