Spaces:
Paused
Paused
Commit
·
f18c295
1
Parent(s):
081b510
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,4 +9,15 @@ port: 7860
|
|
| 9 |
pinned: false
|
| 10 |
---
|
| 11 |
|
| 12 |
-
# WizardLM Doc Chat
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
pinned: false
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# WizardLM Doc Chat (WIP)
|
| 13 |
+
|
| 14 |
+
Goal:
|
| 15 |
+
|
| 16 |
+
Benchmark/dog fooding document chat with local LLM models. Demo document is the bitcoin pdf. Ignore other features.
|
| 17 |
+
|
| 18 |
+
Technical features:
|
| 19 |
+
|
| 20 |
+
* New: Optimized for GPU `n_layers`
|
| 21 |
+
* Hugging Face embeddings
|
| 22 |
+
* WizardLM 7B quantized ggml model
|
| 23 |
+
* Bleeding edge llama.cpp
|