Update README.md
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ tags:
|
|
18 |
|
19 |
# llama-cpp-python 0.3.9 Prebuilt Wheel with CUDA Support for Windows
|
20 |
|
21 |
-
This repository provides a prebuilt Python wheel for **llama-cpp-python** (version 0.3.9) with NVIDIA CUDA support,
|
22 |
|
23 |
## Available Wheel
|
24 |
- `llama_cpp_python-0.3.9-cp310-cp310-win_amd64.whl` (Python 3.10, CUDA 12.8)
|
|
|
18 |
|
19 |
# llama-cpp-python 0.3.9 Prebuilt Wheel with CUDA Support for Windows
|
20 |
|
21 |
+
This repository provides a prebuilt Python wheel for **llama-cpp-python** (version 0.3.9) with NVIDIA CUDA support, for Windows 10/11 (x64) systems. This wheel enables GPU-accelerated inference for large language models (LLMs) using the `llama.cpp` library, simplifying setup by eliminating the need to compile from source. The wheel is compatible with Python 3.10 and supports NVIDIA GPUs, including the latest Blackwell architecture.
|
22 |
|
23 |
## Available Wheel
|
24 |
- `llama_cpp_python-0.3.9-cp310-cp310-win_amd64.whl` (Python 3.10, CUDA 12.8)
|