# Models with reduced matrix size and overfitted for testing

Base models and adapters for LLMs to be used to test converting to `gguf` and testing inference. 

These LLMs are in `safetensors` format with their architecture unchanged but for the size of their tensors. 



Folders structure:
```
<model architecture>/hidden_size=<reduced size>/<base|lora>
```
where:
- `base`: overfitted to complete this [Sagan's Pale Blue Dot paragraph](https://github.com/ltoniazzi/reduce-llms-for-testing/blob/main/data/pale_blue_dot.txt)
- `lora`: overfitted to complete this [Bohemian Rapshody paragraph](https://github.com/ltoniazzi/reduce-llms-for-testing/blob/main/data/bohemian_rapshody.txt)

These models are generated with the repo [reduce-llms-for-testing](https://github.com/ltoniazzi/reduce-llms-for-testing). 
Please open an issue/PR there if you want to add more models.