Added information about the prompt
Browse files
README.md
CHANGED
|
@@ -10,6 +10,7 @@ tags:
|
|
| 10 |
|
| 11 |
This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
|
| 12 |
The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been trained using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
|
|
|
|
| 13 |
|
| 14 |
Next there are some examples to show what the model is currently capable of.
|
| 15 |
(I have edited the quotes to be able to show the prompts correctly here the model outputs proper markdown.)
|
|
|
|
| 10 |
|
| 11 |
This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
|
| 12 |
The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been trained using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
|
| 13 |
+
Unlike the base model the prompt is based on Alapaca.
|
| 14 |
|
| 15 |
Next there are some examples to show what the model is currently capable of.
|
| 16 |
(I have edited the quotes to be able to show the prompts correctly here the model outputs proper markdown.)
|