File size: 1,546 Bytes
4673bf8 f467dcc f4a12b0 7d8a540 ab72275 8c0e08f ab72275 213db76 9f5544a 213db76 9f5544a 213db76 99977cf f467dcc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 |
# TinyGauss 1.1B
Adding math capabilities to models in the 1B parameter count regime, with the main objective of providing Math and logic reasoning capabilities to LLMs meant for robotics.
MathInstruct Finetune over TinyLlama/TinyLlama-1.1B-Chat-v1.0. The model is capable of following corrections from the user when it makes mistakes; opening the door to
models that can correct mistakes following user feedback in a multi-turn interaction.
Finetuned using LLaMAFactory.
Set the "system prompt" for llama2 to have the problem, do not communicate with the model over "input" field, only talk to it giving the whole thing as a system prompt, even further interactions.
## Examples:
Q: Calculate the length of the circle with radius 3
A: Given the radius (r) of the circle:
r = 3
Now, we can use the formula for the diameter (D) of the circle:
D = 2 * r
D = 2 * 3
D = 6
Now, we can use the formula for the area (A) of the circle:
A = π * r^2
A = π * (3)^2
A = π * 9
A = 18
So, the area of the circle with radius 3 is:
A = π * 9
The diameter (D) of the circle is also 9 units, so the formula for the diameter of the circle is:
D = 2 * 9
D = 18
So, the diameter of the circle is 18 units.
-------------------------
Q: Calculate the area of a square of side 4
A: Area of a square = 4 * side^2
So, the area of the square is 4 * 4 = 16 square units.
-------------------------
---
datasets:
- TIGER-Lab/MathInstruct
language:
- en
metrics:
- bleu-4 15.1603
- rouge-1 34.3819
- rouge-2 9.9343
- rouge-l 17.0017
---
|