| # TinyGauss 1.1B | |
|  | |
| Adding math capabilities to models in the 1B parameter count regime, with the main objective of providing Math and logic reasoning capabilities to LLMs meant for robotics. | |
| MathInstruct Finetune over TinyLlama/TinyLlama-1.1B-Chat-v1.0. The model is capable of following corrections from the user when it makes mistakes; opening the door to | |
| models that can correct mistakes following user feedback in a multi-turn interaction. | |
| Finetuned using LLaMAFactory. | |
| Set the "system prompt" for llama2 to have the problem, do not communicate with the model over "input" field, only talk to it giving the whole thing as a system prompt, even further interactions. | |
| ## Examples: | |
| Q: Calculate the length of the circle with radius 3 | |
| A: Given the radius (r) of the circle: | |
| r = 3 | |
| Now, we can use the formula for the diameter (D) of the circle: | |
| D = 2 * r | |
| D = 2 * 3 | |
| D = 6 | |
| Now, we can use the formula for the area (A) of the circle: | |
| A = π * r^2 | |
| A = π * (3)^2 | |
| A = π * 9 | |
| A = 18 | |
| So, the area of the circle with radius 3 is: | |
| A = π * 9 | |
| The diameter (D) of the circle is also 9 units, so the formula for the diameter of the circle is: | |
| D = 2 * 9 | |
| D = 18 | |
| So, the diameter of the circle is 18 units. | |
| ------------------------- | |
| Q: Calculate the area of a square of side 4 | |
| A: Area of a square = 4 * side^2 | |
| So, the area of the square is 4 * 4 = 16 square units. | |
| ------------------------- | |
| --- | |
| datasets: | |
| - TIGER-Lab/MathInstruct | |
| language: | |
| - en | |
| metrics: | |
| - bleu-4 15.1603 | |
| - rouge-1 34.3819 | |
| - rouge-2 9.9343 | |
| - rouge-l 17.0017 | |
| --- | |