Hugging Face's logo

yalhessi
/
lemexp-task1-min_symbols_template_small-deepseek-coder-1.3b-base-fsdp

PEFT
Safetensors
Generated from Trainer
Model card Files Community
yalhessi commited on
Commit
f4cd1d8
·
verified ·
1 Parent(s): da42d1f

End of training

Browse files
Files changed (5) hide show
  1. README.md +10 -10
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. loss_plot.png +0 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.2105
20
 
21
  ## Model description
22
 
@@ -52,15 +52,15 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
- | 0.4402 | 0.2001 | 629 | 0.3310 |
56
- | 0.3256 | 0.4001 | 1258 | 0.2849 |
57
- | 0.2909 | 0.6002 | 1887 | 0.2562 |
58
- | 0.2536 | 0.8003 | 2516 | 0.2424 |
59
- | 0.2435 | 1.0003 | 3145 | 0.2343 |
60
- | 0.2396 | 1.2004 | 3774 | 0.2342 |
61
- | 0.2342 | 1.4004 | 4403 | 0.2229 |
62
- | 0.2175 | 1.6005 | 5032 | 0.2162 |
63
- | 0.2144 | 1.8006 | 5661 | 0.2105 |
64
 
65
 
66
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.1984
20
 
21
  ## Model description
22
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
+ | 0.4383 | 0.2001 | 629 | 0.3292 |
56
+ | 0.322 | 0.4001 | 1258 | 0.2787 |
57
+ | 0.2868 | 0.6002 | 1887 | 0.2509 |
58
+ | 0.2489 | 0.8003 | 2516 | 0.2356 |
59
+ | 0.2363 | 1.0003 | 3145 | 0.2278 |
60
+ | 0.2192 | 1.2004 | 3774 | 0.2188 |
61
+ | 0.2116 | 1.4004 | 4403 | 0.2094 |
62
+ | 0.1985 | 1.6005 | 5032 | 0.2042 |
63
+ | 0.1961 | 1.8006 | 5661 | 0.1984 |
64
 
65
 
66
  ### Framework versions
adapter_config.json CHANGED
@@ -23,8 +23,8 @@
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
- "q_proj",
27
- "v_proj"
28
  ],
29
  "task_type": "CAUSAL_LM",
30
  "use_dora": false,
 
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
+ "v_proj",
27
+ "q_proj"
28
  ],
29
  "task_type": "CAUSAL_LM",
30
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6312d95a01cc4db50a00ade14fc2dce072339b2e4fc91d0d6523afe8b1aa8dc
3
  size 6304096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf549f8153db3be2e6d9d6f18976df33ffd887bb5774850a27641a8ad948a6a9
3
  size 6304096
loss_plot.png CHANGED
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e5684781326a10753b4de85fc53d41978898830d107da2c702d097b3d4bf06c3
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52cfd25008bab5d6c0ea2e107046ded22acb6f681d557e803c3c6a5f8e673773
3
  size 5496