---
metrics:
- code_eval
library_name: transformers
tags:
- code
model-index:
- name: Tiny-StarCoder-Py
  results:
  - task:
      type: text-generation
    dataset:
      type: openai_humaneval
      name: HumanEval
    metrics:
    - name: pass@1
      type: pass@1
      value: 7.84%
      verified: false
---
159M model with the same architecture and tokenizer as StarCoder (8k context length) pre-trained on 100B tokens of Python from StarCoderData (~6 epochs)

Full training arguments + loss at: https://wandb.ai/loubnabnl/tiny_starcoder/runs/qogbxkgy/overview?workspace=user-loubnabnl

Pass@1: 7.84%