Spaces:
Build error
Build error
File size: 544 Bytes
f48d4d6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
from transformers import BertTokenizer, BertForSequenceClassification
from fastai.text.all import Learner
# 1) KoBERT ํ ํฌ๋์ด์ ๋ถ๋ฌ์ค๊ธฐ
tokenizer = BertTokenizer.from_pretrained('monologg/kobert')
# 2) ๋ชจ๋ธ ์ ์ ๋ฐ fine-tune
model = BertForSequenceClassification.from_pretrained('monologg/kobert', num_labels=len(categories))
# ... (FastAI ๋ฐ์ดํฐ๋ธ๋ก & Trainer ์ค์ )
# 3) ํ์ต ํ ์ ์ฅ
learn = Learner(dls, model, loss_func=CrossEntropyLossFlat(), metrics=accuracy)
learn.fine_tune(3)
learn.export('model_ko.pkl')
|