Spaces:

chbsaikiran
/

SMOLLM2_105M

Sleeping

chbsaikiran commited on Feb 13

Commit

1ba7aba

1 Parent(s): 1b17bcf

updated app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -24,7 +24,7 @@ model = LlamaForCausalLM(
     dim=576,
     num_layers=30,
     hidden_dim=1536,
-    num_heads=9
 )
 checkpoint = torch.load(checkpoint_path, map_location=device)
 model.load_state_dict(checkpoint['model_state_dict'])

     dim=576,
     num_layers=30,
     hidden_dim=1536,
+    num_heads=8
 )
 checkpoint = torch.load(checkpoint_path, map_location=device)
 model.load_state_dict(checkpoint['model_state_dict'])