How to deploy gpt oss 120B in Openshift AI platform
#126
by
eselvam
- opened
How to deploy the gpt oss 120B in openshift AI platform.
I'm getting this error while deploying the model.
ValueError: The checkpoint you are trying to load has model type gpt_oss but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
I got it working with vllm=0.10.1.1 and transformers==4.56.0.dev0