FastAPI Inference Template π
A lightweight template to wrap any π€ Transformers model as an API with FastAPI.
Endpoints
GET /
β health checkPOST /predict
β run inference
Example Usage
curl -X POST "http://localhost:8000/predict" \
-H "Content-Type: application/json" \
-d '{"text": "Markets are looking strong today"}'
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
π
Ask for provider support