For a question answering task, you would use the [TFDistilBertForQuestionAnswering] model head.