Spaces:
Sleeping
Sleeping
File size: 1,699 Bytes
91e79f3 491a2cb 855ed09 8b97534 924e1aa 491a2cb |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
We use the HuggingFace Competition submission mechanism:
1. Go to the [LiveRAG Challenge HuggingFace page](https://huggingface.co/spaces/LiveRAG/Challenge)
2. Login by clicking the blue bar on the left rail says "Login with Hugging Face"
3. Click "New submission" on the left rail
4. In the pop-up window click "Choose File" and choose your Answer file\
4.1 You may add a submission description (optional)
5. Click "Submit" to submit your Answer file
6. If the Answer file was successfully uploaded, you will see the message: "Success! You have 4 submissions remaining today"
7. To view your submission information, click "Cancel" in the pop-up window and then click "My submission" in the left rail\
7.1 The submission "Status" shows "Success" if your Answer file is a valid JSONL file and all Answers are valid (i.e., comply with the [Answer schema](Answer.json.schema))\
7.2 In case the submission "Status" shows "Success", the "Public score" shows "Number_of_valid_answers" which is the number of valid Answers included in the submitted Answer file (not an actual scoring)
8. You may submit up to 5 Answer files, and optionally select the one you'd like to be evaluated by checking its “Selected” box in the “My submission” tab\
8.1 You may change the selected submission and then click the green "Update Selected Submissions" button
9. The evaluated Answer file will be the last selected valid submission made before the session end time. In case no selected valid submission is made before session end time, we’ll evaluate the last valid submission made in time
10. We accept partial submissions where not all questions are answered due to time limitation or any other reason |