Evaluation


Benchmark Platform

We use Codabench (link) for evaluation the test set.


Submission Steps

Step 1 - Benchmark platform:

Sign up your account in Codabench and participate the benchmark (please note all participants should submit the form and send us the signed EULA in registration to get the dataset).


Step 2 - Prepare predictions:

Prepare your submission files with the format mentioned in details. Name your prediction files for Task 1 as "prediction.txt", prediction file for Task 2 as "prediction.json". You can include either or both of them based on the tasks you participate, then compress them as a zip file.


Step 3 - Submission:

In Codabench tab "My Submissions", section "Submission upload", select the tasks, then upload the zip file.