🔎 Evaluation and Ranking

For task 1

The following metrics will be used in the leader board for both phase of task 1

• F1-score,
• Specificity,
• Rk-correlation coefficient (RkC)

For task 2

The following metrics will be used in the leader board for both phase of task 2

• F1-score
• Specificity
• Rk-correlation coefficient (RkC)
• Quadratic weighted Kappa

Ranking method(s)

Only participants with comprehensive results for the task will appear in the final ranking.

In the final ranking, task 2 will be given a higher weight as it is the most challenging and clinically useful task.