Evaluation

Participants must submit their predictions as a .txt file adhering to the following format:

1. The file should include five prediction lines, one prediction per line.

2. Each prediction line consists of 160 binary digits (0 or 1), separated by commas:

   • 0 represents Wild Type.

   • 1 represents ASD.

3. Example of a prediction line: 0,1,0,1,0,1,...,1,0

1. Submission and Selection

   • Each participating team is allowed to submit multiple entries before the deadline, with each submission containing up to five predictions.

   • The highest segment-level result among the five predictions in a submission will be considered the best result for that submission.

2. Leaderboard Updates

   • If a new submission achieves a better segment-level result than the team’s previous best, it will replace the previous result on the leaderboard.

   • This update occurs even if the previous best result had a higher subject-level performance.

3. Final Rankings

   • After the evaluation phase ends, two separate rankings will be established:

a) Segment-Level Ranking: Based on the best segment-level results of all teams.

b) Subject-Level Ranking: Based on the best subject-level results of all teams.

3. • The Overall Ranking is determined by averaging each team’s segment-level and subject-level rankings.

4. Determining the Winner

   • The team with the lowest overall ranking wins the challenge.

   • In case of a tie:

a) The team with the lower segment-level ranking wins the challenge.

b) If still tied, the team that submitted their best segment-level result earlier wins the challenge.

1. Ensure that your .txt file strictly follows the formatting guidelines to avoid evaluation failure.

2. Every team is allowed to submit the prediction file ten times per day.

3. For queries or issues, contact us at info@maduv.org.