• Info
• Contribute

This project evaluates MCQ -> OEQ conversion quality in Modern Standard Arabic (MSA).

For each task, you will see:

• MCQ: the original multiple-choice question (stem, options, correct answer).
• OEQ: the converted open-ended question and answer pair.

Please complete all required labels:

1. Open-Ended Question Quality (1-5)
2. Open-Ended Answer Quality (1-5)
3. If Question Quality is below 4, select at least one Revision Reason for Question.
4. If Answer Quality is below 4, select at least one Revision Reason for Answer.

Scoring guidance:

• 1: Poor
• 2: Weak
• 3: Acceptable
• 4: Good
• 5: Excellent

Question quality focuses on:

• clarity
• naturalness in MSA
• being self-contained
• appropriate scope

Answer quality focuses on:

• correctness against the MCQ answer
• completeness
• conciseness
• fluency in MSA

Use the revision reasons to explain issues when a quality score is < 4.

Thanks for contributing to this annotation task.