Text related annotation
Human annotation of Bangla (and Bangla/English-mixed) posts for polarization.
Human annotation of Bangla (and Bangla/English-mixed) posts for polarization.
Judging the explanation of the hateful meme
Evaluate 200 English ProBel reference explanations for faithfulness, clarity, plausibility, and informativeness.
English Propaganda Explanation - Verification
Verify 3 question–answer pairs for each image. For each pair: (1) mark whether the Q/A is correct and relevant to the image, and (2) mark whether the question cannot be answered without seeing the image.
Verify 3 question–answer pairs for each image. For each pair: (1) mark whether the Q/A is correct and relevant to the image, and (2) mark whether the question cannot be answered without seeing the image.
Edit Egyptian dialect translations of MSA MCQs. MSA fields are fixed and non-editable; only Egyptian fields can be updated.
Edit English translations of MSA MCQs. MSA fields are fixed and non-editable; only English fields can be updated.
Edit Gulf Arabic translations of MSA MCQs. MSA fields are fixed and non-editable; only Gulf Arabic fields can be updated.
Edit Levantine Arabic translations of MSA MCQs. MSA fields are fixed and non-editable; only Levantine Arabic fields can be updated.
Edit Maghrebi Arabic translations of MSA MCQs. MSA fields are fixed and non-editable; only Maghrebi Arabic fields can be updated.
Human evaluation of MCQ to Open Ended Questions (OEQ) conversion quality in Modern Standard Arabic (MSA).
Hateful Meme (English) -- Memeintel Model Reasoning - Verification
Record 3 hallucination-related statements for each multimodal task item.