Evaluate 200 new English ProBel test reference explanations that are not in PropXplain. The sample includes 100 propagandistic and 100 non-propagandistic texts.
Read each text, its gold annotation, and the reference explanation. Rate faithfulness, clarity, plausibility, and informativeness independently from 1 (not) to 5 (very). Each item requires three annotators.
See the project tutorial for criterion definitions and the rating scale.
