Supplementary data for the Pado & Pado 2021,
"Determinants of Grader Agreement"

We are making available the data and modeling code used in our study
"Determinants of Grader Agreement: An Analysis of Multiple Short
Answer Corpora" in order to make our results reproducible to others.

We are not sharing the full corpus data, just the metadata
considered in our study, namely:
- the grade annotations
-  the feature values we computed for the features

Our data is derivative work of the original corpora. **For purposes
beyond reproduction of our study, please ensure that you comply with
the individual licenses of these corpora. **
The corpora and their licensing rules can be found at the following
places:

- ASAP: data and rules for usage available at
  https://www.kaggle.com/c/asap-sas/data. 
 
- ASAP-de: data available at https://github.com/ltl-ude/crosslingual
  We share the annotations with Andrea Horbach's written permission (thank you!)

- CREE, CREG and CSSAG are licensed as CC BY-NC-SA
  CREE, CREG and CSSAG are available on request: 
  see https://uni-tuebingen.de/fakultaeten/philosophische-fakultaet/fachbereiche/neuphilologie/seminar-fuer-sprachwissenschaft/arbeitsbereiche/theoretische-computerlinguistik/ressourcen/corpora/
  for CREE and CREG (see paper for details on which versions we use),
  and contact Ulrike Pado for CSSAG.

- PG: MSR License Agreement for PowerGrading 1.0. The corpus is available at
  https://www.microsoft.com/en-us/download/details.aspx?id=52397


Ulrike and Sebastian Pado
March 2021
ulrike.pado@hft-stuttgart.de
sebastian.pado@ims.uni-stuttgart.de