Using Sampling to Estimate and Improve Performance of Automated Scoring Systems with Guarantees

Implementation of the paper titled "Using Sampling to Estimate and Improve Performance of Automated Scoring Systems with Guarantees" (https://arxiv.org/abs/2111.08906)

If you use the code in this repository, please cite the work as:

@misc{singla2021using,
      title={Using Sampling to Estimate and Improve Performance of Automated Scoring Systems with Guarantees}, 
      author={Yaman Kumar Singla and Sriram Krishna and Rajiv Ratn Shah and Changyou Chen},
      year={2021},
      eprint={2111.08906},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Setup

# Create a virtual environment
python -m venv env
source env/bin/activate

pip install -r requirements.txt

python main.py