For latest update, please move to this repo. ContrastivePruning Source code for AAAI 2022 paper: From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression. Coming soon!