I fine-tuned LINE DistillBERT as the base model using WRIME Ver2 as the teacher data.
Files info
Base model