Get started
48 commitsLast commit ≈ 5 months ago0 stars0 forks
LLM transfer learning to classify country reports into democracy dimensions.
Fine tune LLM for text classifcation on democracy labels. The /notebooks you will find a collection o f notebooks used to fine-tune a classifier for sentence classification. The models tried where BERT, legal-BERT, DeBERTa and RoBERTa. After initial accuracy from all models, RoBERTa performed the best and we focused solely on RoBERTa. We implemented 2 classifiers one for classifying demcoracy dimensions and another for classifying democracy sentiment.
More details about the implementation approaches of these classifiers are found here:
Assessing democratic backsliding in European and its neighborhood