This script is based on the study performed in
Degaetano-Ortlieb, S. and Teich, E. (2018). Using relative entropy for detection and analysis of periods of diachronic linguistic change. In Proceedings of the 2nd Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature at COLING2018. Santa Fe, NM, USA. ACL.
Task: Detect periods of change in diachronic corpora
Method: Relative entropy (Kullback-Leibler Divergence) for comparison based on sliding over a time line.
- Overall trends of periods of change (depending on the linguistic level applied, e.g. words, POS 3-grams)
- Individual contributions of changes (see Figure 2)