Code

Periodization script

This script is based on the study performed in

Degaetano-Ortlieb, S. and Teich, E. (2018). Using relative entropy for detection and analysis of periods of diachronic linguistic change. In Proceedings of the 2nd Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature at COLING2018. Santa Fe, NM, USA. ACL.

periodization RScript

Task: Detect periods of change in diachronic corpora

Method: Relative entropy (Kullback-Leibler Divergence) for comparison based on sliding over a time line.

Output:

  • Overall trends of periods of change (depending on the linguistic level applied, e.g. words, POS 3-grams)

overallKLD

  • Individual contributions of changes (see Figure 2)

periodization