Empirical Implications on Lexical Association Measures

By November 17, 2016,
Page 359-371
Author Brigitte Krenn
Title Empirical Implications on Lexical Association Measures
Abstract An empirical study is presented showing how factors such as co-occurrence frequency, linguistic constraints in the candidate data and type of collocation to be identified influence the identification accuracy achieved, on the one hand, by a mere frequency-based approach and, on the other hand, by well known statistical association measures such as mutual information, Dice coefficient, relative entropy and loglikelihood statistics. The empirical results confirm the weakness of the statistical measures with respect to identifying collocations from data with a high proportion of low frequency data, and reveal differences between the individual association measures depending on the class of collocations to be identified, whether they are applied to full or base form data, and whether the test samples contain low frequency data or not.
Session PART 8 - Extraction of terminologically relevant multiword expressions
author = {Brigitte Krenn},
title = {Empirical Implications on Lexical Association Measures},
pages = {359-371},
booktitle = {Proceedings of the 9th EURALEX International Congress},
year = {2000},
month = {aug},
date = {8-12},
address = {Stuttgart, Germany},
editor = {Ulrich Heid, Stefan Evert, Egbert Lehmann, Christian Rohrer},
publisher = {Institut für Maschinelle Sprachverarbeitung},
isbn = {3-00-006574-1},