Word2Dict – Lemma Selection and Dictionary Editing Assisted by Word Embeddings

Page819-826
AuthorNicolai Hartvig Sørensen, Sanni Nimb
TitleWord2Dict – Lemma Selection and Dictionary Editing Assisted by Word Embeddings
AbstractWe describe the use of a tool that assists lexicographers with extending the lexical coverage of an online Danish dictionary. The tool is based on a word embedding model (word2vec) trained on a large Danish corpus, and it presents semantically related lemmas already included in the dictionary and, importantly, their definitions. Furthermore, lemma candidates, i.e. words from the corpus which are not included in the dictionary, are presented in the tool, supplemented by information on corpus frequency. The tool thereby facilitates the lemma selection as well as the process of writing consistent definitions across synonyms and near synonyms. We discuss the shortcomings of the tool and the semantic model when it comes to identifying words similar in meaning from different genres and registers. We also look closer into whether it does in fact benefit the dictionary-making process or not by studying a number of previously edited words, including their synonyms, and comparing them with the output data from the tool.
SessionPoster Presentations
Keywordslemma selection, word embedding, word2vec, semantic similarity, dictionary-making process
BibTex
@InProceedings{ELX2018-067,
author={Nicolai Hartvig Sørensen, Sanni Nimb},
title={Word2Dict – Lemma Selection and Dictionary Editing Assisted by Word Embeddings},
pages={819-826},
booktitle={Proceedings of the XVIII EURALEX International Congress: Lexicography in Global Contexts},
year={2018},
month={jul},
date={17-21},
address={Ljubljana, Slovenia},
editor={Jaka Čibej, Vojko Gorjanc, Iztok Kosem, Simon Krek},
publisher={Ljubljana University Press, Faculty of Arts},
isbn={978-961-06-0097-8}, }
Download