Word Embeddings: Reliability & Semantic Change
1st Edition
Published on 15. August 2019
188 pages
978-1-61499-995-9 (ISBN)
Description
Word embeddings are a form of distributional semantics increasingly popular for investigating lexical semantic change. However, typical training algorithms are probabilistic, limiting their reliability and the reproducibility of studies.
Johannes Hellrich investigated this problem both empirically and theoretically and found some variants of SVD-based algorithms to be unaffected. Furthermore, he created the JeSemE website to make word embedding based diachronic research more accessible. It provides information on changes in word denotation and emotional connotation in five diachronic corpora.
Finally, the author conducted two case studies on the applicability of these methods by investigating the historical understanding of electricity as well as words connected to Romanticism. They showed the high potential of distributional semantics for further applications in the digital humanities.
Johannes Hellrich investigated this problem both empirically and theoretically and found some variants of SVD-based algorithms to be unaffected. Furthermore, he created the JeSemE website to make word embedding based diachronic research more accessible. It provides information on changes in word denotation and emotional connotation in five diachronic corpora.
Finally, the author conducted two case studies on the applicability of these methods by investigating the historical understanding of electricity as well as words connected to Romanticism. They showed the high potential of distributional semantics for further applications in the digital humanities.
More details
Series
Language
English
Place of publication
London
Netherlands
Publishing group
IOS Press
Target group
Professional and scholarly
File size
7,27 MB
ISBN-13
978-1-61499-995-9 (9781614999959)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Other editions
Additional editions
Johannes Hellrich
Word Embeddings: Reliability & Semantic Change
Book
08/2019
1st Edition
IOS Press,US
€86.85
Article exhausted; check different version
Content
- Intro
- Title Page
- Contents
- Introduction
- Words and Meaning
- Semantic Change
- Reliability
- Contributions
- Outline
- Word Distribution and Meaning
- Sampling Contexts
- Word Association and Similarity
- Word Association Measures
- Word Similarity
- Words as Vectors
- Interpreting Vector Spaces
- SVDPPMI Word Embeddings
- Skip-gram Word Embeddings
- GloVe Word Embeddings
- History and Research Trends
- Evaluating Similarity
- Diachronic Distributional Research
- Non-Embedding Approaches
- Embedding Approaches
- Laws of Semantic Change
- Validity
- Diachronic Corpora
- Corpus of Historical American English
- Deutsches Textarchiv
- Google Books Ngram Corpus
- Royal Society Corpus
- Reliability of Word Embeddings
- Quantifying Reliability
- Causes for Reliability Issues
- A First Look at SG Reliability
- Experimental Setup
- Results
- A Multilingual View on SG Reliability
- Experimental Setup
- Results
- Comparison of Word Embedding Algorithms
- Experimental Setup
- Results
- Downsampling and Reliability
- Experimental Setup
- Results
- Comparison of SGNS implementations
- Experimental Setup
- Results
- Discussion
- Observing Lexical Semantic Change
- Historical Word Emotions
- Related Work
- Historical Emotion Gold Standard
- Algorithms and Adaptations
- Experimental Setup
- Results
- JeSemE - Jena Semantic Explorer
- Used Corpora
- System Architecture
- User Interface
- Alternatives
- Insights for the Digital Humanities
- History of Electricity
- Words Linked to Romanticism
- Discussion
- Conclusion
- Bibliography
