Pilehvar, Mohammad Taher.
Embeddings in Natural Language Processing Theory and Advances in Vector Representations of Meaning / [electronic resource] : by Mohammad Taher Pilehvar, Jose Camacho-Collados. - 1st ed. 2021. - XVIII, 157 p. online resource. - Synthesis Lectures on Human Language Technologies, 1947-4059 . - Synthesis Lectures on Human Language Technologies, .
Preface -- Introduction -- Background -- Word Embeddings -- Graph Embeddings -- Sense Embeddings -- Contextualized Embeddings -- Sentence and Document Embeddings -- Ethics and Bias -- Conclusions -- Bibliography -- Authors' Biographies.
Embeddings have undoubtedly been one of the most influential research areas in Natural Language Processing (NLP). Encoding information into a low-dimensional vector representation, which is easily integrable in modern machine learning models, has played a central role in the development of NLP. Embedding techniques initially focused on words, but the attention soon started to shift to other forms: from graph structures, such as knowledge bases, to other types of textual content, such as sentences and documents. This book provides a high-level synthesis of the main embedding techniques in NLP, in the broad sense. The book starts by explaining conventional word vector space models and word embeddings (e.g., Word2Vec and GloVe) and then moves to other types of embeddings, such as word sense, sentence and document, and graph embeddings. The book also provides an overview of recent developments in contextualized representations (e.g., ELMo and BERT) and explains their potential in NLP. Throughout the book, the reader can find both essential information for understanding a certain topic from scratch and a broad overview of the most successful techniques developed in the literature.
9783031021770
10.1007/978-3-031-02177-0 doi
Artificial intelligence.
Natural language processing (Computer science).
Computational linguistics.
Artificial Intelligence.
Natural Language Processing (NLP).
Computational Linguistics.
Q334-342 TA347.A78
006.3
Embeddings in Natural Language Processing Theory and Advances in Vector Representations of Meaning / [electronic resource] : by Mohammad Taher Pilehvar, Jose Camacho-Collados. - 1st ed. 2021. - XVIII, 157 p. online resource. - Synthesis Lectures on Human Language Technologies, 1947-4059 . - Synthesis Lectures on Human Language Technologies, .
Preface -- Introduction -- Background -- Word Embeddings -- Graph Embeddings -- Sense Embeddings -- Contextualized Embeddings -- Sentence and Document Embeddings -- Ethics and Bias -- Conclusions -- Bibliography -- Authors' Biographies.
Embeddings have undoubtedly been one of the most influential research areas in Natural Language Processing (NLP). Encoding information into a low-dimensional vector representation, which is easily integrable in modern machine learning models, has played a central role in the development of NLP. Embedding techniques initially focused on words, but the attention soon started to shift to other forms: from graph structures, such as knowledge bases, to other types of textual content, such as sentences and documents. This book provides a high-level synthesis of the main embedding techniques in NLP, in the broad sense. The book starts by explaining conventional word vector space models and word embeddings (e.g., Word2Vec and GloVe) and then moves to other types of embeddings, such as word sense, sentence and document, and graph embeddings. The book also provides an overview of recent developments in contextualized representations (e.g., ELMo and BERT) and explains their potential in NLP. Throughout the book, the reader can find both essential information for understanding a certain topic from scratch and a broad overview of the most successful techniques developed in the literature.
9783031021770
10.1007/978-3-031-02177-0 doi
Artificial intelligence.
Natural language processing (Computer science).
Computational linguistics.
Artificial Intelligence.
Natural Language Processing (NLP).
Computational Linguistics.
Q334-342 TA347.A78
006.3