Validity, Reliability, and Significance (Record no. 84633)
[ view plain ]
| 000 -LEADER | |
|---|---|
| fixed length control field | 04269nam a22005415i 4500 |
| 001 - CONTROL NUMBER | |
| control field | 978-3-031-02183-1 |
| 005 - DATE AND TIME OF LATEST TRANSACTION | |
| control field | 20240730163448.0 |
| 008 - FIXED-LENGTH DATA ELEMENTS--GENERAL INFORMATION | |
| fixed length control field | 220601s2022 sz | s |||| 0|eng d |
| 020 ## - INTERNATIONAL STANDARD BOOK NUMBER | |
| ISBN | 9783031021831 |
| -- | 978-3-031-02183-1 |
| 082 04 - CLASSIFICATION NUMBER | |
| Call Number | 006.3 |
| 100 1# - AUTHOR NAME | |
| Author | Riezler, Stefan. |
| 245 10 - TITLE STATEMENT | |
| Title | Validity, Reliability, and Significance |
| Sub Title | Empirical Methods for NLP and Data Science / |
| 250 ## - EDITION STATEMENT | |
| Edition statement | 1st ed. 2022. |
| 300 ## - PHYSICAL DESCRIPTION | |
| Number of Pages | XVII, 147 p. |
| 490 1# - SERIES STATEMENT | |
| Series statement | Synthesis Lectures on Human Language Technologies, |
| 505 0# - FORMATTED CONTENTS NOTE | |
| Remark 2 | Preface -- Acknowledgments -- Introduction -- Validity -- Reliability -- Significance -- Bibliography -- Authors' Biographies. |
| 520 ## - SUMMARY, ETC. | |
| Summary, etc | Empirical methods are means to answering methodological questions of empirical sciences by statistical techniques. The methodological questions addressed in this book include the problems of validity, reliability, and significance. In the case of machine learning, these correspond to the questions of whether a model predicts what it purports to predict, whether a model's performance is consistent across replications, and whether a performance difference between two models is due to chance, respectively. The goal of this book is to answer these questions by concrete statistical tests that can be applied to assess validity, reliability, and significance of data annotation and machine learning prediction in the fields of NLP and data science. Our focus is on model-based empirical methods where data annotations and model predictions are treated as training data for interpretable probabilistic models from the well-understood families of generalized additive models (GAMs) and linear mixed effects models (LMEMs). Based on the interpretable parameters of the trained GAMs or LMEMs, the book presents model-based statistical tests such as a validity test that allows detecting circular features that circumvent learning. Furthermore, the book discusses a reliability coefficient using variance decomposition based on random effect parameters of LMEMs. Last, a significance test based on the likelihood ratio of nested LMEMs trained on the performance scores of two machine learning models is shown to naturally allow the inclusion of variations in meta-parameter settings into hypothesis testing, and further facilitates a refined system comparison conditional on properties of input data. This book can be used as an introduction to empirical methods for machine learning in general, with a special focus on applications in NLP and data science. The book is self-contained, with an appendix on the mathematical background on GAMs and LMEMs, and with an accompanying webpage including R code to replicate experiments presented in the book. |
| 700 1# - AUTHOR 2 | |
| Author 2 | Hagmann, Michael. |
| 856 40 - ELECTRONIC LOCATION AND ACCESS | |
| Uniform Resource Identifier | https://doi.org/10.1007/978-3-031-02183-1 |
| 942 ## - ADDED ENTRY ELEMENTS (KOHA) | |
| Koha item type | eBooks |
| 264 #1 - | |
| -- | Cham : |
| -- | Springer International Publishing : |
| -- | Imprint: Springer, |
| -- | 2022. |
| 336 ## - | |
| -- | text |
| -- | txt |
| -- | rdacontent |
| 337 ## - | |
| -- | computer |
| -- | c |
| -- | rdamedia |
| 338 ## - | |
| -- | online resource |
| -- | cr |
| -- | rdacarrier |
| 347 ## - | |
| -- | text file |
| -- | |
| -- | rda |
| 650 #0 - SUBJECT ADDED ENTRY--SUBJECT 1 | |
| -- | Artificial intelligence. |
| 650 #0 - SUBJECT ADDED ENTRY--SUBJECT 1 | |
| -- | Natural language processing (Computer science). |
| 650 #0 - SUBJECT ADDED ENTRY--SUBJECT 1 | |
| -- | Computational linguistics. |
| 650 14 - SUBJECT ADDED ENTRY--SUBJECT 1 | |
| -- | Artificial Intelligence. |
| 650 24 - SUBJECT ADDED ENTRY--SUBJECT 1 | |
| -- | Natural Language Processing (NLP). |
| 650 24 - SUBJECT ADDED ENTRY--SUBJECT 1 | |
| -- | Computational Linguistics. |
| 830 #0 - SERIES ADDED ENTRY--UNIFORM TITLE | |
| -- | 1947-4059 |
| 912 ## - | |
| -- | ZDB-2-SXSC |
No items available.