Advancing Natural Language Processing in Educational Assessment (Paperback)

Preface by Victoria Yaneva and Matthias von Davier Section I: Automated Scoring Chapter 1: The Role of Robust Software in Automated Scoring by Nitin Madnani, Aoife Cahill, and Anastassia Loukina Chapter 2: Psychometric Considerations when Using Deep Learning for Automated Scoring by Susan Lottridge, Chris Ormerod, and Amir Jafari Chapter 3: Speech Analysis in Assessment by Jared C. Bernstein and Jian Cheng Chapter 4: Assessment of Clinical Skills: A Case Study in Constructing an NLP-Based Scoring System for Patient Notes by Polina Harik, Janet Mee, Christopher Runyon, and Brian E. Clauser Section II: Item Development Chapter 5: Automatic Generation of Multiple-Choice Test Items from Paragraphs Using Deep Neural Networks by Ruslan Mitkov, Le An Ha, Halyna Maslak, Tharindu Ranasinghe, and Vilelmini Sosoni Chapter 6: Training Optimus Prime, M.D.: A Case Study of Automated Item Generation using Artificial Intelligence ? From Fine-Tuned GPT2 to GPT3 and Beyond by Matthias von Davier Chapter 7: Computational Psychometrics for Digital-first Assessments: A Blend of ML and Psychometrics for Item Generation and Scoring by Geoff LaFlair, Kevin Yancey, Burr Settles, Alina A von Davier Section III: Validity and Fairness Chapter 8: Validity, Fairness, and Technology-based Assessment by Suzanne Lane Chapter 9: Evaluating Fairness of Automated Scoring in Educational Measurement by Matthew S. Johnson and Daniel F. McCaffrey Section IV: Emerging Technologies Chapter 10: Extracting Linguistic Signal from Item Text and Its Application to Modeling Item Characteristics by Victoria Yaneva, Peter Baldwin, Le An Ha, and Christopher Runyon Chapter 11: Stealth Literacy Assessment: Leveraging Games and NLP in iSTART by Ying Fang, Laura K. Allen, Rod D. Roscoe, and Danielle S. McNamara Chapter 12: Measuring Scientific Understanding Across International Samples: The Promise of Machine Translation and NLP-based Machine Learning Technologies by Minsu Ha and Ross H. Nehm Chapter 13: Making Sense of College Students’ Writing Achievement and Retention with Automated Writing Evaluation by Jill Burstein, Daniel McCaffrey, Steven Holtzman & Beata Beigman Klebanov Contributor Biographies