Congratulations to PhD student Yoonseo Kim, who published in TESOL Quarterly!
Her article, “Automated Essay Scoring With GPT-4 for a Local Placement Test: Investigating Prompting Strategies, Intra-Rater Reliability, and Alignment With Human Scores,” originated from her qualifying paper.
The study explores the potential of OpenAI’s ChatGPT-4 (gpt-4-0613) as an automated essay scoring (AES) tool in a trial involving 300 essays from an American university’s academic English program placement test. The study also examined improvements through NLP-derived linguistics features and averaging multiple GPT-4 ratings.
Way to go, Yoonseo!
You can find the paper here: https://onlinelibrary.wiley.