CORTEXA
← Browse
arxivcs.CYcs.HC2026-07-17

Student Evaluation of Repeated AI Feedback Across a Semester of Writing

Andres Karjus, Janika Leoste, Tiia Õun

Generative AI is increasingly used for feedback in higher education, but evidence from repeated classroom use remains limited. This short paper analyses 2988 reflective essay-feedback-appraisal instances from 283 Estonian bachelor students across one semester. Students obtained and assessed feedback from a self-selected AI tool using a uniform prompt. The present analysis of the anonymized text corpus covers essay content, AI feedback, and its perceived helpfulness. Students found feedback helpful and actionable more often than not; about a tenth thought AI unhelpful, more so towards the end of the semester. We also analyzed essay reflection depth, and used a validated AI text classifier to estimate the share of essays that could be treated as likely unaided student writing. The study contributes descriptive classroom evidence on integration of AI feedback - a fast and scalable way to provide immediate writing advice, but not a self-contained route to better reflection. Benefits depend on whether students learn to use AI selectively and critically, without sliding into over-use harmful for the learning process.

View free PDFSource page

Related papers

arxivcs.AIcs.CLcs.CYcs.HC2026-07-15

Measuring How Students Rely on Generative AI in Academic Writing: Development and Multi-Source Validation of the Generative AI Reliance Types Scale (GenAI-RTS)

Shahin Hossain, Tukhbita Afroz Nawmi

As generative AI (GenAI) becomes increasingly embedded in undergraduate academic writing, how students rely on these tools, rather than simply whether they use them, has become a central question for learning, academic integrity, and educational equity. Existing measures of relia…

View free PDFSource page
arxivcs.CYcs.AIcs.HC2026-07-15

Learning Engagement Assistant (LEA): Cross-Course Scalability and Classroom Evaluation of an Agentic AI Tutoring System

Teri Rumble, Javad Zarrin, P. George Lovell, Ruth Falconer

This paper is an extension of a paper presented at the ICAART 2026 conference, which introduced LEA (Learning Engagement Assistant), an adaptive AI tutoring agent combining course-specific Retrieval-Augmented Generation (RAG) with structured Knowledge Component (KC) models across…

View free PDFSource page
arxivcs.CYcs.AIcs.HC2026-06-27

Four Types of LLM Reliance and Their Predictors Among Undergraduate Writers: A Mixed-Methods Study at a Minority-Serving R1 University

Shahin Hossain

Although most undergraduates now use large language models (LLMs), a form of generative artificial intelligence (GenAI) for academic writing, no validated method distinguishes the qualitatively different ways students rely on them. Existing instruments assess reliance solely by f…

View free PDFSource page
arxivcs.HCcs.AIcs.CY2026-06-26

Generative AI Literacy Training Improves Intelligence Analysts' Discrimination of Real and AI-Generated Images

Negar Kamali, Candice Rockell Gerstner, Jessica Hullman, Matthew Groh

Across social and online platforms, people are increasingly exposed to AI-generated images. As a consequence, the task of distinguishing AI-generated from authentic images is becoming a central challenge for information ecosystems. While humans perform better than chance, accurac…

View free PDFSource page
arxivcs.HCcs.AIcs.CY2026-06-28

LLMography: Transforming Human-AI Conversations into Traceability, Oversight, and Auditability Indicators

Mohammed Bousmah

The growing use of Large Language Models (LLMs) in education, software engineering, academic writing, and technical documentation raises a key question: how can we evaluate not only AI-assisted outputs, but also the interaction process that produced them? Current debates often fo…

View free PDFSource page
arxivcs.HCcs.AIcs.CYcs.ETeess.SY2026-07-01

AI, Trust, and Teaming: The Humans-as-Handlers Approach for Autonomous and Opaque AI Systems

Nathan G. Wood

Artificial intelligence (AI) is becoming ubiquitous, and across domains, increasingly autonomous systems are carrying out tasks which raise significant ethical and legal challenges which demonstrate a need for strong human-machine teams rooted in trust. In this article, I argue t…

View free PDFSource page