CORTEXA
← Browse
arxivcs.CLcs.AIcs.HCcs.LG2026-07-10

A small language model detects behavioural faithfulness gaps that frontier judges and human raters miss

Kwan Soo Shin, In Seok Kang, Yunkyung Min, Munho Lee

Whether a language model behaves as it claims is a judgement on which independent human raters cannot agree (Fleiss kappa = 0.074). We show that a small, purpose-built instrument does better. A linear read-out of the frozen representation of a from-scratch 146-million-parameter auditor detects companion-induced sycophancy, dependence-fostering and confabulated memories on generator models unseen in training (AUROC 0.804, leave-one-generator-out, against ground truth fixed at generation, independent of human judgement), where a frontier zero-shot judge on the identical items reaches 0.721 and falls to chance on the most distant family. The auditor's substrate is hyperbolic, and its demonstrated benefit is hierarchical: an ablation isolates the advantage over a matched Euclidean control on multi-domain structure. On this task, behavioural faithfulness is measured not by scale but by a small, purpose-built instrument.

View free PDFSource page

Related papers

arxivcs.CLcs.AIcs.HCcs.LG2026-07-09

LEXIC: Lightweight Eye-tracking eXtension via Injected Complexity

Sumin Lee, Kyeonghun Kim, Subeen Lee, Jiwon Yang, Tien Nguyen, Ken Ying-Kai Liao, et al.

On the recent EyeBench benchmark, predicting reading comprehension from eye movements exposes a stark gap: text-aware models using pretrained language models reach 56--63% AUROC, while gaze-only models operate at chance. We ask how far a gaze-only model can be pushed by lightweig…

View free PDFSource page
arxivcs.AIcs.CLcs.HCcs.IRcs.LG2026-06-26

DysLexLens: A Low-Resource LLM Framework for Analysing Dyslexic Learners Insights from Online Forums

Dana Rezazadegan, Atie Kia, Phongpadid Nandavong, Dominique Carlon, Jeremy Nguyen, Abhik Banerjee, et al.

Dyslexic learners increasingly use artificial intelligence (AI) tools to support reading, writing, organisation, and study-related tasks. However, their lived experiences with these tools remain largely underexamined. This paper proposes DysLexLens, a low-resource LLM framework,…

View free PDFSource page
arxivcs.CLcs.AIcs.CYcs.ETcs.HC2026-07-14

Evaluating Health Misinformation in Low-Resource Languages: Integrating Small Language Models with a Culturally-Sensitive Responsible NLP Framework (Bangla as a Case Study)

Farnaz Farid, Raihan Alam, Al Al-Areqi, Farhad Ahamed, Muhammad Hassan Khan, Sadia Hossain, et al.

Artificial Intelligence (AI) technologies, while serving as a foundational enabler for modern social media and digital health services, exert a bivalent effect by simultaneously acting as a combatant against and a spread vector for misinformation. A prevalent challenge in mitigat…

View free PDFSource page
arxivcs.AIcs.CLcs.LGcs.SIphysics.soc-ph2026-07-13

Reproducing human biases in route choice using large language models: Toward scalable behavioral modeling

Jiangtao Han, Shoufeng Ma, Shuxian Xu, Geng Li, Shuai Ling, Ning Jia, et al.

Human choice behavior, including route choice, exhibits systematic behavioral biases that deviate from the assumptions of full rationality. Cumulative prospect theory (CPT) has been widely recognized as an effective framework for characterizing such behavioral patterns. However,…

View free PDFSource page