CORTEXA
← Browse
arxivcs.DLcs.AIcs.CL2026-06-27

Categorizing Mathematical Concepts with LLM Voting Ensembles in Mathswitch

Katja Berčič, Slobodan Stanojevikj

Mathswitch is an open-source project that imports mathematical concept records from sources such as Wikidata, Wikipedia, MathWorld, Encyclopedia of Mathematics, nLab, ProofWiki, and Agda-Unimath, and links records that refer to the same concept. It does not reorganize or redefine the imported content; each source retains its own structure. The current focus is on importing concept data from Wikidata and the resources it links to, with plans to expand to further sources and better concept linking. Because the concept set is approximated through queries over Wikidata's collaboratively edited graph, the imported data is noisy: some items are non-mathematical, while others are ambiguous. In this paper, we test whether a voting ensemble of LLM judges can filter this noise. We evaluate it on Wikidata items with known MathWorld identifiers as a positive control, and examine how classification changes when database identifiers are removed from context. We then inspect the cases where the judges disagree with MathWorld and group these disagreements into three categories (degenerate descriptions, narrow scope bias, and editorial-scope mismatches) that suggest different remediation strategies.

View free PDFSource page

Related papers

arxivcs.CLcs.AIcs.CVcs.DL2026-07-01

Reading Order Inference for Complex Document Layouts

Iddo Hakim, Sharva Gogawale, Omer Ventura, Gal Grudka, Daria Vasyutinsky-Shapira, Berat Kurar-Barakat, et al.

Reading order inference remains a critical bottleneck in the digitization of complex historical manuscripts, where pages contain multiple spatially interleaved reading streams, the canonical example being the Glossa Ordinaria layout, in which a central text is surrounded by comme…

View free PDFSource page
arxivcs.DLcs.AIcs.CL2026-06-28

Em-ergence of the em-dash: a population-level rise in em-dash frequency in medRxiv preprints at the dawn of the large-language-model era

Przemysław Czuma

Large language models (LLMs) can leave subtle stylistic traces in assisted text; one of the most cited is the em-dash (Unicode U+2014). Yet no one has measured whether em-dash use has changed in the scientific literature. This study, pre-registered on the Open Science Framework (…

View free PDFSource page
arxivcs.CLcs.AIcs.DLcs.HC2026-07-18

Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries

Mohammad Arvan, Amber E. Osterholt, Bailee Rue, Yuvaneswaren R. Sureshbabu, Krishna R. Patel, Rebecca T. Feinstein, et al.

Introduction. Clinical and Translational Science Award (CTSA) programs must document their scholars' research impact, but assembling each scholar's record by hand takes staff an estimated 15 hours and does not scale to a full cohort. An artificial intelligence (AI) agent could se…

View free PDFSource page
arxivcs.CLcs.AIcs.DLcs.IRcs.LG2026-07-10

Automatic Thematic Indexing of Large Literary Corpora: A Machine Learning Approach to Voltaire's Complete Works

Miguel Arana-Catania, Gillian Pink, Glenn Roe

Thematic indexing -- the practice of assigning structured conceptual labels to sections of text -- is essential to scholarly access in large-scale literary and historical editions, yet it remains a largely manual, labour-intensive process. This paper explores the application of m…

View free PDFSource page
arxivcs.CLcs.AIcs.DLcs.IRcs.LG2026-07-10

Letting the Data Speak: Extracting Keywords from Crowdsourced Collections with AI

Miguel Arana-Catania, Catherine Conisbee, Matthew Kidd

Identifying and assigning keywords at scale is a technical, practical, and ethical challenge for crowdsourced collections. This article reports the findings of the "Extracting Keywords from Crowdsourced Collections" project, which used the Their Finest Hour Online Archive, a crow…

View free PDFSource page