CORTEXA
← Browse
crossrefMachine Learning and Knowledge Extraction2026-04-28Cited by 1

A Tiny Vision-Based Model for Real-Time Student Attention Detection in Online Classes

Chaymae Yahyati, Ismail Lamaakal, Yassine Maleh, Khalid El Makkaoui, Ibrahim Ouahbi

Online and blended classrooms widen access but remove the in-person cues instructors use to gauge attention. Prior work typically relies on heavy, cloud-bound or multimodal models that are hard to deploy on commodity laptops, treats attention as an unordered label without calibrated probabilities, and evaluates on subject-overlapping splits with limited robustness analysis. This creates a gap in Tiny, deployable, calibration-aware methods validated under realistic protocols. We address this gap with a TinyML, vision-only pipeline that estimates four attention levels: (Very Low, low, high, Very High ) from short webcam clips under strict on-device budgets. Each clip of T=30 frames at 224×224 is processed by a compact hybrid encoder: a CNN extracts per frame spatial features, a BiLSTM models temporal context, and a lightweight GRU refines dynamics; three parallel branches with staggered widths encourage feature diversity before fusion. We apply structured pruning of convolutional channels and recurrent units, post-training INT8 quantization, and temperature scaling for calibrated probabilities; models are exported as ONNX. On DAiSEE with subject-independent splits, the baseline attains 99.86% accuracy and 0.998 macro-F1, with strong ordinal agreement (QWK = 0.998, ordinal MAE = 0.03). The compressed model preserves reliability (macro-F1 = 0.995, QWK = 0.995), remains robust to low light, partial occlusion, and head yaw, and yields ∼4× smaller size and ∼2.3× CPU speedups. These results indicate a deployable, privacy-preserving approach to fine-grained, on-device attention analytics.

View free PDFSource page

Related papers

crossrefMachine Learning and Knowledge Extraction2023-11-07Cited by 19

Reconstruction-Based Adversarial Attack Detection in Vision-Based Autonomous Driving Systems

Manzoor Hussain, Jang-Eui Hong

The perception system is a safety-critical component that directly impacts the overall safety of autonomous driving systems (ADSs). It is imperative to ensure the robustness of the deep-learning model used in the perception system. However, studies have shown that these models ar…

View free PDFSource page
crossrefMachine Learning and Knowledge Extraction2024-05-03Cited by 8

VOD: Vision-Based Building Energy Data Outlier Detection

Jinzhao Tian, Tianya Zhao, Zhuorui Li, Tian Li, Haipei Bie, Vivian Loftness

Outlier detection plays a critical role in building operation optimization and data quality maintenance. However, existing methods often struggle with the complexity and variability of building energy data, leading to poorly generalized and explainable results. To address the gap…

View free PDFSource page
crossrefMachine Learning and Knowledge Extraction2026-03-09Cited by 2

Drift-Aware Online Ensemble Learning for Real-Time Cybersecurity in Internet of Medical Things Networks

Fazliddin Makhmudov, Gayrat Juraev, Ozod Yusupov, Parvina Nasriddinova, Dusmurod Kilichev

The rapid growth of Internet of Medical Things (IoMT) devices has revolutionized diagnostics and patient care within smart healthcare networks. However, this progress has also expanded the attack surface due to the heterogeneity and interconnectivity of medical devices. To overco…

View free PDFSource page
crossrefMachine Learning and Knowledge Extraction2024-01-26Cited by 18

Real-Time Droplet Detection for Agricultural Spraying Systems: A Deep Learning Approach

Nhut Huynh, Kim-Doang Nguyen

Nozzles are ubiquitous in agriculture: they are used to spray and apply nutrients and pesticides to crops. The properties of droplets sprayed from nozzles are vital factors that determine the effectiveness of the spray. Droplet size and other characteristics affect spray retentio…

View free PDFSource page
crossrefMachine Learning and Knowledge Extraction2023-09-29Cited by 8

Optimal Topology of Vision Transformer for Real-Time Video Action Recognition in an End-To-End Cloud Solution

Saman Sarraf, Milton Kabia

This study introduces an optimal topology of vision transformers for real-time video action recognition in a cloud-based solution. Although model performance is a key criterion for real-time video analysis use cases, inference latency plays a more crucial role in adopting such te…

View free PDFSource page
crossrefMachine Learning and Knowledge Extraction2026-04-15Cited by 1

Lightweight Deep Learning Models for Face Mask Detection in Real-Time Edge Environments: A Review and Future Research Directions

Saim Rasheed

Automated face mask detection remains an important component of hygiene compliance, occupational safety, and public health monitoring, even in post-pandemic environments where real-time and non-intrusive surveillance is required. Traditional deep learning models provide strong re…

View free PDFSource page