CORTEXA
← Browse
crossrefElectronics2026-02-19Cited by 1

Adaptive Lighting and Thermal Comfort Control Strategies in Digital Twin Classroom via Deep Reinforcement Learning

Xuegang Wu, Pinle Qin

With the advancement of smart education and carbon neutrality goals, optimizing Indoor Environmental Quality (IEQ) while minimizing energy consumption is critical. Traditional PID or rule-based strategies struggle with the strong non-linearity and time delays of photothermal coupling in high-density classrooms. This paper proposes an adaptive closed-loop control framework fusing Digital Twin (DT) and Deep Reinforcement Learning (DRL). A high-fidelity multi-physics model is constructed as a virtual testbed, utilizing the Proximal Policy Optimization (PPO) algorithm to learn multi-objective strategies. The trained agent is deployed to an edge gateway for real-time inference. Experimental results from a field study distinguish this work from pure simulations. Results demonstrate that compared to PID baselines, the proposed strategy reduces energy consumption by 28.4% while maintaining thermal comfort (PMV) and visual comfort compliance. Furthermore, the variance of PMV is reduced by 66.7%, and system recovery time under stochastic disturbances is shortened by 31.4%.

View free PDFSource page

Related papers

crossrefElectronics2025-08-26

Digital Twin-Assisted Deep Reinforcement Learning for Joint Caching and Power Allocation in Vehicular Networks

Guobin Zhang, Junran Su, Canxuan Zhong, Feng Ke, Yuling Liu

In recent years, digital twin technology has demonstrated remarkable potential in intelligent transportation systems, leveraging its capabilities of high-precision virtual mapping and real-time dynamic simulation of physical entities. By integrating multi-source data, it construc…

View free PDFSource page
crossrefElectronics2024-11-13Cited by 9

Literacy Deep Reinforcement Learning-Based Federated Digital Twin Scheduling for the Software-Defined Factory

Jangsu Ahn, Seongjin Yun, Jin-Woo Kwon, Won-Tae Kim

As user requirements become increasingly complex, the demand for product personalization is growing, but traditional hardware-centric production relies on fixed procedures that lack the flexibility to support diverse requirements. Although bespoke manufacturing has been introduce…

View free PDFSource page
crossrefElectronics2025-06-09Cited by 6

Rail Digital Twin and Deep Learning for Passenger Flow Prediction Using Mobile Data

Yuming Ou, Adriana-Simona Mihăiţă, Adrian Ellison, Tuo Mao, Seunghyeon Lee, Fang Chen

Predicting passenger flows in rail transport systems plays an important role for traffic management centers to make fast decisions during service disruptions. This paper presents an innovative cross-disciplinary approach based on digital twins, deep learning, and traffic simulati…

View free PDFSource page
crossrefElectronics2024-06-21Cited by 77

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

Yongfeng Yin, Zhetao Wang, Lili Zheng, Qingran Su, Yang Guo

Unmanned aerial vehicle (UAV) navigation plays a crucial role in its ability to perform autonomous missions in complex environments. Most of the existing reinforcement learning methods to solve the UAV navigation problem fix the flight altitude and velocity, which largely reduces…

View free PDFSource page
crossrefElectronics2022-08-24Cited by 20

Real-Time Drift-Driving Control for an Autonomous Vehicle: Learning from Nonlinear Model Predictive Control via a Deep Neural Network

Taekgyu Lee, Dongyoon Seo, Jinyoung Lee, Yeonsik Kang

A drift-driving maneuver is a control technique used by an expert driver to control a vehicle along a sharply curved path or slippery road. This study develops a nonlinear model predictive control (NMPC) method for the autonomous vehicle to perform a drift maneuver and generate t…

View free PDFSource page
crossrefElectronics2025-01-30Cited by 10

Collision Avoidance in Autonomous Vehicles Using the Control Lyapunov Function–Control Barrier Function–Quadratic Programming Approach with Deep Reinforcement Learning Decision-Making

Haochong Chen, Fengrui Zhang, Bilin Aksun-Guvenc

Collision avoidance and path planning are critical topics in autonomous vehicle development. This paper presents the progressive development of an optimization-based controller for autonomous vehicles using the Control Lyapunov Function–Control Barrier Function–Quadratic Programm…

View free PDFSource page