5 papers indexed
Ziyang Cai, Xingyu Zhu, Yihe Dong, Yinghui He, Sanjeev Arora
Transformer reasoning is limited by autoregressive decoding, which repeat edly compresses rich hidden computation through token space and makes it difficult for intermediate reasoning states to persist across time. We in troduce Transformers with Temporal Middle-Layer Recurrence…
Simran Kaur, Narutatsu Ri, Yinghui He, Liam Fowl, Sanjeev Arora
Self-distillation is a promising recipe for self-improvement in language models. In this setting, a model can serve as its own teacher when given privileged information, such as a solution to a math problem. This seems especially appealing for thinking models, which can use test-…
Weiwei Chen, Yinghui He, Zhong Ye, Dingzhu Wen, Guanding Yu
Integrated sensing, communication, and computation (ISCC) has recently emerged as a unified framework for enabling edge intelligence. However, existing ISCC designs predominantly rely on single-modal sensing, which is inherently vulnerable to occlusions, environmental uncertainti…
Zhong Ye, Yinghui He, Guanding Yu, Pavel Loskot
The unmanned aerial vehicles (UAVs) will play an important role in the future urban transportation systems. This requires designing robust localization schemes especially for non-cooperative UAVs that do not share any information about their movements. This paper designs a multim…
Ziqi Ye, Yinghui He, Weiwei Chen, Guanding Yu, Rui Zhang
Integrated sensing, communication, and computation (ISCC) is envisioned as a key enabler for intelligent services in future wireless networks. However, in multi-device ISCC systems, directly offloading full orthogonal frequency division multiplexing (OFDM) sensing data to the edg…