Rennong Yang

X-LogSMask: Expand Transformer for Graph-Structured Data

Leyan Li, Rennong Yang, Zhenxing Zhang, Liping Hu

Transformers have become general-purpose architectures, but their all-to-all self-attention is poorly matched to graph data, whose interactions are sparse, structured and multi-scale. Existing Graph Transformers address this mismatch through structural encodings, hybrid message-p…Read more