Antonino Tumeo

ELiTeFormer: An Efficient Transformer for FPGAs

Victor Agostinelli, Nicolas Bohm Agostini, Antonino Tumeo

Transformer blocks are prevalent in large language model (LLM) but present deployment challenges due to their challenging computational and memory demands. While prior work has typically optimized attention mechanisms or feed-forward networks (FFNs) separately, few hardware (HW)…Read more