Skip to main navigation Skip to search Skip to main content

NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

  • Tianyi Zhang
  • , Jonah Yi
  • , Bowen Yao
  • , Zhaozhuo Xu
  • , Anshumali Shrivastava
  • Rice University

Research output: Contribution to journal › Conference article › peer-review

9 Scopus citations

Fingerprint

Dive into the research topics of 'NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention'. Together they form a unique fingerprint.
Sort by

Computer Science