The Memory Processing Unit: A Generalized Interface for End-to-End In-Memory Execution

Jan 31, 2026 by Minh S. Q. Truong, Yiqiu Sun, Dawei Xiong, Amol Shah, Alexander Glass, Abraham Farrell, James A. Bain, L. Carley, Saugata Ghose (International Symposium on High-Performance Computer Architecture)

DOI 10.1109/HPCA68181.2026.11408599

We built the Memory Processing Unit, a microarchitecture-agnostic interface that turns messy, microarchitecture-specific PUM islands into a coherent, scalable compute plane with an ISA, an ensemble execution model, and a control path that lets millions of in-memory vector units run end-to-end workloads without constant CPU babysitting. It maps cleanly to prior PUM datapaths and delivers big real-world wins in both performance and energy across kernels and full applications, so you can finally program inmemory computing like a first-class processor.

source S2, crossref