Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

A Survey on the Expanding Scope and Interdisciplinary Opportunities for Processing-in-Memory Techniques

Journal Article · · IEEE Access
Processing-in-Memory (PIM) is emerging as a practical path to overcome the limitations of traditional von Neumann architectures. At its core, PIM systems implement computing primitives such as logic operations and multiply-accumulate acceleration through compute-in-memory, near-memory processing, or hybrid designs. The role of memory cells varies widely across technologies, acting as inputs, outputs, or analog accumulators through bit-lines and sense amplifiers. This diversity creates trade-offs in precision, bandwidth, latency, and programmability, making it difficult to build a unified understanding on the progress of the field. In this survey, we organize recent advances of PIM into three areas. First, we discuss the progress on the architectural optimizations of PIM and its integration with both DRAM and emerging non-volatile memories. Second, we examine how PIM is being used to accelerate key computing domains, including generative AI workloads and high-performance kernels, along with new approaches. Third, we highlight the growing adoption of PIM in computational sciences, where it is being applied to solve interdisciplinary problems such as genome analysis, mRNA quantification, mass spectrometry, quantum circuit simulation, wave modeling, and secure computation. Finally, we synthesize the major challenges that continue to slow PIM adoption, including manufacturing constraints, power delivery, thermal reliability, data consistency, runtime and memory-management coordination, and the difficulty of building portable software abstractions without sacrificing commercial viability. This work provides an updated, structured perspective on PIM’s potential across computing and computational sciences and the barriers that must be solved for it to reach its full impact.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC05-00OR22725; SC0025645
Other Award/Contract Number:
FOA-0003264
FWPERKJ452
OSTI ID:
3019921
Journal Information:
IEEE Access, Journal Name: IEEE Access Vol. 14; ISSN 2169-3536
Publisher:
IEEECopyright Statement
Country of Publication:
United States
Language:
English

References (76)

Sim 2 PIM: A complete simulation framework for Processing-in-Memory journal July 2022
GraphA: An efficient ReRAM-based architecture to accelerate large scale graph processing journal December 2022
Wafer-scale solution-processed 2D material analog resistive memory array for memory-based computing journal June 2022
A framework for high-throughput sequence alignment using real processing-in-memory systems journal March 2023
BIMSA: accelerating long sequence alignment using processing-in-memory journal October 2024
Benchmarking a New Paradigm: Experimental Analysis and Characterization of a Real Processing-in-Memory System journal January 2022
MLIR: Scaling Compiler Infrastructure for Domain Specific Computation conference February 2021
PIM-Quantifier: A Processing-in-Memory Platform for mRNA Quantification conference December 2021
SynCron: Efficient Synchronization Support for Near-Data-Processing Architectures conference February 2021
DIMM-Link: Enabling Efficient Inter-DIMM Communication for Near-Memory Processing conference February 2023
Pathfinding Future PIM Architectures by Demystifying a Commercial PIM Technology conference March 2024
GoPIM: GCN-Oriented Pipeline Optimization for PIM Accelerators conference March 2025
PIMnet: A Domain-Specific Network for Efficient Collective Communication in Scalable PIM conference March 2025
PAISE: PIM-Accelerated Inference Scheduling Engine for Transformer-based LLM conference March 2025
FACIL: Flexible DRAM Address Mapping for SoC-PIM Cooperative On-device LLM Inference conference March 2025
Demystifying the Characteristics of High Bandwidth Memory for Real-Time Systems conference November 2021
Polynesia: Enabling High-Performance and Energy-Efficient Hybrid Transactional/Analytical Databases with Hardware/Software Co-Design conference May 2022
Demystifying the characteristics of 3D-stacked memories: A case study for Hybrid Memory Cube conference October 2017
ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars conference June 2016
Hardware Architecture and Software Stack for PIM Based on Commercial DRAM Technology : Industrial Product conference June 2021
ABC-DIMM: Alleviating the Bottleneck of Communication in DIMM-based Near-Memory Processing with Inter-DIMM Broadcast conference June 2021
NDPBridge: Enabling Cross-Bank Coordination in Near-DRAM-Bank Processing Architectures conference June 2024
On Error Correction for Nonvolatile Processing-In-Memory conference June 2024
Power, Performance, Area and Cost Analysis of Memory-on-Logic Face-to-Face Bonded 3D Processor Designs conference July 2021
SpecPCM: A Low-Power PCM-Based In-Memory Computing Accelerator for Full-Stack Mass Spectrometry Analysis journal January 2024
PIMSim: A Flexible and Detailed Processing-in-Memory Simulator journal January 2019
Exploring PIM Architecture for High-Performance Graph Pattern Mining journal July 2021
Hybrid MTJ/CNTFET-Based Binary Synapse and Neuron for Process-in-Memory Architecture journal January 2023
Newton: A DRAM-maker’s Accelerator-in-Memory (AiM) Architecture for Machine Learning conference October 2020
Low-Overhead General-Purpose Near-Data Processing in CXL Memory Expanders conference November 2024
PIM-MMU: A Memory Management Unit for Accelerating Data Transfers in Commercial PIM Systems conference November 2024
REGA: Scalable Rowhammer Mitigation with Refresh-Generating Activations conference May 2023
A Method for Efficient Heterogeneous Parallel Compilation: A Cryptography Case Study conference December 2024
Evaluation of Hybrid Memory Technologies Using SOT-MRAM for On-Chip Cache Hierarchy journal March 2015
DyPhase: A Dynamic Phase Change Memory Architecture With Symmetric Write Latency and Restorable Endurance journal September 2018
DRAM-Based Acceleration of Open Modification Search in Hyperdimensional Space journal September 2024
Bank on Compute-Near-Memory: Design Space Exploration of Processing-Near-Bank Architectures journal November 2024
FHEmem: A Processing In-Memory Accelerator for Fully Homomorphic Encryption journal October 2025
Thermal Simulation of Processing-in-Memory Devices using HotSpot 7.0 conference September 2021
CiMBA: Accelerating Genome Sequencing Through On-Device Basecalling via Compute-in-Memory journal June 2025
IMCRYPTO: An In-Memory Computing Fabric for AES Encryption and Decryption journal May 2022
Impact of 3-D Integration on Thermal Performance of RISC-V MemPool Multicore SOC journal December 2023
CMOS Scaling by Nanosheet Device Architectures and Backside Engineering conference April 2024
Samsung PIM/PNM for Transfmer Based AI : Energy Efficiency on PIM/PNM Cluster conference August 2023
25.4 A 20nm 6GB Function-In-Memory DRAM, Based on HBM2 with a 1.2TFLOPS Programmable Computing Unit Using Bank-Level Parallelism, for Machine Learning Applications conference February 2021
Performance Impact of a Slower Main Memory conference October 2016
Concurrent Data Structures for Near-Memory Computing conference July 2017
Google Workloads for Consumer Devices
  • Boroumand, Amirali; Ghose, Saugata; Kim, Youngsok
  • Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems https://doi.org/10.1145/3173162.3173177
conference March 2018
TensorDIMM conference October 2019
Gearbox conference June 2022
To PIM or not for emerging general purpose processing in DDR memory systems conference June 2022
Wave-PIM: Accelerating Wave Simulation Using Processing-in-Memory conference August 2021
Accelerating Weather Prediction Using Near-Memory Reconfigurable Fabric
  • Singh, Gagandeep; Diamantopoulos, Dionysios; Gómez-Luna, Juan
  • ACM Transactions on Reconfigurable Technology and Systems, Vol. 15, Issue 4 https://doi.org/10.1145/3501804
journal June 2022
SYCLops: A SYCL Specific LLVM to MLIR Converter conference May 2022
MemFHE: End-to-end Computing with Fully Homomorphic Encryption in Memory journal March 2024
MetaNMP: Leveraging Cartesian-Like Product to Accelerate HGNNs with Near-Memory Processing conference June 2023
PIMFlow: Compiler and Runtime Support for CNN Models on Processing-in-Memory DRAM conference February 2023
A Full-System Perspective on UPMEM Performance conference October 2023
AttAcc! Unleashing the Power of PIM for Batched Transformer-based Generative Model Inference
  • Park, Jaehyun; Choi, Jaewan; Kyung, Kwanhee
  • Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 https://doi.org/10.1145/3620665.3640422
conference April 2024
NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing
  • Heo, Guseul; Lee, Sangyeop; Cho, Jaehong
  • Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3 https://doi.org/10.1145/3620666.3651380
conference April 2024
CINM (Cinnamon): A Compilation Infrastructure for Heterogeneous Compute In-Memory and Compute Near-Memory Paradigms
  • Khan, Asif Ali; Farzaneh, Hamid; Friebel, Karl Friedrich Alexander
  • Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 4 https://doi.org/10.1145/3622781.3674189
conference April 2024
A Real-time Execution System of Multimodal Transformer through PIM-GPU Collaboration conference June 2024
vPIM: Processing-in-Memory Virtualization conference December 2024
PimPam: Efficient Graph Pattern Matching on Real Processing-in-Memory Hardware journal May 2024
PIMutation: Exploring the Potential of Real PIM Architecture for Quantum Circuit Simulation conference January 2025
Load Balanced PIM-Based Graph Processing journal June 2024
PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System
  • He, Yintao; Mao, Haiyu; Giannoula, Christina
  • Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 https://doi.org/10.1145/3676641.3716009
conference March 2025
PUSHtap: PIM-based In-Memory HTAP with Unified Data Storage Format
  • Zhao, Yilong; Gao, Mingyu; Zhang, Huanchen
  • Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3 https://doi.org/10.1145/3676642.3736120
conference August 2025
LOGIC: Logic Synthesis for Digital In-Memory Computing
  • Rashed, Muhammad Rashedul Haq; Thijssen, Sven; Jha, Sumit
  • ACM Transactions on Design Automation of Electronic Systems, Vol. 30, Issue 2 https://doi.org/10.1145/3711848
journal February 2025
Processing-in-memory: A workload-driven perspective journal November 2019
Medium-Temperature-Oxidized GeOx Resistive-Switching Random-Access Memory and Its Applicability in Processing-in-Memory Computing journal July 2022
DAISM: Digital Approximate In-SRAM Multiplier-Based Accelerator for DNN Training and Inference conference March 2024
SpecHD: Hyperdimensional Computing Framework for FPGA-Based Mass Spectrometry Clustering conference March 2024
PIMSIM-NN: An ISA-based Simulation Framework for Processing-in-Memory Accelerators conference March 2024
Programming Model Extensions for General-Purpose Processing-In-Memory conference May 2024
Nano-Through Silicon Vias (nTSV) for Backside Power Delivery Networks (BSPDN) conference June 2023

Similar Records

PIMS: Memristor-Based Processing-in-Memory-and-Storage.
Technical Report · Wed Jan 31 23:00:00 EST 2018 · OSTI ID:1424888

A survey on processing-in-memory techniques: Advances and challenges
Journal Article · Wed Dec 28 19:00:00 EST 2022 · Memories, Materials, Devices, Circuits and Systems · OSTI ID:1908067

Building more powerful less expensive supercomputers using Processing-In-Memory (PIM) LDRD final report.
Technical Report · Tue Sep 01 00:00:00 EDT 2009 · OSTI ID:993898

Related Subjects