OpenABLext: An automatic code generation framework for agent-based simulations on CPU-GPU-FPGA heterogeneous platforms

Xiao, Jiajian; Andelfinger, Philipp; Cai, Wentong; Richmond, Paul; Knoll, Alois; Eckhoff, David

doi:10.1002/cpe.5807

OpenABLext: An automatic code generation framework for agent-based simulations on CPU-GPU-FPGA heterogeneous platforms

Journal Article · Tue Jun 02 00:00:00 EDT 2020 · Concurrency and Computation. Practice and Experience

DOI:https://doi.org/10.1002/cpe.5807· OSTI ID:1787232

^[1]; Andelfinger, Philipp ^[2]; Cai, Wentong ^[3]; Richmond, Paul ^[4]; Knoll, Alois ^[5]; Eckhoff, David ^[1]

TUMCREATE, Singapore (Singapore); Technical Univ. of Munich (Germany). Dept. of Informatics
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Computer Science and Mathematics Division
Nanyang Technological Univ. (Singapore). School of Computer Science and Engineering
Univ. of Sheffield (United Kingdom). Dept. of Computer Science
Technical Univ. of Munich (Germany). Dept. of Informatics; Nanyang Technological Univ. (Singapore). School of Computer Science and Engineering

The execution of agent-based simulations (ABSs) on hardware accelerator devices such as graphics processing units (GPUs) has been shown to offer great performance potentials. However, in heterogeneous hardware environments, it can become increasingly difficult to find viable partitions of the simulation and provide implementations for different hardware devices. To automate this process, we present OpenABLext, an extension to OpenABL, a model specification language for ABSs. By providing a device-aware OpenCL backend, OpenABLext enables the co-execution of ABS on heterogeneous hardware platforms consisting of central processing units, GPUs, and field programmable gate arrays (FPGAs).We present a novel online dispatching method that efficiently profiles partitions of the simulation during run-time to optimize the hardware assignment while using the profiling results to advance the simulation itself. In addition, OpenABLext features automated conflict resolution based on user-specified rules, supports graph-based simulation spaces, and utilizes an efficient neighbor search algorithm. We show the improved performance of OpenABLext and demonstrate the potential of FPGAs in the context of ABS. We illustrate how co-execution can be used to further lower execution times. OpenABLext can be seen as an enabler to tap the computing power of heterogeneous hardware platforms for ABS.

View Accepted Manuscript (DOE)

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1787232

Journal Information:: Concurrency and Computation. Practice and Experience, Journal Name: Concurrency and Computation. Practice and Experience Journal Issue: 21 Vol. 32; ISSN 1532-0626

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

References (29)

Artificial societies and generative social science Epstein, Joshua M.; Axtell, Robert Artificial Life and Robotics, Vol. 1, Issue 1 https://doi.org/10.1007/BF02471109	journal	March 1997
Heterogeneous parallel_for Template for CPU–GPU Chips Navarro, Angeles; Corbera, Francisco; Rodriguez, Andres International Journal of Parallel Programming, Vol. 47, Issue 2 https://doi.org/10.1007/s10766-018-0555-0	journal	January 2018
Cooperative CPU, GPU, and FPGA heterogeneous execution with EngineCL Dávila Guzmán, María Angélica; Nozal, Raúl; Gran Tejero, Rubén The Journal of Supercomputing, Vol. 75, Issue 3 https://doi.org/10.1007/s11227-019-02768-y	journal	February 2019
A framework for general sparse matrix–matrix multiplication on GPUs and heterogeneous processors Liu, Weifeng; Vinter, Brian Journal of Parallel and Distributed Computing, Vol. 85 https://doi.org/10.1016/j.jpdc.2015.06.010	journal	November 2015
Auto-tuned OpenCL kernel co-execution in OmpSs for heterogeneous systems Pérez, B.; Stafford, E.; Bosque, J. L. Journal of Parallel and Distributed Computing, Vol. 125 https://doi.org/10.1016/j.jpdc.2018.11.001	journal	March 2019
Mathematical Games Gardner, Martin Scientific American, Vol. 223, Issue 4 https://doi.org/10.1038/scientificamerican1070-120	journal	October 1970
Tutorial on agent-based modelling and simulation Macal, C. M.; North, M. J. Journal of Simulation, Vol. 4, Issue 3 https://doi.org/10.1057/jos.2010.3	journal	September 2010
High performance cellular level agent-based simulation with FLAME for the GPU Richmond, P.; Walker, D.; Coakley, S. Briefings in Bioinformatics, Vol. 11, Issue 3 https://doi.org/10.1093/bib/bbp073	journal	February 2010
Matrix multiplication on heterogeneous platforms Beaumont, O.; Boudet, V.; Rastello, F. IEEE Transactions on Parallel and Distributed Systems, Vol. 12, Issue 10 https://doi.org/10.1109/71.963416	journal	January 2001
Bridging the FPGA programmability-portability Gap via automatic OpenCL code generation and tuning Krommydas, Konstantinos; Sasanka, Ruchira; Feng, Wu-chun 2016 IEEE 27th International Conference on Application-specific Systems, Architectures and Processors (ASAP) https://doi.org/10.1109/ASAP.2016.7760796	conference	July 2016
Adaptive Partitioning for Iterated Sequences of Irregular OpenCL Kernels Huchant, Pierre; Barthou, Denis; Counilh, Marie-Christine 2018 30th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) https://doi.org/10.1109/CAHPC.2018.8645867	conference	September 2018
Automatic Command Queue Scheduling for Task-Parallel Workloads in OpenCL Aji, Ashwin Mandayam; Pena, Antonio J.; Balaji, Pavan 2015 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2015.15	conference	September 2015
Exploring Execution Schemes for Agent-Based Traffic Simulation on Heterogeneous Hardware Xiao, Jiajian; Andelfinger, Philipp; Eckhoff, David 2018 IEEE/ACM 22nd International Symposium on Distributed Simulation and Real Time Applications (DS-RT) https://doi.org/10.1109/DISTRA.2018.8601016	conference	October 2018
Efficient Neighbor Searching for Agent-Based Simulation on GPU Li, Xiaosong; Cai, Wentong; Turner, Stephen John 2014 IEEE/ACM 18th International Symposium on Distributed Simulation and Real Time Applications (DS-RT) https://doi.org/10.1109/DS-RT.2014.19	conference	October 2014
OpenCL Performance Prediction using Architecture-Independent Features Johnston, Beau; Falzon, Gregory; Milthorpe, Josh 2018 International Conference on High Performance Computing & Simulation (HPCS) https://doi.org/10.1109/HPCS.2018.00095	conference	July 2018
Automatic OpenCL Code Generation for Multi-device Heterogeneous Architectures Li, Pei; Brunet, Elisabeth; Trahay, Francois 2015 44th International Conference on Parallel Processing (ICPP) https://doi.org/10.1109/ICPP.2015.105	conference	September 2015
OpenACC to FPGA: A Framework for Directive-Based High-Performance Reconfigurable Computing Lee, Seyong; Kim, Jungwon; Vetter, Jeffrey S. 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS.2016.28	conference	May 2016
HeteroMap: A Runtime Performance Predictor for Efficient Processing of Graph Analytics on Heterogeneous Multi-Accelerators Ahmad, Masab; Dogan, Halit; Michael, Christopher J. 2019 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) https://doi.org/10.1109/ISPASS.2019.00039	conference	March 2019
Power analysis of sorting algorithms on FPGA using OpenCL Mahony, Aidan O.; Popovici, Emanuel 2018 29th Irish Signals and Systems Conference (ISSC) https://doi.org/10.1109/ISSC.2018.8585361	conference	June 2018
Modeling Crowd and Trained Leader Behavior during Building Evacuation Pelechano, Nuria; Badler, Norman IEEE Computer Graphics and Applications, Vol. 26, Issue 6 https://doi.org/10.1109/MCG.2006.133	journal	January 2006
A Novel Data-Partitioning Algorithm for Performance Optimization of Data-Parallel Applications on Heterogeneous HPC Platforms Khaleghzadeh, Hamidreza; Manumachu, Ravindranath Reddy; Lastovetsky, Alexey IEEE Transactions on Parallel and Distributed Systems, Vol. 29, Issue 10 https://doi.org/10.1109/TPDS.2018.2827055	journal	October 2018
Experiences creating three implementations of the repast agent modeling toolkit North, Michael J.; Collier, Nicholson T.; Vos, Jerry R. ACM Transactions on Modeling and Computer Simulation, Vol. 16, Issue 1 https://doi.org/10.1145/1122012.1122013	journal	January 2006
Liszt: a domain specific language for building portable mesh-based PDE solvers DeVito, Zachary; Duraisamy, Karthik; Darve, Eric Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063396	conference	January 2011
A dynamic self-scheduling scheme for heterogeneous multiprocessor architectures Belviranli, Mehmet E.; Bhuyan, Laxmi N.; Gupta, Rajiv ACM Transactions on Architecture and Code Optimization, Vol. 9, Issue 4 https://doi.org/10.1145/2400682.2400716	journal	January 2013
Fluidic Kernels: Cooperative Execution of OpenCL Programs on Multiple Heterogeneous Devices Pandit, Prasanna; Govindarajan, R. CGO '14: 12th Annual IEEE/ACM International Symposium on Code Generation and Optimization, Proceedings of Annual IEEE/ACM International Symposium on Code Generation and Optimization https://doi.org/10.1145/2544137.2544163	conference	October 2018
Delite: A Compiler Architecture for Performance-Oriented Embedded Domain-Specific Languages Sujeeth, Arvind K.; Brown, Kevin J.; Lee, Hyoukjoong ACM Transactions on Embedded Computing Systems, Vol. 13, Issue 4s https://doi.org/10.1145/2584665	journal	April 2014
Evaluation of Conflict Resolution Methods for Agent-Based Simulations on the GPU Yang, Mingyu; Andelfinger, Philipp; Cai, Wentong SIGSIM-PADS '18: SIGSIM Principles of Advanced Discrete Simulation, Proceedings of the 2018 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation https://doi.org/10.1145/3200921.3200940	conference	May 2018
A Survey on Agent-based Simulation Using Hardware Accelerators Xiao, Jiajian; Andelfinger, Philipp; Eckhoff, David ACM Computing Surveys, Vol. 51, Issue 6 https://doi.org/10.1145/3291048	journal	February 2019
MASON: A Multiagent Simulation Environment Luke, Sean; Cioffi-Revilla, Claudio; Panait, Liviu SIMULATION, Vol. 81, Issue 7 https://doi.org/10.1177/0037549705058073	journal	July 2005

Similar Records

Population Count on Intel® CPU, GPU, and FPGA

Conference · Tue Dec 31 23:00:00 EST 2019 · OSTI ID:1804082

Evaluation of CHO Benchmarks on the Arria 10 FPGA using Intel FPGA SDK for OpenCL

Technical Report · Tue May 23 00:00:00 EDT 2017 · OSTI ID:1372106

OpenACC to FPGA: A Framework for Directive-based High-Performance Reconfigurable Computing

Conference · Sun May 01 00:00:00 EDT 2016 · OSTI ID:1261388

Related Subjects

97 MATHEMATICS AND COMPUTING
FPGA
OpenABL
OpenCL
agent-based simulation
heterogeneous hardware

OpenABLext: An automatic code generation framework for agent-based simulations on CPU-GPU-FPGA heterogeneous platforms

Citation Formats

References (29)

Similar Records

Related Subjects