Clock Synchronization in High-end Computing Environments: A Strategy for Minimizing Clock Variance at Runtime

Jones, Terry R; Koenig, Gregory A

doi:10.1002/cpe.2868

Clock Synchronization in High-end Computing Environments: A Strategy for Minimizing Clock Variance at Runtime

Journal Article · Tue Jan 01 04:00:00 EST 2013 · Concurrency and Computation. Practice and Experience

DOI:https://doi.org/10.1002/cpe.2868· OSTI ID:1105917

Jones, Terry R ^[1]; Koenig, Gregory A ^[1]

ORNL

We present a new software-based clock synchronization scheme that provides high precision time agreement among distributed memory nodes. The technique is designed to minimize variance from a reference chimer during runtime and with minimal time-request latency. Our scheme permits initial unbounded variations in time and corrects both slow and fast chimers (clock skew). An implementation developed within the context of the MPI message passing interface is described, and time coordination measurements are presented. Among our results, the mean time variance for a set of nodes improved from 20.0 milliseconds under standard Network Time Protocol (NTP) down to 2.29 secs under our scheme.

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: DOE Office of Science; SC USDOE - Office of Science (SC)

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1105917

Journal Information:: Concurrency and Computation. Practice and Experience, Journal Name: Concurrency and Computation. Practice and Experience Journal Issue: 6 Vol. 25; ISSN 1532-0626

Country of Publication:: United States

Language:: English

References (18)

Scalable Parallel Trace-Based Performance Analysis Geimer, Markus; Wolf, Felix; Wylie, Brian J. N. Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/11846802_43	book	January 2006
The Vampir Performance Analysis Tool-Set Knupfer, Andreas; Brunst, Holger; Doleschal, Jens Tools for High Performance Computing https://doi.org/10.1007/978-3-540-68564-7_9	book	January 2008
Internal Timer Synchronization for Parallel Event Tracing Doleschal, Jens; Knüpfer, Andreas; Müller, Matthias S. Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/978-3-540-87475-1_29	book	January 2008
Probabilistic clock synchronization Cristian, Flaviu Distributed Computing, Vol. 3, Issue 3 https://doi.org/10.1007/BF01784024	journal	September 1989
Logical time in distributed computing systems Fidge, C. Computer, Vol. 24, Issue 8 https://doi.org/10.1109/2.84874	journal	August 1991
The accuracy of the clock synchronization achieved by TEMPO in Berkeley UNIX 4.3BSD Gusella, R.; Zatti, S. IEEE Transactions on Software Engineering, Vol. 15, Issue 7 https://doi.org/10.1109/32.29484	journal	July 1989
Implications of non-constant clock drifts for the timestamps of concurrent events Becker, Daniel; Rabenseifner, Rolf; Wolf, Felix 2008 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTR.2008.4663756	conference	September 2008
Time synchronization in sensor networks: a survey Sivrikaya, F.; Yener, B. IEEE Network, Vol. 18, Issue 4 https://doi.org/10.1109/MNET.2004.1316761	journal	July 2004
A Paradigm Change: From Performance Monitoring to Performance Analysis DeRose, Luiz; Poxon, Heidi 2009 21st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) https://doi.org/10.1109/SBAC-PAD.2009.28	conference	October 2009
A Clock Synchronization Strategy for Minimizing Clock Variance at Runtime in High-End Computing Environments Jones, Terry; Koenig, Gregory A. 2010 22nd International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) https://doi.org/10.1109/SBAC-PAD.2010.33	conference	October 2010
Characterizing application sensitivity to OS interference using kernel-level noise injection Ferreira, Kurt B.; Bridges, Patrick; Brightwell, Ron 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2008.5219920	conference	November 2008
Characterizing the Influence of System Noise on Large-Scale Applications by Simulation Hoefler, Torsten; Schneider, Timo; Lumsdaine, Andrew 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.12	conference	November 2010
Improving the Scalability of Parallel Jobs by adding Parallel Awareness to the Operating System Jones, Terry; Tomlinson, Paul; Roberts, Mark Proceedings of the 2003 ACM/IEEE conference on Supercomputing - SC '03 https://doi.org/10.1145/1048935.1050161	conference	January 2003
The ghost in the machine: observing the effects of kernel operation on parallel application performance Nataraj, Aroon; Morris, Alan; Malony, Allen D. Proceedings of the 2007 ACM/IEEE conference on Supercomputing - SC '07 https://doi.org/10.1145/1362622.1362662	conference	January 2007
Linux kernel co-scheduling for bulk synchronous parallel applications Jones, Terry Proceedings of the 1st International Workshop on Runtime and Operating Systems for Supercomputers - ROSS '11 https://doi.org/10.1145/1988796.1988805	conference	January 2011
The part-time parliament Lamport, Leslie ACM Transactions on Computer Systems, Vol. 16, Issue 2 https://doi.org/10.1145/279227.279229	journal	May 1998
Time, clocks, and the ordering of events in a distributed system Lamport, Leslie Communications of the ACM, Vol. 21, Issue 7 https://doi.org/10.1145/359545.359563	journal	July 1978
Linux OS Jitter Measurements at Large Node Counts using a BlueGene/L Jones, Terry R.; Tauferner, Andrew; Inglett, Todd https://doi.org/10.2172/971232	report	January 2010

Similar Records

A Clock Synchronization Strategy for Minimizing Clock Variance at Runtime in High-end Computing Environments

Conference · Thu Dec 31 23:00:00 EST 2009 · OSTI ID:1056896

Providing Runtime Clock Synchronization With Minimal Node-to-Node Time Deviation on XT4s and XT5s

Conference · Fri Dec 31 23:00:00 EST 2010 · OSTI ID:1016620

Automatic Halo Management for the Uintah GPU-Heterogeneous Asynchronous Many-Task Runtime

Journal Article · Thu Dec 06 23:00:00 EST 2018 · International Journal of Parallel Programming · OSTI ID:1567537

Related Subjects

MPI
Time service
clock synchronization
programming tools
supercomputing
system software

Clock Synchronization in High-end Computing Environments: A Strategy for Minimizing Clock Variance at Runtime

Citation Formats

References (18)

Similar Records

Related Subjects