Clock Synchronization in High-end Computing Environments: A Strategy for Minimizing Clock Variance at Runtime

Jones, Terry R; Koenig, Gregory A

doi:10.1002/cpe.2868

Title: Clock Synchronization in High-end Computing Environments: A Strategy for Minimizing Clock Variance at Runtime

Journal Article · Tue Jan 01 00:00:00 EST 2013 · Concurrency and Computation. Practice and Experience

DOI:https://doi.org/10.1002/cpe.2868· OSTI ID:1105917

Jones, Terry R ^[1]; Koenig, Gregory A ^[1]

ORNL

We present a new software-based clock synchronization scheme that provides high precision time agreement among distributed memory nodes. The technique is designed to minimize variance from a reference chimer during runtime and with minimal time-request latency. Our scheme permits initial unbounded variations in time and corrects both slow and fast chimers (clock skew). An implementation developed within the context of the MPI message passing interface is described, and time coordination measurements are presented. Among our results, the mean time variance for a set of nodes improved from 20.0 milliseconds under standard Network Time Protocol (NTP) down to 2.29 secs under our scheme.

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: DE-AC05-00OR22725

OSTI ID:: 1105917

Journal Information:: Concurrency and Computation. Practice and Experience, Vol. 25, Issue 6; ISSN 1532-0626

Country of Publication:: United States

Language:: English

References (16)

Logical time in distributed computing systems Fidge, C. Computer, Vol. 24, Issue 8 https://doi.org/10.1109/2.84874	journal	August 1991
Time, clocks, and the ordering of events in a distributed system Lamport, Leslie Communications of the ACM, Vol. 21, Issue 7 https://doi.org/10.1145/359545.359563	journal	July 1978
A Paradigm Change: From Performance Monitoring to Performance Analysis DeRose, Luiz; Poxon, Heidi 2009 21st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) https://doi.org/10.1109/SBAC-PAD.2009.28	conference	October 2009
Characterizing the Influence of System Noise on Large-Scale Applications by Simulation Hoefler, Torsten; Schneider, Timo; Lumsdaine, Andrew 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.12	conference	November 2010
Improving the Scalability of Parallel Jobs by adding Parallel Awareness to the Operating System Jones, Terry; Tomlinson, Paul; Roberts, Mark Proceedings of the 2003 ACM/IEEE conference on Supercomputing - SC '03 https://doi.org/10.1145/1048935.1050161	conference	January 2003
The ghost in the machine: observing the effects of kernel operation on parallel application performance Nataraj, Aroon; Morris, Alan; Malony, Allen D. Proceedings of the 2007 ACM/IEEE conference on Supercomputing - SC '07 https://doi.org/10.1145/1362622.1362662	conference	January 2007
Characterizing application sensitivity to OS interference using kernel-level noise injection Ferreira, Kurt B.; Bridges, Patrick; Brightwell, Ron 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2008.5219920	conference	November 2008
A Clock Synchronization Strategy for Minimizing Clock Variance at Runtime in High-End Computing Environments Jones, Terry; Koenig, Gregory A. 2010 22nd International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) https://doi.org/10.1109/SBAC-PAD.2010.33	conference	October 2010
Time synchronization in sensor networks: a survey Sivrikaya, F.; Yener, B. IEEE Network, Vol. 18, Issue 4 https://doi.org/10.1109/MNET.2004.1316761	journal	July 2004
Internal Timer Synchronization for Parallel Event Tracing Doleschal, Jens; Knüpfer, Andreas; Müller, Matthias S. Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/978-3-540-87475-1_29	book	January 2008
Implications of non-constant clock drifts for the timestamps of concurrent events Becker, Daniel; Rabenseifner, Rolf; Wolf, Felix 2008 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTR.2008.4663756	conference	September 2008
Linux OS Jitter Measurements at Large Node Counts using a BlueGene/L Jones, Terry R.; Tauferner, Andrew; Inglett, Todd https://doi.org/10.2172/971232	report	January 2010
Probabilistic clock synchronization Cristian, Flaviu Distributed Computing, Vol. 3, Issue 3 https://doi.org/10.1007/BF01784024	journal	September 1989
The accuracy of the clock synchronization achieved by TEMPO in Berkeley UNIX 4.3BSD Gusella, R.; Zatti, S. IEEE Transactions on Software Engineering, Vol. 15, Issue 7 https://doi.org/10.1109/32.29484	journal	July 1989
The part-time parliament Lamport, Leslie ACM Transactions on Computer Systems, Vol. 16, Issue 2 https://doi.org/10.1145/279227.279229	journal	May 1998
Linux kernel co-scheduling for bulk synchronous parallel applications Jones, Terry Proceedings of the 1st International Workshop on Runtime and Operating Systems for Supercomputers - ROSS '11 https://doi.org/10.1145/1988796.1988805	conference	January 2011

Similar Records

A Clock Synchronization Strategy for Minimizing Clock Variance at Runtime in High-end Computing Environments

Conference · Fri Jan 01 00:00:00 EST 2010 · OSTI ID:1105917

Jones, Terry R; Koenig, Gregory A

Providing Runtime Clock Synchronization With Minimal Node-to-Node Time Deviation on XT4s and XT5s

Conference · Sat Jan 01 00:00:00 EST 2011 · OSTI ID:1105917

Jones, Terry R; Koenig, Gregory A

Automatic Halo Management for the Uintah GPU-Heterogeneous Asynchronous Many-Task Runtime

Journal Article · Fri Dec 07 00:00:00 EST 2018 · International Journal of Parallel Programming · OSTI ID:1105917

Peterson, Brad; Humphrey, Alan; Sunderland, Dan; +4 more

Related Subjects

Time service
clock synchronization
MPI
supercomputing
system software
programming tools

Title: Clock Synchronization in High-end Computing Environments: A Strategy for Minimizing Clock Variance at Runtime

Citation Formats

References (16)

Similar Records

Related Subjects