skip to main content

DOE PAGESDOE PAGES

Title: Cheaper Adjoints by Reversing Address Computations

The reverse mode of automatic differentiation is widely used in science and engineering. A severe bottleneck for the performance of the reverse mode, however, is the necessity to recover certain intermediate values of the program in reverse order. Among these values are computed addresses, which traditionally are recovered through forward recomputation and storage in memory. We propose an alternative approach for recovery that uses inverse computation based on dependency information. Address storage constitutes a significant portion of the overall storage requirements. An example illustrates substantial gains that the proposed approach yields, and we show use cases in practical applications.
Authors:
 [1] ;  [2] ;  [3]
  1. INRIA Sophia-Antipolis, 2004 Route des lucioles, BP 93 06902 Valbonne, France
  2. Argonne National Laboratory, MCS, Argonne, IL 60439, USA
  3. Department of Computer Science, RWTH Aachen University, 52056 Aachen, Germany
Publication Date:
OSTI Identifier:
1197992
Grant/Contract Number:
AC02-06CH11357
Type:
Published Article
Journal Name:
Scientific Programming
Additional Journal Information:
Journal Volume: 16; Journal Issue: 1; Related Information: CHORUS Timestamp: 2016-08-23 04:59:30; Journal ID: ISSN 1058-9244
Publisher:
Hindawi Publishing Corporation
Sponsoring Org:
USDOE
Country of Publication:
Egypt
Language:
English