On the implementation of automatic differentiation tools.
Automatic differentiation is a semantic transformation that applies the rules of differential calculus to source code. It thus transforms a computer program that computes a mathematical function into a program that computes the function and its derivatives. Derivatives play an important role in a wide variety of scientific computing applications, including numerical optimization, solution of nonlinear equations, sensitivity analysis, and nonlinear inverse problems. We describe the forward and reverse modes of automatic differentiation and provide a survey of implementation strategies. We describe some of the challenges in the implementation of automatic differentiation tools, with a focus on tools based on source transformation. We conclude with an overview of current research and future opportunities.
- Research Organization:
- Argonne National Lab. (ANL), Argonne, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC); FOR
- DOE Contract Number:
- DE-AC02-06CH11357
- OSTI ID:
- 965748
- Report Number(s):
- ANL/MCS/JA-50315; TRN: US200920%%393
- Journal Information:
- Higher-Order Symbol. Comput., Vol. 21, Issue 3 ; 2008
- Country of Publication:
- United States
- Language:
- ENGLISH
Similar Records
On combining computational differentiation and toolkits for parallel scientific computing.
OpenAD/F : a modular, open-source tool for automatic differentiation of Fortran codes.