Nonlinear Smoothing and the EM Algorithm for Positive Integral Equations of the First Kind
Abstract
We study a modification of the EMS algorithm in which each step of the EMS algorithm is preceded by a nonlinear smoothing step of the form Nfexp(S*log f) , where S is the smoothing operator of the EMS algorithm. In the context of positive integral equations (a la positron emission tomography) the resulting algorithm is related to a convex minimization problem which always admits a unique smooth solution, in contrast to the unmodified maximum likelihood setup. The new algorithm has slightly stronger monotonicity properties than the original EM algorithm. This suggests that the modified EMS algorithm is actually an EM algorithm for the modified problem. The existence of a smooth solution to the modified maximum likelihood problem and the monotonicity together imply the strong convergence of the new algorithm. We also present some simulation results for the integral equation of stereology, which suggests that the new algorithm behaves roughly like the EMS algorithm.
 Authors:
 Department of Mathematical Sciences, University of Delaware, Newark, DE 19716 (United States)
 Publication Date:
 OSTI Identifier:
 21064290
 Resource Type:
 Journal Article
 Resource Relation:
 Journal Name: Applied Mathematics and Optimization; Journal Volume: 39; Journal Issue: 1; Other Information: DOI: 10.1007/s002459900099; Copyright (c) 1999 SpringerVerlag New York Inc.; Article Copyright (c) Inc. 1999 SpringerVerlag New York; Country of input: International Atomic Energy Agency (IAEA)
 Country of Publication:
 United States
 Language:
 English
 Subject:
 71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; ALGORITHMS; CONVERGENCE; INTEGRAL EQUATIONS; MAXIMUMLIKELIHOOD FIT; MINIMIZATION; NONLINEAR PROBLEMS; POSITRON COMPUTED TOMOGRAPHY; SIMULATION
Citation Formats
Eggermont, P. P. B. Nonlinear Smoothing and the EM Algorithm for Positive Integral Equations of the First Kind. United States: N. p., 1999.
Web. doi:10.1007/S002459900099.
Eggermont, P. P. B. Nonlinear Smoothing and the EM Algorithm for Positive Integral Equations of the First Kind. United States. doi:10.1007/S002459900099.
Eggermont, P. P. B. Fri .
"Nonlinear Smoothing and the EM Algorithm for Positive Integral Equations of the First Kind". United States.
doi:10.1007/S002459900099.
@article{osti_21064290,
title = {Nonlinear Smoothing and the EM Algorithm for Positive Integral Equations of the First Kind},
author = {Eggermont, P. P. B.},
abstractNote = {We study a modification of the EMS algorithm in which each step of the EMS algorithm is preceded by a nonlinear smoothing step of the form Nfexp(S*log f) , where S is the smoothing operator of the EMS algorithm. In the context of positive integral equations (a la positron emission tomography) the resulting algorithm is related to a convex minimization problem which always admits a unique smooth solution, in contrast to the unmodified maximum likelihood setup. The new algorithm has slightly stronger monotonicity properties than the original EM algorithm. This suggests that the modified EMS algorithm is actually an EM algorithm for the modified problem. The existence of a smooth solution to the modified maximum likelihood problem and the monotonicity together imply the strong convergence of the new algorithm. We also present some simulation results for the integral equation of stereology, which suggests that the new algorithm behaves roughly like the EMS algorithm.},
doi = {10.1007/S002459900099},
journal = {Applied Mathematics and Optimization},
number = 1,
volume = 39,
place = {United States},
year = {Fri Jan 15 00:00:00 EST 1999},
month = {Fri Jan 15 00:00:00 EST 1999}
}

In (1) the problem of the conditioning of matrices arising in the numerical solution of integral equations of the first kind by Galerkin and collocation schemes was investigated. A lower bound on the matrix condition number was found and its behavior as a function of the smoothness of the kernel of the original equation was studied. Some numerical results presented in (1) and much more extensive studies reported in (2) served to demonstrate the validity and usefulness of the theory. In these studies all basis functions were required to be orthonormal. Current computational methods frequently use nonorthonormal bases (for example,more »

Numerical experiments involving Galerkin and collocation methods for linear integral equations of the first kind
Recently effrots have been made to quantify the difficulties inherent in numerically sovling linear Fredholm integral equations of the first kind (J. Integral Equations, to appear.). In particular, the classical quadrature approach, collocation methods, and Galerkin schemes that make use of various orthonormal basis functions have been shown to lead to matrices with high condition numbers. In fact, it has been possible to obtain explicit lower bounds on these condition numbers as a function of the smoothness of the kernel, essentially independent of the choice of orthonormal basis. These bounds all approach infinity as the number of basis functions increases.more » 
Quadratureiteration method and quadraturesplitting method for Volterra integral equations of the second kind
We construct and analyze for convergence a quadratureiteration method for Volterra integral equations of the second kind and a quadraturesplitting method for linear equations. The iteration processes producing an approximate solution are accelerated, because the integral operator is approximated by a quadrature operator with an arbitrarily small residual operator.