skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Entropy vs. energy waveform processing: A comparison based on the heat equation

Journal Article · · Entropy
DOI:https://doi.org/10.3390/e17063518· OSTI ID:1211541
 [1];  [2];  [1];  [2];  [2]
  1. Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
  2. Washington University in St. Louis, St Louis, MO (United States)
+ Show Author Affiliations

Virtually all modern imaging devices collect electromagnetic or acoustic waves and use the energy carried by these waves to determine pixel values to create what is basically an “energy” picture. However, waves also carry “information”, as quantified by some form of entropy, and this may also be used to produce an “information” image. Numerous published studies have demonstrated the advantages of entropy, or “information imaging”, over conventional methods. The most sensitive information measure appears to be the joint entropy of the collected wave and a reference signal. The sensitivity of repeated experimental observations of a slowly-changing quantity may be defined as the mean variation (i.e., observed change) divided by mean variance (i.e., noise). Wiener integration permits computation of the required mean values and variances as solutions to the heat equation, permitting estimation of their relative magnitudes. There always exists a reference, such that joint entropy has larger variation and smaller variance than the corresponding quantities for signal energy, matching observations of several studies. Moreover, a general prescription for finding an “optimal” reference for the joint entropy emerges, which also has been validated in several studies.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
NIH EB002168; 5R21EB018095; NSF DMS 1300280; AC05-76RL01830
OSTI ID:
1211541
Journal Information:
Entropy, Vol. 17, Issue 6; ISSN 1099-4300
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 7 works
Citation information provided by
Web of Science

References (27)

Joint entropy of continuously differentiable ultrasonic waveforms journal January 2013
Real-time calculation of a limiting form of the Renyi entropy applied to detection of subtle changes in scattering architecture
  • Hughes, M. S.; McCarthy, J. E.; Wickerhauser, M. V.
  • The Journal of the Acoustical Society of America, Vol. 126, Issue 5, p. 2350-2358 https://doi.org/10.1121/1.3224714
journal November 2009
Application of Renyi entropy for ultrasonic molecular imaging journal January 2009
Analysis of digitized waveforms using Shannon entropy journal February 1993
Method of data reduction for accurate determination of acoustic backscatter coefficients
  • Madsen, Ernest L.; Insana, Michael F.; Zagzebski, James A.
  • The Journal of the Acoustical Society of America, Vol. 76, Issue 3 https://doi.org/10.1121/1.391317
journal September 1984
Properties of an entropy-based signal receiver with an application to ultrasonic molecular imaging
  • Hughes, M. S.; McCarthy, J. E.; Marsh, J. N.
  • The Journal of the Acoustical Society of America, Vol. 121, Issue 6, Article No. 3542 https://doi.org/10.1121/1.2722050
journal January 2007
Sensitive Ultrasonic Detection of Dystrophic Skeletal Muscle in Patients with Duchenne Muscular Dystrophy Using an Entropy-Based Signal Receiver journal August 2007
Improved signal processing to detect cancer by ultrasonic molecular imaging of targeted nanoparticles journal June 2011
Analysis of digitized waveforms using Shannon entropy. II. High‐speed algorithms based on Green’s functions journal May 1994
Error bounds on ultrasonic scatterer size estimates journal July 1996
Gray scale second harmonic imaging of acoustic emission signals improves detection of liver tumors in rabbits. journal August 2000
Transformations of Weiner Integrals Under Translations journal April 1944
A comparison of Shannon entropy versus signal energy for acoustic detection of artificially induced defects in Plexiglas journal April 1992
Comparing contrast-enhanced ultrasound to immunohistochemical markers of angiogenesis in a human melanoma xenograft model: preliminary results journal April 2002
Ultrasonic spectrum analysis for tissue evaluation journal February 2003
Analysis of time Series with Wavelets journal March 2007
Long Range Dependence, Unbalanced haar Wavelet Transformation and Changes in Local mean Level journal January 2009
Efficient Similarity Search for Multi-Dimensional time Sequences journal May 2010
Smoothing by spline functions journal October 1967
Characterization of digital waveforms using thermodynamic analogs: applications to detection of materials defects journal September 2005
Characterization of digital waveforms using thermodynamic analogs: detection of contrast-targeted tissue in vivo journal September 2006
Use of smoothing splines for analysis of backscattered ultrasonic waveforms: Application to monitoring of steroid treatment of dystrophic mice journal November 2011
Application of a real-time, calculable limiting form of the Renyi entropy for molecular imaging of tumors journal August 2010
The Wiener Integral journal February 1963
Notes on random functions journal December 1933
The Wiener integral book January 1967
The Wiener Integral book January 2007

Similar Records

Related Subjects

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY
information wave
optimal detection
entropy image
joint entropy