Applications of quantum entropy to statistics
This paper develops two generalizations of the maximum entropy (ME) principle. First, Shannon classical entropy is replaced by von Neumann quantum entropy to yield a broader class of information divergences (or penalty functions) for statistics applications. Negative relative quantum entropy enforces convexity, positivity, non-local extensivity and prior correlations such as smoothness. This enables the extension of ME methods from their traditional domain of ill-posed in-verse problems to new applications such as non-parametric density estimation. Second, given a choice of information divergence, a combination of ME and Bayes rule is used to assign both prior and posterior probabilities. Hyperparameters are interpreted as Lagrange multipliers enforcing constraints. Conservation principles are proposed to act statistical regularization and other hyperparameters, such as conservation of information and smoothness. ME provides an alternative to heirarchical Bayes methods.
- Research Organization:
- Los Alamos National Lab., NM (United States)
- Sponsoring Organization:
- USDOE, Washington, DC (United States)
- DOE Contract Number:
- W-7405-ENG-36
- OSTI ID:
- 10162539
- Report Number(s):
- LA-UR-94-2168; CONF-9408107-2; ON: DE94014416; TRN: 94:013105
- Resource Relation:
- Conference: American Statistical Association,Toronto (Canada),14-18 Aug 1994; Other Information: PBD: [1994]
- Country of Publication:
- United States
- Language:
- English
Similar Records
Density estimation by maximum quantum entropy
On variational definition of quantum entropy