Systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data
Abstract
In accordance with some embodiments, systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data are provided. In some embodiments, the system comprises: first detectors configured to detect a level of photons proportional to incident photon flux; second detectors configured to detect arrival of individual photons; a processor programmed to: receive, from the first detectors, first values indicative of photon flux from a scene with a first resolution; receive, from the second detectors, second values indicative of photon flux from the scene with a lower resolution; provide a first encoder of a trained machine learning model first flux values based on the first values, provide the second encoder of the model second flux values; receive, as output, values indicative of photon flux from the scene; and generate a high dynamic range image based on the third plurality of values.
- Inventors:
- Issue Date:
- Research Org.:
- Univ. of Wisconsin, Madison, WI (United States)
- Sponsoring Org.:
- USDOE; National Science Foundation (NSF)
- OSTI Identifier:
- 2222316
- Patent Number(s):
- 11758297
- Application Number:
- 17/572,236
- Assignee:
- Wisconsin Alumni Research Foundation (Madison, WI)
- DOE Contract Number:
- NA0003921; 1846884
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 01/10/2022
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Gutierrez Barragan, Felipe, Liu, Yuhao, Ingle, Atul, Gupta, Mohit, and Velten, Andreas. Systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data. United States: N. p., 2023.
Web.
Gutierrez Barragan, Felipe, Liu, Yuhao, Ingle, Atul, Gupta, Mohit, & Velten, Andreas. Systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data. United States.
Gutierrez Barragan, Felipe, Liu, Yuhao, Ingle, Atul, Gupta, Mohit, and Velten, Andreas. Tue .
"Systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data". United States. https://www.osti.gov/servlets/purl/2222316.
@article{osti_2222316,
title = {Systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data},
author = {Gutierrez Barragan, Felipe and Liu, Yuhao and Ingle, Atul and Gupta, Mohit and Velten, Andreas},
abstractNote = {In accordance with some embodiments, systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data are provided. In some embodiments, the system comprises: first detectors configured to detect a level of photons proportional to incident photon flux; second detectors configured to detect arrival of individual photons; a processor programmed to: receive, from the first detectors, first values indicative of photon flux from a scene with a first resolution; receive, from the second detectors, second values indicative of photon flux from the scene with a lower resolution; provide a first encoder of a trained machine learning model first flux values based on the first values, provide the second encoder of the model second flux values; receive, as output, values indicative of photon flux from the scene; and generate a high dynamic range image based on the third plurality of values.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Sep 12 00:00:00 EDT 2023},
month = {Tue Sep 12 00:00:00 EDT 2023}
}
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Noise-optimal capture for high dynamic range photography
conference, June 2010
- Hasinoff, Samuel W.; Durand, Fredo; Freeman, William T.
- 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Systems, methods, and media for high dynamic range imaging using dead-time-limited single photon detectors
patent, April 2020
- Ingle, Atul; Gupta, Mohit; Velten, Andreas
- US Patent Document 10,616,512
Neuromorphic Camera Guided High Dynamic Range Imaging
conference, June 2020
- Han, Jin; Zhou, Chu; Duan, Peiqi
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Single image HDR reconstruction using a CNN with masked features and perceptual loss
journal, August 2020
- Santos, Marcel Santana; Ren, Tsang Ing; Kalantari, Nima Khademi
- ACM Transactions on Graphics, Vol. 39, Issue 4
Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline
conference, June 2020
- Liu, Yu-Lun; Lai, Wei-Sheng; Chen, Yu-Sheng
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
HDR image reconstruction from a single exposure using deep CNNs
journal, November 2017
- Eilertsen, Gabriel; Kronander, Joel; Denes, Gyorgy
- ACM Transactions on Graphics, Vol. 36, Issue 6
Systems, methods, and media for motion adaptive imaging using single-photon image sensor data
patent, December 2022
- Seets, Trevor; Ingle, Atul; Velten, Andreas
- US Patent Document 11,539,895
ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content
journal, May 2018
- Marnerides, D.; BashfordâRogers, T.; Hatchett, J.
- Computer Graphics Forum, Vol. 37, Issue 2
The Quanta Image Sensor: Every Photon Counts
journal, August 2016
- Fossum, Eric; Ma, Jiaju; Masoodian, Saleh
- Sensors, Vol. 16, Issue 8
The effect of exposure on MaxRGB color constancy
conference, February 2010
- Funt, Brian; Shi, Lilong
- SPIE Proceedings
A multiresolution spline with application to image mosaics
journal, October 1983
- Burt, Peter J.; Adelson, Edward H.
- ACM Transactions on Graphics (TOG), Vol. 2, Issue 4
Systems, methods, and media for high dynamic range quanta burst imaging
patent, November 2021
- Gupta, Mohit; Ma, Sizhuo
- US Patent Document 11,170,549
Recovering high dynamic range radiance maps from photographs
conference, January 2008
- Debevec, Paul E.; Malik, Jitendra
- ACM SIGGRAPH 2008 classes on - SIGGRAPH '08
A wide dynamic range CMOS image sensor with multiple exposure-time signal outputs and 12-bit column-parallel cyclic A/D converters
journal, December 2005
- Mase, M.; Kawahito, S.; Sasaki, M.
- IEEE Journal of Solid-State Circuits, Vol. 40, Issue 12