Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Infrared-Fused Vision-Based Thermoregulation Performance Estimation for Personal Thermal Comfort-Driven HVAC System Controls

Journal Article · · Buildings
 [1];  [2];  [3];  [3];  [3];  [3];  [4];  [4]
  1. National Univ. of Singapore (Singapore); Univ. of California, Berkeley, CA (United States)
  2. National Univ. of Singapore (Singapore)
  3. Univ. of California, Berkeley, CA (United States)
  4. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Thermal comfort is one of the primary factors influencing occupant health, well-being, and productivity in buildings. Existing thermal comfort systems require occupants to frequently communicate their comfort vote via a survey which is impractical as a long-term solution. Here, we present a novel thermal infrared-fused computer vision sensing method to capture thermoregulation performance in a non-intrusive and non-invasive manner. In this method, we align thermal and visible images, detect facial segments (i.e., nose, eyes, face boundary), and accordingly read the temperatures from the appropriate coordinates in the thermal image. We focus on the human face since it is often clearly visible to cameras and is not merged into a hot background (unlike hands). We use a regularized Gaussian Mixture model to track the thermoregulation changes over time and apply a heuristic algorithm to extract hot and cold indices. We present a personalized and a generalized comfort modeling method, selected based on the availability of the occupant historical indices measurements in a neutral environment, and use the time-series of the hot and cold indices to define corrections to HVAC system operations in the form of setpoint constraints. To evaluate the efficacy of our proposed approach in responding to thermal stimuli, we designed a series of controlled experiments to simulate exposure to cold and hot environments. While applying personalized modeling showed an acceptable average accuracy of 91.3%, the generalized model’s average accuracy was only 65.2%. This shows the importance of having access to physiological records in modeling and assessing comfort. We also found that individual differences should be considered in selecting the cooling and heating rates when some knowledge of the occupant’s overall thermal preference is available.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office; Singapore Ministry of Education; USDOE
Grant/Contract Number:
AC02-05CH11231; A-0008302-00-00
OSTI ID:
1881531
Alternate ID(s):
OSTI ID: 1906693
Journal Information:
Buildings, Vol. 12, Issue 8; ISSN 2075-5309
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English

References (43)

Real-time and contactless measurements of thermal discomfort based on human poses for energy efficient control of buildings journal September 2019
Skin and core temperature response to partial- and whole-body heating and cooling journal October 2004
HVAC system energy optimization using an adaptive hybrid metaheuristic journal October 2017
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks journal October 2016
Measuring skin temperature before, during and after exercise: a comparison of thermocouples and infrared thermography journal January 2014
Cascade Multi-View Hourglass Model for Robust 3D Face Alignment conference May 2018
A comparative study of predicting individual thermal sensation and satisfaction using wrist-worn temperature sensor, thermal camera and ambient temperature sensor journal August 2019
Heart Rate Variability, Homeostasis, and Brain Function journal January 2012
Application of wearable EEG sensors for indoor thermal comfort measurements journal December 2021
Temperature regulation in women: Effects of the menstrual cycle journal March 2020
Effect of thermal comfort on occupant productivity in office buildings: Response surface analysis journal August 2020
Thermal adaptation in the built environment: a literature review journal February 1998
The effect of temperature, metabolic rate and dynamic localized airflow on thermal comfort journal November 2013
Towards unsupervised learning of thermal comfort using infrared thermography journal February 2018
A knowledge based approach for selecting energy-aware and comfort-driven HVAC temperature set points journal December 2014
Experimental study on physiological responses and thermal comfort under various ambient temperatures journal January 2008
Effect of perspiration on skin temperature measurements by infrared thermography and contact thermometry during aerobic cycling journal September 2015
Non-intrusive interpretation of human thermal comfort through analysis of facial infrared thermography journal October 2018
An online learning approach for quantifying personalized thermal comfort via adaptive stochastic modeling journal October 2015
Non-invasive (non-contact) measurements of human thermal physiology signals and thermal comfort/discomfort poses -A review journal October 2020
Quantifying the influence of temperature setpoints, building and system features on energy consumption conference December 2015
Prediction of whole-body thermal sensation in the non-steady state based on skin temperature journal October 2013
Personal CO2 bubble: Context-dependent variations and wearable sensors usability journal March 2019
Thermal history and adaptation: Does a long-term indoor thermal exposure impact human thermal adaptability? journal December 2016
Energy savings from temperature setpoints and deadband: Quantifying the influence of building and system properties on savings journal March 2016
Thermal comfort and gender: a literature review: Thermal comfort and gender: a literature review journal November 2011
Circadian aspects of body temperature regulation in exercise journal May 2009
A Comparison between Conductive and Infrared Devices for Measuring Mean Skin Temperature at Rest, during Exercise in the Heat, and Recovery journal February 2015
Real-Time Monitoring of Occupants’ Thermal Comfort through Infrared Imaging: A Preliminary Study journal February 2017
Three‐dimensional analysis of the effect of human movement on indoor airflow patterns journal September 2020
Differences between young adults and elderly in thermal comfort, productivity, and thermal physiology in response to a moderate temperature drift and a steady-state condition: Differences between young adults and elderly in thermal comfort, productivity, and thermal physiology journal April 2010
Artificial Intelligence for Efficient Thermal Comfort Systems: Requirements, Current Applications and Future Directions journal April 2020
Towards Personalization of Indoor Air Quality: Review of Sensing Requirements and Field Deployments journal April 2022
Skin Blood Flow in Adult Human Thermoregulation: How It Works, When It Does Not, and Why journal May 2003
Machine learning empowered COVID-19 patient monitoring using non-contact sensing: An extensive review journal April 2022
A short history of sweat gland biology journal June 2007
Infrared thermography of human face for monitoring thermoregulation performance and estimating personal thermal comfort journal November 2016
Mechanisms and modifiers of reflex induced cutaneous vasodilation and vasoconstriction in humans journal October 2010
Prediction of thermal sensation using low-cost infrared array sensors monitoring system journal September 2019
Monitoring fatigue in construction workers using physiological measurements journal October 2017
Skin Temperature Extraction Using Facial Landmark Detection and Thermal Imaging for Comfort Assessment
  • Aryal, Ashrant; Becerik-Gerber, Burcin
  • BuildSys '19: The 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation https://doi.org/10.1145/3360322.3360848
conference November 2019
Stacked Hourglass Networks for Human Pose Estimation book January 2016
How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks) conference October 2017