Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

Patel, Radhen; Cox, Rebecca; Correll, Nikolaus

doi:10.1007/s10514-018-9751-4

Title: Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

Journal Article · Sat Apr 21 00:00:00 EDT 2018 · Autonomous Robots

DOI:https://doi.org/10.1007/s10514-018-9751-4· OSTI ID:1478224

Patel, Radhen ^[1]; Cox, Rebecca ^[1]; Correll, Nikolaus ^[1]

Univ. of Colorado, Boulder, CO (United States)

Here, we describe a combined proximity, contact and force (PCF) sensor based on a commodity infrared distance sensor embedded in a transparent elastomer with applications in robotic manipulation. Prior to contact, the sensor works as a distance sensor, whereas after contact the elastomer magnifies the near field of the proximity sensors letting the sensor interpret the indentation on elastomer as force. Contact occurs at the transition of proximity and force. We describe in detail the sensor design, its principle of operation and experimentally characterize the design parameters including polymer thickness, its mixing ratio, and emitter current of the infrared sensor. We also show that the sensor response has an inflection point at contact that is independent of an object’s surface properties, making it a robust detector for contact events. We finally demonstrate a series of use cases for the proposed PCF sensor, including (1) improving pre-grasp alignment, (2) determining contact event with objects, (3) obtaining simple 3D point cloud models of objects using both proximity and contact, and (4) registering self-generated point clouds to those from a RGB-D camera using a Baxter robot and Kinova Jaco arm.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000

OSTI ID:: 1478224

Report Number(s):: SAND-2017-1719J; 654186

Journal Information:: Autonomous Robots, Vol. 42, Issue 7; ISSN 0929-5593

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 25 works

Citation information provided by
Web of Science

References (41)

Humanoid Multimodal Tactile-Sensing Modules Mittendorfer, P.; Cheng, G. IEEE Transactions on Robotics, Vol. 27, Issue 3 https://doi.org/10.1109/TRO.2011.2106330	journal	June 2011
Characterization of a silicon-based shear-force sensor on human subjects IEEE Transactions on Biomedical Engineering, Vol. 49, Issue 11 https://doi.org/10.1109/TBME.2002.804586	journal	November 2002
A fuzzy logic controller for the application of skin pressure Lancaster, S. S. IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04. https://doi.org/10.1109/NAFIPS.2004.1337384	conference	January 2004
Conformable and scalable tactile sensor skin for curved surfaces Ohmura, Y.; Kuniyoshi, Y.; Nagakubo, A. Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. https://doi.org/10.1109/ROBOT.2006.1641896	conference	January 2006
Fiber optically sensorized multi-fingered robotic hand 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) https://doi.org/10.1109/IROS.2015.7353606	conference	September 2015
Simultaneous localization, mapping, and manipulation for unsupervised object discovery Ma, Lu; Ghafarianzadeh, Mahsa; Coleman, David 2015 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2015.7139365	conference	May 2015
A new fabrication method for all-PDMS waveguides Cai, Ziliang; Qiu, Weiping; Shao, Guocheng Sensors and Actuators A: Physical, Vol. 204 https://doi.org/10.1016/j.sna.2013.09.019	journal	December 2013
Reactive grasping using optical proximity sensors Hsiao, Kaijen; Nangeroni, Paul; Huber, Manfred 2009 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ROBOT.2009.5152849	conference	May 2009
Improving robot manipulation through fingertip perception Maldonado, Alexis; Alvarez, Humberto; Beetz, Michael 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2012) https://doi.org/10.1109/IROS.2012.6385560	conference	October 2012
Tactile Sensing—From Humans to Humanoids Dahiya, R. S.; Metta, G.; Valle, M. IEEE Transactions on Robotics, Vol. 26, Issue 1 https://doi.org/10.1109/TRO.2009.2033627	journal	February 2010
Using gripper mounted infrared proximity sensors for robot feedback control Balek, D.; Kelley, R. Proceedings. 1985 IEEE International Conference on Robotics and Automation https://doi.org/10.1109/ROBOT.1985.1087328	conference	January 1985
Learning to pick up objects through active exploration Oberlin, John; Tellex, Stefanie 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) https://doi.org/10.1109/DEVLRN.2015.7346151	conference	August 2015
A soft pneumatic actuator that can sense grasp and touch Farrow, Nicholas; Correll, Nikolaus 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) https://doi.org/10.1109/IROS.2015.7353689	conference	September 2015
Raman, mid-infrared, near-infrared and ultraviolet–visible spectroscopy of PDMS silicone rubber for characterization of polymer optical waveguide materials Cai, Dengke; Neyer, Andreas; Kuckuk, Rüdiger Journal of Molecular Structure, Vol. 976, Issue 1-3 https://doi.org/10.1016/j.molstruc.2010.03.054	journal	July 2010
The Feel of MEMS Barometers: Inexpensive and Easily Customized Tactile Array Sensors Tenzer, Yaroslav; Jentoft, Leif P.; Howe, Robert D. IEEE Robotics & Automation Magazine, Vol. 21, Issue 3 https://doi.org/10.1109/MRA.2014.2310152	journal	September 2014
Integrated force and distance sensing using elastomer-embedded commodity proximity sensors Patel, Radhen; Correll, Nikolaus Robotics: Science and Systems 2016, Robotics: Science and Systems XII https://doi.org/10.15607/RSS.2016.XII.035	conference	January 2016
Human-Inspired Robotic Grasp Control With Tactile Sensing Romano, Joseph M.; Hsiao, Kaijen; Niemeyer, Günter IEEE Transactions on Robotics, Vol. 27, Issue 6 https://doi.org/10.1109/TRO.2011.2162271	journal	December 2011
Functionalized textiles for interactive soft robotics Farrow, Nicholas; McIntire, Lauren; Correll, Nikolaus 2017 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2017.7989651	conference	May 2017
Normal and Shear Force Measurement Using a Flexible Polymer Tactile Sensor With Embedded Multiple Capacitors Journal of Microelectromechanical Systems, Vol. 17, Issue 4 https://doi.org/10.1109/JMEMS.2008.921727	journal	August 2008
Texture recognition and localization in amorphous robotic skin Hughes, Dana; Correll, Nikolaus Bioinspiration & Biomimetics, Vol. 10, Issue 5 https://doi.org/10.1088/1748-3190/10/5/055002	journal	September 2015
Using infrared sensors for distance measurement in mobile robots Benet, G.; Blanes, F.; Simó, J. E. Robotics and Autonomous Systems, Vol. 40, Issue 4 https://doi.org/10.1016/S0921-8890(02)00271-3	journal	September 2002
Soft Fiber Optic Sensors for Precision Measurement of Shear Stress and Pressure Zhang, Zhi Feng; Tao, Xiao Ming; Zhang, Hua Peng IEEE Sensors Journal, Vol. 13, Issue 5 https://doi.org/10.1109/JSEN.2012.2237393	journal	May 2013
Principles of Optics Born, Max; Wolf, Emil; Bhatia, A. B. Cambridge University Press https://doi.org/10.1017/CBO9781139644181	book	January 1999
A manipulator plays Jenga Kroger, Torsten; Finkemeyer, Bernd; Winkelbach, Simon IEEE Robotics & Automation Magazine, Vol. 15, Issue 3 https://doi.org/10.1109/MRA.2008.921547	journal	September 2008
Extrinsic dexterity: In-hand manipulation with external forces Dafle, Nikhil Chavan; Rodriguez, Alberto; Paolini, Robert 2014 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2014.6907062	conference	May 2014
Contact sensing and grasping performance of compliant hands Dollar, Aaron M.; Jentoft, Leif P.; Gao, Jason H. Autonomous Robots, Vol. 28, Issue 1 https://doi.org/10.1007/s10514-009-9144-9	journal	August 2009
Force and proximity fingertip sensor to enhance grasping perception Konstantinova, Jelizaveta; Stilli, Agostino; Althoefer, Kaspar 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) https://doi.org/10.1109/IROS.2015.7353659	conference	September 2015
Wearable motion capture suit with full-body tactile sensors Fujimori, Y.; Ohmura, Y.; Harada, T. 2009 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ROBOT.2009.5152758	conference	May 2009
A capacitive tactile sensor for shear and normal force measurements Zhu, F.; Spronck, J. W. Sensors and Actuators A: Physical, Vol. 31, Issue 1-3 https://doi.org/10.1016/0924-4247(92)80089-L	journal	March 1992
Increased poly(dimethylsiloxane) stiffness improves viability and morphology of mouse fibroblast cells Park, Joong Yull; Yoo, Sung Ju; Lee, Eun-Joong BioChip Journal, Vol. 4, Issue 3 https://doi.org/10.1007/s13206-010-4311-9	journal	September 2010
Simplified grasping and manipulation with dextrous robot hands Fearing, R. IEEE Journal on Robotics and Automation, Vol. 2, Issue 4 https://doi.org/10.1109/JRA.1986.1087063	journal	December 1986
Tactile proximity sensors for robotic applications Goger, D.; Alagi, H.; Worn, H. 2013 IEEE International Conference on Industrial Technology (ICIT 2013), 2013 IEEE International Conference on Industrial Technology (ICIT) https://doi.org/10.1109/ICIT.2013.6505804	conference	February 2013
Directions Toward Effective Utilization of Tactile Skin: A Review Dahiya, Ravinder S.; Mittendorfer, Philipp; Valle, Maurizio IEEE Sensors Journal, Vol. 13, Issue 11 https://doi.org/10.1109/JSEN.2013.2279056	journal	November 2013
Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot Mittendorfer, P.; Yoshida, E.; Cheng, G. Advanced Robotics, Vol. 29, Issue 1 https://doi.org/10.1080/01691864.2014.952493	journal	January 2015
Data-Driven Grasp Synthesis—A Survey Bohg, Jeannette; Morales, Antonio; Asfour, Tamim IEEE Transactions on Robotics, Vol. 30, Issue 2 https://doi.org/10.1109/TRO.2013.2289018	journal	April 2014
A surface micromachined microtactile sensor array Gray, B. L.; Fearing, R. S. Proceedings of IEEE International Conference on Robotics and Automation https://doi.org/10.1109/ROBOT.1996.503564	conference	January 1996
Re-configurable fluid circuits by PDMS elastomer micromachining Armani, D.; Liu, C.; Aluru, N. Technical Digest. IEEE International MEMS 99 Conference. Twelfth IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.99CH36291) https://doi.org/10.1109/MEMSYS.1999.746817	conference	January 1999
A Soft Strain Sensor Based on Ionic and Metal Liquids Chossat, Jean-Baptiste; Park, Yong-Lae; Wood, Robert J. IEEE Sensors Journal, Vol. 13, Issue 9 https://doi.org/10.1109/JSEN.2013.2263797	journal	September 2013
A Novel Type of Compliant, Underactuated Robotic Hand for Dexterous Grasping Deimel, Raphael; Brock, Oliver Robotics: Science and Systems 2014, Robotics: Science and Systems X https://doi.org/10.15607/RSS.2014.X.018	conference	July 2014
An LED-based Tactile Sensor for Multi-sensing over Large Areas Rossiter, J.; Mukai, T. 2006 5th IEEE Conference on Sensors https://doi.org/10.1109/ICSENS.2007.355597	conference	October 2006
Simplified Grasping and Manipulation with Dextrous Robot Hands Fearing, R. S. 1984 American Control Conference https://doi.org/10.23919/acc.1984.4788350	conference	July 1984

Cited By (3)

Soft robot perception using embedded soft sensors and recurrent neural networks Thuruthel, Thomas George; Shih, Benjamin; Laschi, Cecilia Science Robotics, Vol. 4, Issue 26 https://doi.org/10.1126/scirobotics.aav1488	journal	January 2019
An Embedded, Multi-Modal Sensor System for Scalable Robotic and Prosthetic Hand Fingers Weiner, Pascal; Neef, Caterina; Shibata, Yoshihisa Sensors, Vol. 20, Issue 1 https://doi.org/10.3390/s20010101	journal	December 2019
An Embedded, Multi-Modal Sensor System for Scalable Robotic and Prosthetic Hand Fingers Weiner, Pascal; Neef, Caterina; Shibata, Yoshihisa Karlsruhe https://doi.org/10.5445/ir/1000105802	text	January 2020

Similar Records

Soft Robotic Glove System for Wearable Haptic Teleoperation - 18373

Conference · Sun Jul 01 00:00:00 EDT 2018 · OSTI ID:1478224

Skorina, Erik; Rameshwar, Raagini; Pirasmepulkul, Saraj; +6 more

Failure of brittle micro-spherical shells embedded in elastomer matrix under indentation

Journal Article · Sat May 11 00:00:00 EDT 2019 · Composites Part B: Engineering · OSTI ID:1478224

Lu, Yinan; Carroll, Jay D.; Long, Kevin N.; +1 more

R and DE Robotic Sensor Intern Team: Advanced Sensor Suite Prototype

Conference · Mon Jul 01 00:00:00 EDT 2019 · OSTI ID:1478224

Suarez, Christopher; McMahon, Conor; Losada, Manuel; +3 more

Related Subjects

42 ENGINEERING
Tactile sensing
Robotic grasping
Manipulation
PCF-sensor

Title: Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

Citation Formats

References (41)

Cited By (3)

Similar Records

Related Subjects