Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

Patel, Radhen; Cox, Rebecca; Correll, Nikolaus

doi:10.1007/s10514-018-9751-4

Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

Journal Article · Sat Apr 21 00:00:00 EDT 2018 · Autonomous Robots

DOI:https://doi.org/10.1007/s10514-018-9751-4· OSTI ID:1478224

Patel, Radhen ^[1]; Cox, Rebecca ^[1]; Correll, Nikolaus ^[1]

Univ. of Colorado, Boulder, CO (United States)

Here, we describe a combined proximity, contact and force (PCF) sensor based on a commodity infrared distance sensor embedded in a transparent elastomer with applications in robotic manipulation. Prior to contact, the sensor works as a distance sensor, whereas after contact the elastomer magnifies the near field of the proximity sensors letting the sensor interpret the indentation on elastomer as force. Contact occurs at the transition of proximity and force. We describe in detail the sensor design, its principle of operation and experimentally characterize the design parameters including polymer thickness, its mixing ratio, and emitter current of the infrared sensor. We also show that the sensor response has an inflection point at contact that is independent of an object’s surface properties, making it a robust detector for contact events. We finally demonstrate a series of use cases for the proposed PCF sensor, including (1) improving pre-grasp alignment, (2) determining contact event with objects, (3) obtaining simple 3D point cloud models of objects using both proximity and contact, and (4) registering self-generated point clouds to those from a RGB-D camera using a Baxter robot and Kinova Jaco arm.

View Accepted Manuscript (DOE)

Research Organization:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000

OSTI ID:: 1478224

Report Number(s):: SAND--2017-1719J; 654186

Journal Information:: Autonomous Robots, Journal Name: Autonomous Robots Journal Issue: 7 Vol. 42; ISSN 0929-5593

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

References (42)

A Tactile Sensor Instantaneously Evaluating Friction Coefficients Nakamura, Katsuhiko; Shinoda, Hiroyuki Transducers ’01 Eurosensors XV https://doi.org/10.1007/978-3-642-59497-7_331	book	January 2001
Contact sensing and grasping performance of compliant hands Dollar, Aaron M.; Jentoft, Leif P.; Gao, Jason H. Autonomous Robots, Vol. 28, Issue 1 https://doi.org/10.1007/s10514-009-9144-9	journal	August 2009
Increased poly(dimethylsiloxane) stiffness improves viability and morphology of mouse fibroblast cells Park, Joong Yull; Yoo, Sung Ju; Lee, Eun-Joong BioChip Journal, Vol. 4, Issue 3 https://doi.org/10.1007/s13206-010-4311-9	journal	September 2010
A capacitive tactile sensor for shear and normal force measurements Zhu, F.; Spronck, J. W. Sensors and Actuators A: Physical, Vol. 31, Issue 1-3 https://doi.org/10.1016/0924-4247(92)80089-L	journal	March 1992
Using infrared sensors for distance measurement in mobile robots Benet, G.; Blanes, F.; Simó, J. E. Robotics and Autonomous Systems, Vol. 40, Issue 4 https://doi.org/10.1016/S0921-8890(02)00271-3	journal	September 2002
Raman, mid-infrared, near-infrared and ultraviolet–visible spectroscopy of PDMS silicone rubber for characterization of polymer optical waveguide materials Cai, Dengke; Neyer, Andreas; Kuckuk, Rüdiger Journal of Molecular Structure, Vol. 976, Issue 1-3 https://doi.org/10.1016/j.molstruc.2010.03.054	journal	July 2010
A new fabrication method for all-PDMS waveguides Cai, Ziliang; Qiu, Weiping; Shao, Guocheng Sensors and Actuators A: Physical, Vol. 204 https://doi.org/10.1016/j.sna.2013.09.019	journal	December 2013
Principles of Optics Born, Max; Wolf, Emil; Bhatia, A. B. Cambridge University Press https://doi.org/10.1017/CBO9781139644181	book	January 1999
Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot Mittendorfer, P.; Yoshida, E.; Cheng, G. Advanced Robotics, Vol. 29, Issue 1 https://doi.org/10.1080/01691864.2014.952493	journal	January 2015
Texture recognition and localization in amorphous robotic skin Hughes, Dana; Correll, Nikolaus Bioinspiration & Biomimetics, Vol. 10, Issue 5 https://doi.org/10.1088/1748-3190/10/5/055002	journal	September 2015
Learning to pick up objects through active exploration Oberlin, John; Tellex, Stefanie 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) https://doi.org/10.1109/DEVLRN.2015.7346151	conference	August 2015
Tactile proximity sensors for robotic applications Goger, D.; Alagi, H.; Worn, H. 2013 IEEE International Conference on Industrial Technology (ICIT 2013), 2013 IEEE International Conference on Industrial Technology (ICIT) https://doi.org/10.1109/ICIT.2013.6505804	conference	February 2013
Extrinsic dexterity: In-hand manipulation with external forces Dafle, Nikhil Chavan; Rodriguez, Alberto; Paolini, Robert 2014 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2014.6907062	conference	May 2014
Simultaneous localization, mapping, and manipulation for unsupervised object discovery Ma, Lu; Ghafarianzadeh, Mahsa; Coleman, David 2015 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2015.7139365	conference	May 2015
Functionalized textiles for interactive soft robotics Farrow, Nicholas; McIntire, Lauren; Correll, Nikolaus 2017 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2017.7989651	conference	May 2017
An LED-based Tactile Sensor for Multi-sensing over Large Areas Rossiter, J.; Mukai, T. 2006 5th IEEE Conference on Sensors https://doi.org/10.1109/ICSENS.2007.355597	conference	October 2006
Improving robot manipulation through fingertip perception Maldonado, Alexis; Alvarez, Humberto; Beetz, Michael 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2012) https://doi.org/10.1109/IROS.2012.6385560	conference	October 2012
Fiber optically sensorized multi-fingered robotic hand No authors listed 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) https://doi.org/10.1109/IROS.2015.7353606	conference	September 2015
Force and proximity fingertip sensor to enhance grasping perception Konstantinova, Jelizaveta; Stilli, Agostino; Althoefer, Kaspar 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) https://doi.org/10.1109/IROS.2015.7353659	conference	September 2015
A soft pneumatic actuator that can sense grasp and touch Farrow, Nicholas; Correll, Nikolaus 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) https://doi.org/10.1109/IROS.2015.7353689	conference	September 2015
Normal and Shear Force Measurement Using a Flexible Polymer Tactile Sensor With Embedded Multiple Capacitors No authors listed Journal of Microelectromechanical Systems, Vol. 17, Issue 4 https://doi.org/10.1109/JMEMS.2008.921727	journal	August 2008
Simplified grasping and manipulation with dextrous robot hands Fearing, R. IEEE Journal on Robotics and Automation, Vol. 2, Issue 4 https://doi.org/10.1109/JRA.1986.1087063	journal	December 1986
Soft Fiber Optic Sensors for Precision Measurement of Shear Stress and Pressure Zhang, Zhi Feng; Tao, Xiao Ming; Zhang, Hua Peng IEEE Sensors Journal, Vol. 13, Issue 5 https://doi.org/10.1109/JSEN.2012.2237393	journal	May 2013
A Soft Strain Sensor Based on Ionic and Metal Liquids Chossat, Jean-Baptiste; Park, Yong-Lae; Wood, Robert J. IEEE Sensors Journal, Vol. 13, Issue 9 https://doi.org/10.1109/JSEN.2013.2263797	journal	September 2013
Directions Toward Effective Utilization of Tactile Skin: A Review Dahiya, Ravinder S.; Mittendorfer, Philipp; Valle, Maurizio IEEE Sensors Journal, Vol. 13, Issue 11 https://doi.org/10.1109/JSEN.2013.2279056	journal	November 2013
Re-configurable fluid circuits by PDMS elastomer micromachining Armani, D.; Liu, C.; Aluru, N. Technical Digest. IEEE International MEMS 99 Conference. Twelfth IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.99CH36291) https://doi.org/10.1109/MEMSYS.1999.746817	conference	January 1999
A manipulator plays Jenga Kroger, Torsten; Finkemeyer, Bernd; Winkelbach, Simon IEEE Robotics & Automation Magazine, Vol. 15, Issue 3 https://doi.org/10.1109/MRA.2008.921547	journal	September 2008
The Feel of MEMS Barometers: Inexpensive and Easily Customized Tactile Array Sensors Tenzer, Yaroslav; Jentoft, Leif P.; Howe, Robert D. IEEE Robotics & Automation Magazine, Vol. 21, Issue 3 https://doi.org/10.1109/MRA.2014.2310152	journal	September 2014
A fuzzy logic controller for the application of skin pressure Lancaster, S. S. IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04. https://doi.org/10.1109/NAFIPS.2004.1337384	conference	January 2004
Using gripper mounted infrared proximity sensors for robot feedback control Balek, D.; Kelley, R. Proceedings. 1985 IEEE International Conference on Robotics and Automation https://doi.org/10.1109/ROBOT.1985.1087328	conference	January 1985
A surface micromachined microtactile sensor array Gray, B. L.; Fearing, R. S. Proceedings of IEEE International Conference on Robotics and Automation https://doi.org/10.1109/ROBOT.1996.503564	conference	January 1996
Conformable and scalable tactile sensor skin for curved surfaces Ohmura, Y.; Kuniyoshi, Y.; Nagakubo, A. Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. https://doi.org/10.1109/ROBOT.2006.1641896	conference	January 2006
Wearable motion capture suit with full-body tactile sensors Fujimori, Y.; Ohmura, Y.; Harada, T. 2009 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ROBOT.2009.5152758	conference	May 2009
Reactive grasping using optical proximity sensors Hsiao, Kaijen; Nangeroni, Paul; Huber, Manfred 2009 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ROBOT.2009.5152849	conference	May 2009
Characterization of a silicon-based shear-force sensor on human subjects No authors listed IEEE Transactions on Biomedical Engineering, Vol. 49, Issue 11 https://doi.org/10.1109/TBME.2002.804586	journal	November 2002
Tactile Sensing—From Humans to Humanoids Dahiya, R. S.; Metta, G.; Valle, M. IEEE Transactions on Robotics, Vol. 26, Issue 1 https://doi.org/10.1109/TRO.2009.2033627	journal	February 2010
Humanoid Multimodal Tactile-Sensing Modules Mittendorfer, P.; Cheng, G. IEEE Transactions on Robotics, Vol. 27, Issue 3 https://doi.org/10.1109/TRO.2011.2106330	journal	June 2011
Human-Inspired Robotic Grasp Control With Tactile Sensing Romano, Joseph M.; Hsiao, Kaijen; Niemeyer, Günter IEEE Transactions on Robotics, Vol. 27, Issue 6 https://doi.org/10.1109/TRO.2011.2162271	journal	December 2011
Data-Driven Grasp Synthesis—A Survey Bohg, Jeannette; Morales, Antonio; Asfour, Tamim IEEE Transactions on Robotics, Vol. 30, Issue 2 https://doi.org/10.1109/TRO.2013.2289018	journal	April 2014
A Novel Type of Compliant, Underactuated Robotic Hand for Dexterous Grasping Deimel, Raphael; Brock, Oliver Robotics: Science and Systems 2014, Robotics: Science and Systems X https://doi.org/10.15607/RSS.2014.X.018	conference	July 2014
Integrated force and distance sensing using elastomer-embedded commodity proximity sensors Patel, Radhen; Correll, Nikolaus Robotics: Science and Systems 2016, Robotics: Science and Systems XII https://doi.org/10.15607/RSS.2016.XII.035	conference	January 2016
Simplified Grasping and Manipulation with Dextrous Robot Hands Fearing, R. S. 1984 American Control Conference https://doi.org/10.23919/acc.1984.4788350	conference	July 1984

Cited By (3)

An Embedded, Multi-Modal Sensor System for Scalable Robotic and Prosthetic Hand Fingers Weiner, Pascal; Neef, Caterina; Shibata, Yoshihisa Karlsruhe https://doi.org/10.5445/ir/1000105802	text	January 2020
Soft robot perception using embedded soft sensors and recurrent neural networks Thuruthel, Thomas George; Shih, Benjamin; Laschi, Cecilia Science Robotics, Vol. 4, Issue 26 https://doi.org/10.1126/scirobotics.aav1488	journal	January 2019
An Embedded, Multi-Modal Sensor System for Scalable Robotic and Prosthetic Hand Fingers Weiner, Pascal; Neef, Caterina; Shibata, Yoshihisa Sensors, Vol. 20, Issue 1 https://doi.org/10.3390/s20010101	journal	December 2019

Similar Records

Soft Robotic Glove System for Wearable Haptic Teleoperation - 18373

Conference · Sun Jul 01 00:00:00 EDT 2018 · OSTI ID:22977681

Experiments in robotic sensori-motor control during grasp

Technical Report · Fri Sep 06 00:00:00 EDT 1991 · OSTI ID:5972625

Experiments in robotic sensori-motor control during grasp

Technical Report · Fri Sep 06 00:00:00 EDT 1991 · OSTI ID:10112514

Related Subjects

42 ENGINEERING
Manipulation
PCF-sensor
Robotic grasping
Tactile sensing

Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

Citation Formats

References (42)

Cited By (3)

Similar Records

Related Subjects