Header logo is de

Machine Learning for Haptics: Inferring Multi-Contact Stimulation From Sparse Sensor Configuration




Robust haptic sensation systems are essential for obtaining dexterous robots. Currently, we have solutions for small surface areas such as fingers, but affordable and robust techniques for covering large areas of an arbitrary 3D surface are still missing. Here, we introduce a general machine learning framework to infer multi-contact haptic forces on a 3D robot’s limb surface from internal deformation measured by only a few physical sensors. The general idea of this framework is to predict first the whole surface deformation pattern from the sparsely placed sensors and then to infer number, locations and force magnitudes of unknown contact points. We show how this can be done even if training data can only be obtained for single-contact points using transfer learning at the example of a modified limb of the Poppy robot. With only 10 strain-gauge sensors we obtain a high accuracy also for multiple-contact points. The method can be applied to arbitrarily shaped surfaces and physical sensor types, as long as training data can be obtained.

Author(s): Sun, Huanbo and Martius, Georg
Journal: Frontiers in Neurorobotics
Volume: 13
Pages: 51
Year: 2019

Department(s): Autonomous Learning
Research Project(s): Robust and Affordable Haptic Sensation with Sparse Sensor Configuration
Bibtex Type: Article (article)

DOI: 10.3389/fnbot.2019.00051
URL: https://www.frontiersin.org/article/10.3389/fnbot.2019.00051


  title = {Machine Learning for Haptics: Inferring Multi-Contact Stimulation From Sparse Sensor Configuration},
  author = {Sun, Huanbo and Martius, Georg},
  journal = {Frontiers in Neurorobotics},
  volume = {13},
  pages = {51},
  year = {2019},
  url = {https://www.frontiersin.org/article/10.3389/fnbot.2019.00051}