Header logo is


2017


Thumb xl image toc
Six Degree-of-Freedom Localization of Endoscopic Capsule Robots using Recurrent Neural Networks embedded into a Convolutional Neural Network

Turan, M., Abdullah, A., Jamiruddin, R., Araujo, H., Konukoglu, E., Sitti, M.

arXiv preprint arXiv:1705.06196, May 2017 (article)

Abstract
Since its development, ingestible wireless endoscopy is considered to be a painless diagnostic method to detect a number of diseases inside GI tract. Medical related engineering companies have made significant improvements in this technology in last decade; however, some major limitations still residue. Localization of the next generation steerable endoscopic capsule robot in six degreeof-freedom (DoF) and active motion control are some of these limitations. The significance of localization capability concerns with the doctors correct diagnosis of the disease area. This paper presents a very robust 6-DoF localization method based on supervised training of an architecture consisting of recurrent networks (RNN) embedded into a convolutional neural network (CNN) to make use of both just-in-moment information obtained by CNN and correlative information across frames obtained by RNN. To our knowledge, our idea of embedding RNNs into a CNN architecture is for the first time proposed in literature. The experimental results show that the proposed RNN-in-CNN architecture performs very well for endoscopic capsule robot localization in cases vignetting, reflection distortions, noise, sudden camera movements and lack of distinguishable features.

pi

DOI Project Page [BibTex]


Thumb xl publications toc
Controllable load sharing for soft adhesive interfaces on three-dimensional surfaces

Song, S., Drotlef, D., Majidi, C., Sitti, M.

Proceedings of the National Academy of Sciences, 114(22):E4344–E4353, National Acad Sciences, May 2017 (article)

Abstract
For adhering to three-dimensional (3D) surfaces or objects, current adhesion systems are limited by a fundamental trade-off between 3D surface conformability and high adhesion strength. This limitation arises from the need for a soft, mechanically compliant interface, which enables conformability to nonflat and irregularly shaped surfaces but significantly reduces the interfacial fracture strength. In this work, we overcome this trade-off with an adhesion-based soft-gripping system that exhibits enhanced fracture strength without sacrificing conformability to nonplanar 3D surfaces. Composed of a gecko-inspired elastomeric microfibrillar adhesive membrane supported by a pressure-controlled deformable gripper body, the proposed soft-gripping system controls the bonding strength by changing its internal pressure and exploiting the mechanics of interfacial equal load sharing. The soft adhesion system can use up to ∼26% of the maximum adhesion of the fibrillar membrane, which is 14× higher than the adhering membrane without load sharing. Our proposed load-sharing method suggests a paradigm for soft adhesion-based gripping and transfer-printing systems that achieves area scaling similar to that of a natural gecko footpad.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl image toc
A Non-Rigid Map Fusion-Based RGB-Depth SLAM Method for Endoscopic Capsule Robots

Turan, M., Almalioglu, Y., Araujo, H., Konukoglu, E., Sitti, M.

arXiv preprint arXiv:1705.05444, May 2017 (article)

Abstract
In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is considered as a minimally invasive novel diagnostic technology to inspect the entire GI tract and to diagnose various diseases and pathologies. Since the development of this technology, medical device companies and many groups have made significant progress to turn such passive capsule endoscopes into robotic active capsule endoscopes to achieve almost all functions of current active flexible endoscopes. However, the use of robotic capsule endoscopy still has some challenges. One such challenge is the precise localization of such active devices in 3D world, which is essential for a precise three-dimensional (3D) mapping of the inner organ. A reliable 3D map of the explored inner organ could assist the doctors to make more intuitive and correct diagnosis. In this paper, we propose to our knowledge for the first time in literature a visual simultaneous localization and mapping (SLAM) method specifically developed for endoscopic capsule robots. The proposed RGB-Depth SLAM method is capable of capturing comprehensive dense globally consistent surfel-based maps of the inner organs explored by an endoscopic capsule robot in real time. This is achieved by using dense frame-to-model camera tracking and windowed surfelbased fusion coupled with frequent model refinement through non-rigid surface deformations.

pi

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
An Interactive Augmented-Reality Video Training Platform for the da Vinci Surgical System

Carlson, J., Kuchenbecker, K. J.

Workshop paper (3 pages) presented at the ICRA Workshop on C4 Surgical Robots, Singapore, May 2017 (misc)

Abstract
Teleoperated surgical robots such as the Intuitive da Vinci Surgical System facilitate minimally invasive surgeries, which decrease risk to patients. However, these systems can be difficult to learn, and existing training curricula on surgical simulators do not offer students the realistic experience of a full operation. This paper presents an augmented-reality video training platform for the da Vinci that will allow trainees to rehearse any surgery recorded by an expert. While the trainee operates a da Vinci in free space, they see their own instruments overlaid on the expert video. Tools are identified in the source videos via color segmentation and kernelized correlation filter tracking, and their depth is calculated from the da Vinci’s stereoscopic video feed. The user tries to follow the expert’s movements, and if any of their tools venture too far away, the system provides instantaneous visual feedback and pauses to allow the user to correct their motion. The trainee can also rewind the expert video by bringing either da Vinci tool very close to the camera. This combined and augmented video provides the user with an immersive and interactive training experience.

hi

[BibTex]

[BibTex]


Thumb xl hydrophobic toc
Hydrophobic pinning with copper nanowhiskers leads to bactericidal properties

Singh, A. V., Baylan, S., Park, B., Richter, G., Sitti, M.

PloS One, 12(4):e0175428, Public Library of Science, April 2017 (article)

Abstract
The considerable morbidity associated with hospitalized patients and clinics in developed countries due to biofilm formation on biomedical implants and surgical instruments is a heavy economic burden. An alternative to chemically treated surfaces for bactericidal activity started emerging from micro/nanoscale topographical cues in the last decade. Here, we demonstrate a putative antibacterial surface using copper nanowhiskers deposited by molecular beam epitaxy. Furthermore, the control of biological response is based on hydrophobic pinning of water droplets in the Wenzel regime, causing mechanical injury and cell death. Scanning electron microscopy images revealed the details of the surface morphology and non-contact mode laser scanning of the surface revealed the microtopography-associated quantitative parameters. Introducing the bacterial culture over nanowhiskers produces mechanical injury to cells, leading to a reduction in cell density over time due to local pinning of culture medium to whisker surfaces. Extended culture to 72 hours to observe biofilm formation revealed biofilm inhibition with scattered microcolonies and significantly reduced biovolume on nanowhiskers. Therefore, surfaces patterned with copper nanowhiskers can serve as potential antibiofilm surfaces. The topography-based antibacterial surfaces introduce a novel prospect in developing mechanoresponsive nanobiomaterials to reduce the risk of medical device biofilm-associated infections, contrary to chemical leaching of copper as a traditional bactericidal agent.

pi

link (url) [BibTex]

link (url) [BibTex]


Thumb xl fig  quali  arm
Probabilistic Articulated Real-Time Tracking for Robot Manipulation

(Best Paper of RA-L 2017, Finalist of Best Robotic Vision Paper Award of ICRA 2017)

Garcia Cifuentes, C., Issac, J., Wüthrich, M., Schaal, S., Bohg, J.

IEEE Robotics and Automation Letters (RA-L), 2(2):577-584, April 2017 (article)

Abstract
We propose a probabilistic filtering method which fuses joint measurements with depth images to yield a precise, real-time estimate of the end-effector pose in the camera frame. This avoids the need for frame transformations when using it in combination with visual object tracking methods. Precision is achieved by modeling and correcting biases in the joint measurements as well as inaccuracies in the robot model, such as poor extrinsic camera calibration. We make our method computationally efficient through a principled combination of Kalman filtering of the joint measurements and asynchronous depth-image updates based on the Coordinate Particle Filter. We quantitatively evaluate our approach on a dataset recorded from a real robotic platform, annotated with ground truth from a motion capture system. We show that our approach is robust and accurate even under challenging conditions such as fast motion, significant and long-term occlusions, and time-varying biases. We release the dataset along with open-source code of our approach to allow for quantitative comparison with alternative approaches.

am

arXiv video code and dataset video PDF DOI Project Page [BibTex]


Thumb xl toc image
Soft 3D-Printed Phantom of the Human Kidney with Collecting System

Adams, F., Qiu, T., Mark, A., Fritz, B., Kramer, L., Schlager, D., Wetterauer, U., Miernik, A., Fischer, P.

Ann. of Biomed. Eng., 45(4):963-972, April 2017 (article)

Abstract
Organ models are used for planning and simulation of operations, developing new surgical instruments, and training purposes. There is a substantial demand for in vitro organ phantoms, especially in urological surgery. Animal models and existing simulator systems poorly mimic the detailed morphology and the physical properties of human organs. In this paper, we report a novel fabrication process to make a human kidney phantom with realistic anatomical structures and physical properties. The detailed anatomical structure was directly acquired from high resolution CT data sets of human cadaveric kidneys. The soft phantoms were constructed using a novel technique that combines 3D wax printing and polymer molding. Anatomical details and material properties of the phantoms were validated in detail by CT scan, ultrasound, and endoscopy. CT reconstruction, ultrasound examination, and endoscopy showed that the designed phantom mimics a real kidney's detailed anatomy and correctly corresponds to the targeted human cadaver's upper urinary tract. Soft materials with a tensile modulus of 0.8-1.5 MPa as well as biocompatible hydrogels were used to mimic human kidney tissues. We developed a method of constructing 3D organ models from medical imaging data using a 3D wax printing and molding process. This method is cost-effective means for obtaining a reproducible and robust model suitable for surgical simulation and training purposes.

pf

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Guiding Trajectory Optimization by Demonstrated Distributions

Osa, T., Ghalamzan E., A. M., Stolkin, R., Lioutikov, R., Peters, J., Neumann, G.

IEEE Robotics and Automation Letters, 2(2):819-826, April 2017 (article)

ei

DOI [BibTex]

DOI [BibTex]


no image
Whole-body multi-contact motion in humans and humanoids: Advances of the CoDyCo European project

Padois, V., Ivaldi, S., Babic, J., Mistry, M., Peters, J., Nori, F.

Robotics and Autonomous Systems, 90, pages: 97-117, April 2017, Special Issue on New Research Frontiers for Intelligent Autonomous Systems (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl image toc
Biohybrid microtube swimmers driven by single captured bacteria

Stanton, M. M., Park, B., Miguel-López, A., Ma, X., Sitti, M., Sánchez, S.

Small, 13(19), March 2017 (article)

Abstract
Bacteria biohybrids employ the motility and power of swimming bacteria to carry and maneuver microscale particles. They have the potential to perform microdrug and cargo delivery in vivo, but have been limited by poor design, reduced swimming capabilities, and impeded functionality. To address these challenge, motile Escherichia coli are captured inside electropolymerized microtubes, exhibiting the first report of a bacteria microswimmer that does not utilize a spherical particle chassis. Single bacterium becomes partially trapped within the tube and becomes a bioengine to push the microtube though biological media. Microtubes are modified with “smart” material properties for motion control, including a bacteria-attractant polydopamine inner layer, addition of magnetic components for external guidance, and a biochemical kill trigger to cease bacterium swimming on demand. Swimming dynamics of the bacteria biohybrid are quantified by comparing “length of protrusion” of bacteria from the microtubes with respect to changes in angular autocorrelation and swimmer mean squared displacement. The multifunctional microtubular swimmers present a new generation of biocompatible micromotors toward future microbiorobots and minimally invasive medical applications.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Probabilistic Movement Primitives for Coordination of Multiple Human-Robot Collaborative Tasks

Maeda, G., Neumann, G., Ewerton, M., Lioutikov, R., Kroemer, O., Peters, J.

Autonomous Robots, 41(3):593-612, March 2017 (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Hand-Clapping Games with a Baxter Robot

Fitter, N. T., Kuchenbecker, K. J.

Hands-on demonstration presented at ACM/IEEE International Conference on Human-Robot Interaction (HRI), Vienna, Austria, March 2017 (misc)

Abstract
Robots that work alongside humans might be more effective if they could forge a strong social bond with their human partners. Hand-clapping games and other forms of rhythmic social-physical interaction may foster human-robot teamwork, but the design of such interactions has scarcely been explored. At the HRI 2017 conference, we will showcase several such interactions taken from our recent work with the Rethink Robotics Baxter Research Robot, including tempo-matching, Simon says, and Pat-a-cake-like games. We believe conference attendees will be both entertained and intrigued by this novel demonstration of social-physical HRI.

hi

Project Page [BibTex]

Project Page [BibTex]


no image
Automatic OSATS Rating of Trainee Skill at a Pediatric Laparoscopic Suturing Task

Oquendo, Y. A., Riddle, E. W., Hiller, D., Blinman, T. A., Kuchenbecker, K. J.

Surgical Endoscopy, 31(Supplement 1):S28, Extended abstract presented as a podium presentation at the Annual Meeting of the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES), Springer, Houston, USA, March 2017 (misc)

Abstract
Introduction: Minimally invasive surgery has revolutionized surgical practice, but challenges remain. Trainees must acquire complex technical skills while minimizing patient risk, and surgeons must maintain their skills for rare procedures. These challenges are magnified in pediatric surgery due to the smaller spaces, finer tissue, and relative dearth of both inanimate and virtual simulators. To build technical expertise, trainees need opportunities for deliberate practice with specific performance feedback, which is typically provided via tedious human grading. This study aimed to validate a novel motion-tracking system and machine learning algorithm for automatically evaluating trainee performance on a pediatric laparoscopic suturing task using a 1–5 OSATS Overall Skill rating. Methods: Subjects (n=14) ranging from medical students to fellows per- formed one or two trials of an intracorporeal suturing task in a custom pediatric laparoscopy training box (Fig. 1) after watching a video of ideal performance by an expert. The position and orientation of the tools and endoscope were recorded over time using Ascension trakSTAR magnetic motion-tracking sensors, and both instrument grasp angles were recorded over time using flex sensors on the handles. The 27 trials were video-recorded and scored on the OSATS scale by a senior fellow; ratings ranged from 1 to 4. The raw motion data from each trial was processed to calculate over 200 preliminary motion parameters. Regularized least-squares regression (LASSO) was used to identify the most predictive parameters for inclusion in a regression tree. Model performance was evaluated by leave-one-subject-out cross validation, wherein the automatic scores given to each subject’s trials (by a model trained on all other data) are compared to the corresponding human rater scores. Results: The best-performing LASSO algorithm identified 14 predictive parameters for inclusion in the regression tree, including completion time, linear path length, angular path length, angular acceleration, grasp velocity, and grasp acceleration. The final model’s raw output showed a strong positive correlation of 0.87 with the reviewer-generated scores, and rounding the output to the nearest integer yielded a leave-one-subject-out cross-validation accuracy of 77.8%. Results are summarized in the confusion matrix (Table 1). Conclusions: Our novel motion-tracking system and regression model automatically gave previously unseen trials overall skill scores that closely match scores from an expert human rater. With additional data and further development, this system may enable creation of a motion-based training platform for pediatric laparoscopic surgery and could yield insights into the fundamental components of surgical skill.

hi

[BibTex]

[BibTex]


no image
How Much Haptic Surface Data is Enough?

Burka, A., Kuchenbecker, K. J.

Workshop paper (5 pages) presented at the AAAI Spring Symposium on Interactive Multi-Sensory Object Perception for Embodied Agents, Stanford, USA, March 2017 (misc)

Abstract
The Proton Pack is a portable visuo-haptic surface interaction recording device that will be used to collect a vast multimodal dataset, intended for robots to use as part of an approach to understanding the world around them. In order to collect a useful dataset, we want to pick a suitable interaction duration for each surface, noting the tradeoff between data collection resources and completeness of data. One interesting approach frames the data collection process as an online learning problem, building an incremental surface model and using that model to decide when there is enough data. Here we examine how to do such online surface modeling and when to stop collecting data, using kinetic friction as a first domain in which to apply online modeling.

hi

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
Bioinspired tactile sensor for surface roughness discrimination

Yi, Z., Zhang, Y., Peters, J.

Sensors and Actuators A: Physical, 255, pages: 46-53, March 2017 (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Sticky Solution Provides Grip for the First Robotic Pollinator

Amador, G. J., Hu, D. L.

Chem, 2(2):162 - 164, Febuary 2017 (article)

Abstract
Bees, move over. A lily has been pollinated by a remote-controlled flying robot. The robot is hairy, just like a real bee, and sticks to pollen by virtue of an ionic liquid gel, whose fabrication is discussed by Svetlana Chechetka et al. in this issue of Chem.

pi

link (url) DOI [BibTex]


Thumb xl toc image
Pattern formation and collective effects in populations of magnetic microswimmers

Vach, P. J., (Walker) Schamel, D., Fischer, P., Fratzl, P., Faivre, D.

J. of Phys. D: Appl. Phys., 50(11):11LT03, Febuary 2017 (article)

Abstract
Self-propelled particles are one prototype of synthetic active matter used to understand complex biological processes, such as the coordination of movement in bacterial colonies or schools of fishes. Collective patterns such as clusters were observed for such systems, reproducing features of biological organization. However, one limitation of this model is that the synthetic assemblies are made of identical individuals. Here we introduce an active system based on magnetic particles at colloidal scales. We use identical but also randomly-shaped magnetic micropropellers and show that they exhibit dynamic and reversible pattern formation.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl screen shot 2017 06 14 at 2.58.42 pm
Spinal joint compliance and actuation in a simulated bounding quadruped robot

Pouya, S., Khodabakhsh, M., Sproewitz, A., Ijspeert, A.

{Autonomous Robots}, pages: 437–452, Kluwer Academic Publishers, Springer, Dordrecht, New York, NY, Febuary 2017 (article)

dlg

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


Thumb xl toc image
On-chip enzymatic microbiofuel cell-powered integrated circuits

Mark, A. G., Suraniti, E., Roche, J., Richter, H., Kuhn, A., Mano, N., Fischer, P.

Lab on a Chip, 17(10):1761-1768, Febuary 2017, Recent HOT Article (article)

Abstract
A variety of diagnostic and therapeutic medical technologies rely on long term implantation of an electronic device to monitor or regulate a patient's condition. One proposed approach to powering these devices is to use a biofuel cell to convert the chemical energy from blood nutrients into electrical current to supply the electronics. We present here an enzymatic microbiofuel cell whose electrodes are directly integrated into a digital electronic circuit. Glucose oxidizing and oxygen reducing enzymes are immobilized on microelectrodes of an application specific integrated circuit (ASIC) using redox hydrogels to produce an enzymatic biofuel cell, capable of harvesting electrical power from just a single droplet of 5 mM glucose solution. Optimisation of the fuel cell voltage and power to match the requirements of the electronics allow self-powered operation of the on-board digital circuitry. This study represents a step towards implantable self-powered electronic devices that gather their energy from physiological fluids.

Recent HOT Article.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Strong Rotational Anisotropies Affect Nonlinear Chiral Metamaterials

Hooper, D. C., Mark, A. G., Kuppe, C., Collins, J. T., Fischer, P., Valev, V. K.

Advanced Materials, 29(13):1605110, January 2017 (article)

Abstract
Masked by rotational anisotropies, the nonlinear chiroptical response of a metamaterial is initially completely inaccessible. Upon rotating the sample the chiral information emerges. These results highlight the need for a general method to extract the true chiral contributions to the nonlinear optical signal, which would be hugely valuable in the present context of increasingly complex chiral meta/nanomaterials.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl image toc
Rubbing Against Blood Clots Using Helical Robots: Modeling and In Vitro Experimental Validation

Khalil, I. S., Tabak, A. F., Sadek, K., Mahdy, D., Hamdi, N., Sitti, M.

IEEE Robotics and Automation Letters, 2(2):927-934, IEEE, January 2017 (article)

Abstract
The risk of side effects from thrombolytic agents can be minimized by using smaller doses, assisted by mechanical rubbing against blood clots using helical robots. Quantifying this observation, we study the influence of rubbing against clots on their removal rate in vitro. First, we present a hydrodynamic model of the helical robot based on the resistive-force theory to investigate the rubbing behavior of the clots using robot driven by two rotating dipole fields. Second, we experimentally evaluate the influence of the rubbing on the removal rate of the blood clots. Not only do we find that the removal rate of mechanical rubbing (-0.56 ± 0.27 mm3 /min) is approximately three times greater than the dissolution rate of chemical lysis using streptokinase (-0.17 ± 0.032 mm3/min), but we also show that this removal rate can be controlled via the rubbing speed of the robot.

pi

DOI [BibTex]

DOI [BibTex]


no image
Nanoscale topographical control of capillary assembly of nanoparticles

Flauraud, V., Mastrangeli, M., Bernasconi, G., Butet, J., Alexander, D., Shahrabi, E., Martin, O., Brugger, J.

Scientific Reports, Nature Nanotechnology, 12, pages: 73-80, January 2017 (article)

Abstract
Predetermined and selective placement of nanoparticles onto large-area substrates with nanometre-scale precision is essential to harness the unique properties of nanoparticle assemblies, in particular for functional optical and electro-optical nanodevices. Unfortunately, such high spatial organization is currently beyond the reach of top-down nanofabrication techniques alone. Here, we demonstrate that topographic features comprising lithographed funnelled traps and auxiliary sidewalls on a solid substrate can deterministically direct the capillary assembly of Au nanorods to attain simultaneous control of position, orientation and interparticle distance at the nanometre level. We report up to 100% assembly yield over centimetre-scale substrates. We achieve this by optimizing the three sequential stages of capillary nanoparticle assembly: insertion of nanorods into the traps, resilience against the receding suspension front and drying of the residual solvent. Finally, using electron energy-loss spectroscopy we characterize the spectral response and near-field properties of spatially programmable Au nanorod dimers, highlighting the opportunities for precise tunability of the plasmonic modes in larger assemblies.

pi

DOI [BibTex]

DOI [BibTex]


no image
Importance of Matching Physical Friction, Hardness, and Texture in Creating Realistic Haptic Virtual Surfaces

Culbertson, H., Kuchenbecker, K. J.

IEEE Transactions on Haptics, 10(1):63-74, January 2017 (article)

hi

[BibTex]


no image
Effects of Grip-Force, Contact, and Acceleration Feedback on a Teleoperated Pick-and-Place Task

Khurshid, R. P., Fitter, N. T., Fedalei, E. A., Kuchenbecker, K. J.

IEEE Transactions on Haptics, 10(1):40-53, January 2017 (article)

hi

[BibTex]

[BibTex]


no image
Multiaxial Polarity Determines Individual Cellular and Nuclear Chirality

Raymond, M. J., Ray, P., Kaur, G., Fredericks, M., Singh, A. V., Wan, L. Q.

Cellular and Molecular Bioengineering, 10(1):63-74, 2017 (article)

Abstract
Intrinsic cell chirality has been implicated in the left--right (LR) asymmetry of embryonic development. Impaired cell chirality could lead to severe birth defects in laterality. Previously, we detected cell chirality with an in vitro micropatterning system. Here, we demonstrate for the first time that chirality can be quantified as the coordination of multiaxial polarization of individual cells and nuclei. Using an object labeling, connected component based method, we characterized cell chirality based on cell and nuclear shape polarization and nuclear positioning of each cell in multicellular patterns of epithelial cells. We found that the cells adopted a LR bias the boundaries by positioning the sharp end towards the leading edge and leaving the nucleus at the rear. This behavior is consistent with the directional migration observed previously on the boundary of micropatterns. Although the nucleus is chirally aligned, it is not strongly biased towards or away from the boundary. As the result of the rear positioning of nuclei, the nuclear positioning has an opposite chirality to that of cell alignment. Overall, our results have revealed deep insights of chiral morphogenesis as the coordination of multiaxial polarization at the cellular and subcellular levels.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Model-based Contextual Policy Search for Data-Efficient Generalization of Robot Skills

Kupcsik, A., Deisenroth, M., Peters, J., Ai Poh, L., Vadakkepat, V., Neumann, G.

Artificial Intelligence, 247, pages: 415-439, 2017, Special Issue on AI and Robotics (article)

ei

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


no image
Anticipatory Action Selection for Human-Robot Table Tennis

Wang, Z., Boularias, A., Mülling, K., Schölkopf, B., Peters, J.

Artificial Intelligence, 247, pages: 399-414, 2017, Special Issue on AI and Robotics (article)

Abstract
Abstract Anticipation can enhance the capability of a robot in its interaction with humans, where the robot predicts the humans' intention for selecting its own action. We present a novel framework of anticipatory action selection for human-robot interaction, which is capable to handle nonlinear and stochastic human behaviors such as table tennis strokes and allows the robot to choose the optimal action based on prediction of the human partner's intention with uncertainty. The presented framework is generic and can be used in many human-robot interaction scenarios, for example, in navigation and human-robot co-manipulation. In this article, we conduct a case study on human-robot table tennis. Due to the limited amount of time for executing hitting movements, a robot usually needs to initiate its hitting movement before the opponent hits the ball, which requires the robot to be anticipatory based on visual observation of the opponent's movement. Previous work on Intention-Driven Dynamics Models (IDDM) allowed the robot to predict the intended target of the opponent. In this article, we address the problem of action selection and optimal timing for initiating a chosen action by formulating the anticipatory action selection as a Partially Observable Markov Decision Process (POMDP), where the transition and observation are modeled by the \{IDDM\} framework. We present two approaches to anticipatory action selection based on the \{POMDP\} formulation, i.e., a model-free policy learning method based on Least-Squares Policy Iteration (LSPI) that employs the \{IDDM\} for belief updates, and a model-based Monte-Carlo Planning (MCP) method, which benefits from the transition and observation model by the IDDM. Experimental results using real data in a simulated environment show the importance of anticipatory action selection, and that \{POMDPs\} are suitable to formulate the anticipatory action selection problem by taking into account the uncertainties in prediction. We also show that existing algorithms for POMDPs, such as \{LSPI\} and MCP, can be applied to substantially improve the robot's performance in its interaction with humans.

am ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
easyGWAS: A Cloud-based Platform for Comparing the Results of Genome-wide Association Studies

Grimm, D., Roqueiro, D., Salome, P., Kleeberger, S., Greshake, B., Zhu, W., Liu, C., Lippert, C., Stegle, O., Schölkopf, B., Weigel, D., Borgwardt, K.

The Plant Cell, 29(1):5-19, 2017 (article)

ei

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
A Novel Unsupervised Segmentation Approach Quantifies Tumor Tissue Populations Using Multiparametric MRI: First Results with Histological Validation

Katiyar, P., Divine, M. R., Kohlhofer, U., Quintanilla-Martinez, L., Schölkopf, B., Pichler, B. J., Disselhorst, J. A.

Molecular Imaging and Biology, 19(3):391-397, 2017 (article)

ei

DOI [BibTex]

DOI [BibTex]


Thumb xl early stopping teaser
Early Stopping Without a Validation Set

Mahsereci, M., Balles, L., Lassner, C., Hennig, P.

arXiv preprint arXiv:1703.09580, 2017 (article)

Abstract
Early stopping is a widely used technique to prevent poor generalization performance when training an over-expressive model by means of gradient-based optimization. To find a good point to halt the optimizer, a common practice is to split the dataset into a training and a smaller validation set to obtain an ongoing estimate of the generalization performance. In this paper we propose a novel early stopping criterion which is based on fast-to-compute, local statistics of the computed gradients and entirely removes the need for a held-out validation set. Our experiments show that this is a viable approach in the setting of least-squares and logistic regression as well as neural networks.

ps pn

link (url) Project Page Project Page [BibTex]


no image
Krylov Subspace Recycling for Fast Iterative Least-Squares in Machine Learning

Roos, F. D., Hennig, P.

arXiv preprint arXiv:1706.00241, 2017 (article)

Abstract
Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time approximations, such as spectral and inducing-point methods, have been suggested and are now in wide use. These are low-rank approximations that choose the low-rank space a priori and do not refine it over time. While this allows linear cost in the data-set size, it also causes a finite, uncorrected approximation error. Authors from numerical linear algebra have explored ways to iteratively refine such low-rank approximations, at a cost of a small number of matrix-vector multiplications. This idea is particularly interesting in the many situations in machine learning where one has to solve a sequence of related symmetric positive definite linear problems. From the machine learning perspective, such deflation methods can be interpreted as transfer learning of a low-rank approximation across a time-series of numerical tasks. We study the use of such methods for our field. Our empirical results show that, on regression and classification problems of intermediate size, this approach can interpolate between low computational cost and numerical precision.

pn

link (url) Project Page [BibTex]


no image
Minimax Estimation of Kernel Mean Embeddings

Tolstikhin, I., Sriperumbudur, B., Muandet, K.

Journal of Machine Learning Research, 18(86):1-47, 2017 (article)

ei

link (url) Project Page [BibTex]


no image
Kernel Mean Embedding of Distributions: A Review and Beyond

Muandet, K., Fukumizu, K., Sriperumbudur, B., Schölkopf, B.

Foundations and Trends in Machine Learning, 10(1-2):1-141, 2017 (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Computing with Uncertainty

Hennig, P.

2017 (mpi_year_book)

Abstract
Machine learning requires computer hardware to reliable and efficiently compute estimations for ever more complex and fundamentally incomputable quantities. A research team at MPI for Intelligent Systems in Tübingen develops new algorithms which purposely lower the precision of computations and return an explicit measure of uncertainty over the correct result alongside the estimate. Doing so allows for more flexible management of resources, and increases the reliability of intelligent systems.

link (url) DOI [BibTex]


no image
Convergence Analysis of Deterministic Kernel-Based Quadrature Rules in Misspecified Settings

Kanagawa, M., Sriperumbudur, B. K., Fukumizu, K.

Arxiv e-prints, arXiv:1709.00147v1 [math.NA], 2017 (article)

Abstract
This paper presents convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test integrand is less smooth than a Sobolev RKHS based on which a quadrature rule is constructed. We provide convergence guarantees based on two different assumptions on a quadrature rule: one on quadrature weights, and the other on design points. More precisely, we show that convergence rates can be derived (i) if the sum of absolute weights remains constant (or does not increase quickly), or (ii) if the minimum distance between distance design points does not decrease very quickly. As a consequence of the latter result, we derive a rate of convergence for Bayesian quadrature in misspecified settings. We reveal a condition on design points to make Bayesian quadrature robust to misspecification, and show that, under this condition, it may adaptively achieve the optimal rate of convergence in the Sobolev space of a lesser order (i.e., of the unknown smoothness of a test integrand), under a slightly stronger regularity condition on the integrand.

pn

arXiv [BibTex]

arXiv [BibTex]


no image
Prediction of intention during interaction with iCub with Probabilistic Movement Primitives

Dermy, O., Paraschos, A., Ewerton, M., Charpillet, F., Peters, J., Ivaldi, S.

Frontiers in Robotics and AI, 4, pages: 45, 2017 (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Manifold-based multi-objective policy search with sample reuse

Parisi, S., Pirotta, M., Peters, J.

Neurocomputing, 263, pages: 3-14, (Editors: Madalina Drugan, Marco Wiering, Peter Vamplew, and Madhu Chetty), 2017, Special Issue on Multi-Objective Reinforcement Learning (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Spectral Clustering predicts tumor tissue heterogeneity using dynamic 18F-FDG PET: a complement to the standard compartmental modeling approach

Katiyar, P., Divine, M. R., Kohlhofer, U., Quintanilla-Martinez, L., Schölkopf, B., Pichler, B. J., Disselhorst, J. A.

Journal of Nuclear Medicine, 58(4):651-657, 2017 (article)

ei

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Electroencephalographic identifiers of motor adaptation learning

Ozdenizci, O., Yalcin, M., Erdogan, A., Patoglu, V., Grosse-Wentrup, M., Cetin, M.

Journal of Neural Engineering, 14(4):046027, 2017 (article)

ei

link (url) [BibTex]

link (url) [BibTex]


no image
Gene delivery particle engineering strategies for shape-dependent targeting of cells and tissues.

Kozielski, K., Sitti, M.

Current Gene Therapy, 17, 2017 (article)

Abstract
Background: Successful gene delivery requires overcoming both systemic and intracellular obstacles before the nucleic acid cargo can successfully reach its tissue and subcellular target location. Materials & Methods: Non-viral mechanisms to enable targeting while avoiding off-target delivery have arisen via biological, chemical, and physical engineering strategies. Discussion: Herein we will discuss the physical parameters in particle design that promote tissue- and cell-targeted delivery of genetic cargo. We will discuss systemic concerns, such as circulation, tissue localization, and clearance, as well as cell-scale obstacles, such as cellular uptake and nucleic acid packaging. Conclusion: In particular, we will focus on engineering particle shape and size in order to enhance delivery and promote precise targeting. We will also address methods to program or change particle shape in situ using environmentally triggered cues.

pi

DOI [BibTex]


no image
Self-Organized Behavior Generation for Musculoskeletal Robots

Der, R., Martius, G.

Frontiers in Neurorobotics, 11, pages: 8, 2017 (article)

al

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Detecting distortions of peripherally presented letter stimuli under crowded conditions

Wallis, T. S. A., Tobias, S., Bethge, M., Wichmann, F. A.

Attention, Perception, & Psychophysics, 79(3):850-862, 2017 (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl image toc
Multi-fractal characterization of bacterial swimming dynamics: a case study on real and simulated Serratia marcescens

Koorehdavoudi, H., Bogdan, P., Wei, G., Marculescu, R., Zhuang, J., Carlsen, R. W., Sitti, M.

Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, 473(2203), The Royal Society, 2017 (article)

Abstract
To add to the current state of knowledge about bacterial swimming dynamics, in this paper, we study the fractal swimming dynamics of populations of Serratia marcescens bacteria both in vitro and in silico, while accounting for realistic conditions like volume exclusion, chemical interactions, obstacles and distribution of chemoattractant in the environment. While previous research has shown that bacterial motion is non-ergodic, we demonstrate that, besides the non-ergodicity, the bacterial swimming dynamics is multi-fractal in nature. Finally, we demonstrate that the multi-fractal characteristic of bacterial dynamics is strongly affected by bacterial density and chemoattractant concentration.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Thumb xl comp 5d wbkgng copy
Microemulsion-Based Soft Bacteria-Driven Microswimmers for Active Cargo Delivery

Singh, A. V., Hosseinidoust, Z., Park, B., Yasa, O., Sitti, M.

ACS Nano, 0(0):null, 2017, PMID: 28858477 (article)

Abstract
Biohybrid cell-driven microsystems offer unparalleled possibilities for realization of soft microrobots at the micron scale. Here, we introduce a bacteria-driven microswimmer that combines the active locomotion and sensing capabilities of bacteria with the desirable encapsulation and viscoelastic properties of a soft double-micelle microemulsion for active transport and delivery of cargo (e.g., imaging agents, genes, and drugs) to living cells. Quasi-monodisperse double emulsions were synthesized with an aqueous core that encapsulated the fluorescence imaging agents, as a proof-of-concept cargo in this study, and an outer oil shell that was functionalized with streptavidin for specific and stable attachment of biotin-conjugated Escherichia coli. Motile bacteria effectively propelled the soft microswimmers across a Transwell membrane, actively delivering imaging agents (i.e., dyes) encapsulated inside of the micelles to a monolayer of cultured MCF7 breast cancer and J744A.1 macrophage cells, which enabled real-time, live-cell imaging of cell organelles, namely mitochondria, endoplasmic reticulum, and Golgi body. This in vitro model demonstrates the proof-of-concept feasibility of the proposed soft microswimmers and offers promise for potential biomedical applications in active and/or targeted transport and delivery of imaging agents, drugs, stem cells, siRNA, and therapeutic genes to live tissue in in vitro disease models (e.g., organ-on-a-chip devices) and stagnant or low-flow-velocity fluidic regions of the human body.

pi

link (url) DOI Project Page [BibTex]


no image
Biomechanics and Locomotion Control in Legged Animals and Legged Robots

Sproewitz, A., Heim, S.

2017 (mpi_year_book)

Abstract
An animal's running gait is dynamic, efficient, elegant, and adaptive. We see locomotion in animals as an orchestrated interplay of the locomotion apparatus, interacting with its environment. The Dynamic Locomotion Group at the Max Planck Institute for Intelligent Systems in Stuttgart develops novel legged robots to decipher aspects of biomechanics and neuromuscular control of legged locomotion in animals, and to understand general principles of locomotion.

link (url) DOI [BibTex]


no image
Mode Evolution in Strongly Coupled Plasmonic Dolmens Fabricated by Templated Assembly

Flauraud, V., Bernasconi, G. D., Butet, J., Mastrangeli, M., Alexander, D. T. L., Martin, O. J. F., Brugger, J.

ACS Photonics, 4(7):1661-1668, 2017 (article)

Abstract
Plasmonic antennas have enabled a wealth of applications that exploit tailored near-fields and radiative properties, further endowed by the bespoke interactions of multiple resonant building blocks. Specifically, when the interparticle distances are reduced to a few nanometers, coupling may be greatly enhanced leading to ultimate near-field intensities and confinement along with a large energy splitting of resonant modes. While this concept is well-known, the fabrication and characterization of suitable multimers with controlled geometries and few-nanometer gaps remains highly challenging. In this article, we present the topographically templated assembly of single-crystal colloidal gold nanorods into trimers, with a dolmen geometry. This fabrication method enables the precise positioning of high-quality nanorods, with gaps as small as 1.5 nm, which permits a gradual and controlled symmetry breaking by tuning the arrangement of these strongly coupled nanostructures. To characterize the fabricated structures, we perform electron energy loss spectroscopy (EELS) near-field hyperspectral imaging and geometrically accurate EELS, plane wave, and eigenmode full-wave computations to reveal the principles governing the electromagnetic response of such nanostructures that have been extensively studied under plane wave excitation for their Fano resonant properties. These experiments track the evolution of the multipolar interactions with high accuracy as the antenna geometry varies. Our results provide new insights in strongly coupled single-crystal building blocks and open news opportunities for the design and fabrication of plasmonic systems.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Two-sample Hypothesis Testing for Inhomogeneous Random Graphs

Ghoshdastidar, D., Gutzeit, M., Carpentier, A., von Luxburg, U.

2017, arXiv preprint (arXiv:1707.00833) (article)

slt

Project Page [BibTex]

Project Page [BibTex]


no image
Temporal evolution of the central fixation bias in scene viewing

Rothkegel, L. O. M., Trukenbrod, H. A., Schütt, H. H., Wichmann, F. A., Engbert, R.

Journal of Vision, 17(13):3, 2017 (article)

ei

DOI Project Page [BibTex]

DOI Project Page [BibTex]