Header logo is


2014


Series of Multilinked Caterpillar Track-type Climbing Robots
Series of Multilinked Caterpillar Track-type Climbing Robots

Lee, G., Kim, H., Seo, K., Kim, J., Sitti, M., Seo, T.

Journal of Field Robotics, November 2014 (article)

Abstract
Climbing robots have been widely applied in many industries involving hard to access, dangerous, or hazardous environments to replace human workers. Climbing speed, payload capacity, the ability to overcome obstacles, and wall-to-wall transitioning are significant characteristics of climbing robots. Here, multilinked track wheel-type climbing robots are proposed to enhance these characteristics. The robots have been developed for five years in collaboration with three universities: Seoul National University, Carnegie Mellon University, and Yeungnam University. Four types of robots are presented for different applications with different surface attachment methods and mechanisms: MultiTank for indoor sites, Flexible caterpillar robot (FCR) and Combot for heavy industrial sites, and MultiTrack for high-rise buildings. The method of surface attachment is different for each robot and application, and the characteristics of the joints between links are designed as active or passive according to the requirement of a given robot. Conceptual design, practical design, and control issues of such climbing robot types are reported, and a proper choice of the attachment methods and joint type is essential for the successful multilink track wheel-type climbing robot for different surface materials, robot size, and computational costs.

pi

DOI [BibTex]

2014


DOI [BibTex]


no image
Wenn es was zu sagen gibt

(Klaus Tschira Award 2014 in Computer Science)

Trimpe, S.

Bild der Wissenschaft, pages: 20-23, November 2014, (popular science article in German) (article)

am ics

PDF Project Page [BibTex]

PDF Project Page [BibTex]


{MoSh}: Motion and Shape Capture from Sparse Markers
MoSh: Motion and Shape Capture from Sparse Markers

Loper, M. M., Mahmood, N., Black, M. J.

ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 33(6):220:1-220:13, ACM, New York, NY, USA, November 2014 (article)

Abstract
Marker-based motion capture (mocap) is widely criticized as producing lifeless animations. We argue that important information about body surface motion is present in standard marker sets but is lost in extracting a skeleton. We demonstrate a new approach called MoSh (Motion and Shape capture), that automatically extracts this detail from mocap data. MoSh estimates body shape and pose together using sparse marker data by exploiting a parametric model of the human body. In contrast to previous work, MoSh solves for the marker locations relative to the body and estimates accurate body shape directly from the markers without the use of 3D scans; this effectively turns a mocap system into an approximate body scanner. MoSh is able to capture soft tissue motions directly from markers by allowing body shape to vary over time. We evaluate the effect of different marker sets on pose and shape accuracy and propose a new sparse marker set for capturing soft-tissue motion. We illustrate MoSh by recovering body shape, pose, and soft-tissue motion from archival mocap data and using this to produce animations with subtlety and realism. We also show soft-tissue motion retargeting to new characters and show how to magnify the 3D deformations of soft tissue to create animations with appealing exaggerations.

ps

pdf video data pdf from publisher link (url) DOI Project Page Project Page Project Page [BibTex]

pdf video data pdf from publisher link (url) DOI Project Page Project Page Project Page [BibTex]


Can I recognize my body’s weight? The influence of shape and texture on the perception of self
Can I recognize my body’s weight? The influence of shape and texture on the perception of self

Piryankova, I., Stefanucci, J., Romero, J., de la Rosa, S., Black, M., Mohler, B.

ACM Transactions on Applied Perception for the Symposium on Applied Perception, 11(3):13:1-13:18, September 2014 (article)

Abstract
The goal of this research was to investigate women’s sensitivity to changes in their perceived weight by altering the body mass index (BMI) of the participants’ personalized avatars displayed on a large-screen immersive display. We created the personalized avatars with a full-body 3D scanner that records both the participants’ body geometry and texture. We altered the weight of the personalized avatars to produce changes in BMI while keeping height, arm length and inseam fixed and exploited the correlation between body geometry and anthropometric measurements encapsulated in a statistical body shape model created from thousands of body scans. In a 2x2 psychophysical experiment, we investigated the relative importance of visual cues, namely shape (own shape vs. an average female body shape with equivalent height and BMI to the participant) and texture (own photo-realistic texture or checkerboard pattern texture) on the ability to accurately perceive own current body weight (by asking them ‘Is the avatar the same weight as you?’). Our results indicate that shape (where height and BMI are fixed) had little effect on the perception of body weight. Interestingly, the participants perceived their body weight veridically when they saw their own photo-realistic texture and significantly underestimated their body weight when the avatar had a checkerboard patterned texture. The range that the participants accepted as their own current weight was approximately a 0.83 to −6.05 BMI% change tolerance range around their perceived weight. Both the shape and the texture had an effect on the reported similarity of the body parts and the whole avatar to the participant’s body. This work has implications for new measures for patients with body image disorders, as well as researchers interested in creating personalized avatars for games, training applications or virtual reality.

ps

pdf DOI Project Page Project Page [BibTex]

pdf DOI Project Page Project Page [BibTex]


no image
Robotics and Neuroscience

Floreano, Dario, Ijspeert, Auke Jan, Schaal, S.

Current Biology, 24(18):R910-R920, sep 2014 (article)

am

[BibTex]

[BibTex]


no image
3D to 2D bijection for spherical objects under equidistant fisheye projection

Ahmad, A., Xavier, J., Santos-Victor, J., Lima, P.

Computer Vision and Image Understanding, 125, pages: 172-183, August 2014 (article)

Abstract
The core problem addressed in this article is the 3D position detection of a spherical object of known-radius in a single image frame, obtained by a dioptric vision system consisting of only one fisheye lens camera that follows equidistant projection model. The central contribution is a bijection principle between a known-radius spherical object’s 3D world position and its 2D projected image curve, that we prove, thus establishing that for every possible 3D world position of the spherical object, there exists a unique curve on the image plane if the object is projected through a fisheye lens that follows equidistant projection model. Additionally, we present a setup for the experimental verification of the principle’s correctness. In previously published works we have applied this principle to detect and subsequently track a known-radius spherical object.

ps

DOI [BibTex]

DOI [BibTex]


Segmented molecular design of self-healing proteinaceous materials.
Segmented molecular design of self-healing proteinaceous materials.

Sariola, V., Pena-Francesch, A., Jung, H., Çetinkaya, M., Pacheco, C., Sitti, M., Demirel, M. C.

Scientific reports, 5, pages: 13482-13482, Nature Publishing Group, July 2014 (article)

Abstract
Hierarchical assembly of self-healing adhesive proteins creates strong and robust structural and interfacial materials, but understanding of the molecular design and structure–property relationships of structural proteins remains unclear. Elucidating this relationship would allow rational design of next generation genetically engineered self-healing structural proteins. Here we report a general self-healing and -assembly strategy based on a multiphase recombinant protein based material. Segmented structure of the protein shows soft glycine- and tyrosine-rich segments with self-healing capability and hard beta-sheet segments. The soft segments are strongly plasticized by water, lowering the self-healing temperature close to body temperature. The hard segments self-assemble into nanoconfined domains to reinforce the material. The healing strength scales sublinearly with contact time, which associates with diffusion and wetting of autohesion. The finding suggests that recombinant structural proteins from heterologous expression have potential as strong and repairable engineering materials.

pi

DOI [BibTex]

DOI [BibTex]


Breathing Life into Shape: Capturing, Modeling and Animating {3D} Human Breathing
Breathing Life into Shape: Capturing, Modeling and Animating 3D Human Breathing

Tsoli, A., Mahmood, N., Black, M. J.

ACM Transactions on Graphics, (Proc. SIGGRAPH), 33(4):52:1-52:11, ACM, New York, NY, July 2014 (article)

Abstract
Modeling how the human body deforms during breathing is important for the realistic animation of lifelike 3D avatars. We learn a model of body shape deformations due to breathing for different breathing types and provide simple animation controls to render lifelike breathing regardless of body shape. We capture and align high-resolution 3D scans of 58 human subjects. We compute deviations from each subject’s mean shape during breathing, and study the statistics of such shape changes for different genders, body shapes, and breathing types. We use the volume of the registered scans as a proxy for lung volume and learn a novel non-linear model relating volume and breathing type to 3D shape deformations and pose changes. We then augment a SCAPE body model so that body shape is determined by identity, pose, and the parameters of the breathing model. These parameters provide an intuitive interface with which animators can synthesize 3D human avatars with realistic breathing motions. We also develop a novel interface for animating breathing using a spirometer, which measures the changes in breathing volume of a “breath actor.”

ps

pdf video link (url) DOI Project Page Project Page Project Page [BibTex]


Bio-Hybrid Cell-Based Actuators for Microsystems
Bio-Hybrid Cell-Based Actuators for Microsystems

Carlsen, R. W., Sitti, M.

Small, 10(19):3831-3851, June 2014 (article)

Abstract
As we move towards the miniaturization of devices to perform tasks at the nano and microscale, it has become increasingly important to develop new methods for actuation, sensing, and control. Over the past decade, bio-hybrid methods have been investigated as a promising new approach to overcome the challenges of scaling down robotic and other functional devices. These methods integrate biological cells with artificial components and therefore, can take advantage of the intrinsic actuation and sensing functionalities of biological cells. Here, the recent advancements in bio-hybrid actuation are reviewed, and the challenges associated with the design, fabrication, and control of bio-hybrid microsystems are discussed. As a case study, focus is put on the development of bacteria-driven microswimmers, which has been investigated as a targeted drug delivery carrier. Finally, a future outlook for the development of these systems is provided. The continued integration of biological and artificial components is envisioned to enable the performance of tasks at a smaller and smaller scale in the future, leading to the parallel and distributed operation of functional systems at the microscale.

pi

DOI [BibTex]

DOI [BibTex]


Nanopropellers and Their Actuation in Complex Viscoelastic Media
Nanopropellers and Their Actuation in Complex Viscoelastic Media

Schamel, D., Mark, A. G., Gibbs, J. G., Miksch, C., Morozov, K. I., Leshansky, A. M., Fischer, P.

ACS Nano, 8(9):8794-8801, June 2014, Featured cover article. (article)

Abstract
Tissue and biological fluids are complex viscoelastic media with a nanoporous macromolecular structure. Here, we demonstrate that helical nanopropellers can be controllably steered through such a biological gel. The screw-propellers have a filament diameter of about 70 nm and are smaller than previously reported nanopropellers as well as any swimming microorganism. We show that the nanoscrews will move through high-viscosity solutions with comparable velocities to that of larger micropropellers, even though they are so small that Brownian forces suppress their actuation in pure water. When actuated in viscoelastic hyaluronan gels, the nanopropellers appear to have a significant advantage, as they are of the same size range as the gel’s mesh size. Whereas larger helices will show very low or negligible propulsion in hyaluronan solutions, the nanoscrews actually display significantly enhanced propulsion velocities that exceed the highest measured speeds in Newtonian fluids. The nanopropellers are not only promising for applications in the extracellular environment but small enough to be taken up by cells.

Featured cover article.

pf

Video - Helical Micro and Nanopropellers for Applications in Biological Fluidic Environments link (url) DOI [BibTex]


Nonmyopic View Planning for Active Object Classification and Pose Estimation
Nonmyopic View Planning for Active Object Classification and Pose Estimation

Atanasov, N., Sankaran, B., Le Ny, J., Pappas, G., Daniilidis, K.

IEEE Transactions on Robotics, May 2014, clmc (article)

Abstract
One of the central problems in computer vision is the detection of semantically important objects and the estimation of their pose. Most of the work in object detection has been based on single image processing and its performance is limited by occlusions and ambiguity in appearance and geometry. This paper proposes an active approach to object detection by controlling the point of view of a mobile depth camera. When an initial static detection phase identifies an object of interest, several hypotheses are made about its class and orientation. The sensor then plans a sequence of viewpoints, which balances the amount of energy used to move with the chance of identifying the correct hypothesis. We formulate an active M-ary hypothesis testing problem, which includes sensor mobility, and solve it using a point-based approximate POMDP algorithm. The validity of our approach is verified through simulation and real-world experiments with the PR2 robot. The results suggest a significant improvement over static object detection

am

Web pdf link (url) [BibTex]

Web pdf link (url) [BibTex]


3D Traffic Scene Understanding from Movable Platforms
3D Traffic Scene Understanding from Movable Platforms

Geiger, A., Lauer, M., Wojek, C., Stiller, C., Urtasun, R.

IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 36(5):1012-1025, published, IEEE, Los Alamitos, CA, May 2014 (article)

Abstract
In this paper, we present a novel probabilistic generative model for multi-object traffic scene understanding from movable platforms which reasons jointly about the 3D scene layout as well as the location and orientation of objects in the scene. In particular, the scene topology, geometry and traffic activities are inferred from short video sequences. Inspired by the impressive driving capabilities of humans, our model does not rely on GPS, lidar or map knowledge. Instead, it takes advantage of a diverse set of visual cues in the form of vehicle tracklets, vanishing points, semantic scene labels, scene flow and occupancy grids. For each of these cues we propose likelihood functions that are integrated into a probabilistic generative model. We learn all model parameters from training data using contrastive divergence. Experiments conducted on videos of 113 representative intersections show that our approach successfully infers the correct layout in a variety of very challenging scenarios. To evaluate the importance of each feature cue, experiments using different feature combinations are conducted. Furthermore, we show how by employing context derived from the proposed method we are able to improve over the state-of-the-art in terms of object detection and object orientation estimation in challenging and cluttered urban environments.

avg ps

pdf link (url) [BibTex]

pdf link (url) [BibTex]


Data-Driven Grasp Synthesis - A Survey
Data-Driven Grasp Synthesis - A Survey

Bohg, J., Morales, A., Asfour, T., Kragic, D.

IEEE Transactions on Robotics, 30, pages: 289 - 309, IEEE, April 2014 (article)

Abstract
We review the work on data-driven grasp synthesis and the methodologies for sampling and ranking candidate grasps. We divide the approaches into three groups based on whether they synthesize grasps for known, familiar or unknown objects. This structure allows us to identify common object representations and perceptual processes that facilitate the employed data-driven grasp synthesis technique. In the case of known objects, we concentrate on the approaches that are based on object recognition and pose estimation. In the case of familiar objects, the techniques use some form of a similarity matching to a set of previously encountered objects. Finally for the approaches dealing with unknown objects, the core part is the extraction of specific features that are indicative of good grasps. Our survey provides an overview of the different methodologies and discusses open problems in the area of robot grasping. We also draw a parallel to the classical approaches that rely on analytic formulations.

am

PDF link (url) DOI Project Page [BibTex]

PDF link (url) DOI Project Page [BibTex]


Adaptive Offset Correction for Intracortical Brain Computer Interfaces
Adaptive Offset Correction for Intracortical Brain Computer Interfaces

Homer, M. L., Perge, J. A., Black, M. J., Harrison, M. T., Cash, S. S., Hochberg, L. R.

IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22(2):239-248, March 2014 (article)

Abstract
Intracortical brain computer interfaces (iBCIs) decode intended movement from neural activity for the control of external devices such as a robotic arm. Standard approaches include a calibration phase to estimate decoding parameters. During iBCI operation, the statistical properties of the neural activity can depart from those observed during calibration, sometimes hindering a user’s ability to control the iBCI. To address this problem, we adaptively correct the offset terms within a Kalman filter decoder via penalized maximum likelihood estimation. The approach can handle rapid shifts in neural signal behavior (on the order of seconds) and requires no knowledge of the intended movement. The algorithm, called MOCA, was tested using simulated neural activity and evaluated retrospectively using data collected from two people with tetraplegia operating an iBCI. In 19 clinical research test cases, where a nonadaptive Kalman filter yielded relatively high decoding errors, MOCA significantly reduced these errors (10.6 ± 10.1\%; p < 0.05, pairwise t-test). MOCA did not significantly change the error in the remaining 23 cases where a nonadaptive Kalman filter already performed well. These results suggest that MOCA provides more robust decoding than the standard Kalman filter for iBCIs.

ps

pdf DOI Project Page [BibTex]

pdf DOI Project Page [BibTex]


A physically-based approach to reflection separation: from physical modeling to constrained optimization
A physically-based approach to reflection separation: from physical modeling to constrained optimization

Kong, N., Tai, Y., Shin, J. S.

IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 36(2):209-221, IEEE Computer Society, Febuary 2014 (article)

Abstract
We propose a physically-based approach to separate reflection using multiple polarized images with a background scene captured behind glass. The input consists of three polarized images, each captured from the same view point but with a different polarizer angle separated by 45 degrees. The output is the high-quality separation of the reflection and background layers from each of the input images. A main technical challenge for this problem is that the mixing coefficient for the reflection and background layers depends on the angle of incidence and the orientation of the plane of incidence, which are spatially varying over the pixels of an image. Exploiting physical properties of polarization for a double-surfaced glass medium, we propose a multiscale scheme which automatically finds the optimal separation of the reflection and background layers. Through experiments, we demonstrate that our approach can generate superior results to those of previous methods.

ps

Publisher site [BibTex]

Publisher site [BibTex]


Simpler, faster, more accurate melanocytic lesion segmentation through MEDS
Simpler, faster, more accurate melanocytic lesion segmentation through MEDS

Peruch, F., Bogo, F., Bonazza, M., Cappelleri, V., Peserico, E.

IEEE Transactions on Biomedical Engineering, 61(2):557-565, February 2014 (article)

ps

DOI [BibTex]

DOI [BibTex]


Targets-Drives-Means: {A} declarative approach to dynamic behavior specification with higher usability
Targets-Drives-Means: A declarative approach to dynamic behavior specification with higher usability

Berenz, V., Suzuki, K.

Robotics and Autonomous Systems, 62(4):545-555, 2014 (article)

am

link (url) DOI [BibTex]


Roombots: A hardware perspective on 3D self-reconfiguration and locomotion with a homogeneous modular robot
Roombots: A hardware perspective on 3D self-reconfiguration and locomotion with a homogeneous modular robot

Spröwitz, A., Moeckel, R., Vespignani, M., Bonardi, S., Ijspeert, A. J.

{Robotics and Autonomous Systems}, 62(7):1016-1033, Elsevier, Amsterdam, 2014 (article)

Abstract
In this work we provide hands-on experience on designing and testing a self-reconfiguring modular robotic system, Roombots (RB), to be used among others for adaptive furniture. In the long term, we envision that RB can be used to create sets of furniture, such as stools, chairs and tables that can move in their environment and that change shape and functionality during the day. In this article, we present the first, incremental results towards that long term vision. We demonstrate locomotion and reconfiguration of single and metamodule RB over 3D surfaces, in a structured environment equipped with embedded connection ports. RB assemblies can move around in non-structured environments, by using rotational or wheel-like locomotion. We show a proof of concept for transferring a Roombots metamodule (two in-series coupled RB modules) from the non-structured environment back into the structured grid, by aligning the RB metamodule in an entrapment mechanism. Finally, we analyze the remaining challenges to master the full Roombots scenario, and discuss the impact on future Roombots hardware.

dlg

DOI [BibTex]

DOI [BibTex]


Circular polarization interferometry: circularly polarized modes of cholesteric liquid crystals
Circular polarization interferometry: circularly polarized modes of cholesteric liquid crystals

Sanchez-Castillo, A., Eslami, S., Giesselmann, F., Fischer, P.

OPTICS EXPRESS, 22(25):31227-31236, 2014 (article)

Abstract
We describe a novel polarization interferometer which permits the determination of the refractive indices for circularly-polarized light. It is based on a Jamin-Lebedeff interferometer, modified with waveplates, and permits us to experimentally determine the refractive indices n(L) and n(R) of the respectively left- and right-circularly polarized modes in a cholesteric liquid crystal. Whereas optical rotation measurements only determine the circular birefringence, i.e. the difference (n(L) - n(R)), the interferometer also permits the determination of their absolute values. We report refractive indices of a cholesteric liquid crystal in the region of selective (Bragg) reflection as a function of temperature. (C) 2014 Optical Society of America

pf

DOI [BibTex]

DOI [BibTex]


Self-Propelling Nanomotors in the Presence of Strong Brownian Forces
Self-Propelling Nanomotors in the Presence of Strong Brownian Forces

Lee, T., Alarcon-Correa, M., Miksch, C., Hahn, K., Gibbs, J. G., Fischer, P.

NANO LETTERS, 14(5):2407-2412, 2014 (article)

Abstract
Motility in living systems is due to an array of complex molecular nanomotors that are essential for the function and survival of cells. These protein nanomotors operate not only despite of but also because of stochastic forces. Artificial means of realizing motility rely on local concentration or temperature gradients that are established across a particle, resulting in slip velocities at the particle surface and thus motion of the particle relative to the fluid. However, it remains unclear if these artificial motors can function at the smallest of scales, where Brownian motion dominates and no actively propelled living organisms can be found. Recently, the first reports have appeared suggesting that the swimming mechanisms of artificial structures may also apply to enzymes that are catalytically active. Here we report a scheme to realize artificial Janus nanoparticles (JNPs) with an overall size that is comparable to that of some enzymes similar to 30 nm. Our JNPs can catalyze the decomposition of hydrogen peroxide to water and oxygen and thus actively move by self-electrophoresis. Geometric anisotropy of the Pt-Au Janus nanoparticles permits the simultaneous observation of their translational and rotational motion by dynamic light scattering. While their dynamics is strongly influenced by Brownian rotation, the artificial Janus nanomotors show bursts of linear ballistic motion resulting in enhanced diffusion.

pf

DOI [BibTex]


Shape control in wafer-based aperiodic 3D nanostructures
Shape control in wafer-based aperiodic 3D nanostructures

Hyeon-Ho, J., Mark, A. G., Gibbs, J. G., Reindl, T., Waizmann, U., Weis, J., Fischer, P.

NANOTECHNOLOGY, 25(23), 2014, Cover article. (article)

Abstract
Controlled local fabrication of three-dimensional (3D) nanostructures is important to explore and enhance the function of single nanodevices, but is experimentally challenging. We present a scheme based on e-beam lithography (EBL) written seeds, and glancing angle deposition (GLAD) grown structures to create nanoscale objects with defined shapes but in aperiodic arrangements. By using a continuous sacrificial corral surrounding the features of interest we grow isolated 3D nanostructures that have complex cross-sections and sidewall morphology that are surrounded by zones of clean substrate.

Cover article.

pf

DOI [BibTex]

DOI [BibTex]


no image
A Limiting Property of the Matrix Exponential

Trimpe, S., D’Andrea, R.

IEEE Transactions on Automatic Control, 59(4):1105-1110, 2014 (article)

am ics

PDF DOI [BibTex]

PDF DOI [BibTex]


no image
Event-Based State Estimation With Variance-Based Triggering

Trimpe, S., D’Andrea, R.

IEEE Transactions on Automatic Control, 59(12):3266-3281, 2014 (article)

am ics

PDF Supplementary material DOI Project Page [BibTex]

PDF Supplementary material DOI Project Page [BibTex]


A freely-moving monkey treadmill model
A freely-moving monkey treadmill model

Foster, J., Nuyujukian, P., Freifeld, O., Gao, H., Walker, R., Ryu, S., Meng, T., Murmann, B., Black, M., Shenoy, K.

J. of Neural Engineering, 11(4):046020, 2014 (article)

Abstract
Objective: Motor neuroscience and brain-machine interface (BMI) design is based on examining how the brain controls voluntary movement, typically by recording neural activity and behavior from animal models. Recording technologies used with these animal models have traditionally limited the range of behaviors that can be studied, and thus the generality of science and engineering research. We aim to design a freely-moving animal model using neural and behavioral recording technologies that do not constrain movement. Approach: We have established a freely-moving rhesus monkey model employing technology that transmits neural activity from an intracortical array using a head-mounted device and records behavior through computer vision using markerless motion capture. We demonstrate the excitability and utility of this new monkey model, including the fi rst recordings from motor cortex while rhesus monkeys walk quadrupedally on a treadmill. Main results: Using this monkey model, we show that multi-unit threshold-crossing neural activity encodes the phase of walking and that the average ring rate of the threshold crossings covaries with the speed of individual steps. On a population level, we find that neural state-space trajectories of walking at diff erent speeds have similar rotational dynamics in some dimensions that evolve at the step rate of walking, yet robustly separate by speed in other state-space dimensions. Significance: Freely-moving animal models may allow neuroscientists to examine a wider range of behaviors and can provide a flexible experimental paradigm for examining the neural mechanisms that underlie movement generation across behaviors and environments. For BMIs, freely-moving animal models have the potential to aid prosthetic design by examining how neural encoding changes with posture, environment, and other real-world context changes. Understanding this new realm of behavior in more naturalistic settings is essential for overall progress of basic motor neuroscience and for the successful translation of BMIs to people with paralysis.

ps

pdf Supplementary DOI Project Page [BibTex]

pdf Supplementary DOI Project Page [BibTex]


Swimming by reciprocal motion at low Reynolds number
Swimming by reciprocal motion at low Reynolds number

Qiu, T., Lee, T., Mark, A. G., Morozov, K. I., Muenster, R., Mierka, O., Turek, S., Leshansky, A. M., Fischer, P.

NATURE COMMUNICATIONS, 5, 2014, Max Planck Press Release. (article)

Abstract
Biological microorganisms swim with flagella and cilia that execute nonreciprocal motions for low Reynolds number (Re) propulsion in viscous fluids. This symmetry requirement is a consequence of Purcell's scallop theorem, which complicates the actuation scheme needed by microswimmers. However, most biomedically important fluids are non-Newtonian where the scallop theorem no longer holds. It should therefore be possible to realize a microswimmer that moves with reciprocal periodic body-shape changes in non-Newtonian fluids. Here we report a symmetric `micro-scallop', a single-hinge microswimmer that can propel in shear thickening and shear thinning (non-Newtonian) fluids by reciprocal motion at low Re. Excellent agreement between our measurements and both numerical and analytical theoretical predictions indicates that the net propulsion is caused by modulation of the fluid viscosity upon varying the shear rate. This reciprocal swimming mechanism opens new possibilities in designing biomedical microdevices that can propel by a simple actuation scheme in non-Newtonian biological fluids.

Max Planck Press Release.

pf

Video - A Swimming Micro-Scallop Video - Winner of the Micro-robotic Design Challenge in Hamlyn Symposium on Medical Robotics DOI [BibTex]

Video - A Swimming Micro-Scallop Video - Winner of the Micro-robotic Design Challenge in Hamlyn Symposium on Medical Robotics DOI [BibTex]


Nanohelices by shadow growth
Nanohelices by shadow growth

Gibbs, J. G., Mark, A. G., Lee, T., Eslami, S., Schamel, D., Fischer, P.

NANOSCALE, 6(16):9457-9466, 2014 (article)

Abstract
The helix has remarkable qualities and is prevalent in many fields including mathematics, physics, chemistry, and biology. This shape, which is chiral by nature, is ubiquitous in biology with perhaps the most famous example being DNA. Other naturally occurring helices are common at the nanoscale in the form of protein secondary structures and in various macromolecules. Nanoscale helices exhibit a wide range of interesting mechanical, optical, and electrical properties which can be intentionally engineered into the structure by choosing the correct morphology and material. As technology advances, these fabrication parameters can be fine-tuned and matched to the application of interest. Herein, we focus on the fabrication and properties of nanohelices grown by a dynamic shadowing growth method combined with fast wafer-scale substrate patterning which has a number of distinct advantages. We review the fabrication methodology and provide several examples that illustrate the generality and utility of nanohelices shadow-grown on nanopatterns.

pf

Video - Fabrication of Designer Nanostructures DOI [BibTex]


A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles behind Them
A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles behind Them

(Journal version of the Longuet-Higgins Prize paper on "Secrets of Optical Flow")

Sun, D., Roth, S., Black, M. J.

International Journal of Computer Vision (IJCV), 106(2):115-137, 2014 (article)

Abstract
The accuracy of optical flow estimation algorithms has been improving steadily as evidenced by results on the Middlebury optical flow benchmark. The typical formulation, however, has changed little since the work of Horn and Schunck. We attempt to uncover what has made recent advances possible through a thorough analysis of how the objective function, the optimization method, and modern implementation practices influence accuracy. We discover that "classical'' flow formulations perform surprisingly well when combined with modern optimization and implementation techniques. One key implementation detail is the median filtering of intermediate flow fields during optimization. While this improves the robustness of classical methods it actually leads to higher energy solutions, meaning that these methods are not optimizing the original objective function. To understand the principles behind this phenomenon, we derive a new objective function that formalizes the median filtering heuristic. This objective function includes a non-local smoothness term that robustly integrates flow estimates over large spatial neighborhoods. By modifying this new term to include information about flow and image boundaries we develop a method that can better preserve motion details. To take advantage of the trend towards video in wide-screen format, we further introduce an asymmetric pyramid downsampling scheme that enables the estimation of longer range horizontal motions. The methods are evaluated on Middlebury, MPI Sintel, and KITTI datasets using the same parameter settings.

ps

pdf full text code [BibTex]

pdf full text code [BibTex]


Detection and Tracking of Occluded People
Detection and Tracking of Occluded People

Tang, S., Andriluka, M., Schiele, B.

International Journal of Computer Vision, 110, pages: 58-69, 2014 (article)

ps

PDF [BibTex]

PDF [BibTex]


Continuously distributed magnetization profile for millimeter-scale elastomeric undulatory swimming
Continuously distributed magnetization profile for millimeter-scale elastomeric undulatory swimming

Diller, E., Zhuang, J., Zhan Lum, G., Edwards, M. R., Sitti, M.

Applied Physics Letters, 104(17):174101, AIP, 2014 (article)

Abstract
We have developed a millimeter-scale magnetically driven swimming robot for untethered motion at mid to low Reynolds numbers. The robot is propelled by continuous undulatory deformation, which is enabled by the distributed magnetization profile of a flexible sheet. We demonstrate control of a prototype device and measure deformation and speed as a function of magnetic field strength and frequency. Experimental results are compared with simple magnetoelastic and fluid propulsion models. The presented mechanism provides an efficient remote actuation method at the millimeter scale that may be suitable for further scaling down in size for microrobotics applications in biotechnology and healthcare

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Chiral Nanomagnets
Chiral Nanomagnets

Eslami, S., Gibbs, J. G., Rechkemmer, Y., van Slageren, J., Alarcon-Correa, M., Lee, T., Mark, A. G., Rikken, G. L. J. A., Fischer, P.

ACS PHOTONICS, 1(11):1231-1236, 2014 (article)

Abstract
We report on the enhanced optical properties of chiral magnetic nanohelices with critical dimensions comparable to the ferromagnetic domain size. They are shown to be ferromagnetic at room temperature, have defined chirality, and exhibit large optical activity in the visible as verified by electron microscopy, superconducting quantum interference device (SQUID) magnetometry, natural circular dichroism (NCD), and magnetic circular dichroism (MCD) measurements. The structures exhibit magneto-chiral dichroism (MChD), which directly demonstrates coupling between their structural chirality and magnetism. A chiral nickel (Ni) film consisting of an array of nanohelices similar to 100 nm in length exhibits an MChD anisotropy factor g(MChD) approximate to 10(-4) T-1 at room temperature in a saturation field of similar to 0.2 T, permitting polarization-independent control of the film's absorption properties through magnetic field modulation. This is also the first report of MChD in a material with structural chirality on the order of the wavelength of light, and therefore the Ni nanohelix array is a metamaterial with magnetochiral properties that can be tailored through a dynamic deposition process.

pf

DOI [BibTex]

DOI [BibTex]


Wireless powering of e-swimmers
Wireless powering of e-swimmers

Roche, J., Carrara, S., Sanchez, J., Lannelongue, J., Loget, G., Bouffier, L., Fischer, P., Kuhn, A.

SCIENTIFIC REPORTS, 4, 2014 (article)

Abstract
Miniaturized structures that can move in a controlled way in solution and integrate various functionalities are attracting considerable attention due to the potential applications in fields ranging from autonomous micromotors to roving sensors. Here we introduce a concept which allows, depending on their specific design, the controlled directional motion of objects in water, combined with electronic functionalities such as the emission of light, sensing, signal conversion, treatment and transmission. The approach is based on electric field-induced polarization, which triggers different chemical reactions at the surface of the object and thereby its propulsion. This results in a localized electric current that can power in a wireless way electronic devices in water, leading to a new class of electronic swimmers (e-swimmers).

pf

DOI [BibTex]

DOI [BibTex]


Swelling and shrinking behaviour of photoresponsive phosphonium-based ionogel microstructures
Swelling and shrinking behaviour of photoresponsive phosphonium-based ionogel microstructures

Czugala, M., O’Connell, C., Blin, C., Fischer, P., Fraser, K. J., Benito-Lopez, F., Diamond, D.

SENSORS AND ACTUATORS B-CHEMICAL, 194, pages: 105-113, 2014 (article)

Abstract
Photoresponsive N-isopropylacrylamide ionogel microstructures are presented in this study. These ionogels are synthesised using phosphonium based room temperature ionic liquids, together with the photochromic compound benzospiropyran. The microstructures can be actuated using light irradiation, facilitating non-contact and non-invasive operation. For the first time, the characterisation of the swelling and shrinking behaviour of several photopatterned ionogel microstructures is presented and the influence of surface-area-to-volume ratio on the swelling kinetics is evaluated. It was found that the swelling and shrinking behaviour of the ionogels is strongly dependent on the nature of the ionic liquid. In particular, the {[}P-6,P-6,P-6,P-14]{[}NTf2] ionogel exhibits the greatest degree of swelling, reaching up to 180\% of its initial size, and the fastest shrinkage rate (k(sh) = 29 +/- 4 x 10(-2) s(-1)). (C) 2014 Elsevier B. V. All rights reserved.

pf

DOI [BibTex]

DOI [BibTex]


Kinematic primitives for walking and trotting gaits of a quadruped robot with compliant legs
Kinematic primitives for walking and trotting gaits of a quadruped robot with compliant legs

Spröwitz, A. T., Ajallooeian, M., Tuleu, A., Ijspeert, A. J.

Frontiers in Computational Neuroscience, 8(27):1-13, 2014 (article)

Abstract
In this work we research the role of body dynamics in the complexity of kinematic patterns in a quadruped robot with compliant legs. Two gait patterns, lateral sequence walk and trot, along with leg length control patterns of different complexity were implemented in a modular, feed-forward locomotion controller. The controller was tested on a small, quadruped robot with compliant, segmented leg design, and led to self-stable and self-stabilizing robot locomotion. In-air stepping and on-ground locomotion leg kinematics were recorded, and the number and shapes of motion primitives accounting for 95\% of the variance of kinematic leg data were extracted. This revealed that kinematic patterns resulting from feed-forward control had a lower complexity (in-air stepping, 2–3 primitives) than kinematic patterns from on-ground locomotion (νm4 primitives), although both experiments applied identical motor patterns. The complexity of on-ground kinematic patterns had increased, through ground contact and mechanical entrainment. The complexity of observed kinematic on-ground data matches those reported from level-ground locomotion data of legged animals. Results indicate that a very low complexity of modular, rhythmic, feed-forward motor control is sufficient for level-ground locomotion in combination with passive compliant legged hardware.

dlg

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Perspective: Intelligent Systems: Bits and Bots

Spatz, J. P., Schaal, S.

Nature, (509), 2014, clmc (article)

Abstract
What is intelligence, and can we create it? Animals can perceive, reason, react and learn, but they are just one example of an intelligent system. Intelligent systems could be robots as large as humans, helping with search-and- rescue operations in dangerous places, or smart devices as tiny as a cell, delivering drugs to a target within the body. Even computing systems can be intelligent, by perceiving the world, crawling the web and processing â??big dataâ?? to extract and learn from complex information.Understanding not only how intelligence can be reproduced, but also how to build systems that put these ideas into practice, will be a challenge. Small intelligent systems will require new materials and fabrication methods, as well as com- pact information processors and power sources. And for nano-sized systems, the rules change altogether. The laws of physics operate very differently at tiny scales: for a nanorobot, swimming through water is like struggling through treacle.Researchers at the Max Planck Institute for Intelligent Systems have begun to solve these problems by developing new computational methods, experiment- ing with unique robotic systems and fabricating tiny, artificial propellers, like bacterial flagella, to propel nanocreations through their environment.

am

PDF link (url) [BibTex]

PDF link (url) [BibTex]


no image
Bio-Hybrid Cell-Based Actuators for Microsystems

Carlsen, Rika Wright, Sitti, Metin

Small, 10(19):3831-3851, 2014 (article)

Abstract
As we move towards the miniaturization of devices to perform tasks at the nano and microscale, it has become increasingly important to develop new methods for actuation, sensing, and control. Over the past decade, bio-hybrid methods have been investigated as a promising new approach to overcome the challenges of scaling down robotic and other functional devices. These methods integrate biological cells with artificial components and therefore, can take advantage of the intrinsic actuation and sensing functionalities of biological cells. Here, the recent advancements in bio-hybrid actuation are reviewed, and the challenges associated with the design, fabrication, and control of bio-hybrid microsystems are discussed. As a case study, focus is put on the development of bacteria-driven microswimmers, which has been investigated as a targeted drug delivery carrier. Finally, a future outlook for the development of these systems is provided. The continued integration of biological and artificial components is envisioned to enable the performance of tasks at a smaller and smaller scale in the future, leading to the parallel and distributed operation of functional systems at the microscale.

pi

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


no image
Continuous electrowetting of non-toxic liquid metal for RF applications

Gough, R. C., Morishita, A. M., Dang, J. H., Hu, W., Shiroma, W. A., Ohta, A. T.

IEEE Access, 2, pages: 874-882, IEEE, 2014 (article)

pi

[BibTex]

[BibTex]


no image
Laser-induced microbubble poration of localized single cells

Fan, Q., Hu, W., Ohta, A. T.

Lab on a Chip, 14(9):1572-1578, Royal Society of Chemistry, 2014 (article)

pi

[BibTex]

[BibTex]


no image
Biopsy using a Magnetic Capsule Endoscope Carrying, Releasing and Retrieving Untethered Micro-Grippers

Yim, S., Gultepe, E., Gracias, D. H., Sitti, M.

IEEE Trans. on Biomedical Engineering, 61(2):513-521, IEEE, 2014 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Investigation of tip current and normal force measured simultaneously during local oxidation of titanium using dual-mode scanning probe microscopy

Ozcan, O., Hu, W., Sitti, M., Bain, J., Ricketts, D.

IET Micro \& Nano Letters, 9(5):332-336, IET, 2014 (article)

pi

[BibTex]

[BibTex]


no image
SoftCubes: Stretchable and self-assembling three-dimensional soft modular matter

Yim, S., Sitti, M.

The International Journal of Robotics Research, 33(8):1083-1097, SAGE Publications Sage UK: London, England, 2014 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


Segmentation of Biomedical Images Using Active Contour Model with Robust Image Feature and Shape Prior
Segmentation of Biomedical Images Using Active Contour Model with Robust Image Feature and Shape Prior

S. Y. Yeo, X. Xie, I. Sazonov, P. Nithiarasu

International Journal for Numerical Methods in Biomedical Engineering, 30(2):232- 248, 2014 (article)

Abstract
In this article, a new level set model is proposed for the segmentation of biomedical images. The image energy of the proposed model is derived from a robust image gradient feature which gives the active contour a global representation of the geometric configuration, making it more robust in dealing with image noise, weak edges, and initial configurations. Statistical shape information is incorporated using nonparametric shape density distribution, which allows the shape model to handle relatively large shape variations. The segmentation of various shapes from both synthetic and real images depict the robustness and efficiency of the proposed method.

ps

[BibTex]

[BibTex]


no image
Staying sticky: contact self-cleaning of gecko-inspired adhesives

Mengüç, Y., Röhrig, M., Abusomwan, U., Hölscher, H., Sitti, M.

Journal of The Royal Society Interface, 11(94):20131205, The Royal Society, 2014 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Dynamic Trapping and Two-Dimensional Transport of Swimming Microorganisms Using a Rotating Magnetic Micro-Robot

Ye, Z., Sitti, M.

Lab on a Chip, 14(13):2177-2182, Royal Society of Chemistry, 2014 (article)

pi

Project Page [BibTex]


no image
STRIDE II: a water strider-inspired miniature robot with circular footpads

Ozcan, O., Wang, H., Taylor, J. D., Sitti, M.

International Journal of Advanced Robotic Systems, 11(6):85, SAGE Publications Sage UK: London, England, 2014 (article)

pi

[BibTex]

[BibTex]


no image
Soft Grippers Using Micro-Fibrillar Adhesives for Transfer Printing

Song, S., Sitti, M.

Advanced Materials, 26(28):4901-4906, 2014 (article)

pi

[BibTex]

[BibTex]


no image
Can DC motors directly drive flapping wings at high frequency and large wing strokes?

Campolo, D., Azhar, M., Lau, G., Sitti, M.

IEEE/ASME Trans. on Mechatronics, 19(1):109-120, 2014 (article)

pi

[BibTex]

[BibTex]


no image
Magnetic steering control of multi-cellular bio-hybrid microswimmers

Carlsen, R. W., Edwards, M. R., Zhuang, J., Pacoret, C., Sitti, M.

Lab on a Chip, 14(19):3850-3859, Royal Society of Chemistry, 2014 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Analytical modeling and experimental characterization of chemotaxis in serratia marcescens

Zhuang, J., Wei, G., Carlsen, R. W., Edwards, M. R., Marculescu, R., Bogdan, P., Sitti, M.

Physical Review E, 89(5):052704, American Physical Society, 2014 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Swimming characterization of Serratia marcescens for bio-hybrid micro-robotics

Edwards, M. R., Carlsen, R. W., Zhuang, J., Sitti, M.

Journal of Micro-Bio Robotics, 9(3):47-60, Springer Berlin Heidelberg, 2014 (article)

pi

[BibTex]

[BibTex]


no image
Influence of Magnetic Fields on Magneto-Aerotaxis

Bennet, M., McCarthy, A., Fix, D., Edwards, M. R., Repp, F., Vach, P., Dunlop, J. W., Sitti, M., Buller, G. S., Klumpp, S., others,

PLoS One, 9(7):e101150, Public Library of Science, 2014 (article)

pi

[BibTex]

[BibTex]