Header logo is


2018


no image
Kinetics of orbitally shaken particles constrained to two dimensions

Ipparthi, D., Hageman, T. A. G., Cambier, N., Sitti, M., Dorigo, M., Abelmann, L., Mastrangeli, M.

Physical Review E, 98(4):042137, 2018 (article)

pi

[BibTex]

2018


[BibTex]


no image
Seed-mediated synthesis of plasmonic gold nanoribbons using cancer cells for hyperthermia applications

Singh, A. V., Alapan, Y., Jahnke, T., Laux, P., Luch, A., Aghakhani, A., Kharratian, S., Onbasli, M. C., Bill, J., Sitti, M.

Journal of Materials Chemistry B, 6(46):7573-7581, 2018 (article)

pi

[BibTex]

[BibTex]


no image
Thick permalloy films for the imaging of spin texture dynamics in perpendicularly magnetized systems

Finizio, S., Wintz, S., Bracher, D., Kirk, E., Semisalova, A. S., Förster, J., Zeissler, K., We\ssels, T., Weigand, M., Lenz, K., Kleibert, A., Raabe, J.

{Physical Review B}, 98(10), American Physical Society, Woodbury, NY, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Dynamic Janus metasurfaces in the visible spectral region

Yu, P., Li, J., Zhang, S., Jin, Z., Schütz, G., Qiu, C., Hirscher, M., Liu, N.

{Nano Letters}, 18(7):4584-4589, American Chemical Society, Washington, DC, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Review of ultrafast demagnetization after femtosecond laser pulses: A complex interaction of light with quantum matter

Fähnle, M., Haag, M., Illg, C., Müller, B. Y., Weng, W., Tsatsoulis, T., Huang, H., Briones Paz, J. Z., Teeny, N., Zhang, L., Kuhn, T.

{American Journal of Modern Physics}, 7(2):68-74, Science Publishing Group, New York, NY, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Direct observation of Zhang-Li torque expansion of magnetic droplet solitons

Chung, S., Tuan Le, Q., Ahlberg, M., Awad, A. A., Weigand, M., Bykova, I., Khymyn, R., Dvornik, M., Mazraati, H., Houshang, A., Jiang, S., Nguyen, T. N. A., Goering, E., Schütz, G., Gräfe, J., \AAkerman, J.

{Physical Review Letters}, 120(21), American Physical Society, Woodbury, N.Y., 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
XMCD investigations on new hard magnetic systems

Chen, Y.

Universität Stuttgart, Stuttgart, 2018 (phdthesis)

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Current-induced skyrmion generation through morphological thermal transitions in chiral ferromagnetic heterostructures

Lemesh, I., Litzius, K., Böttcher, M., Bassirian, P., Kerber, N., Heinze, D., Zázvorka, J., Büttner, F., Caretta, L., Mann, M., Weigand, M., Finizio, S., Raabe, J., Im, M., Stoll, H., Schütz, G., Dupé, B., Kläui, M., Beach, G. S. D.

{Advanced Materials}, 30(49), Wiley-VCH, Weinheim, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Direct observations of sub-100 nm spin wave propagation in magnonic wave-guides

Träger, N., Gruszecki, P., Lisiecki, F., Förster, J., Weigand, M., Kuswik, P., Dubowik, J., Schütz, G., Krawczyk, M., Gräfe, J.

In 2018 IEEE International Magnetics Conference (INTERMAG 2018), IEEE, Singapore, 2018 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]


no image
Assessment methodology of promising porous materials for near ambient temperature hydrogen storage applications

Minuto, F. D., Balderas-Xicohténcatl, R., Policicchio, A., Hirscher, M., Agostino, R. G.

{International Journal of Hydrogen Energy}, 43(31):14550-14556, Elsevier, Amsterdam, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Emission and propagation of multi-dimensional spin waves in anisotropic spin textures

Sluka, V., Schneider, T., Gallardo, R. A., Kakay, A., Weigand, M., Warnatz, T., Mattheis, R., Roldan-Molina, A., Landeros, P., Tiberkevich, V., Slavin, A., Schütz, G., Erbe, A., Deac, A., Lindner, J., Raabe, J., Fassbender, J., Wintz, S.

2018 (misc)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
3d nanofabrication of high-resolution multilayer Fresnel zone plates

Sanli, U. T., Jiao, C., Baluktsian, M., Grévent, C., Hahn, K., Wang, Y., Srot, V., Richter, G., Bykova, I., Weigand, M., Schütz, G., Keskinbora, K.

{Advanced Science}, 5(9), Wiley-VCH, Weinheim, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Photocatalytic CO2 reduction by Cr-substituted Ba2(In2-xCrx)O5\mbox⋅(H2O)δ(0.04 ≤x ≤0.60)

Yoon, S., Gaul, M., Sharma, S., Son, K., Hagemann, H., Ziegenbalg, D., Schwingenschlogl, U., Widenmeyer, M., Weidenkaff, A.

{Solid State Sciences}, 78, pages: 22-29, Elsevier Masson SAS, Paris, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Correction of axial position uncertainty and systematic detector errors in ptychographic diffraction imaging

Loetgering, L., Rose, M., Keskinbora, K., Baluktsian, M., Dogan, G., Sanli, U., Bykova, I., Weigand, M., Schütz, G., Wilhein, T.

{Optical Engineering}, 57(8), The Society, Redondo Beach, Calif., 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Thermodynamics, kinetics and selectivity of H2 and D2 on zeolite 5A below 77K

Xiong, R., Balderas-Xicohténcatl, R., Zhang, L., Li, P., Yao, Y., Sang, G., Chen, C., Tang, T., Luo, D., Hirscher, M.

{Microporous and Mesoporous Materials}, 264, pages: 22-27, Elsevier, Amsterdam, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
The role of surface oxides on hydrogen sorption kinetics in titanium thin films

Hadjixenophontos, E., Michalek, L., Roussel, M., Hirscher, M., Schmitz, G.

{Applied Surface Science}, 441, pages: 324-330, Elsevier B.V., Amsterdam, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Volumetric hydrogen storage capacity in metal-organic frameworks

Balderas-Xicohténcatl, R., Schlichtenmayer, M., Hirscher, M.

{Energy Technology}, 6(3):578-582, Wiley-VCH, Weinheim, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Ferromagnetism in nitrogen and fluorine substituted BaTiO3

Yoon, S., Son, K., Ebbinghaus, S. G., Widenmeyer, M., Weidenkaff, A.

{Journal of Alloys and Compounds}, 749, pages: 628-633, Elsevier B.V., Lausanne, Switzerland, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
New concepts for 3d optics in x-ray microscopy

Sanli, U., Ceylan, H., Jiao, C., Baluktsian, M., Grevent, C., Hahn, K., Wang, Y., Srot, V., Richter, G., Bykova, I., Weigand, M., Sitti, M., Schütz, G., Keskinbora, K.

{Microscopy and Microanalysis}, 24(Suppl 2):288-289, Cambridge University Press, New York, NY, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Thermal skyrmion diffusion applied in probabilistic computing

Zázvorka, J., Jakobs, F., Heinze, D., Keil, N., Kromin, S., Jaiswal, S., Litzius, K., Jakob, G., Virnau, P., Pinna, D., Everschor-Sitte, K., Donges, A., Nowak, U., Kläui, M.

2018 (misc)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
High volumetric hydrogen storage capacity using interpenetrated metal-organic frameworks

Balderas-Xicohténcatl, R., Schmieder, P., Denysenko, D., Volkmer, D., Hirscher, M.

{Energy Technology}, 6(3):510-512, Wiley-VCH, Weinheim, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Spin-wave interference in magnetic vortex stacks

Behncke, C., Adolff, C. F., Lenzing, N., Hänze, M., Schulte, B., Weigand, M., Schütz, G., Meier, G.

{Communications Physics}, 1, Nature Publishing Group, London, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
High-throughput synthesis of modified Fresnel zone plate arrays via ion beam lithography

Keskinbora, K., Sanli, U. T., Baluktsian, M., Grévent, C., Weigand, M., Schütz, G.

{Beilstein Journal of Nanotechnology}, 9, pages: 2049-2056, Beilstein-Institut, Frankfurt am Main, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Deterministic creation and deletion of a single magnetic skyrmion observed by direct time-resolved X-ray microscopy

Woo, S., Song, K. M., Zhang, X., Ezawa, M., Zhou, Y., Liu, X., Weigand, M., Finizio, S., Raabe, J., Park, M.-C., Lee, K.-Y., Choi, J. W., Min, B.-C., Koo, H. C., Chang, J.

{Nature Electronics}, 1(5):288-296, Springer Nature, London, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Magnetic skyrmion as a nonlinear resistive element: A potential building block for reservoir computing

Prychynenko, D., Sitte, M., Litzius, K., Krüger, B., Bourianoff, G., Kläui, M., Sinova, J., Everschor-Sitte, K.

{Physical Review Applied}, 9(1), American Physical Society, College Park, Md. [u.a.], 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
Tunable geometrical frustration in magnoic vortex crystals

Behncke, C., Adolff, C. F., Wintz, S., Hänze, M., Schulte, B., Weigand, M., Finizio, S., Raabe, J., Meier, G.

{Scientific Reports}, 8, Nature Publishing Group, London, UK, 2018 (article)

mms

DOI [BibTex]

DOI [BibTex]


no image
High-Resolution X-ray Ptychography for Magnetic Imaging

Bykova, I.

Universität Stuttgart, Stuttgart, 2018 (phdthesis)

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Interpreting FORC diagrams beyond the Preisach model: an experimental permalloy micro array investigation

Gross, F., Ilse, S., Schütz, G., Gräfe, J., Goering, E.

In 2018 IEEE International Magnetics Conference (INTERMAG 2018), IEEE, Singapore, 2018 (inproceedings)

mms

DOI [BibTex]

DOI [BibTex]

2017


Thumb xl larsnips
The Numerics of GANs

Mescheder, L., Nowozin, S., Geiger, A.

In Proceedings from the conference "Neural Information Processing Systems 2017., (Editors: Guyon I. and Luxburg U.v. and Bengio S. and Wallach H. and Fergus R. and Vishwanathan S. and Garnett R.), Curran Associates, Inc., Advances in Neural Information Processing Systems 30 (NIPS), December 2017 (inproceedings)

Abstract
In this paper, we analyze the numerics of common algorithms for training Generative Adversarial Networks (GANs). Using the formalism of smooth two-player games we analyze the associated gradient vector field of GAN training objectives. Our findings suggest that the convergence of current algorithms suffers due to two factors: i) presence of eigenvalues of the Jacobian of the gradient vector field with zero real-part, and ii) eigenvalues with big imaginary part. Using these findings, we design a new algorithm that overcomes some of these limitations and has better convergence properties. Experimentally, we demonstrate its superiority on training common GAN architectures and show convergence on GAN architectures that are known to be notoriously hard to train.

avg

pdf Project Page [BibTex]

2017


pdf Project Page [BibTex]


Thumb xl hines et al 2016 advanced materials
Soft Actuators for Small-Scale Robotics

Hines, L., Petersen, K., Lum, G. Z., Sitti, M.

Advanced Materials, 2017 (article)

Abstract
This review comprises a detailed survey of ongoing methodologies for soft actuators, highlighting approaches suitable for nanometer- to centimeter-scale robotic applications. Soft robots present a special design challenge in that their actuation and sensing mechanisms are often highly integrated with the robot body and overall functionality. When less than a centimeter, they belong to an even more special subcategory of robots or devices, in that they often lack on-board power, sensing, computation, and control. Soft, active materials are particularly well suited for this task, with a wide range of stimulants and a number of impressive examples, demonstrating large deformations, high motion complexities, and varied multifunctionality. Recent research includes both the development of new materials and composites, as well as novel implementations leveraging the unique properties of soft materials.

pi

DOI [BibTex]


Thumb xl 41315 2017 39 fig3 html
A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots

Turan, M., Shabbir, J., Araujo, H., Konukoglu, E., Sitti, M.

International Journal of Intelligent Robotics and Applications, 1(4):442-450, December 2017 (article)

Abstract
A reliable, real time localization functionality is crutial for actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we extend the success of deep learning approaches from various research fields to the problem of sensor fusion for endoscopic capsule robots. We propose a multi-sensor fusion based localization approach which combines endoscopic camera information and magnetic sensor based localization information. The results performed on real pig stomach dataset show that our method achieves sub-millimeter precision for both translational and rotational movements.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Thumb xl 3d mikroroboterb
3D Chemical Patterning of Micromaterials for Encoded Functionality

Ceylan, H., Yasa, I. C., Sitti, M.

Advanced Materials, 2017 (article)

Abstract
Programming local chemical properties of microscale soft materials with 3D complex shapes is indispensable for creating sophisticated functionalities, which has not yet been possible with existing methods. Precise spatiotemporal control of two-photon crosslinking is employed as an enabling tool for 3D patterning of microprinted structures for encoding versatile chemical moieties.

pi

DOI Project Page [BibTex]


Thumb xl f2.large
Biohybrid actuators for robotics: A review of devices actuated by living cells

Ricotti, L., Trimmer, B., Feinberg, A. W., Raman, R., Parker, K. K., Bashir, R., Sitti, M., Martel, S., Dario, P., Menciassi, A.

Science Robotics, 2(12), Science Robotics, November 2017 (article)

Abstract
Actuation is essential for artificial machines to interact with their surrounding environment and to accomplish the functions for which they are designed. Over the past few decades, there has been considerable progress in developing new actuation technologies. However, controlled motion still represents a considerable bottleneck for many applications and hampers the development of advanced robots, especially at small length scales. Nature has solved this problem using molecular motors that, through living cells, are assembled into multiscale ensembles with integrated control systems. These systems can scale force production from piconewtons up to kilonewtons. By leveraging the performance of living cells and tissues and directly interfacing them with artificial components, it should be possible to exploit the intricacy and metabolic efficiency of biological actuation within artificial machines. We provide a survey of important advances in this biohybrid actuation paradigm.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Thumb xl teaser iccv2017
Bounding Boxes, Segmentations and Object Coordinates: How Important is Recognition for 3D Scene Flow Estimation in Autonomous Driving Scenarios?

Behl, A., Jafari, O. H., Mustikovela, S. K., Alhaija, H. A., Rother, C., Geiger, A.

In Proceedings IEEE International Conference on Computer Vision (ICCV), IEEE, Piscataway, NJ, USA, IEEE International Conference on Computer Vision (ICCV), October 2017 (inproceedings)

Abstract
Existing methods for 3D scene flow estimation often fail in the presence of large displacement or local ambiguities, e.g., at texture-less or reflective surfaces. However, these challenges are omnipresent in dynamic road scenes, which is the focus of this work. Our main contribution is to overcome these 3D motion estimation problems by exploiting recognition. In particular, we investigate the importance of recognition granularity, from coarse 2D bounding box estimates over 2D instance segmentations to fine-grained 3D object part predictions. We compute these cues using CNNs trained on a newly annotated dataset of stereo images and integrate them into a CRF-based model for robust 3D scene flow estimation - an approach we term Instance Scene Flow. We analyze the importance of each recognition cue in an ablation study and observe that the instance segmentation cue is by far strongest, in our setting. We demonstrate the effectiveness of our method on the challenging KITTI 2015 scene flow benchmark where we achieve state-of-the-art performance at the time of submission.

avg

pdf suppmat Poster Project Page [BibTex]

pdf suppmat Poster Project Page [BibTex]


Thumb xl jonas teaser
Sparsity Invariant CNNs

Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., Geiger, A.

International Conference on 3D Vision (3DV) 2017, International Conference on 3D Vision (3DV), October 2017 (conference)

Abstract
In this paper, we consider convolutional neural networks operating on sparse inputs with an application to depth upsampling from sparse laser scan data. First, we show that traditional convolutional networks perform poorly when applied to sparse data even when the location of missing data is provided to the network. To overcome this problem, we propose a simple yet effective sparse convolution layer which explicitly considers the location of missing data during the convolution operation. We demonstrate the benefits of the proposed network architecture in synthetic and real experiments \wrt various baseline approaches. Compared to dense baselines, the proposed sparse convolution network generalizes well to novel datasets and is invariant to the level of sparsity in the data. For our evaluation, we derive a novel dataset from the KITTI benchmark, comprising 93k depth annotated RGB images. Our dataset allows for training and evaluating depth upsampling and depth prediction techniques in challenging real-world settings.

avg

pdf suppmat Project Page Project Page [BibTex]

pdf suppmat Project Page Project Page [BibTex]


Thumb xl gernot teaser
OctNetFusion: Learning Depth Fusion from Data

Riegler, G., Ulusoy, A. O., Bischof, H., Geiger, A.

International Conference on 3D Vision (3DV) 2017, International Conference on 3D Vision (3DV), October 2017 (conference)

Abstract
In this paper, we present a learning based approach to depth fusion, i.e., dense 3D reconstruction from multiple depth images. The most common approach to depth fusion is based on averaging truncated signed distance functions, which was originally proposed by Curless and Levoy in 1996. While this method is simple and provides great results, it is not able to reconstruct (partially) occluded surfaces and requires a large number frames to filter out sensor noise and outliers. Motivated by the availability of large 3D model repositories and recent advances in deep learning, we present a novel 3D CNN architecture that learns to predict an implicit surface representation from the input depth maps. Our learning based method significantly outperforms the traditional volumetric fusion approach in terms of noise reduction and outlier suppression. By learning the structure of real world 3D objects and scenes, our approach is further able to reconstruct occluded regions and to fill in gaps in the reconstruction. We demonstrate that our learning based approach outperforms both vanilla TSDF fusion as well as TV-L1 fusion on the task of volumetric fusion. Further, we demonstrate state-of-the-art 3D shape completion results.

avg

pdf Video 1 Video 2 Project Page Project Page [BibTex]

pdf Video 1 Video 2 Project Page Project Page [BibTex]


no image
Editorial for the Special Issue on Microdevices and Microsystems for Cell Manipulation

Hu, W., Ohta, A. T.

8, Multidisciplinary Digital Publishing Institute, September 2017 (misc)

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl 7 byung fig
Multifunctional Bacteria-Driven Microswimmers for Targeted Active Drug Delivery

Park, B., Zhuang, J., Yasa, O., Sitti, M.

ACS Nano, 11(9):8910-8923, September 2017, PMID: 28873304 (article)

Abstract
High-performance, multifunctional bacteria-driven microswimmers are introduced using an optimized design and fabrication method for targeted drug delivery applications. These microswimmers are made of mostly single Escherichia coli bacterium attached to the surface of drug-loaded polyelectrolyte multilayer (PEM) microparticles with embedded magnetic nanoparticles. The PEM drug carriers are 1 μm in diameter and are intentionally fabricated with a more viscoelastic material than the particles previously studied in the literature. The resulting stochastic microswimmers are able to swim at mean speeds of up to 22.5 μm/s. They can be guided and targeted to specific cells, because they exhibit biased and directional motion under a chemoattractant gradient and a magnetic field, respectively. Moreover, we demonstrate the microswimmers delivering doxorubicin anticancer drug molecules, encapsulated in the polyelectrolyte multilayers, to 4T1 breast cancer cells under magnetic guidance in vitro. The results reveal the feasibility of using these active multifunctional bacteria-driven microswimmers to perform targeted drug delivery with significantly enhanced drug transfer, when compared with the passive PEM microparticles.

pi

link (url) DOI Project Page [BibTex]


Thumb xl publications toc
EndoSensorFusion: Particle Filtering-Based Multi-sensory Data Fusion with Switching State-Space Model for Endoscopic Capsule Robots

Turan, M., Almalioglu, Y., Gilbert, H., Araujo, H., Cemgil, T., Sitti, M.

ArXiv e-prints, September 2017 (article)

Abstract
A reliable, real time multi-sensor fusion functionality is crucial for localization of actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we propose a novel multi-sensor fusion approach based on a particle filter that incorporates an online estimation of sensor reliability and a non-linear kinematic model learned by a recurrent neural network. Our method sequentially estimates the true robot pose from noisy pose observations delivered by multiple sensors. We experimentally test the method using 5 degree-of-freedom (5-DoF) absolute pose measurement by a magnetic localization system and a 6-DoF relative pose measurement by visual odometry. In addition, the proposed method is capable of detecting and handling sensor failures by ignoring corrupted data, providing the robustness expected of a medical device. Detailed analyses and evaluations are presented using ex-vivo experiments on a porcine stomach model prove that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.

pi

link (url) Project Page [BibTex]


Thumb xl andreas teaser
Direct Visual Odometry for a Fisheye-Stereo Camera

Liu, P., Heng, L., Sattler, T., Geiger, A., Pollefeys, M.

In Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Piscataway, NJ, USA, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), September 2017 (inproceedings)

Abstract
We present a direct visual odometry algorithm for a fisheye-stereo camera. Our algorithm performs simultaneous camera motion estimation and semi-dense reconstruction. The pipeline consists of two threads: a tracking thread and a mapping thread. In the tracking thread, we estimate the camera pose via semi-dense direct image alignment. To have a wider field of view (FoV) which is important for robotic perception, we use fisheye images directly without converting them to conventional pinhole images which come with a limited FoV. To address the epipolar curve problem, plane-sweeping stereo is used for stereo matching and depth initialization. Multiple depth hypotheses are tracked for selected pixels to better capture the uncertainty characteristics of stereo matching. Temporal motion stereo is then used to refine the depth and remove false positive depth hypotheses. Our implementation runs at an average of 20 Hz on a low-end PC. We run experiments in outdoor environments to validate our algorithm, and discuss the experimental results. We experimentally show that we are able to estimate 6D poses with low drift, and at the same time, do semi-dense 3D reconstruction with high accuracy.

avg

pdf Project Page [BibTex]

pdf Project Page [BibTex]


Thumb xl publications toc
Endo-VMFuseNet: Deep Visual-Magnetic Sensor Fusion Approach for Uncalibrated, Unsynchronized and Asymmetric Endoscopic Capsule Robot Localization Data

Turan, M., Almalioglu, Y., Gilbert, H., Eren Sari, A., Soylu, U., Sitti, M.

ArXiv e-prints, September 2017 (article)

Abstract
In the last decade, researchers and medical device companies have made major advances towards transforming passive capsule endoscopes into active medical robots. One of the major challenges is to endow capsule robots with accurate perception of the environment inside the human body, which will provide necessary information and enable improved medical procedures. We extend the success of deep learning approaches from various research fields to the problem of uncalibrated, asynchronous, and asymmetric sensor fusion for endoscopic capsule robots. The results performed on real pig stomach datasets show that our method achieves sub-millimeter precision for both translational and rotational movements and contains various advantages over traditional sensor fusion techniques.

pi

link (url) Project Page [BibTex]


Thumb xl comp 5d copy
Magnetotactic Bacteria Powered Biohybrids Target E. coli Biofilms

Stanton, M. M., Park, B., Vilela, D., Bente, K., Faivre, D., Sitti, M., Sánchez, S.

ACS Nano, 0(0):null, September 2017, PMID: 28933815 (article)

Abstract
Biofilm colonies are typically resistant to general antibiotic treatment and require targeted methods for their removal. One of these methods includes the use of nanoparticles as carriers for antibiotic delivery, where they randomly circulate in fluid until they make contact with the infected areas. However, the required proximity of the particles to the biofilm results in only moderate efficacy. We demonstrate here that the nonpathogenic magnetotactic bacteria Magnetosopirrillum gryphiswalense (MSR-1) can be integrated with drug-loaded mesoporous silica microtubes to build controllable microswimmers (biohybrids) capable of antibiotic delivery to target an infectious biofilm. Applying external magnetic guidance capability and swimming power of the MSR-1 cells, the biohybrids are directed to and forcefully pushed into matured Escherichia coli (E. coli) biofilms. Release of the antibiotic, ciprofloxacin, is triggered by the acidic microenvironment of the biofilm, ensuring an efficient drug delivery system. The results reveal the capabilities of a nonpathogenic bacteria species to target and dismantle harmful biofilms, indicating biohybrid systems have great potential for antibiofilm applications.

pi

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


Thumb xl hassan paper teasere
Augmented Reality Meets Deep Learning for Car Instance Segmentation in Urban Scenes

Alhaija, H. A., Mustikovela, S. K., Mescheder, L., Geiger, A., Rother, C.

In Proceedings of the British Machine Vision Conference 2017, Proceedings of the British Machine Vision Conference, September 2017 (inproceedings)

Abstract
The success of deep learning in computer vision is based on the availability of large annotated datasets. To lower the need for hand labeled images, virtually rendered 3D worlds have recently gained popularity. Unfortunately, creating realistic 3D content is challenging on its own and requires significant human effort. In this work, we propose an alternative paradigm which combines real and synthetic data for learning semantic instance segmentation models. Exploiting the fact that not all aspects of the scene are equally important for this task, we propose to augment real-world imagery with virtual objects of the target category. Capturing real-world images at large scale is easy and cheap, and directly provides real background appearances without the need for creating complex 3D models of the environment. We present an efficient procedure to augment these images with virtual objects. This allows us to create realistic composite images which exhibit both realistic background appearance as well as a large number of complex object arrangements. In contrast to modeling complete 3D environments, our data augmentation approach requires only a few user interactions in combination with 3D shapes of the target object category. We demonstrate the utility of the proposed approach for training a state-of-the-art high-capacity deep model for semantic instance segmentation. In particular, we consider the task of segmenting car instances on the KITTI dataset which we have annotated with pixel-accurate ground truth. Our experiments demonstrate that models trained on augmented imagery generalize better than those trained on synthetic data or models trained on limited amounts of annotated real data.

avg

pdf Project Page [BibTex]

pdf Project Page [BibTex]


no image
Swimming in low reynolds numbers using planar and helical flagellar waves

Khalil, I. S. M., Tabak, A. F., Seif, M. A., Klingner, A., Adel, B., Sitti, M.

In International Conference on Intelligent Robots and Systems (IROS) 2017, pages: 1907-1912, International Conference on Intelligent Robots and Systems, September 2017 (inproceedings)

Abstract
In travelling towards the oviducts, sperm cells undergo transitions between planar to helical flagellar propulsion by a beating tail based on the viscosity of the environment. In this work, we aim to model and mimic this behaviour in low Reynolds number fluids using externally actuated soft robotic sperms. We numerically investigate the effects of transition between planar to helical flagellar propulsion on the swimming characteristics of the robotic sperm using a model based on resistive-force theory to study the role of viscous forces on its flexible tail. Experimental results are obtained using robots that contain magnetic particles within the polymer matrix of its head and an ultra-thin flexible tail. The planar and helical flagellar propulsion are achieved using in-plane and out-of-plane uniform fields with sinusoidally varying components, respectively. We experimentally show that the swimming speed of the robotic sperm increases by a factor of 1.4 (fluid viscosity 5 Pa.s) when it undergoes a controlled transition between planar to helical flagellar propulsion, at relatively low actuation frequencies.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl img01
Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks

Mescheder, L., Nowozin, S., Geiger, A.

In Proceedings of the 34th International Conference on Machine Learning, 70, Proceedings of Machine Learning Research, (Editors: Doina Precup, Yee Whye Teh), PMLR, International Conference on Machine Learning (ICML), August 2017 (inproceedings)

Abstract
Variational Autoencoders (VAEs) are expressive latent variable models that can be used to learn complex probability distributions from training data. However, the quality of the resulting model crucially relies on the expressiveness of the inference model. We introduce Adversarial Variational Bayes (AVB), a technique for training Variational Autoencoders with arbitrarily expressive inference models. We achieve this by introducing an auxiliary discriminative network that allows to rephrase the maximum-likelihood-problem as a two-player game, hence establishing a principled connection between VAEs and Generative Adversarial Networks (GANs). We show that in the nonparametric limit our method yields an exact maximum-likelihood assignment for the parameters of the generative model, as well as the exact posterior distribution over the latent variables given an observation. Contrary to competing approaches which combine VAEs with GANs, our approach has a clear theoretical justification, retains most advantages of standard Variational Autoencoders and is easy to implement.

avg

pdf suppmat Project Page arxiv-version Project Page [BibTex]

pdf suppmat Project Page arxiv-version Project Page [BibTex]


Thumb xl publications toc
Sparse-then-Dense Alignment based 3D Map Reconstruction Method for Endoscopic Capsule Robots

Turan, M., Yigit Pilavci, Y., Ganiyusufoglu, I., Araujo, H., Konukoglu, E., Sitti, M.

ArXiv e-prints, August 2017 (article)

Abstract
Since the development of capsule endoscopcy technology, substantial progress were made in converting passive capsule endoscopes to robotic active capsule endoscopes which can be controlled by the doctor. However, robotic capsule endoscopy still has some challenges. In particular, the use of such devices to generate a precise and globally consistent three-dimensional (3D) map of the entire inner organ remains an unsolved problem. Such global 3D maps of inner organs would help doctors to detect the location and size of diseased areas more accurately, precisely, and intuitively, thus permitting more accurate and intuitive diagnoses. The proposed 3D reconstruction system is built in a modular fashion including preprocessing, frame stitching, and shading-based 3D reconstruction modules. We propose an efficient scheme to automatically select the key frames out of the huge quantity of raw endoscopic images. Together with a bundle fusion approach that aligns all the selected key frames jointly in a globally consistent way, a significant improvement of the mosaic and 3D map accuracy was reached. To the best of our knowledge, this framework is the first complete pipeline for an endoscopic capsule robot based 3D map reconstruction containing all of the necessary steps for a reliable and accurate endoscopic 3D map. For the qualitative evaluations, a real pig stomach is employed. Moreover, for the first time in literature, a detailed and comprehensive quantitative analysis of each proposed pipeline modules is performed using a non-rigid esophagus gastro duodenoscopy simulator, four different endoscopic cameras, a magnetically activated soft capsule robot (MASCE), a sub-millimeter precise optical motion tracker and a fine-scale 3D optical scanner.

pi

link (url) Project Page [BibTex]

link (url) Project Page [BibTex]


no image
Dipole codes attractively encode glue functions

Ipparthi, D., Mastrangeli, M., Winslow, A.

Theoretical Computer Science, 671, pages: 19 - 25, August 2017, Computational Self-Assembly (article)

Abstract
Dipole words are sequences of magnetic dipoles, in which alike elements repel and opposite elements attract. Magnetic dipoles contrast with more general sets of bonding types, called glues, in which pairwise bonding strength is specified by a glue function. We prove that every glue function g has a set of dipole words, called a dipole code, that attractively encodes g: the pairwise attractions (positive or non-positive bond strength) between the words are identical to those of g. Moreover, we give such word sets of asymptotically optimal length. Similar results are obtained for a commonly used subclass of glue functions.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Hypoxia‐enhanced adhesion of red blood cells in microscale flow

Kim, M., Alapan, Y., Adhikari, A., Little, J. A., Gurkan, U. A.

Microcirculation, 24(5):e12374, July 2017 (article)

Abstract
Abstract Objectives The advancement of microfluidic technology has facilitated the simulation of physiological conditions of the microcirculation, such as oxygen tension, fluid flow, and shear stress in these devices. Here, we present a micro‐gas exchanger integrated with microfluidics to study RBC adhesion under hypoxic flow conditions mimicking postcapillary venules. Methods We simulated a range of physiological conditions and explored RBC adhesion to endothelial or subendothelial components (FN or LN). Blood samples were injected into microchannels at normoxic or hypoxic physiological flow conditions. Quantitative evaluation of RBC adhesion was performed on 35 subjects with homozygous SCD. Results Significant heterogeneity in RBC adherence response to hypoxia was seen among SCD patients. RBCs from a HEA population showed a significantly greater increase in adhesion compared to RBCs from a HNA population, for both FN and LN. Conclusions The approach presented here enabled the control of oxygen tension in blood during microscale flow and the quantification of RBC adhesion in a cost‐efficient and patient‐specific manner. We identified a unique patient population in which RBCs showed enhanced adhesion in hypoxia in vitro. Clinical correlates suggest a more severe clinical phenotype in this subgroup.

pi

link (url) DOI [BibTex]

link (url) DOI [BibTex]