Header logo is


2011


Multi-Modal Scene Understanding for Robotic Grasping
Multi-Modal Scene Understanding for Robotic Grasping

Bohg, J.

(2011:17):vi, 194, Trita-CSC-A, KTH Royal Institute of Technology, KTH, Computer Vision and Active Perception, CVAP, Centre for Autonomous Systems, CAS, KTH, Centre for Autonomous Systems, CAS, December 2011 (phdthesis)

Abstract
Current robotics research is largely driven by the vision of creating an intelligent being that can perform dangerous, difficult or unpopular tasks. These can for example be exploring the surface of planet mars or the bottom of the ocean, maintaining a furnace or assembling a car. They can also be more mundane such as cleaning an apartment or fetching groceries. This vision has been pursued since the 1960s when the first robots were built. Some of the tasks mentioned above, especially those in industrial manufacturing, are already frequently performed by robots. Others are still completely out of reach. Especially, household robots are far away from being deployable as general purpose devices. Although advancements have been made in this research area, robots are not yet able to perform household chores robustly in unstructured and open-ended environments given unexpected events and uncertainty in perception and execution.In this thesis, we are analyzing which perceptual and motor capabilities are necessary for the robot to perform common tasks in a household scenario. In that context, an essential capability is to understand the scene that the robot has to interact with. This involves separating objects from the background but also from each other.Once this is achieved, many other tasks become much easier. Configuration of object scan be determined; they can be identified or categorized; their pose can be estimated; free and occupied space in the environment can be outlined.This kind of scene model can then inform grasp planning algorithms to finally pick up objects.However, scene understanding is not a trivial problem and even state-of-the-art methods may fail. Given an incomplete, noisy and potentially erroneously segmented scene model, the questions remain how suitable grasps can be planned and how they can be executed robustly.In this thesis, we propose to equip the robot with a set of prediction mechanisms that allow it to hypothesize about parts of the scene it has not yet observed. Additionally, the robot can also quantify how uncertain it is about this prediction allowing it to plan actions for exploring the scene at specifically uncertain places. We consider multiple modalities including monocular and stereo vision, haptic sensing and information obtained through a human-robot dialog system. We also study several scene representations of different complexity and their applicability to a grasping scenario. Given an improved scene model from this multi-modal exploration, grasps can be inferred for each object hypothesis. Dependent on whether the objects are known, familiar or unknown, different methodologies for grasp inference apply. In this thesis, we propose novel methods for each of these cases. Furthermore,we demonstrate the execution of these grasp both in a closed and open-loop manner showing the effectiveness of the proposed methods in real-world scenarios.

am

pdf [BibTex]

2011


pdf [BibTex]


no image
Iterative path integral stochastic optimal control: Theory and applications to motor control

Theodorou, E. A.

University of Southern California, University of Southern California, Los Angeles, CA, 2011 (phdthesis)

am

PDF [BibTex]

PDF [BibTex]


no image
Learning of grasp selection based on shape-templates

Herzog, A.

Karlsruhe Institute of Technology, 2011 (mastersthesis)

am

[BibTex]

[BibTex]

2005


no image
Bruder sein das ist nicht schwer, Schwester sein dagegen sehr?" - Geschlechtsspezifische Betrachtungsweisen zur Situation von Geschwistern behinderter Kinder und Jugendlicher

Wirzberger, M.

Protestant University of Applied Sciences, Bochum, 2005 (thesis)

Abstract
Die Diplomarbeit beschäftigt sich mit der Lebenssituation von Geschwistern behinderter Kinder und Jugendlicher und berücksichtigt hier besonders den Aspekt des Geschlechts. Nach einer Darstellung familiensoziologischer Grundlagen erläutert die Verfasserin den hohen Stellenwert von Geschwisterbeziehungen innerhalb der Familie, sowie deren Entwicklung und Veränderung im Laufe des Lebens. Der Schwerpunkt liegt dabei auf dem Kindes- und Jugendalter. Anschließend werden Grundlagen, Prozesse und Mechanismen geschlechtsspezifischer Sozialisation, und die Auswirkungen des Geschlechts auf die Geschwisterbeziehung thematisiert. Kapitel 3 beschäftigt sich zunächst mit dem Begriff der Behinderung mit Bezug auf das SGB IX und die ICF. Danach beschreibt die Verfasserin, mit welchen spezifischen Belastungen sich die Eltern behinderter Kinder und Jugendlicher konfrontiert sehen. Die Auswirkungen einer Behinderung auf die Geschwister stehen im Mittelpunkt dieser Arbeit und werden anhand von Studien von HACKENBERG und GROSSMAN, sowie Aussagen von ACHILLES ausführlich dargestellt, wobei auch hier der Aspekt des Geschlechts detailliert in die Schilderung der Situation einbezogen wird. Um eine Verbindung von Theorie und Praxis zu gewährleisten, werden zusammenfassende Hypothesen formuliert und anhand von drei Fallgeschichten exemplarisch überprüft. Abschließend erläutert die Verfasserin die Konsequenzen ihrer Diplomarbeit für die heilpädagogische Arbeit.

re

DOI [BibTex]