Header logo is


2008


no image
Learning to control in operational space

Peters, J., Schaal, S.

International Journal of Robotics Research, 27, pages: 197-212, 2008, clmc (article)

Abstract
One of the most general frameworks for phrasing control problems for complex, redundant robots is operational space control. However, while this framework is of essential importance for robotics and well-understood from an analytical point of view, it can be prohibitively hard to achieve accurate control in face of modeling errors, which are inevitable in com- plex robots, e.g., humanoid robots. In this paper, we suggest a learning approach for opertional space control as a direct inverse model learning problem. A first important insight for this paper is that a physically cor- rect solution to the inverse problem with redundant degrees-of-freedom does exist when learning of the inverse map is performed in a suitable piecewise linear way. The second crucial component for our work is based on the insight that many operational space controllers can be understood in terms of a constrained optimal control problem. The cost function as- sociated with this optimal control problem allows us to formulate a learn- ing algorithm that automatically synthesizes a globally consistent desired resolution of redundancy while learning the operational space controller. From the machine learning point of view, this learning problem corre- sponds to a reinforcement learning problem that maximizes an immediate reward. We employ an expectation-maximization policy search algorithm in order to solve this problem. Evaluations on a three degrees of freedom robot arm are used to illustrate the suggested approach. The applica- tion to a physically realistic simulator of the anthropomorphic SARCOS Master arm demonstrates feasibility for complex high degree-of-freedom robots. We also show that the proposed method works in the setting of learning resolved motion rate control on real, physical Mitsubishi PA-10 medical robotics arm.

am ei

link (url) DOI [BibTex]

2008


link (url) DOI [BibTex]


Voltage-Controllable Magnetic Composite Based on Multifunctional Polyethylene Microparticles
Voltage-Controllable Magnetic Composite Based on Multifunctional Polyethylene Microparticles

Ghosh, A., Sheridon, N. K., Fischer, P.

SMALL, 4(11):1956-1958, 2008 (article)

pf

DOI [BibTex]


no image
Adaptation to a sub-optimal desired trajectory

M. Mistry, E. A. G. L. T. Y. S. S. M. K.

Advances in Computational Motor Control VII, Symposium at the Society for Neuroscience Meeting, Washington DC, 2008, 2008, clmc (article)

am

PDF [BibTex]

PDF [BibTex]


no image
Operational space control: A theoretical and emprical comparison

Nakanishi, J., Cory, R., Mistry, M., Peters, J., Schaal, S.

International Journal of Robotics Research, 27(6):737-757, 2008, clmc (article)

Abstract
Dexterous manipulation with a highly redundant movement system is one of the hallmarks of hu- man motor skills. From numerous behavioral studies, there is strong evidence that humans employ compliant task space control, i.e., they focus control only on task variables while keeping redundant degrees-of-freedom as compliant as possible. This strategy is robust towards unknown disturbances and simultaneously safe for the operator and the environment. The theory of operational space con- trol in robotics aims to achieve similar performance properties. However, despite various compelling theoretical lines of research, advanced operational space control is hardly found in actual robotics imple- mentations, in particular new kinds of robots like humanoids and service robots, which would strongly profit from compliant dexterous manipulation. To analyze the pros and cons of different approaches to operational space control, this paper focuses on a theoretical and empirical evaluation of different methods that have been suggested in the literature, but also some new variants of operational space controllers. We address formulations at the velocity, acceleration and force levels. First, we formulate all controllers in a common notational framework, including quaternion-based orientation control, and discuss some of their theoretical properties. Second, we present experimental comparisons of these approaches on a seven-degree-of-freedom anthropomorphic robot arm with several benchmark tasks. As an aside, we also introduce a novel parameter estimation algorithm for rigid body dynamics, which ensures physical consistency, as this issue was crucial for our successful robot implementations. Our extensive empirical results demonstrate that one of the simplified acceleration-based approaches can be advantageous in terms of task performance, ease of parameter tuning, and general robustness and compliance in face of inevitable modeling errors.

am

link (url) [BibTex]

link (url) [BibTex]


no image
Efficient inverse kinematics algorithms for highdimensional movement systems

Tevatia, G., Schaal, S.

CLMC Technical Report: TR-CLMC-2008-1, 2008, clmc (techreport)

Abstract
Real-time control of the endeffector of a humanoid robot in external coordinates requires computationally efficient solutions of the inverse kinematics problem. In this context, this paper investigates methods of resolved motion rate control (RMRC) that employ optimization criteria to resolve kinematic redundancies. In particular we focus on two established techniques, the pseudo inverse with explicit optimization and the extended Jacobian method. We prove that the extended Jacobian method includes pseudo-inverse methods as a special solution. In terms of computational complexity, however, pseudo-inverse and extended Jacobian differ significantly in favor of pseudo-inverse methods. Employing numerical estimation techniques, we introduce a computationally efficient version of the extended Jacobian with performance comparable to the original version. Our results are illustrated in simulation studies with a multiple degree-offreedom robot, and were evaluated on an actual 30 degree-of-freedom full-body humanoid robot.

am

link (url) [BibTex]

link (url) [BibTex]


no image
A library for locally weighted projection regression

Klanke, S., Vijayakumar, S., Schaal, S.

Journal of Machine Learning Research, 9, pages: 623-626, 2008, clmc (article)

Abstract
In this paper we introduce an improved implementation of locally weighted projection regression (LWPR), a supervised learning algorithm that is capable of handling high-dimensional input data. As the key features, our code supports multi-threading, is available for multiple platforms, and provides wrappers for several programming languages.

am

link (url) [BibTex]

link (url) [BibTex]


no image
Optimization strategies in human reinforcement learning

Hoffmann, H., Theodorou, E., Schaal, S.

Advances in Computational Motor Control VII, Symposium at the Society for Neuroscience Meeting, Washington DC, 2008, 2008, clmc (article)

am

PDF [BibTex]

PDF [BibTex]


Chiral molecules split light: Reflection and refraction in a chiral liquid
Chiral molecules split light: Reflection and refraction in a chiral liquid

Ghosh, A., Fischer, P.

PHYSICAL REVIEW LETTERS, 97(17), 2006, Featured highlight ‘Fundamental optical physics: Refraction’ Nature Photonics, Nov. 2006. (article)

Abstract
A light beam changes direction as it enters a liquid at an angle from another medium, such as air. Should the liquid contain molecules that lack mirror symmetry, then it has been predicted by Fresnel that the light beam will not only change direction, but will actually split into two separate beams with a small difference in the respective angles of refraction. Here we report the observation of this phenomenon. We also demonstrate that the angle of reflection does not equal the angle of incidence in a chiral medium. Unlike conventional optical rotation, which depends on the path-length through the sample, the reported reflection and refraction phenomena arise within a few wavelengths at the interface and thereby suggest a new approach to polarimetry that can be used in microfluidic volumes.

Featured highlight ‘Fundamental optical physics: Refraction’ Nature Photonics, Nov. 2006.

pf

DOI [BibTex]

DOI [BibTex]


Direct chiral discrimination in NMR spectroscopy
Direct chiral discrimination in NMR spectroscopy

Buckingham, A., Fischer, P.

CHEMICAL PHYSICS, 324(1):111-116, 2006 (article)

Abstract
Conventional nuclear magnetic resonance spectroscopy is unable to distinguish between the two mirror-image forms (enantiomers) of a chiral molecule. This is because the NMR spectrum is determined by the chemical shifts and spin-spin coupling constants which - in the absence of a chiral solvent - are identical for the two enantiomers. We discuss how chirality may nevertheless be directly detected in liquid-state NMR spectroscopy: In a chiral molecule, the rotating nuclear magnetic moment induces an electric dipole moment in the direction perpendicular to itself and to the permanent magnetic field of the spectrometer. We present computations of the precessing electric polarization following a pi/2 pulse. Our estimates indicate that the electric polarization should be detectable in favourable cases. We also predict that application of an electrostatic field induces a chirally sensitive magnetization oscillating in the direction of the permanent magnetic field. We show that the electric-field-perturbed chemical shift tensor, the nuclear magnetic shielding polarizability, underlies these chiral NMR effects. (c) 2005 Elsevier B.V. All rights reserved.

pf

DOI [BibTex]

DOI [BibTex]


Ring-resonator-based frequency-domain optical activity measurements of a chiral liquid
Ring-resonator-based frequency-domain optical activity measurements of a chiral liquid

Vollmer, F., Fischer, P.

OPTICS LETTERS, 31(4):453-455, 2006 (article)

Abstract
Chiral liquids rotate the plane of polarization of linearly polarized light and are therefore optically active. Here we show that optical rotation can be observed in the frequency domain. A chiral liquid introduced in a fiber-loop ring resonator that supports left and right circularly polarized modes gives rise to relative frequency shifts that are a direct measure of the liquid's circular birefringence and hence of its optical activity. The effect is in principle not diminished if the circumference of the ring is reduced. The technique is similarly applicable to refractive index and linear birefringence measurements. (c) 2006 Optical Society of America.

pf

DOI [BibTex]


Sign of the refractive index in a gain medium with negative permittivity and permeability
Sign of the refractive index in a gain medium with negative permittivity and permeability

Chen, Y., Fischer, P., Wise, F.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA B-OPTICAL PHYSICS, 23(1):45-50, 2006 (article)

Abstract
We show how the sign of the refractive index in any medium may be derived using a rigorous analysis based on Einstein causality. In particular, we consider left-handed materials, i.e., media that have negative permittivities and permeabilities at the frequency of interest. We find that the consideration of gain in such media can give rise to a positive refractive index. (c) 2006 Optical Society of America.

pf

DOI [BibTex]

DOI [BibTex]


no image
Statistical Learning of LQG controllers

Theodorou, E.

Technical Report-2006-1, Computational Action and Vision Lab University of Minnesota, 2006, clmc (techreport)

am

PDF [BibTex]

PDF [BibTex]

1997


no image
Locally weighted learning

Atkeson, C. G., Moore, A. W., Schaal, S.

Artificial Intelligence Review, 11(1-5):11-73, 1997, clmc (article)

Abstract
This paper surveys locally weighted learning, a form of lazy learning and memory-based learning, and focuses on locally weighted linear regression. The survey discusses distance functions, smoothing parameters, weighting functions, local model structures, regularization of the estimates and bias, assessing predictions, handling noisy data and outliers, improving the quality of predictions by tuning fit parameters, interference between old and new data, implementing locally weighted learning efficiently, and applications of locally weighted learning. A companion paper surveys how locally weighted learning can be used in robot learning and control. Keywords: locally weighted regression, LOESS, LWR, lazy learning, memory-based learning, least commitment learning, distance functions, smoothing parameters, weighting functions, global tuning, local tuning, interference.

am

link (url) [BibTex]

1997


link (url) [BibTex]


no image
Locally weighted learning for control

Atkeson, C. G., Moore, A. W., Schaal, S.

Artificial Intelligence Review, 11(1-5):75-113, 1997, clmc (article)

Abstract
Lazy learning methods provide useful representations and training algorithms for learning about complex phenomena during autonomous adaptive control of complex systems. This paper surveys ways in which locally weighted learning, a type of lazy learning, has been applied by us to control tasks. We explain various forms that control tasks can take, and how this affects the choice of learning paradigm. The discussion section explores the interesting impact that explicitly remembering all previous experiences has on the problem of learning to control. Keywords: locally weighted regression, LOESS, LWR, lazy learning, memory-based learning, least commitment learning, forward models, inverse models, linear quadratic regulation (LQR), shifting setpoint algorithm, dynamic programming.

am

link (url) [BibTex]

link (url) [BibTex]