Header logo is


2004


no image
Learning Motor Primitives with Reinforcement Learning

Peters, J., Schaal, S.

In Proceedings of the 11th Joint Symposium on Neural Computation, http://resolver.caltech.edu/CaltechJSNC:2004.poster020, 2004, clmc (inproceedings)

Abstract
One of the major challenges in action generation for robotics and in the understanding of human motor control is to learn the "building blocks of move- ment generation," or more precisely, motor primitives. Recently, Ijspeert et al. [1, 2] suggested a novel framework how to use nonlinear dynamical systems as motor primitives. While a lot of progress has been made in teaching these mo- tor primitives using supervised or imitation learning, the self-improvement by interaction of the system with the environment remains a challenging problem. In this poster, we evaluate different reinforcement learning approaches can be used in order to improve the performance of motor primitives. For pursuing this goal, we highlight the difficulties with current reinforcement learning methods, and line out how these lead to a novel algorithm which is based on natural policy gradients [3]. We compare this algorithm to previous reinforcement learning algorithms in the context of dynamic motor primitive learning, and show that it outperforms these by at least an order of magnitude. We demonstrate the efficiency of the resulting reinforcement learning method for creating complex behaviors for automous robotics. The studied behaviors will include both discrete, finite tasks such as baseball swings, as well as complex rhythmic patterns as they occur in biped locomotion

am

[BibTex]

2004


[BibTex]


no image
Dynamic behavior and simulation of nanoparticle sliding during nanoprobe-based positioning

Tafazzoli, A., Sitti, M.

In Proc. ASME International Mechanical Engineering Conference, 19, pages: 32, 2004 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Imaging sub-ns spin dynamics in magnetic nanostructures with magnetic transmission X-ray microscopy

Fischer, P., Stoll, H., Puzic, A., Van Waeyenberge, B., Raabe, J., Haug, T., Denbeaux, G., Pearson, A., Höllinger, R., Back, C. H., Weiss, D., Schütz, G.

In Synchrotron Radiation Instrumentation, 705, pages: 1291-1294, AIP Conference Proceedings, American Institute of Physics, San Francisco, California (USA), 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Modern nanostructured high-temperature permanent magnets

Goll, D., Kronmüller, H., Stadelmaier, H. H.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 578-583, Laboratoire de Cristallographie/Laboratoire Louis Néel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Existence of transient temperature spike induced by SHI: evidence by ion beam analysis

Avasthi, D. K., Ghosh, S., Srivastava, S. K., Assmann, W.

In 219-220, pages: 206-214, Albuquerque, NM [USA], 2004 (inproceedings)

mms

[BibTex]

[BibTex]


no image
Three-dimensional nanoscale manipulation and manufacturing using proximal probes: controlled pulling of polymer micro/nanofibers

Nain, A. S., Amon, C., Sitti, M.

In Mechatronics, 2004. ICM’04. Proceedings of the IEEE International Conference on, pages: 224-230, 2004 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Micro-and nano-scale robotics

Sitti, M.

In American Control Conference, 2004. Proceedings of the 2004, 1, pages: 1-8, 2004 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Gecko inspired surface climbing robots

Menon, C., Murphy, M., Sitti, M.

In Robotics and Biomimetics, 2004. ROBIO 2004. IEEE International Conference on, pages: 431-436, 2004 (inproceedings)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Hard magnetic hollow nanospheres

Goll, D., Berkowitz, A. E., Bertram, H. N.

In Proceedings of the 18th International Workshop on Rare-Earth Magnets and their Applications, pages: 704-707, Laboratoire de Cristallographie/Laboratoire Louis Neel, CNRS, Grenoble, 2004 (inproceedings)

mms

[BibTex]

[BibTex]