Header logo is


2012


Thumb xl thumb hennigk2012
Quasi-Newton Methods: A New Direction

Hennig, P., Kiefel, M.

In Proceedings of the 29th International Conference on Machine Learning, pages: 25-32, ICML ’12, (Editors: John Langford and Joelle Pineau), Omnipress, New York, NY, USA, ICML, July 2012 (inproceedings)

Abstract
Four decades after their invention, quasi- Newton methods are still state of the art in unconstrained numerical optimization. Although not usually interpreted thus, these are learning algorithms that fit a local quadratic approximation to the objective function. We show that many, including the most popular, quasi-Newton methods can be interpreted as approximations of Bayesian linear regression under varying prior assumptions. This new notion elucidates some shortcomings of classical algorithms, and lights the way to a novel nonparametric quasi-Newton method, which is able to make more efficient use of available information at computational cost similar to its predecessors.

ei ps pn

website+code pdf link (url) [BibTex]

2012


website+code pdf link (url) [BibTex]


Thumb xl screen shot 2017 09 21 at 00.54.33
Entropy Search for Information-Efficient Global Optimization

Hennig, P., Schuler, C.

Journal of Machine Learning Research, 13, pages: 1809-1837, -, June 2012 (article)

Abstract
Contemporary global optimization algorithms are based on local measures of utility, rather than a probability measure over location and value of the optimum. They thus attempt to collect low function values, not to learn about the optimum. The reason for the absence of probabilistic global optimizers is that the corresponding inference problem is intractable in several ways. This paper develops desiderata for probabilistic optimization algorithms, then presents a concrete algorithm which addresses each of the computational intractabilities with a sequence of approximations and explicitly adresses the decision problem of maximizing information gain from each evaluation.

ei pn

PDF Web Project Page [BibTex]

PDF Web Project Page [BibTex]


no image
Learning Tracking Control with Forward Models

Bócsi, B., Hennig, P., Csató, L., Peters, J.

In pages: 259 -264, IEEE International Conference on Robotics and Automation (ICRA), May 2012 (inproceedings)

Abstract
Performing task-space tracking control on redundant robot manipulators is a difficult problem. When the physical model of the robot is too complex or not available, standard methods fail and machine learning algorithms can have advantages. We propose an adaptive learning algorithm for tracking control of underactuated or non-rigid robots where the physical model of the robot is unavailable. The control method is based on the fact that forward models are relatively straightforward to learn and local inversions can be obtained via local optimization. We use sparse online Gaussian process inference to obtain a flexible probabilistic forward model and second order optimization to find the inverse mapping. Physical experiments indicate that this approach can outperform state-of-the-art tracking control algorithms in this context.

ei pn

PDF Web DOI [BibTex]

PDF Web DOI [BibTex]


no image
Approximate Gaussian Integration using Expectation Propagation

Cunningham, J., Hennig, P., Lacoste-Julien, S.

In pages: 1-11, -, January 2012 (inproceedings) Submitted

Abstract
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We offer here an empirical study of the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approximation is highly accurate. We also extend the derivations to the more general case of polyhedral integration regions. However, we find that in this polyhedral case, EP's answer, though often accurate, can be almost arbitrarily wrong. These unexpected results elucidate an interesting and non-obvious feature of EP not yet studied in detail, both for the problem of Gaussian probabilities and for EP more generally.

ei pn

Web [BibTex]

Web [BibTex]


no image
Kernel Topic Models

Hennig, P., Stern, D., Herbrich, R., Graepel, T.

In Fifteenth International Conference on Artificial Intelligence and Statistics, 22, pages: 511-519, JMLR Proceedings, (Editors: Lawrence, N. D. and Girolami, M.), JMLR.org, AISTATS , 2012 (inproceedings)

Abstract
Latent Dirichlet Allocation models discrete data as a mixture of discrete distributions, using Dirichlet beliefs over the mixture weights. We study a variation of this concept, in which the documents' mixture weight beliefs are replaced with squashed Gaussian distributions. This allows documents to be associated with elements of a Hilbert space, admitting kernel topic models (KTM), modelling temporal, spatial, hierarchical, social and other structure between documents. The main challenge is efficient approximate inference on the latent Gaussian. We present an approximate algorithm cast around a Laplace approximation in a transformed basis. The KTM can also be interpreted as a type of Gaussian process latent variable model, or as a topic model conditional on document features, uncovering links between earlier work in these areas.

ei pn

PDF Web [BibTex]

PDF Web [BibTex]


Thumb xl toc image
Fourier-transform photocurrent spectroscopy using a supercontinuum light source

Petermann, C., Beigang, R., Fischer, P.

APPLIED PHYSICS LETTERS, 100(6), 2012 (article)

Abstract
We demonstrate an implementation of frequency-encoded photocurrent spectroscopy using a super-continuum light source. The spectrally broad light is spatially dispersed and modulated with a special mechanical chopper design that permits a continuous wavelength-dependent modulation. After recombination, the light beam contains a frequency encoded spectrum which enables us to map the spectral response of a given sample in 60 ms and with a lateral resolution of 10 mu m. (C) 2012 American Institute of Physics.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image2
Eine neue Form von Cavity Enhanced Absorption Spectroscopy

Petermann, C., Fischer, P.

DE Gruyter, 79(1), 2012, Best paper award OPTO 2011 (article)

Abstract
Wir stellen eine Kopplungsmethode für resonatorgestützte Absorptionsmessungen vor, bei der Licht durch einen im Resonator platzierten akustooptischen Modulator aktiv ein- und ausgekoppelt wird. Dies ermöglicht es Cavity-Ring-Down-Spektroskopie (CRDS) mit breitbandigen und zeitlich inkohärenten Lichtquellen niedriger spektraler Leistungsdichte durchzuführen. Das Verfahren wird zum ersten Mal mit einer breitbandigen Superkontinuum-Quelle demonstriert.

___________________________________________________________________________________________

A new coupling scheme for cavity enhanced absorption spectroscopy makes use of an intracavity acousto-optical modulator to actively switch light into (and out of) a resonator. This allows cavity ringdown spectroscopy (CRDS) to be implemented with broadband temporally incoherent light sources with low spectral power densities. The method is demonstrated for the first time using a broadband supercontinuum source. Best paper award OPTO 2011.

pf

link (url) [BibTex]

link (url) [BibTex]


no image
Variants of guided self-organization for robot control

Martius, G., Herrmann, J.

Theory in Biosci., 131(3):129-137, Springer Berlin / Heidelberg, 2012 (article)

al

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
The Playful Machine - Theoretical Foundation and Practical Realization of Self-Organizing Robots

Der, R., Martius, G.

Springer, Berlin Heidelberg, 2012 (book)

Abstract
Autonomous robots may become our closest companions in the near future. While the technology for physically building such machines is already available today, a problem lies in the generation of the behavior for such complex machines. Nature proposes a solution: young children and higher animals learn to master their complex brain-body systems by playing. Can this be an option for robots? How can a machine be playful? The book provides answers by developing a general principle---homeokinesis, the dynamical symbiosis between brain, body, and environment---that is shown to drive robots to self-determined, individual development in a playful and obviously embodiment-related way: a dog-like robot starts playing with a barrier, eventually jumping or climbing over it; a snakebot develops coiling and jumping modes; humanoids develop climbing behaviors when fallen into a pit, or engage in wrestling-like scenarios when encountering an opponent. The book also develops guided self-organization, a new method that helps to make the playful machines fit for fulfilling tasks in the real world.

al

link (url) [BibTex]

2009


Thumb xl toc image
Full phase and amplitude control in computer-generated holography

Fratz, M., Fischer, P., Giel, D. M.

OPTICS LETTERS, 34(23):3659-3661, 2009 (article)

Abstract
We report what we believe to be the first realization of a computer-generated complex-valued hologram recorded in a single film of photoactive polymer. Complex-valued holograms give rise to a diffracted optical field with control over its amplitude and phase. The holograms are generated by a one-step direct laser writing process in which a spatial light modulator (SLM) is imaged onto a polymer film. Temporal modulation of the SLM during exposure controls both the strength of the induced birefringence and the orientation of the fast axis. We demonstrate that complex holograms can be used to impart arbitrary amplitude and phase profiles onto a beam and thereby open new possibilities in the control of optical beams. (C) 2009 Optical Society of America

pf

[BibTex]

2009


[BibTex]


Thumb xl toc image
Digital polarization holograms with defined magnitude and orientation of each pixel’s birefringence

Fratz, M., Giel, D. M., Fischer, P.

OPTICS LETTERS, 34(8):1270-1272, 2009 (article)

Abstract
A new form of digital polarization holography is demonstrated that permits both the amplitude and the phase of a diffracted beam to be independently controlled. This permits two independent intensity images to be stored in the same hologram. To fabricate the holograms, a birefringence with defined retardance and orientation of the fast axis is recorded into a photopolymer film. The holograms are selectively read out by choosing the polarization state of the read beam. Polarization holograms of this kind increase the data density in holographic data storage and allow higher quality diffractive optical elements to be written. (C) 2009 Optical Society of America

pf

[BibTex]


Thumb xl toc images
Controlled Propulsion of Artificial Magnetic Nanostructured Propellers

Ghosh, A., Fischer, P.

NANO LETTERS, 9(6):2243-2245, 2009, Featured highlight ‘Nanotechnology: The helix that delivers’ Nature 459, 13 (2009). (article)

Abstract
For biomedical applications, such as targeted drug delivery and microsurgery, it is essential to develop a system of swimmers that can be propelled wirelessly in fluidic environments with good control. Here, we report the construction and operation of chiral colloidal propellers that can be navigated in water with micrometer-level precision using homogeneous magnetic fields. The propellers are made via nanostructured surfaces and can be produced in large numbers. The nanopropellers can carry chemicals, push loads, and act as local probes in rheological measurements.

Featured highlight ‘Nanotechnology: The helix that delivers’ Nature 459, 13 (2009).

pf

Video - Nanospropellers DOI [BibTex]

Video - Nanospropellers DOI [BibTex]


Thumb xl toc image
Absolute Asymmetric Reduction Based on the Relative Orientation of Achiral Reactants

Kuhn, A., Fischer, P.

ANGEWANDTE CHEMIE-INTERNATIONAL EDITION, 48(37):6857-6860, 2009 (article)

pf

DOI [BibTex]

DOI [BibTex]


no image
A Sensor-Based Learning Algorithm for the Self-Organization of Robot Behavior

Hesse, F., Martius, G., Der, R., Herrmann, J. M.

Algorithms, 2(1):398-409, 2009 (article)

Abstract
Ideally, sensory information forms the only source of information to a robot. We consider an algorithm for the self-organization of a controller. At short timescales the controller is merely reactive but the parameter dynamics and the acquisition of knowledge by an internal model lead to seemingly purposeful behavior on longer timescales. As a paradigmatic example, we study the simulation of an underactuated snake-like robot. By interacting with the real physical system formed by the robotic hardware and the environment, the controller achieves a sensitive and body-specific actuation of the robot.

al

link (url) [BibTex]

link (url) [BibTex]

2008


Thumb xl toc image
Voltage-Controllable Magnetic Composite Based on Multifunctional Polyethylene Microparticles

Ghosh, A., Sheridon, N. K., Fischer, P.

SMALL, 4(11):1956-1958, 2008 (article)

pf

DOI [BibTex]

2008



no image
Emergence of Interaction Among Adaptive Agents

Martius, G., Nolfi, S., Herrmann, J. M.

In Proc. From Animals to Animats 10 (SAB 2008), 5040, pages: 457-466, LNCS, Springer, 2008 (inproceedings)

al

DOI [BibTex]

DOI [BibTex]


no image
Structure from Behavior in Autonomous Agents

Martius, G., Fiedler, K., Herrmann, J.

In Proc. IEEE Intl. Conf. Intelligent Robots and Systems (IROS 2008), pages: 858 - 862, 2008 (inproceedings)

al

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Nonlinear optical spectroscopy of chiral molecules

Fischer, P., Hache, F.

CHIRALITY, 17(8):421-437, 2005 (article)

Abstract
We review nonlinear optical processes that are specific to chiral molecules in solution and on surfaces. In contrast to conventional natural optical activity phenomena, which depend linearly on the electric field strength of the optical field, we discuss how optical processes that are nonlinear (quadratic, cubic, and quartic) functions of the electromagnetic field strength may probe optically active centers and chiral vibrations. We show that nonlinear techniques open entirely new ways of exploring chirality in chemical and biological systems: The cubic processes give rise to nonlinear circular dichroism and nonlinear optical rotation and make it possible to observe dynamic chiral processes at ultrafast time scales. The quadratic second-harmonic and sum-frequency-generation phenomena and the quartic processes may arise entirely in the electric-dipole approximation and do not require the use of circularly polarized light to detect chirality: They provide surface selectivity and their observables can be relatively much larger than in linear optical activity. These processes also give rise to the generation of light at a new color, and in liquids this frequency conversion only occurs if the solution is optically active. We survey recent chiral nonlinear optical experiments and give examples of their application to problems of biophysical interest. (C) 2005 Wiley-Liss, Inc.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Negative refraction at optical frequencies in nonmagnetic two-component molecular media

Chen, Y., Fischer, P., Wise, F.

PHYSICAL REVIEW LETTERS, 95(6), 2005 (article)

Abstract
There is significant motivation to develop media with negative refractive indices at optical frequencies, but efforts in this direction are hampered by the weakness of the magnetic response at such frequencies. We show theoretically that a nonmagnetic medium with two atomic or molecular constituents can exhibit a negative refractive index. A negative index is possible even when the real parts of both the permittivity and permeability are positive. This surprising result provides a route to isotropic negative-index media at optical frequencies.

pf

DOI [BibTex]

DOI [BibTex]


no image
Learning to Feel the Physics of a Body

Der, R., Hesse, F., Martius, G.

In Computational Intelligence for Modelling, Control and Automation, CIMCA 2005 , 2, pages: 252-257, Washington, DC, USA, 2005 (inproceedings)

Abstract
Despite the tremendous progress in robotic hardware and in both sensorial and computing efficiencies the performance of contemporary autonomous robots is still far below that of simple animals. This has triggered an intensive search for alternative approaches to the control of robots. The present paper exemplifies a general approach to the self-organization of behavior which has been developed and tested in various examples in recent years. We apply this approach to an underactuated snake like artifact with a complex physical behavior which is not known to the controller. Due to the weak forces available, the controller so to say has to develop a kind of feeling for the body which is seen to emerge from our approach in a natural way with meandering and rotational collective modes being observed in computer simulation experiments.

al

[BibTex]

[BibTex]