Header logo is


1998


Thumb xl bildschirmfoto 2012 12 06 um 10.05.20
Summarization of video-taped presentations: Automatic analysis of motion and gesture

Ju, S. X., Black, M. J., Minneman, S., Kimber, D.

IEEE Trans. on Circuits and Systems for Video Technology, 8(5):686-696, September 1998 (article)

Abstract
This paper presents an automatic system for analyzing and annotating video sequences of technical talks. Our method uses a robust motion estimation technique to detect key frames and segment the video sequence into subsequences containing a single overhead slide. The subsequences are stabilized to remove motion that occurs when the speaker adjusts their slides. Any changes remaining between frames in the stabilized sequences may be due to speaker gestures such as pointing or writing, and we use active contours to automatically track these potential gestures. Given the constrained domain, we define a simple set of actions that can be recognized based on the active contour shape and motion. The recognized actions provide an annotation of the sequence that can be used to access a condensed version of the talk from a Web page.

ps

pdf pdf from publisher DOI [BibTex]

1998


pdf pdf from publisher DOI [BibTex]


Thumb xl bildschirmfoto 2012 12 06 um 12.22.18
Robust anisotropic diffusion

Black, M. J., Sapiro, G., Marimont, D., Heeger, D.

IEEE Transactions on Image Processing, 7(3):421-432, March 1998 (article)

Abstract
Relations between anisotropic diffusion and robust statistics are described in this paper. Specifically, we show that anisotropic diffusion can be seen as a robust estimation procedure that estimates a piecewise smooth image from a noisy input image. The edge-stopping; function in the anisotropic diffusion equation is closely related to the error norm and influence function in the robust estimation framework. This connection leads to a new edge-stopping; function based on Tukey's biweight robust estimator that preserves sharper boundaries than previous formulations and improves the automatic stopping of the diffusion. The robust statistical interpretation also provides a means for detecting the boundaries (edges) between the piecewise smooth regions in an image that has been smoothed with anisotropic diffusion. Additionally, we derive a relationship between anisotropic diffusion and regularization with line processes. Adding constraints on the spatial organization of the line processes allows us to develop new anisotropic diffusion equations that result in a qualitative improvement in the continuity of edges

ps

pdf pdf from publisher [BibTex]

pdf pdf from publisher [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.33.36
The Digital Office: Overview

Black, M., Berard, F., Jepson, A., Newman, W., Saund, E., Socher, G., Taylor, M.

In AAAI Spring Symposium on Intelligent Environments, pages: 1-6, Stanford, March 1998 (inproceedings)

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.46.31
A framework for modeling appearance change in image sequences

Black, M. J., Fleet, D. J., Yacoob, Y.

In Sixth International Conf. on Computer Vision, ICCV’98, pages: 660-667, Mumbai, India, January 1998 (inproceedings)

Abstract
Image "appearance" may change over time due to a variety of causes such as 1) object or camera motion; 2) generic photometric events including variations in illumination (e.g. shadows) and specular reflections; and 3) "iconic changes" which are specific to the objects being viewed and include complex occlusion events and changes in the material properties of the objects. We propose a general framework for representing and recovering these "appearance changes" in an image sequence as a "mixture" of different causes. The approach generalizes previous work on optical flow to provide a richer description of image events and more reliable estimates of image motion.

ps

pdf video [BibTex]

pdf video [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.49.49
Parameterized modeling and recognition of activities

Yacoob, Y., Black, M. J.

In Sixth International Conf. on Computer Vision, ICCV’98, pages: 120-127, Mumbai, India, January 1998 (inproceedings)

Abstract
A framework for modeling and recognition of temporal activities is proposed. The modeling of sets of exemplar activities is achieved by parameterizing their representation in the form of principal components. Recognition of spatio-temporal variants of modeled activities is achieved by parameterizing the search in the space of admissible transformations that the activities can undergo. Experiments on recognition of articulated and deformable object motion from image motion parameters are presented.

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl toc image
Surface second-order nonlinear optical activity

Fischer, P., Buckingham, A.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA B-OPTICAL PHYSICS, 15(12):2951-2957, 1998 (article)

Abstract
Following the recent observation of a large second-harmonic intensity difference from a monolayer of chiral molecules with left and right circularly polarized light, the scattering theory is generalized and extended to predict linear and circular intensity differences for the more Versatile sum-frequency spectroscopy. Estimates indicate that intensity differences should be detectable for a typical experimental arrangement. The second-order nonlinear surface susceptibility tensor is given for different surface point groups in the electric dipole approximation; it is shown that nonlinear optical activity phenomena unambiguously probe molecular chirality only for molecular monolayers that are symmetric about the normal. Other surface symmetries can give rise to intensity differences from monolayers composed of achiral molecules. A water surface is predicted to show Linear and nonlinear optical activity in the presence of an electric field parallel to the surface. (C) 1998 Optical Society of America {[}S0740-3224(98)01311-3] OCIS codes: 190.0190, 190.4350, 240.6490.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Linear electro-optic effect in optically active liquids

Buckingham, A., Fischer, P.

CHEMICAL PHYSICS LETTERS, 297(3-4):239-246, 1998 (article)

Abstract
A linear effect of an electrostatic field F on the intensity of sum- and difference-frequency generation in a chiral liquid is predicted. It arises in the electric dipole approximation. The effect changes sign with the enantiomer and on reversing the direction of the electrostatic field. The sum-frequency generator chi(alpha beta gamma)((2)) (-omega(3);omega(1),omega(2)), where omega(3) = omega(1) + omega(2), and the electric field-induced sum-frequency generator chi(alpha beta gamma delta)((3))(-omega(3);omega(1),omega(2),0)F-delta interfere and their contributions to the scattering power can be distinguished. Encouraging predictions are given for a typical experimental arrangement. (C) 1998 Elsevier Science B.V. All rights reserved.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Monolayers of hexadecyltrimethylammonium p-tosylate at the air-water interface. 1. Sum-frequency spectroscopy

Bell, G., Li, Z., Bain, C., Fischer, P., Duffy, D.

JOURNAL OF PHYSICAL CHEMISTRY B, 102(47):9461-9472, 1998 (article)

Abstract
Sum-frequency vibrational spectroscopy has been used to determine the structure of monolayers of the cationic surfactant, hexadecyltrimethylammonium p-tosylate (C(16)TA(+)Ts(-)), at the surface of water. Selective deuteration of the cation or the anion allowed the separate detection of sum-frequency spectra of the surfactant and of counterions that are bound to the monolayer. The p-tosylate ions an oriented with their methyl groups pointing away from the aqueous subphase and with the C-2 axis tilted, on average, by 30-40 degrees from the surface normal. The vibrational spectra of C(16)TA(+) indicate that the number of gauche defects in the monolayer does not change dramatically when bromide counterions are replaced by p-tosylate. The ends of the hydrocarbon chains of C16TA+ are, however, tilted much further from the surface normal in the presence of p-tosylate than in the presence of bromide. A quantitative analysis of the sum-frequency spectra requires a knowledge of the molecular hyperpolarizability tensor: the role of ab initio calculations and Raman spectroscopy in determining the components of this tensor is discussed.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image
Ultraviolet resonance Raman study of drug binding in dihydrofolate reductase, gyrase, and catechol O-methyltransferase

Couling, V., Fischer, P., Klenerman, D., Huber, W.

BIOPHYSICAL JOURNAL, 75(2):1097-1106, 1998 (article)

Abstract
This paper presents a study of the use of ultraviolet resonance Raman (UVRR) spectroscopic methods as a means of elucidating aspects of drug-protein interactions. Some of the RR vibrational bands of the aromatic amino acids tyrosine and tryptophan are sensitive to the microenvironment, and the use of UV excitation radiation allows selective enhancement of the spectral features of the aromatic amino acids, enabling observation specifically of their change in microenvironment upon drug binding. The three drug-protein systems investigated in this study are dihydrofolate reductase with its inhibitor trimethoprim, gyrase with novobiocin, and catechol O-methyltransferase with dinitrocatechol. It is demonstrated that UVRR spectroscopy has adequate sensitivity to be a useful means of detecting drug-protein interactions in those systems for which the electronic absorption of the aromatic amino acids changes because of hydrogen bonding and/or possible dipole-dipole and dipole-polarizability interactions with the ligand.

pf

DOI [BibTex]

DOI [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.23.21
Motion feature detection using steerable flow fields

Fleet, D. J., Black, M. J., Jepson, A. D.

In IEEE Conf. on Computer Vision and Pattern Recognition, CVPR-98, pages: 274-281, IEEE, Santa Barbara, CA, 1998 (inproceedings)

Abstract
The estimation and detection of occlusion boundaries and moving bars are important and challenging problems in image sequence analysis. Here, we model such motion features as linear combinations of steerable basis flow fields. These models constrain the interpretation of image motion, and are used in the same way as translational or affine motion models. We estimate the subspace coefficients of the motion feature models directly from spatiotemporal image derivatives using a robust regression method. From the subspace coefficients we detect the presence of a motion feature and solve for the orientation of the feature and the relative velocities of the surfaces. Our method does not require the prior computation of optical flow and recovers accurate estimates of orientation and velocity.

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl paybotteaser
PLAYBOT: A visually-guided robot for physically disabled children

Tsotsos, J. K., Verghese, G., Dickinson, S., Jenkin, M., Jepson, A., Milios, E., Nuflo, F., Stevenson, S., Black, M., Metaxas, D., Culhane, S., Ye, Y., Mann, R.

Image & Vision Computing, Special Issue on Vision for the Disabled, 16(4):275-292, 1998 (article)

Abstract
This paper overviews the PLAYBOT project, a long-term, large-scale research program whose goal is to provide a directable robot which may enable physically disabled children to access and manipulate toys. This domain is the first test domain, but there is nothing inherent in the design of PLAYBOT that prohibits its extension to other tasks. The research is guided by several important goals: vision is the primary sensor; vision is task directed; the robot must be able to visually search its environment; object and event recognition are basic capabilities; environments must be natural and dynamic; users and environments are assumed to be unpredictable; task direction and reactivity must be smoothly integrated; and safety is of high importance. The emphasis of the research has been on vision for the robot this is the most challenging research aspect and the major bottleneck to the development of intelligent robots. Since the control framework is behavior-based, the visual capabilities of PLAYBOT are described in terms of visual behaviors. Many of the components of PLAYBOT are briefly described and several examples of implemented sub-systems are shown. The paper concludes with a description of the current overall system implementation, and a complete example of PLAYBOT performing a simple task.

ps

pdf pdf from publisher DOI [BibTex]

pdf pdf from publisher DOI [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.18.33
Visual surveillance of human activity

L. Davis, S. F., Harwood, D., Yacoob, Y., Hariatoglu, I., Black, M.

In Asian Conference on Computer Vision, ACCV, 1998 (inproceedings)

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.29.19
A Probabilistic framework for matching temporal trajectories: Condensation-based recognition of gestures and expressions

Black, M. J., Jepson, A. D.

In European Conf. on Computer Vision, ECCV-98, pages: 909-924, Freiburg, Germany, 1998 (inproceedings)

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl bildschirmfoto 2012 12 06 um 12.33.38
EigenTracking: Robust matching and tracking of articulated objects using a view-based representation

Black, M. J., Jepson, A.

International Journal of Computer Vision, 26(1):63-84, 1998 (article)

Abstract
This paper describes an approach for tracking rigid and articulated objects using a view-based representation. The approach builds on and extends work on eigenspace representations, robust estimation techniques, and parameterized optical flow estimation. First, we note that the least-squares image reconstruction of standard eigenspace techniques has a number of problems and we reformulate the reconstruction problem as one of robust estimation. Second we define a “subspace constancy assumption” that allows us to exploit techniques for parameterized optical flow estimation to simultaneously solve for the view of an object and the affine transformation between the eigenspace and the image. To account for large affine transformations between the eigenspace and the image we define a multi-scale eigenspace representation and a coarse-to-fine matching strategy. Finally, we use these techniques to track objects over long image sequences in which the objects simultaneously undergo both affine image motions and changes of view. In particular we use this “EigenTracking” technique to track and recognize the gestures of a moving hand.

ps

pdf pdf from publisher video [BibTex]


Thumb xl bildschirmfoto 2013 01 14 um 09.40.25
Recognizing temporal trajectories using the Condensation algorithm

Black, M. J., Jepson, A. D.

In Int. Conf. on Automatic Face and Gesture Recognition, pages: 16-21, Nara, Japan, 1998 (inproceedings)

ps

pdf [BibTex]

pdf [BibTex]


Thumb xl cipollabook
Looking at people in action - An overview

Yacoob, Y., Davis, L. S., Black, M., Gavrila, D., Horprasert, T., Morimoto, C.

In Computer Vision for Human–Machine Interaction, (Editors: R. Cipolla and A. Pentland), Cambridge University Press, 1998 (incollection)

ps

publisher site google books [BibTex]

publisher site google books [BibTex]