Motion Based Decompositing Video Abstract We present a method to decompose video sequences into layers that represent the relative depths of complex scenes. Our method combines spatial information with temporal occlusions to determine relative depths of these layers. Spatial information is obtained through edge detection and a customized contour completion algorithm. Activity in a scene […]
Irfan A. Essa “Computers Seeing People”, AI Magazine 20(2): Summer 1999, 69-82 Abstract AI researchers are interested in building intelligent machines that can interact with them as they interact with each other. Science fiction writers have given us these goals in the form of HAL in 2001: A Space Odyssey and Commander Data in Star […]
Coding, analysis, interpretation, and recognition of facial expressions Essa, I.A. Pentland, A.P. In IEEE Transactions on Pattern Analysis and Machine Intelligence, July 1997, Volume: 19 , Issue: 7, pp 757 – 763, ISSN: 0162-8828, CODEN: ITPIDJ. INSPEC Accession Number:5661539 Digital Object Identifier: 10.1109/34.598232 Abstract We describe a computer vision system for observing facial motion by […]
Darrell, T.J.; Essa, I.A.; Pentland, A.P., “Task-specific gesture analysis in real-time using interpolated views” Transactions on Pattern Analysis and Machine Intelligence , vol.18, no.12, pp.1236-1242, Dec 1996 URL: [ieeexplore.ieee.org] [DOI] Abstract Hand and face gestures are modeled using an appearance-based approach in which patterns are represented as a vector of similarity scores to a set […]
S. Basu, I. Essa, A. Pentland (1996) “Motion regularization for model-based head tracking.” In Proceedings of Proceedings of the 13th International Conference on Pattern Recognition, 1996., 25-29 Aug 1996 Volume: 3, page(s): 611-616. [ DOI | PDF] Abstract This paper describes a method for the robust tracking of rigid head motion from video. This method […]
Essa, I.A. Pentland, A.P. (1995), “Facial expression recognition using a dynamic model and motion energy”, In Proceedings of Fifth International Conference on Computer Vision, 1995, 20-23 June 1995, page(s): 360 – 367, 06/20/1995 – 06/23/1995, Cambridge, MA, ISBN: 0-8186-7042-8, INSPEC Accession Number:5028034 Digital Object Identifier: [DOI:10.1109/ICCV.1995.466916][IEEEXplore#] Abstract Previous efforts at facial expression recognition have been […]
Thesis: Irfan Essa's PhD Thesis (1994): "Analysis, interpretation and synthesis of facial expressions"
Irfan Essa (1994), “Analysis, interpretation and synthesis of facial expressions“, PhD Thesis, MIT, Cambridge, MA, USA. (Advisor: Alex (Sandy) Pentland) [PDF] Abstract This thesis describes a computer vision system for observing the “action units” of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow […]
Citation Abstract We describe a computer vision system for observing the “action units” of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial structure. This modeling results in a time-varying spatial […]
Thesis: Irfan Essa's MS Thesis (1990): "Contact detection, collision forces and friction for physically based virtual world modeling"
Publication Abstract Detection of contact and calculation of collision forces is an important problem in any kind of physical multi-body simulation. For computer graphics and physically-based animation, it is especially important to devise methods that combine efficient computational methods with powerful existing graphics tools if one is to obtain a realistic, real-time virtual world. Most of the physical simulations are computationally […]