21.3.6.2 Face Action Units for Expressions and Motion Analysis

Huang, C.L., Huang, Y.M.,
Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameter(s) Classification,
JVCIR(8), 1997, pp. 278-290. BibRef 9700

Essa, I.A.[Irfan A.], and Pentland, A.P.[Alex P.],
Coding, Analysis, Interpretation, and Recognition of Facial Expressions,
PAMI(19), No. 7, July 1997, pp. 757-763.
IEEE Abstract. IEEE Top Reference.
WWW Version. 9708 BibRef
Earlier:
Facial Expression Recognition Using Image Motion,
MBR97(Chapter 12). MIT. BibRef
Earlier:
Facial Expression Recognition Using a Dynamic Model and Motion Energy,
ICCV95(360-367).
WWW Version.
WWW Version. BibRef
And: Vismod-307, 1995.
HTML Version. and
Postscript Version. Spatio-temporal technique for expression recognition. Rather than use the heuristic (psychological system) FACS, use a probabilistic scheme to characterize motion and muscle activation. BibRef

Essa, I.A., Pentland, A.P.,
A Vision System for Observing and Extracting Facial Action Parameters,
CVPR94(76-83).
IEEE Abstract. IEEE Top Reference. BibRef 9400
And: Vismod-247, 1993.
HTML Version. and
Postscript Version. BibRef

Essa, I.A.[Irfan A.], Darrell, T.J.[Trevor J.], Pentland, A.P.[Alex P.],
Tracking Facial Motion,
Vismod-272, 1994.
HTML Version. and
Postscript Version. BibRef 9400

Essa, I.A.[Irfan A.],
Analysis, Interpretation and Synthesis of Facial Expressions,
Vismod-303, 1994.
HTML Version. and
Postscript Version. BibRef 9400

Zhang, L.[Liang],
Automatic Adaptation of a Face Model Using Action Units for Semantic Coding of Videophone Sequences,
CirSysVideo(8), No. 6, October 1998, pp. 781.
IEEE Top Reference. BibRef 9810
Earlier:
Estimation of the Mouth Features Using Deformable Templates,
ICIP97(III: 328-331).
WWW Version. 9710Lipreading. BibRef

Donato, G.[Gianluca], Bartlett, M.S.[Marian Stewart], Hager, J.C.[Joseph C.], Ekman, P.[Paul], Sejnowski, T.J.[Terrence J.],
Classifying Facial Actions,
PAMI(21), No. 10, October 1999, pp. 974-989.
IEEE Abstract. IEEE Top Reference.
WWW Version. Uses the FACS ( See also Facial Action Coding System: A Technique for the Measurement of Facial Movement, The. ) coding system. 96% for 12 facial actions. BibRef 9910

Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.,
Measuring Facial Expressions by Computer Image Analysis,
Psychophysiology(36), 1999, pp. 253-264. BibRef 9900

Fleet, D.J.[David J.], Black, M.J.[Michael J.], Yacoob, Y.[Yaser], Jepson, A.D.[Allan D.],
Design and Use of Linear Models for Image Motion Analysis,
IJCV(36), No. 3, February-March 2000, pp. 171-193.
WWW Version. 0003
PDF Version. See also Probabilistic Detection and Tracking of Motion Boundaries. See also Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion. See also Estimating Optical-Flow in Segmented Images Using Variable-Order Parametric Models with Local Deformations. BibRef

Black, M.J.[Michael J.],
Explaining Optical Flow Events with Parameterized Spatio-temporal Models,
CVPR99(I: 326-332).
IEEE Abstract. IEEE Top Reference.
WWW Version. Generative Spatio-Temporal model. Basis for flow fields. Used for facial expressions. BibRef 9900

Black, M.J., Yacoob, Y., Jepson, A.D., Fleet, D.J.,
Learning Parameterized Models of Image Motion,
CVPR97(561-567).
IEEE Abstract. IEEE Top Reference.
WWW Version. 9704Several applications. BibRef

Tian, Y.L.[Ying-Li], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.],
Recognizing Action Units for Facial Expression Analysis,
PAMI(23), No. 2, February 2001, pp. 97-115.
IEEE Abstract. IEEE Top Reference.
WWW Version. 0102 BibRef
And: CMU-RI-TR-99-40, December, 1999.
HTML Version. BibRef
And:
Recognizing Upper Face Action Units for Facial Expression Analysis,
CVPR00(I: 294-301).
IEEE Abstract. IEEE Top Reference.
WWW Version. 0005Analyze expressions using permanent facial features and transient features. Describe expressions in terms of action units rather than prototypical expressions. Compares results with: See also Measuring Facial Expressions by Computer Image Analysis. See also Classifying Facial Actions. See also Automated Face Analysis by Feature Point Tracking Has High Concurrent Validity with Manual FACS Coding. and See also Detection, Tracking, and Classification of Action Units in Facial Expression. BibRef

Tian, Y.L., Kanade, T., Cohn, J.F.,
Recognizing Facial Actions by Combining Geometric Features and Regional Appearance Patterns,
CMU-RI-TR-01-01, January 2001.
PDF Version. 0102 BibRef

Tian, Y.L.[Ying-Li], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.],
Evaluation of gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity,
AFGR02(218-223).
WWW Version. 0206 BibRef
Earlier:
Recognizing Lower Face Action Units in Facial Expression,
AFGR00(484-490).
WWW Version. 0003 BibRef
And:
Multi-State Based Facial Feature Tracking and Detection,
CMU-RI-TR-99-18, August, 1999.
HTML Version. BibRef

Cohn, J.F.[Jeffrey F.], Kanade, T.[Takeo],
Use of automated facial image analysis for measurement of emotion expression,
EmotionElicitation06(xx-yy).
HTML Version. BibRef 0600

Cohn, J.F.[Jeffrey F.], Ambadar, Z., and Ekman, P.,
Observer-based measurement of facial expression with the Facial Action Coding System,
EmotionElicitation06(xx-yy).
HTML Version. BibRef 0600

Lai, T.H.[Tzung-Heng], Wang, T.H.[Te-Hsun], Lien, J.J.J.[Jenn-Jier James],
Incremental Perspective Motion Model for Rigid and Non-rigid Motion Separation,
PSIVT07(613-624).
WWW Version. 0712Motion extraction in facial expression analysis. BibRef

Lien, J.J.J., Kanade, T., Cohn, J.F., Li, C.C.,
Automated Facial Expression Recognition Based on FACS Action Units,
AFGR98(390-395).
WWW Version. BibRef 9800

Lien, J.J.J.,
Automatic Recognition of Facial Expressions Using Hidden Markov Models and Estimation of Expression Intensity,
CMU-RI-TR-98-31, April, 1998.
HTML Version. BibRef 9804

Lien, J.J.J.[James J.J.], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.], Li, C.C.[Ching-Chung], Zlochower, A.J.[Adena J.],
Subtly Different Facial Expression Recognition and Expression Intensity Estimation,
CVPR98(853-859).
IEEE Abstract. IEEE Top Reference.
PDF Version. BibRef 9800

Cohn, J.F., Zlochower, A.J., Lien, J.J.J., Kanade, T.,
Automated Face Analysis by Feature Point Tracking Has High Concurrent Validity with Manual FACS Coding,
Psychophysiology(36), 1999, pp. 35-43.
PDF Version. BibRef 9900

Cohn, J.F., Zlochower, A.J., Lien, J.J.J., Kanade, T.,
Feature-Point Tracking by Optical Flow Discriminates Subtle Differences in Facial Expression,
AFGR98(396-401).
WWW Version. BibRef 9800

Lien, J.J.J.[James J.J.], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.], Li, C.C.[Ching-Chung],
Detection, Tracking, and Classification of Action Units in Facial Expression,
RAS(31), 2000, pp. 131-146. BibRef 0001

Tao, H.[Hai], Huang, T.S.[Thomas S.],
Visual Estimation and Compression of Facial Motion Parameters: Elements of a 3D Model-Based Video Coding System,
IJCV(50), No. 2, November 2002, pp. 111-125.
WWW Version. 0210 BibRef
Earlier:
Explanation-based Facial Motion Tracking Using a Piecewise Bezier Volume Deformation Model,
CVPR99(I: 611-617).
IEEE Abstract. IEEE Top Reference.
WWW Version. BibRef

Tao, H.[Hai], Lopez, R., Huang, T.S.,
Tracking Facial Features Using Probabilistic Network,
AFGR98(166-170).
WWW Version. BibRef 9800

Pardās, M.[Montse], Bonafonte, A.[Antonio],
Facial animation parameters extraction and expression recognition using Hidden Markov Models,
SP:IC(17), No. 9, October 2002, pp. 675-688.
WWW Version. 0211 BibRef

Chuang, C.F.[Chao-Fa], Shih, F.Y.[Frank Y.],
Recognizing facial action units using independent component analysis and support vector machine,
PR(39), No. 9, September 2006, pp. 1795-1798.
WWW Version. 0606Action unit; Independent component analysis; Support vector machine BibRef

Tong, Y.[Yan], Wang, Y.[Yang], Zhu, Z.W.[Zhi-Wei], Ji, Q.[Qiang],
Robust facial feature tracking under varying face pose and facial expression,
PR(40), No. 11, November 2007, pp. 3195-3208.
WWW Version. 0707 BibRef
Earlier:
Facial Feature Tracking using a Multi-State Hierarchical Shape Model under Varying Face Pose and Facial Expression,
ICPR06(I: 283-286).
WWW Version. 0609Facial feature detection and tracking; Active shape model; Face pose estimation See also Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships. BibRef

Zhu, Z.W.[Zhi-Wei], Ji, Q.[Qiang],
Robust Pose Invariant Facial Feature Detection and Tracking in Real-Time,
ICPR06(I: 1092-1095).
WWW Version. 0609 BibRef
And:
Robust Real-Time Face Pose and Facial Expression Recovery,
CVPR06(I: 681-688).
WWW Version. 0606 See also Real Time 3D Face Pose Tracking From an Uncalibrated Camera. BibRef

Gu, H.S.[Hai-Song], Ji, Q.[Qiang], Zhu, Z.W.[Zhi-Wei],
Active facial tracking for fatigue detection,
WACV02(137-142).
IEEE Abstract. IEEE Top Reference. 0303 BibRef

Gu, H.S.[Hai-Song], Ji, Q.[Qiang],
Facial event classification with task oriented dynamic Bayesian network,
CVPR04(II: 870-875).
IEEE Abstract. IEEE Top Reference. 0408 BibRef
And:
An automated face reader for fatigue detection,
AFGR04(111-116).
IEEE Abstract. IEEE Top Reference. 0411 BibRef

Tong, Y.[Yan], Ji, Q.[Qiang],
Multiview Facial Feature Tracking with a Multi-modal Probabilistic Model,
ICPR06(I: 307-310).
WWW Version. 0609 BibRef

Xu, S.A.[Shu-Ang], Jia, Y.D.[Yun-De], Zhang, X.X.[Xiao-Xun],
Coding Facial Expression with Oriented Steerable Filters,
ICIP06(2057-2060). 0610
WWW Version. BibRef

McCall, J.C.[Joel C.], Trivedi, M.M.[Mohan M.],
Pose invariant affect analysis using thin-plate splines,
ICPR04(III: 958-964).
WWW Version. 0409Facial landmark tracking, feature vector extraction and expression recognition. BibRef

McCall, J.C.[Joel C.], Trivedi, M.M.[Mohan M.],
Facial Action Coding Using Multiple Visual Cues and a Hierarchy of Particle Filters,
V4HCI06(150).
WWW Version. 0609 BibRef

Whitehill, J., Omlin, C.W.,
Haar Features for FACS AU Recognition,
FGR06(97-101).
WWW Version. 0604 BibRef

Whitehill, J., Omlin, C.W.,
Local versus Global Segmentation for Facial Expression Recognition,
FGR06(357-362).
WWW Version. 0604 BibRef

Tong, Y.[Yan], Liao, W.H.[Wen-Hui], Ji, Q.[Qiang],
Inferring Facial Action Units with Causal Relations,
CVPR06(II: 1623-1630).
WWW Version. 0606 BibRef

Valstar, M.F.[Michel F.], Pantic, M.[Maja],
Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics,
CVHCI07(118-127).
WWW Version. 0710 BibRef
Earlier:
Fully Automatic Facial Action Unit Detection and Temporal Analysis,
V4HCI06(149).
WWW Version. 0609 BibRef

Valstar, M.F., Patras, I., Pantic, M.,
Facial Action Unit Detection using Probabilistic Actively Learned Support Vector Machines on Tracked Facial Point Data,
VHCI05(III: 76-76).
WWW Version. 0507 BibRef

Wang, Y.[Yang], Lucey, S.[Simon], Cohn, J.F.[Jeffrey F.],
Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search,
NRTL07(1-8).
WWW Version. 0710 BibRef

de la Torre, F.[Fernando], Campoy, J.[Joan], Ambadar, Z.[Zara], Cohn, J.F.[Jeffrey F.],
Temporal Segmentation of Facial Behavior,
ICCV07(1-8).
WWW Version. 0710 BibRef

Lucey, S., Matthews, I., Hu, C.B.[Chang-Bo], Ambadar, Z., de la Torre, F., Cohn, J.F.,
AAM Derived Face Representations for Robust Facial Action Recognition,
FGR06(155-162).
WWW Version.
HTML Version. 0604 See also Multi-View AAM Fitting and Camera Calibration. BibRef

Sifakis, E.[Eftychios], Fedkiw, R.[Ron],
Facial Muscle Activations from Motion Capture,
CVPR05(II: 1195).
WWW Version. 0507 BibRef

Wang, H.C.[Hong-Cheng], Ahuja, N.,
Facial expression decomposition,
ICCV03(958-965).
WWW Version. 0311 BibRef

Fasel, B.[Beat], Luettin, J.[Juergen],
Recognition of Asymmetric Facial Action Unit Activities and Intensities,
ICPR00(Vol I: 1100-1103).
WWW Version.
HTML Version. 0009 BibRef

Colmenarez, A.J.[Antonio J.], Frey, B.J.[Brendan J.], Huang, T.S.[Thomas S.],
A Probabilistic Framework for Embedded Face and Facial Expression Recognition,
CVPR99(I: 592-597).
IEEE Abstract. IEEE Top Reference.
WWW Version. BibRef 9900
And:
Embedded Face and Facial Expression Recognition,
ICIP99(I:633-637).
IEEE Abstract. IEEE Top Reference. BibRef

Frey, B.J.[Brendan J.], Colmenarez, A.J., Huang, T.S.,
Mixtures of Local Linear Subspaces for Face Recognition,
CVPR98(32-37).
IEEE Abstract. IEEE Top Reference. BibRef 9800

Weng, J.[John], Hwang, W.S.[Wey-Shiuan],
Sensorimotor Action Sequence Learning with Application to Face Recognition Under Discourse,
ICPR98(Vol I: 252-254).
WWW Version. 9808 BibRef

Saji, H.[Hitoshi], Nakatani, H.[Hiromasa], Ohta, H.[Hiroshi],
Recognition of Facial Expressions Using Muscle-Based Feature Models,
ICPR98(Vol II: 1379-1381).
WWW Version. 9808 BibRef

Ishikawa, T.[Takahiro], Yazaki, K.[Kazuhiko], Sera, H.[Hajime], Morishima, S.[Shigeo], Terzopoulos, D.[Demetri],
Facial Muscle Parameter Decision from 2D Frontal Image,
ICPR98(Vol I: 160-162).
WWW Version. 9808 BibRef

Eisert, P., and Girod, B.,
Model-Based Estimation of Facial Expression Parameters from Image Sequences,
ICIP97(II: 418-421).
WWW Version. BibRef 9700

Chapter on Face Recognition, Detection, Tracking, Gesture Recognition, Fingerprints, Biometrics continues in
Emotion Recognition from Face Images .