21.3.6.3 Face Action Units for Expressions and Motion Analysis

Chapter Contents (Back)
Face Recognition. Application, Faces. Faces, Expression. FACS. FAU, FACS

Huang, C.L., Huang, Y.M.,
Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameter(s) Classification,
JVCIR(8), 1997, pp. 278-290. BibRef 9700

Essa, I.A.[Irfan A.], and Pentland, A.P.[Alex P.],
Coding, Analysis, Interpretation, and Recognition of Facial Expressions,
PAMI(19), No. 7, July 1997, pp. 757-763.
IEEE Abstract. IEEE Top Reference.
WWW Version. 9708
BibRef
Earlier:
Facial Expression Recognition Using Image Motion,
MBR97(Chapter 12). MIT. BibRef
Earlier:
Facial Expression Recognition Using a Dynamic Model and Motion Energy,
ICCV95(360-367).
IEEE DOI Link
WWW Version. BibRef
And: Vismod-307, 1995.
HTML Version. and
Postscript Version. Spatio-temporal technique for expression recognition. Rather than use the heuristic (psychological system) FACS, use a probabilistic scheme to characterize motion and muscle activation. BibRef

Essa, I.A., Pentland, A.P.,
A Vision System for Observing and Extracting Facial Action Parameters,
CVPR94(76-83).
IEEE Abstract. IEEE Top Reference. BibRef 9400
And: Vismod-247, 1993.
HTML Version. and
Postscript Version. BibRef

Essa, I.A.[Irfan A.], Darrell, T.J.[Trevor J.], Pentland, A.P.[Alex P.],
Tracking Facial Motion,
Vismod-272, 1994.
HTML Version. and
Postscript Version. BibRef 9400

Essa, I.A.[Irfan A.],
Analysis, Interpretation and Synthesis of Facial Expressions,
Vismod-303, 1994.
HTML Version. and
Postscript Version. BibRef 9400

Zhang, L.[Liang],
Automatic Adaptation of a Face Model Using Action Units for Semantic Coding of Videophone Sequences,
CirSysVideo(8), No. 6, October 1998, pp. 781.
IEEE Top Reference. BibRef 9810
Earlier:
Estimation of the Mouth Features Using Deformable Templates,
ICIP97(III: 328-331).
IEEE DOI Link 9710
Lipreading. BibRef

Donato, G.[Gianluca], Bartlett, M.S.[Marian Stewart], Hager, J.C.[Joseph C.], Ekman, P.[Paul], Sejnowski, T.J.[Terrence J.],
Classifying Facial Actions,
PAMI(21), No. 10, October 1999, pp. 974-989.
IEEE Abstract. IEEE Top Reference.
WWW Version. Uses the FACS ( See also Facial Action Coding System: A Technique for the Measurement of Facial Movement, The. ) coding system. 96% for 12 facial actions. BibRef 9910

Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.,
Measuring Facial Expressions by Computer Image Analysis,
Psychophysiology(36), 1999, pp. 253-264. BibRef 9900

Fleet, D.J.[David J.], Black, M.J.[Michael J.], Yacoob, Y.[Yaser], Jepson, A.D.[Allan D.],
Design and Use of Linear Models for Image Motion Analysis,
IJCV(36), No. 3, February-March 2000, pp. 171-193.
WWW Version. 0003

PDF Version. See also Probabilistic Detection and Tracking of Motion Boundaries. See also Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion. See also Estimating Optical-Flow in Segmented Images Using Variable-Order Parametric Models with Local Deformations. BibRef

Black, M.J.[Michael J.],
Explaining Optical Flow Events with Parameterized Spatio-temporal Models,
CVPR99(I: 326-332).
IEEE Abstract. IEEE Top Reference.
WWW Version. Generative Spatio-Temporal model. Basis for flow fields. Used for facial expressions. BibRef 9900

Black, M.J., Yacoob, Y., Jepson, A.D., Fleet, D.J.,
Learning Parameterized Models of Image Motion,
CVPR97(561-567).
IEEE Abstract. IEEE Top Reference.
WWW Version. 9704
Several applications. BibRef

Tian, Y.L.[Ying-Li], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.],
Recognizing Action Units for Facial Expression Analysis,
PAMI(23), No. 2, February 2001, pp. 97-115.
IEEE Abstract. IEEE Top Reference.
WWW Version. 0102
BibRef
And: CMU-RI-TR-99-40, December, 1999.
HTML Version. BibRef
And:
Recognizing Upper Face Action Units for Facial Expression Analysis,
CVPR00(I: 294-301).
IEEE Abstract. IEEE Top Reference.
WWW Version. 0005
Analyze expressions using permanent facial features and transient features. Describe expressions in terms of action units rather than prototypical expressions. Compares results with: See also Measuring Facial Expressions by Computer Image Analysis. See also Classifying Facial Actions. See also Automated Face Analysis by Feature Point Tracking Has High Concurrent Validity with Manual FACS Coding. and See also Detection, Tracking, and Classification of Action Units in Facial Expression. BibRef

Tian, Y.L., Kanade, T., Cohn, J.F.,
Recognizing Facial Actions by Combining Geometric Features and Regional Appearance Patterns,
CMU-RI-TR-01-01, January 2001.
PDF Version. 0102
BibRef

Tian, Y.L.[Ying-Li], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.],
Evaluation of gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity,
AFGR02(218-223).
IEEE DOI Link 0206
BibRef
Earlier:
Recognizing Lower Face Action Units in Facial Expression,
AFGR00(484-490).
IEEE DOI Link 0003
BibRef
And:
Multi-State Based Facial Feature Tracking and Detection,
CMU-RI-TR-99-18, August, 1999.
HTML Version. BibRef

Cohn, J.F.[Jeffrey F.], Kanade, T.[Takeo],
Use of automated facial image analysis for measurement of emotion expression,
EmotionElicitation06(xx-yy).
HTML Version. BibRef 0600

Cohn, J.F.[Jeffrey F.], Ambadar, Z., and Ekman, P.,
Observer-based measurement of facial expression with the Facial Action Coding System,
EmotionElicitation06(xx-yy).
HTML Version. BibRef 0600

Wang, T.H.[Te-Hsun], Lien, J.J.J.[Jenn-Jier James],
Facial expression recognition system based on rigid and non-rigid motion separation and 3D pose estimation,
PR(42), No. 5, May 2009, pp. 962-977.
Elsevier DOI Link
WWW Version. 0902
Facial expression recognition; FACS action units; Rigid and non-rigid motion separation; 3D pose estimation; Perspective projection See also view-based statistical system for multi-view face detection and pose estimation, A. BibRef

Lai, T.H.[Tzung-Heng], Wang, T.H.[Te-Hsun], Lien, J.J.J.[Jenn-Jier James],
Incremental Perspective Motion Model for Rigid and Non-rigid Motion Separation,
PSIVT07(613-624).
Springer DOI Link 0712
Motion extraction in facial expression analysis. BibRef

Lien, J.J.J., Kanade, T., Cohn, J.F., Li, C.C.,
Automated Facial Expression Recognition Based on FACS Action Units,
AFGR98(390-395).
IEEE DOI Link BibRef 9800

Lien, J.J.J.,
Automatic Recognition of Facial Expressions Using Hidden Markov Models and Estimation of Expression Intensity,
CMU-RI-TR-98-31, April, 1998.
HTML Version. BibRef 9804

Lien, J.J.J.[James J.J.], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.], Li, C.C.[Ching-Chung], Zlochower, A.J.[Adena J.],
Subtly Different Facial Expression Recognition and Expression Intensity Estimation,
CVPR98(853-859).
IEEE Abstract. IEEE Top Reference.
PDF Version. BibRef 9800

Cohn, J.F., Zlochower, A.J., Lien, J.J.J., Kanade, T.,
Automated Face Analysis by Feature Point Tracking Has High Concurrent Validity with Manual FACS Coding,
Psychophysiology(36), 1999, pp. 35-43.
PDF Version. BibRef 9900

Cohn, J.F., Zlochower, A.J., Lien, J.J.J., Kanade, T.,
Feature-Point Tracking by Optical Flow Discriminates Subtle Differences in Facial Expression,
AFGR98(396-401).
IEEE DOI Link BibRef 9800

Lien, J.J.J.[James J.J.], Kanade, T.[Takeo], Cohn, J.F.[Jeffrey F.], Li, C.C.[Ching-Chung],
Detection, Tracking, and Classification of Action Units in Facial Expression,
RAS(31), 2000, pp. 131-146. BibRef 0001

Tao, H.[Hai], Huang, T.S.[Thomas S.],
Visual Estimation and Compression of Facial Motion Parameters: Elements of a 3D Model-Based Video Coding System,
IJCV(50), No. 2, November 2002, pp. 111-125.
WWW Version. 0210
BibRef
Earlier:
Explanation-based Facial Motion Tracking Using a Piecewise Bezier Volume Deformation Model,
CVPR99(I: 611-617).
IEEE Abstract. IEEE Top Reference.
WWW Version. BibRef

Tao, H.[Hai], Huang, T.S.[Thomas S.],
A Piecewise Bézier Volume Deformation Model and Its Applications in Facial Motion Capture,
AIPU02(39-56). 0905
BibRef

Tao, H.[Hai], Lopez, R., Huang, T.S.,
Tracking Facial Features Using Probabilistic Network,
AFGR98(166-170).
IEEE DOI Link BibRef 9800

Pardŕs, M.[Montse], Bonafonte, A.[Antonio],
Facial animation parameters extraction and expression recognition using Hidden Markov Models,
SP:IC(17), No. 9, October 2002, pp. 675-688.
WWW Version. 0211
BibRef

Chuang, C.F.[Chao-Fa], Shih, F.Y.[Frank Y.],
Recognizing facial action units using independent component analysis and support vector machine,
PR(39), No. 9, September 2006, pp. 1795-1798.
WWW Version. 0606
Action unit; Independent component analysis; Support vector machine BibRef

Littlewort, G.[Gwen], Bartlett, M.S.[Marian Stewart], Fasel, I.R.[Ian R.], Susskind, J.[Joshua], Movellan, J.R.[Javier R.],
Dynamics of Facial Expression Extracted Automatically from Video,
IVC(24), No. 6, 1 June 2006, pp. 615-625.
WWW Version. 0606
BibRef
Earlier: FaceVideo04(80).
HTML Version. 0502
Facial action coding; Support vector machines; Adaboost BibRef

Bartlett, M.S.[Marian Stewart], Littlewort, G.[Gwen], Frank, M.[Mark], Lainscsek, C.[Claudia], Fasel, I.R.[Ian R.], Movellan, J.R.[Javier R.],
Fully Automatic Facial Action Recognition in Spontaneous Behavior,
FGR06(223-230).
IEEE DOI Link 0604
BibRef
Earlier:
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior,
CVPR05(II: 568-573).
IEEE DOI Link 0507
BibRef

Braathen, B., Bartlett, M.S., Littlewort, G., Smith, E., Movellan, J.R.,
An approach to automatic recognition of spontaneous facial actions,
AFGR02(345-350).
IEEE DOI Link 0206
BibRef

Whitehill, J.[Jacob], Littlewort, G.[Gwen], Fasel, I.R.[Ian R.], Bartlett, M.[Marian], Movellan, J.R.[Javier R.],
Toward Practical Smile Detection,
PAMI(31), No. 11, November 2009, pp. 2106-2111.
IEEE DOI Link 0910
Explore whether learning can be applied to a practical scenario. Includes a dataset of thousands of different people. BibRef

Tong, Y.[Yan], Liao, W.H.[Wen-Hui], Ji, Q.A.[Qi-Ang],
Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships,
PAMI(29), No. 10, October 2007, pp. 1683-1699.
IEEE DOI Link 0710
Integrate relations, dynamics, and appearance. See also Robust facial feature tracking under varying face pose and facial expression. BibRef

Tong, Y.[Yan], Liao, W.H.[Wen-Hui], Xue, Z.[Zheng], Ji, Q.A.[Qi-Ang],
A Unified Probabilistic Framework for Facial Activity Modeling and xoUnderstanding,
CVPR07(1-8).
IEEE DOI Link 0706
BibRef

Tong, Y.[Yan], Wang, Y.[Yang], Zhu, Z.W.[Zhi-Wei], Ji, Q.A.[Qi-Ang],
Robust facial feature tracking under varying face pose and facial expression,
PR(40), No. 11, November 2007, pp. 3195-3208.
WWW Version. 0707
BibRef
Earlier:
Facial Feature Tracking using a Multi-State Hierarchical Shape Model under Varying Face Pose and Facial Expression,
ICPR06(I: 283-286).
WWW Version. 0609
Facial feature detection and tracking; Active shape model; Face pose estimation See also Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships. BibRef

Zhu, Z.W.[Zhi-Wei], Ji, Q.A.[Qi-Ang],
Robust Pose Invariant Facial Feature Detection and Tracking in Real-Time,
ICPR06(I: 1092-1095).
WWW Version. 0609
BibRef
And:
Robust Real-Time Face Pose and Facial Expression Recovery,
CVPR06(I: 681-688).
IEEE DOI Link 0606
See also Real Time 3D Face Pose Tracking From an Uncalibrated Camera. BibRef

Gu, H.S.[Hai-Song], Ji, Q.A.[Qi-Ang], Zhu, Z.W.[Zhi-Wei],
Active facial tracking for fatigue detection,
WACV02(137-142).
IEEE Abstract. IEEE Top Reference. 0303
BibRef

Gu, H.S.[Hai-Song], Ji, Q.A.[Qi-Ang],
Facial event classification with task oriented dynamic Bayesian network,
CVPR04(II: 870-875).
IEEE Abstract. IEEE Top Reference. 0408
BibRef
And:
An automated face reader for fatigue detection,
AFGR04(111-116).
IEEE Abstract. IEEE Top Reference. 0411
BibRef

Tong, Y.[Yan], Ji, Q.A.[Qi-Ang],
Multiview Facial Feature Tracking with a Multi-modal Probabilistic Model,
ICPR06(I: 307-310).
WWW Version. 0609
BibRef

Yang, P.[Peng], Liu, Q.S.[Qing-Shan], Metaxas, D.N.[Dimitris N.],
Boosting encoded dynamic features for facial expression recognition,
PRL(30), No. 2, 15 January 2009, pp. 132-139,.
Elsevier DOI Link
WWW Version. 0804
BibRef
Earlier:
Similarity Features for Facial Event Analysis,
ECCV08(I: 685-696).
Springer DOI Link 0810
BibRef
Earlier:
Boosting Coded Dynamic Features for Facial Action Units and Facial Expression Recognition,
CVPR07(1-6).
IEEE DOI Link 0706
Pattern recognition; Facial expression; Video understanding; Boosting BibRef

Yang, P.[Peng], Liu, Q.S.[Qing-Shan], Cui, X.Y.[Xin-Yi], Metaxas, D.N.[Dimitris N.],
Facial expression recognition using encoded dynamic features,
CVPR08(1-8).
IEEE DOI Link 0806
BibRef

Littlewort, G.C.[Gwen C.], Bartlett, M.S.[Marian Stewart], Lee, K.[Kang],
Automatic coding of facialexpressions displayed during posed and genuine pain,
IVC(27), No. 12, November 2009, pp. 1797-1803,.
Elsevier DOI Link
WWW Version. 0910
Machine learning; Computer vision; Malingering; Facial expression; Spontaneous behavior; Automated FACS BibRef

Ashraf, A.B.[Ahmed Bilal], Lucey, S.[Simon], Cohn, J.F.[Jeffrey F.], Chen, T.H.[Tsu-Han], Ambadar, Z.[Zara], Prkachin, K.M.[Kenneth M.], Solomon, P.E.[Patricia E.],
The painful face: Pain expression recognition using active appearance models,
IVC(27), No. 12, November 2009, pp. 1788-1796,.
Elsevier DOI Link
WWW Version. 0910
Active appearance models; Support vector machines; Pain; Facial expression; Automatic facial image analysis; FACS BibRef


Mahoor, M.H.[Mohammad H.], Cadavid, S.[Steven], Messinger, D.S.[Daniel S.], Cohn, J.F.[Jeffrey F.],
A framework for automated measurement of the intensity of non-posed Facial Action Units,
CVPR4HB09(74-80).
IEEE DOI Link 0906
BibRef

Lucey, P.[Patrick], Cohn, J.[Jeffrey], Lucey, S.[Simon], Sridharan, S.[Sridha], Prkachin, K.M.[Kenneth M.],
Automatically detecting action units from faces of pain: Comparing shape and appearance features,
CVPR4HB09(12-18).
IEEE DOI Link 0906
BibRef

Zor, C.[Cemre], Windeatt, T.[Terry],
Upper Facial Action Unit Recognition,
ICB09(239-248).
Springer DOI Link 0906
BibRef

Windeatt, T.[Terry], Dias, K.[Kaushala],
Ensemble Approaches to Facial Action Unit Classification,
CIARP08(551-559).
Springer DOI Link 0809
BibRef

Sun, Y.[Yi], Reale, M.[Michael], Yin, L.J.[Li-Jun],
Recognizing partial facial action units based on 3D dynamic range data for facial expression recognition,
FG08(1-8).
IEEE DOI Link 0809
BibRef

Tong, Y.[Yan], Chen, J.X.[Ji-Xu], Ji, Q.A.[Qi-Ang],
Modeling and exploiting the spatio-temporal facial action dependencies for robust spontaneous facial expression recognition,
CVPR4HB09(34-41).
IEEE DOI Link 0906
BibRef

Zhang, L.[Lei], Tong, Y.[Yan], Ji, Q.A.[Qi-Ang],
Active Image Labeling and Its Application to Facial Action Labeling,
ECCV08(II: 706-719).
Springer DOI Link 0810
BibRef
And:
Interactive labeling of facial action units,
ICPR08(1-4).
IEEE DOI Link 0812
BibRef

de Campos, C.P.[Cassio P.], Tong, Y.[Yan], Ji, Q.A.[Qi-Ang],
Constrained Maximum Likelihood Learning of Bayesian Networks for Facial Action Recognition,
ECCV08(III: 168-181).
Springer DOI Link 0810
BibRef

de Campos, C.P.[Cassio P.], Ji, Q.A.[Qi-Ang],
Improving Bayesian Network parameter learning using constraints,
ICPR08(1-4).
IEEE DOI Link 0812
BibRef

Xu, S.A.[Shu-Ang], Jia, Y.D.[Yun-De], Zhang, X.X.[Xiao-Xun],
Coding Facial Expression with Oriented Steerable Filters,
ICIP06(2057-2060). 0610

IEEE DOI Link BibRef

McCall, J.C.[Joel C.], Trivedi, M.M.[Mohan M.],
Pose invariant affect analysis using thin-plate splines,
ICPR04(III: 958-964).
IEEE DOI Link 0409
Facial landmark tracking, feature vector extraction and expression recognition. BibRef

McCall, J.C.[Joel C.], Trivedi, M.M.[Mohan M.],
Facial Action Coding Using Multiple Visual Cues and a Hierarchy of Particle Filters,
V4HCI06(150).
IEEE DOI Link 0609
BibRef

Whitehill, J., Omlin, C.W.,
Haar Features for FACS AU Recognition,
FGR06(97-101).
IEEE DOI Link 0604
BibRef

Whitehill, J., Omlin, C.W.,
Local versus Global Segmentation for Facial Expression Recognition,
FGR06(357-362).
IEEE DOI Link 0604
BibRef

Tong, Y.[Yan], Liao, W.H.[Wen-Hui], Ji, Q.A.[Qi-Ang],
Inferring Facial Action Units with Causal Relations,
CVPR06(II: 1623-1630).
IEEE DOI Link 0606
BibRef

Koelstra, S.[Sander], Pantic, M.[Maja],
Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics,
FG08(1-8).
IEEE DOI Link 0809
BibRef

Valstar, M.F.[Michel F.], Pantic, M.[Maja],
Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics,
CVHCI07(118-127).
Springer DOI Link 0710
BibRef
Earlier:
Fully Automatic Facial Action Unit Detection and Temporal Analysis,
V4HCI06(149).
IEEE DOI Link 0609
BibRef

Valstar, M.F., Patras, I., Pantic, M.,
Facial Action Unit Detection using Probabilistic Actively Learned Support Vector Machines on Tracked Facial Point Data,
VHCI05(III: 76-76).
IEEE DOI Link 0507
BibRef

Wang, Y.[Yang], Lucey, S.[Simon], Cohn, J.F.[Jeffrey F.],
Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search,
NRTL07(1-8).
IEEE DOI Link 0710
BibRef

de la Torre, F.[Fernando], Campoy, J.[Joan], Ambadar, Z.[Zara], Cohn, J.F.[Jeffrey F.],
Temporal Segmentation of Facial Behavior,
ICCV07(1-8).
IEEE DOI Link 0710
BibRef

Lucey, S., Matthews, I., Hu, C.B.[Chang-Bo], Ambadar, Z., de la Torre, F., Cohn, J.F.,
AAM Derived Face Representations for Robust Facial Action Recognition,
FGR06(155-162).
IEEE DOI Link
HTML Version. 0604
See also Multi-View AAM Fitting and Camera Calibration. BibRef

Sifakis, E.[Eftychios], Fedkiw, R.[Ron],
Facial Muscle Activations from Motion Capture,
CVPR05(II: 1195).
IEEE DOI Link 0507
BibRef

Wang, H.C.[Hong-Cheng], Ahuja, N.,
Facial expression decomposition,
ICCV03(958-965).
IEEE DOI Link 0311
BibRef

Fasel, B.[Beat], Luettin, J.[Juergen],
Recognition of Asymmetric Facial Action Unit Activities and Intensities,
ICPR00(Vol I: 1100-1103).
IEEE DOI Link
HTML Version. 0009
BibRef

Colmenarez, A.J.[Antonio J.], Frey, B.J.[Brendan J.], Huang, T.S.[Thomas S.],
A Probabilistic Framework for Embedded Face and Facial Expression Recognition,
CVPR99(I: 592-597).
IEEE Abstract. IEEE Top Reference.
WWW Version. BibRef 9900
And:
Embedded Face and Facial Expression Recognition,
ICIP99(I:633-637).
IEEE Abstract. IEEE Top Reference. BibRef

Frey, B.J.[Brendan J.], Colmenarez, A.J., Huang, T.S.,
Mixtures of Local Linear Subspaces for Face Recognition,
CVPR98(32-37).
IEEE Abstract. IEEE Top Reference. BibRef 9800

Weng, J.[John], Hwang, W.S.[Wey-Shiuan],
Sensorimotor Action Sequence Learning with Application to Face Recognition Under Discourse,
ICPR98(Vol I: 252-254).
IEEE DOI Link 9808
BibRef

Saji, H.[Hitoshi], Nakatani, H.[Hiromasa], Ohta, H.[Hiroshi],
Recognition of Facial Expressions Using Muscle-Based Feature Models,
ICPR98(Vol II: 1379-1381).
IEEE DOI Link 9808
BibRef

Ishikawa, T.[Takahiro], Yazaki, K.[Kazuhiko], Sera, H.[Hajime], Morishima, S.[Shigeo], Terzopoulos, D.[Demetri],
Facial Muscle Parameter Decision from 2D Frontal Image,
ICPR98(Vol I: 160-162).
IEEE DOI Link 9808
BibRef

Eisert, P., and Girod, B.,
Model-Based Estimation of Facial Expression Parameters from Image Sequences,
ICIP97(II: 418-421).
IEEE DOI Link BibRef 9700

Chapter on Face Recognition, Detection, Tracking, Gesture Recognition, Fingerprints, Biometrics continues in
Emotion Recognition from Face Images .


Last update:Nov 16, 2009 at 19:35:14