Advanced Search
Article Contents
Article Contents

Robust and flexible landmarks detection for uncontrolled frontal faces in the wild

Abstract Related Papers Cited by
  • In this paper, we propose a robust facial landmarking scheme for frontal faces which can be applied on both controlled and uncontrolled environment. This scheme is based on improvement/extension of the tree-structured facial landmarking scheme proposed by Zhu and Ramanan. The whole system is divided into two main parts: face detection and face landmarking. In the face detection part, we proposed a Tree-structured Filter Model (TFM) combined with Viola and Jones face detector to significantly reduce the false positives while maintaining high accuracy. For the facial landmarking step, we improve the accuracy and the amount of the facial landmarks by readjusting the face structure to provide better geometrical information. Furthermore, we expand the face models into Multi-Resolution (MR) models with the adaptive landmark approach via landmark reduction to train the face models to be able to detect facial landmarks on face images with resolutions as low as 30x30 pixels. Our experiments show that our proposed approaches can improve the accuracy of facial landmark detection on both controlled and uncontrolled environment. Furthermore, they also show that our MR models are more robust on detecting facial components (eyebrows, eyes, nose, and mouth) on very small faces.
    Mathematics Subject Classification: Primary: 68U10.


    \begin{equation} \\ \end{equation}
  • [1]

    T. L. Berg, A. C. Berg, J. Edwards and D. A. Forsyth, Who's in the picture? in NIPS, 2004.


    O. Çeliktutan, S. Ulukaya and B. Sankur, A comparative study of face landmarking techniques, EURASIP Journal on Image and Video Processing, 2013 (2013), 13.


    P. Conilione and D. Wang, Fuzzy approach for semantic face image retrieval, The Computer Journal, 55 (2012), 1130-1145.


    T. F. Cootes, C. J. Taylor, D. H. Cooper and J. Graham, Active shape models-their training and application, Computer vision and image understanding, 61 (1995), 38-59.


    N. Dalal and B. Triggs, Histograms of oriented gradients for human detection, in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 1, IEEE, (2005), 886-893.


    L. Ding and A. M. Martinez, Features versus context: An approach for precise and detailed detection and delineation of faces and facial features, IEEE Trans. Pattern Anal. Mach. Intell., 32 (2010), 2022-2038.


    P. F. Felzenszwalb, R. B. Girshick, D. McAllester and D. Ramanan, Object detection with discriminatively trained part-based models, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32 (2010), 1627-1645.


    P. F. Felzenszwalb and D. P. Huttenlocher, Pictorial structures for object recognition, International Journal of Computer Vision, 61 (2005), 55-79.


    G. D. Forney Jr, The viterbi algorithm, Proceedings of the IEEE, 61 (1973), 268-278.


    Y. Freund and R. E. Schapire, A desicion-theoretic generalization of on-line learning and an application to boosting, in Computational learning theory, Springer, (1995), 23-37.


    J. H. Friedman, Multivariate adaptive regression splines, The annals of statistics, 19 (1991), 1-67.doi: 10.1214/aos/1176347963.


    R. Gross, I. Matthews, J. Cohn, T. Kanade and S. Baker, Multi-pie, Image Vision Computing, 28 (2010), 807-813.


    V. Jain and E. Learned-Miller, FDDB: A Benchmark for Face Detection in Unconstrained Settings, Technical Report UM-CS-2010-009, University of Massachusetts, Amherst, 2010.


    A. Kasinski, A. Florek and A. Schmidt, The PUT face database, Image Processing and Communications, 13 (2008), 59-64.


    J. C. Klontz and A. K. Jain, A case study of automated face recognition: The boston marathon bombings suspects, IEEE Computer, 46 (2013), 91-94.


    M. Koestinger, P. Wohlhart, P. M. Roth and H. Bischof, Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization, in First IEEE International Workshop on Benchmarking Facial Image Analysis Technologies, 2011.


    V. Le, J. Brandt, Z. Lin, L. Bourdev and T. S. Huang, Interactive facial feature localization, in Proceedings of the 12th European conference on Computer Vision - Volume Part III, ECCV'12, Springer-Verlag, Berlin, Heidelberg, (2012), 679-692.


    A. Liang, W. Liu, L. Li, M. R. Farid and V. Le, Accurate facial landmarks detection for frontal faces with extended tree-structured models, in Pattern Recognition (ICPR), 2014 22nd International Conference on, IEEE, (2014), 538-543.


    A. Liang, C. Wang, W. Liu and L. Li, A novel landmark detector system for multi resolution frontal faces, in Digital lmage Computing: Techniques and Applications (DlCTA), 2014 International Conference on, IEEE, (2014), 1-8.


    D. G. Lowe, Distinctive image features from scale-invariant keypoints, International journal of computer vision, 60 (2004), 91-110.


    A. M. Martínez and R. Benavente, The AR Face Database, Technical Report 24, Computer Vision Center, Bellatera, 1998, http://www.cat.uab.cat/Public/Publications/1998/MaB1998/CVCReport24.pdf.


    S. Milborrow, Stasm User Manual, http://www.milbo.org/stasm-files/stasm4.pdf, 2013.


    S. Milborrow and F. Nicolls, Active Shape Models with SIFT Descriptors and MARS, VISAPP, http://www.milbo.users.sonic.net/stasm.


    S. Milborrow and F. Nicolls, Locating facial features with an extended active shape model, in Computer Vision-ECCV 2008, Springer, (2008), 504-513.


    A. Torralba, K. P. Murphy and W. T. Freeman, Sharing visual features for multiclass and multiview object detection, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 29 (2007), 854-869.


    P. Viola and M. J. Jones, Robust real-time face detection, International journal of computer vision, 57 (2004), 137-154.


    X. Xiong and F. De la Torre, Supervised descent method and its applications to face alignment, in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, IEEE, (2013), 532-539.


    W. Zhao, R. Chellappa, P. J. Phillips and A. Rosenfeld, Face recognition: A literature survey, ACM Computing Surveys (CSUR), 35 (2003), 399-458.


    X. Zhu and D. Ramanan, Face detection, pose estimation and landmark localization in the wild, http://www.ics.uci.edu/ xzhu/face/.


    X. Zhu and D. Ramanan, Face detection, pose estimation, and landmark localization in the wild, in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR '12, IEEE Computer Society, Washington, DC, USA, (2012), 2879-2886.

  • 加载中

Article Metrics

HTML views() PDF downloads(347) Cited by(0)

Access History

Other Articles By Authors



    DownLoad:  Full-Size Img  PowerPoint