Automatic Generation of Facial Expression Using Triangular Geometric Deformation

 

Jia-Shing Sheu*¹, Tsu-Shien Hsieh² and Ho-Nien Shou³

 

^1,2 Department of Computer Science, National Taipei University of Education, Taipei, Taiwan. *jiashing@tea.ntue.edu.tw

³ Department of Aviation & Communication Electronics, Air Force Institute of Technology, Kaohsiung, Taiwan.

 

Abstract

This paper presents an image deformation algorithm and constructs an automatic facial expression generation system to generate new facial expressions in neutral state. After the users input the face image in a neutral state into the system, the system separates the possible facial areas and the image background by skin color segmentation. It then uses the morphological operation to remove noise and to capture the organs of facial expression, such as the eyes, mouth, eyebrow, and nose. The feature control points are labeled according to the feature points (FPs) defined by MPEG-4. After the designation of the deformation expression, the system also increases the image correction points based on the obtained FP coordinates. The FPs are utilized as image deformation units by triangular segmentation. The triangle is split into two vectors. The triangle points are regarded as linear combinations of two vectors, and the coefficients of the linear combinations correspond to the triangular vectors of the original image. Next, the corresponding coordinates are obtained to complete the image correction by image interpolation technology to generate the new expression. As for the proposed deformation algorithm, 10 additional correction points are generated in the positions corresponding to the FPs obtained according to MPEG-4. Obtaining the correction points within a very short operation time is easy. Using a particular triangulation for deformation can extend the material area without narrowing the unwanted material area, thus saving the filling material operation in some areas.

Keywords: Facial expression generation, feature capture, geometric transformation, image correction.

 

DESCARGAR ARTÍCULO EN FORMATO PDF

 

References

[1] A. Mehrabian, "Communication without words," Psychology Today, vol. 2, no. 9, pp. 52-55, 1968.         [ Links ]

[2] R. Brunelli et al., "Face recognition: Features versus templates," IEEE T. Pattern Anal. Mach. Intell., vol. 15, pp. 1042-1052, 1993.         [ Links ]

[3] A. Yullie et al., "Feature exaction from faces using deformable templates," Int. J. Comput. Vision, vol. 8, no. 2, pp. 99-111, 1992.         [ Links ]

[4] G. tzirita and C. Garcia, "Face detection using quantized skin color region merging and wavelet packet analysis," IEEE T. Multimedia, vol. 1, no. 3, pp. 264-277, 1999.         [ Links ]

[5] M. Sharif et al., "Enhanced and Fast Face Recognition by Hashing Algorithm," J. Appl. Res. Technol., vol. 10, no. 8, pp. 607-617, 2012.         [ Links ]

[6] M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cog. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.         [ Links ]

[7] L. Sirovich and M. Kirby, "Low-dimensional procedure for the characterization of human faces," J. Opt. Soc. Am. A, vol. 4, no. 3, pp. 519-524, 1987.         [ Links ]

[8] S. Theodoridis and K. Koutroumbas, "Pattern recognition," 4th ed., Burlington: Academic Press, 2009.         [ Links ]

[9] A. Pentland et al., "View-Based and modular eigenspaces for face recognition," 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 81-94, Jun. 1994.         [ Links ]

[10] M. Nazi et al., "PSO-GA Based Optimized Feature Selection Using Facial and Clothing Information for Gender Classification," J. Appl. Res. Technol., vol. 12, pp. 145-152, 2014.         [ Links ]

[11] A. Rahardja et al., "A neural network approach to component versus holistic recognition of facial expressions in images," Proc. of SPIE Intelligent Robots and Computer Vision X: Algorithms and Techniques, vol. 1607, pp. 62-70, 1991.         [ Links ]

[12] A. Khanam and M. Mufti, "Intelligent expression blending for performance driven facial animation," IEEE T. Consum. Electr., vol. 53, no. 2, pp. 578-583, May 2007.         [ Links ]

[13] L. Ramírez-Valdez and R. Hasimoto-Beltran, "3D facial expression synthesis and its application to face recognition systems," J. Appl. Res. Technol., vol. 7, no. 3, pp. 323-339, 2009.         [ Links ]

[14] J. Ilonen et al., "Image feature localization by multiple hypothesis testing of gabor features," IEEE T. Image Process., vol. 17, no. 3, pp. 311-325, 2008.         [ Links ]

[15] T. Darrel et al., "Active face tracking and pose estimation in an interactive room," IEEE Conf. on Computer Vision & Pattern Recognition, San Francisco, 1996, pp. 67-72.         [ Links ]

[16] P. S. Aleksic and A. K. Katsaggelos, "Automatic facial expression recognition using facial animation parameters and multistream HMMs," IEEE T. Inf. Foren. Sec., vol. 1, no. 1, pp. 3-11, 2006.         [ Links ]

[17] L. Ding and A. M. Martinez, "Features versus context: an approach for precise and detailed detection and delineation of faces and facial features," IEEE T. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 2022-2038, 2010.         [ Links ]

[18] M. H. Yang and N. Ahuja, "Detecting human faces in color images," IEEE International Conf. on Image Processing, pp. 127-139, Oct. 1998.         [ Links ]

[19] R. L. Hsu et al., "Face detection in color image," IEEE T. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 696-706, May 2002.         [ Links ]

[20] S. L. Phung et al., "Skin segmentation using color pixel classification: analysis and comparison," IEEE T. Pattern Anal. Mach. Intell., vol. 27, no. 1, pp. 148-154, Jan. 2005.         [ Links ]

[21] Y. Wang and B. Yuan, "Novel approach for human face detection from color images under complex background," Pattern Recogn., vol. 34, pp. 1983-1992, 2001.         [ Links ]

[22] D. Chai and K. N. Ngan, "Face segmentation using skin-color map in videophone applications," IEEE T. Circ. Syst. Vid., vol. 9, no. 4, pp. 551-564, 1999.         [ Links ]

[23] R. C. Gonzalez and R. E. Woods, "Digital Image Processing," 3rd ed., Prentice Hall, 2008.         [ Links ]

[24] K. Jensen and D. Anastassiou, "Subpixel edge localization and the interpolation of still images," IEEE T. Image Process., vol. 4, pp. 285-295, 1995.         [ Links ]

[25] M. Soriano et al., "Skin color modeling under varying illumination conditions using the skin locus for selecting," IEEE Nordic Signal Processing Symposium, Kolmarden, Sweden, 2000.

[26] C. C. Chiang et al., "A novel method for detecting lip, eyes and faces in real time," Real-Time Imaging, vol. 9, no. 4, pp. 288-287, Aug. 2003.         [ Links ]

[27] C. M. Lin, "Vision-based lip contour extraction and tracking for generating MPEG-4 facial animation parameters," Master's Thesis, Department of Computer Science and Information Engineering, National Dong Hwa University , 2006.         [ Links ]

[28] F. Chang and C. J. Chen, "A component-labeling algorithm using contour tracing technique," IEEE Proceedings of the Seventh International Conference on Document, Edinburgh, Scotland, 2003.         [ Links ]

[29] Y. M. Wu, "The implementation of gesture recognition for media player system," Master's Thesis, Department of Electrical Engineering, National Taiwan University of Science and Technology, 2008.         [ Links ]

[30] J. Canny, "A Computational Approach to Edge Detection," IEEE T. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Nov. 1986.         [ Links ]

[31] L. J. Guibas and J. Stolfi, "Primitives for the manipulation of general subdivisions and the computation of Voronoi diagrams," ACM T. Graphic, vol. 4, pp. 74-123, 1985.         [ Links ]

[32] A. M. Finch et al., "Matching Delaunay graphs," Pattern Recogn., vol. 30, no. 1, pp. 123-140, 1997.         [ Links ]