The server is under maintenance between 08:00 to 12:00 (GMT+08:00), and please visit
later.
We apologize for any inconvenience caused
Lip Motion and Voice Consistency Algorithm Based on Fusing Spatiotemporal Correlation Degree
Author(s): ZHU Zheng-yu, HE Qian-hua, FENG Xiao-hui, YE Wan-ling, LI Yan-xiong, YANG Ji-chen
Pages: 779-
785
Year: 2014
Issue:
4
Journal: Acta Electronica Sinica
Keyword: spatiotemporal characteristic; consistent analysis; coinertia analysis(CoIA); correlation degree fusion;
Abstract: This paper constructs a spatiotemporal lip motion model based on traditional simple pronunciation and lip motion spatial model ,and proposes methods for measuring the correlation degree between voice and the spatial ,temporal characteristic of lip motion .In addition ,a fusion scheme for the spatial and temporal correlation degree is proposed to measure the consistency of voice and lip motion .The temporal consistent score is defined as the correlation between lip shape (height and width) and the speech am-plitude .The Coinertia is used as the initial correlation degree of speech and lip spatial characteristic .Both the spatial and temporal correlation degrees are modified by audiovisual initial delay .Experimental results show that the proposed method reduces EER by about 8 .2% compared to the CoIA method .
Citations
No citation found