1
|
Shujaat S, Khambay BS, Ju X, Devine JC, McMahon JD, Wales C, Ayoub AF. The clinical application of three-dimensional motion capture (4D): a novel approach to quantify the dynamics of facial animations. Int J Oral Maxillofac Surg 2014; 43:907-16. [PMID: 24583138 DOI: 10.1016/j.ijom.2014.01.010] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2012] [Revised: 01/15/2014] [Accepted: 01/20/2014] [Indexed: 11/18/2022]
Abstract
The aim of this pilot study was to evaluate the feasibility of measuring the change in magnitude, speed, and motion similarity of facial animations in head and neck oncology patients, before and after lip split mandibulotomy. Seven subjects (four males, three females) aged 42-80 years were recruited. The subjects were asked to perform four facial animations (maximal smile, lip purse, cheek puff, and grimace) from rest to maximal position. The animations were captured using a Di4D motion capture system, which recorded 60 frames/s. Nine facial soft tissue landmarks were manually digitized on the first frame of the three-dimensional image of each animation by the same operator and were tracked automatically for the sequential frames. The intra-operator digitization error was within 0.4mm. Lip purse and maximal smile animations showed the least amount of change in magnitude (0.2mm) following surgery; speed difference was least for smile animation (-0.1mm/s). Motion similarity was found to be highest for lip purse animation (0.78). This pilot study confirmed that surgery did influence the dynamics of facial animations, and the Di4D capture system can be regarded as a feasible objective tool for assessing the impact of surgical interventions on facial soft tissue movements.
Collapse
Affiliation(s)
- S Shujaat
- Oral & Maxillofacial Surgery, Faculty of Medicine, MVLS College, Glasgow University Dental Hospital and School, Glasgow, UK
| | - B S Khambay
- Oral & Maxillofacial Surgery, Faculty of Medicine, MVLS College, Glasgow University Dental Hospital and School, Glasgow, UK
| | - X Ju
- Oral & Maxillofacial Surgery, Faculty of Medicine, MVLS College, Glasgow University Dental Hospital and School, Glasgow, UK
| | - J C Devine
- Regional Maxillofacial Unit, Southern General Hospital, Glasgow, UK
| | - J D McMahon
- Regional Maxillofacial Unit, Southern General Hospital, Glasgow, UK
| | - C Wales
- Regional Maxillofacial Unit, Southern General Hospital, Glasgow, UK
| | - A F Ayoub
- Oral & Maxillofacial Surgery, Faculty of Medicine, MVLS College, Glasgow University Dental Hospital and School, Glasgow, UK.
| |
Collapse
|
2
|
Emrith K, Broadbent L, Smith L, Smith M, Molleda J. Real-time recovery of moving 3D faces for emerging applications. COMPUT IND 2013. [DOI: 10.1016/j.compind.2013.03.011] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
3
|
Popat H, Richmond S, Zhurov AI, Rosin PL, Marshall D. A geometric morphometric approach to the analysis of lip shape during speech: development of a clinical outcome measure. PLoS One 2013; 8:e57368. [PMID: 23451213 PMCID: PMC3581441 DOI: 10.1371/journal.pone.0057368] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2012] [Accepted: 01/12/2013] [Indexed: 12/05/2022] Open
Abstract
Objective assessments of lip movement can be beneficial in many disciplines including visual speech recognition, for surgical outcome assessment in patients with cleft lip and for the rehabilitation of patients with facial nerve impairments. The aim of this study was to develop an outcome measure for lip shape during speech using statistical shape analysis techniques. Lip movements during speech were captured from a sample of adult subjects considered as average using a three-dimensional motion capture system. Geometric Morphometrics was employed to extract three-dimensional coordinate data for lip shape during four spoken words decomposed into seven visemes (which included the resting lip shape). Canonical variate analysis was carried out in an attempt to statistically discriminate the seven visemes. The results showed that the second canonical variate discriminated the resting lip shape from articulation of the utterances and accounted for 17.2% of the total variance of the model. The first canonical variate was significant in discriminating between the utterances and accounted for 72.8% of the total variance of the model. The outcome measure was created using the 95% confidence intervals of the canonical variate scores for each subject plotted as ellipses for each viseme. The method and outcome model is proposed as reference to compare lip movement during speech in similar population groups.
Collapse
Affiliation(s)
- Hashmat Popat
- Applied Clinical Research and Public Health, School of Dentistry, Cardiff University, Cardiff, United Kingdom.
| | | | | | | | | |
Collapse
|
4
|
Huang ZH, Shi FJ, Chen F, Liang FX, Li Q, Yu JL, Li Z, Han XJ. In Vitro and In Vivo Assessment of an Intelligent Artificial Anal Sphincter in Rabbits. Artif Organs 2011; 35:964-9. [DOI: 10.1111/j.1525-1594.2010.01186.x] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
|
5
|
Popat H, Henley E, Richmond S, Benedikt L, Marshall D, Rosin PL. A comparison of the reproducibility of verbal and nonverbal facial gestures using three-dimensional motion analysis. Otolaryngol Head Neck Surg 2010; 142:867-72. [DOI: 10.1016/j.otohns.2010.03.003] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2010] [Revised: 02/25/2010] [Accepted: 03/01/2010] [Indexed: 11/25/2022]
Abstract
Objective: To evaluate the reproducibility of selected verbal and nonverbal facial gestures. Study Design: Cross-sectional study. Setting: School of Dentistry, Cardiff University, Cardiff, United Kingdom. Subjects and Methods: Twenty-five white subjects were asked to perform four verbal gestures and two nonverbal facial gestures in a normal, relaxed manner. The sequences were captured using a noninvasive, three-dimensional motion analysis scanner (3dMDFace Dynamic System; 3Q Technologies, Atlanta, GA) at an initial time point (T1) and one month later (T2). Principal component analysis was used to analyze the dynamics of lip movement, and dynamic time warping was used to evaluate the reproducibility between T1 and T2 for the individual facial gestures. Statistical analyses were used to compare the reproducibility of the different facial gestures. Results: All four verbal gestures were found to be significantly more reproducible than the nonverbal gestures. The word “puppy” was most reproducible, and the normal smile expression least reproducible. A hierarchy of reproducibility is proposed as “puppy,” “baby,” “rope,” “bob,” standardized smile, normal smile. Conclusion: Verbal facial gestures, in particular the words “puppy” and “baby,” are more appropriate for use in the assessment of lip movement when compared with smile expressions because of their high level of reproducibility over a one-month period.
Collapse
Affiliation(s)
- Hashmat Popat
- Applied Clinical Research and Public Health, School of Dentistry, Cardiff University, Heath Park, Cardiff, United Kingdom
| | - Emma Henley
- Applied Clinical Research and Public Health, School of Dentistry, Cardiff University, Heath Park, Cardiff, United Kingdom
| | - Stephen Richmond
- Applied Clinical Research and Public Health, School of Dentistry, Cardiff University, Heath Park, Cardiff, United Kingdom
| | - Lanthao Benedikt
- Cardiff School of Computer Science, Cardiff University, Heath Park, Cardiff, United Kingdom
| | - David Marshall
- Cardiff School of Computer Science, Cardiff University, Heath Park, Cardiff, United Kingdom
| | - Paul L. Rosin
- Cardiff School of Computer Science, Cardiff University, Heath Park, Cardiff, United Kingdom
| |
Collapse
|
6
|
Popat H, Richmond S, Benedikt L, Marshall D, Rosin P. Quantitative analysis of facial movement—A review of three-dimensional imaging techniques. Comput Med Imaging Graph 2009; 33:377-83. [DOI: 10.1016/j.compmedimag.2009.03.003] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2009] [Accepted: 03/11/2009] [Indexed: 11/28/2022]
|
7
|
Popat H, Richmond S, Playle R, Marshall D, Rosin PL, Cosker D. Three-dimensional motion analysis - an exploratory study. Part 1: Assessment of facial movement. Orthod Craniofac Res 2008; 11:216-23. [DOI: 10.1111/j.1601-6343.2008.00433.x] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|