Studies of Visual Inspection

Assessment of Aircraft Engine Blade Inspection Performance Using Attribute Agreement Analysis

Background—Visual inspection is an important element of aircraft engine maintenance to assure flight safety. Predominantly performed by human operators, those maintenance activities are prone to human error. While false negatives imply a risk to aviation safety, false positives can lead to increased maintenance cost. The aim of the present study was to evaluate the human performance in visual inspection of aero engine blades, specifically the operators’ consistency, accuracy, and reproducibility, as well as the system reliability. Methods—Photographs of 26 blades were presented to 50 industry practitioners of three skill levels to assess their performance. Each image was shown to each operator twice in random order, leading to N = 2600 observations. The data were statistically analysed using Attribute Agreement Analysis (AAA) and Kappa analysis. Results—The results show that operators were on average 82.5% consistent with their serviceability decision, while achieving an inspection accuracy of 67.7%. The operators’ reproducibility was 15.4%, as was the accuracy of all operators with the ground truth. Subsequently, the false-positive and false-negative rates were analysed separately to the overall inspection accuracy, showing that 20 operators (40%) achieved acceptable performances, thus meeting the required standard. Conclusions—In aviation maintenance the false-negative rate of <5% as per Aerospace Standard AS13100 is arguably the single most important metric since it determines the safety outcomes. The results of this study show acceptable false-negative performance in 60% of appraisers. Thus, there is the desirability to seek ways to improve the performance. Some suggestions are given in this regard.

Eye Movement and Pupil Measures: A Review

Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first describe the main oculomotor events studied in the literature, and their characteristics exploited by different measures. Next, we review various eye movement and pupil measures from prior literature. Finally, we discuss our observations based on applications of these measures, the benefits and practical challenges involving these measures, and our recommendations on future eye-tracking research directions.

Evaluation of Influence Factors on the Visual Inspection Performance of Aircraft Engine Blades

Background—There are various influence factors that affect visual inspection of aircraft engine blades including type of inspection, defect type, severity level, blade perspective and background colour. The effect of those factors on the inspection performance was assessed. Method—The inspection accuracy of fifty industry practitioners was measured for 137 blade images, leading to N = 6850 observations. The data were statistically analysed to identify the significant factors. Subsequent evaluation of the eye tracking data provided additional insights into the inspection process. Results—Inspection accuracies in borescope inspections were significantly lower compared to piece-part inspection at 63.8% and 82.6%, respectively. Airfoil dents (19.0%), cracks (11.0%), and blockage (8.0%) were the most difficult defects to detect, while nicks (100.0%), tears (95.5%), and tip curls (89.0%) had the highest detection rates. The classification accuracy was lowest for airfoil dents (5.3%), burns (38.4%), and tears (44.9%), while coating loss (98.1%), nicks (90.0%), and blockage (87.5%) were most accurately classified. Defects of severity level S1 (72.0%) were more difficult to detect than increased severity levels S2 (92.8%) and S3 (99.0%). Moreover, visual perspectives perpendicular to the airfoil led to better inspection rates (up to 87.5%) than edge perspectives (51.0% to 66.5%). Background colour was not a significant factor. The eye tracking results of novices showed an unstructured search path, characterised by numerous fixations, leading to longer inspection times. Experts in contrast applied a systematic search strategy with focus on the edges, and showed a better defect discrimination ability. This observation was consistent across all stimuli, thus independent of the influence factors. Conclusions—Eye tracking identified the challenges of the inspection process and errors made. A revised inspection framework was proposed based on insights gained, and support the idea of an underlying mental model.

Assessment of the Effect of Cleanliness on the Visual Inspection of Aircraft Engine Blades: An Eye Tracking Study

Background-The visual inspection of aircraft parts such as engine blades is crucial to ensure safe aircraft operation. There is a need to understand the reliability of such inspections and the factors that affect the results. In this study, the factor 'cleanliness' was analysed among other factors. Method-Fifty industry practitioners of three expertise levels inspected 24 images of parts with a variety of defects in clean and dirty conditions, resulting in a total of N = 1200 observations. The data were analysed statistically to evaluate the relationships between cleanliness and inspection performance. Eye tracking was applied to understand the search strategies of different levels of expertise for various part conditions. Results-The results show an inspection accuracy of 86.8% and 66.8% for clean and dirty blades, respectively. The statistical analysis showed that cleanliness and defect type influenced the inspection accuracy, while expertise was surprisingly not a significant factor. In contrast, inspection time was affected by expertise along with other factors, including cleanliness, defect type and visual acuity. Eye tracking revealed that inspectors (experts) apply a more structured and systematic search with less fixations and revisits compared to other groups. Conclusions-Cleaning prior to inspection leads to better results. Eye tracking revealed that inspectors used an underlying search strategy characterised by edge detection and differentiation between surface deposits and other types of damage, which contributed to better performance.

Evaluation of eye movements and visual performance in patients with cataract

Eye movement is an essential component of visual perception. Eye movement disorders have been observed in many eye disease, and are thought to affect various visual performance in daily life. However, eye movement behaviors of the elderly with cataract are poorly understood, and the impact of cataract surgery on eye movements has not been investigated. In this study, we observed the eye movement behaviors in thirty patients with bilateral age-related cataract while performing three performance-based tasks (visual search, face recognition and reading). Eye movements were automatically recorded by an eye tracker during task performance. We found an overall improved visual performance postoperatively, presented as elevated percentage of correctly identified objects and faces, reduced search time and increased reading speed. Eye movement parameters were found significantly altered after cataract surgery. Fixation count, total fixation duration and total visit duration were markedly increased in the visual search task and face recognition task. The proportion of regressive saccades was obviously decreased in the reading task. These eye movement parameters were found to be correlated with the measures of visual performance. Our findings suggested a potential association between the eye movement disturbance and impaired visual performance, and provided a new insight on the potential usefulness of eye movement as an objective and valid tool to understand visual impairments caused by cataract, as well as evaluate practical outcomes of cataract surgery.

Preliminary Study of Eye-Tracking During the Coil Insertion Task in a Silastic Model of Intracranial Aneurysms

OBJECTIVE

Surgical skills are generally acquired by watching the "hand movements" of experts. "Eye movements" are now attracting attention in skill-learning fields. Eye-tracking technology was introduced preliminarily to develop a better skill-learning system for neuroendovascular treatments.

METHODS

During a task to place a detachable coil into a silastic cerebral aneurysm model under biplane X-ray fluoroscopy, gaze points were recorded using a head-mount eye-tracking device.

RESULTS

During the task, 91% of fixations were allocated to the monitor displaying fluoroscopic images, and the others to the hands of operators or unspecified visual targets. More than 80% of fixations were located in frontal or lateral fluoroscopic images. Fixations were placed more frequently around the aneurysm than the microcatheter. One operator failed to recognize the timing when the proximal marker of the coil overlapped that of the microcatheter. The subject allocated most fixations to the frontal fluoroscopic image, whereas other subjects placed most fixations to the lateral fluoroscopic image. Furthermore, that operator put no fixations to the proximal marker of the microcatheter.

CONCLUSIONS

The results of this preliminary study imply the feasibility of the eye tracking-based learning system for neuroendovascular treatments. The eye-tracking analysis has potential in investigating or preventing procedural failures in neuroendovascular treatments.

Eye Movement Parameters for Performance Evaluation in Projection-based Stereoscopic Display

The current study applied Structural Equation Modeling (SEM) to analyze the rela-tionship among index of difficulty (ID) and parallax on eye gaze movement time (EMT), fixation duration (FD), time to first fixation (TFF), number of fixation (NF), and eye gaze accuracy (AC) simultaneously. EMT, FD, TFF, NF, and AC were measured in the projec-tion-based stereoscopic display by utilizing Tobii eye tracker system. Ten participants were recruited to perform multi-directional tapping task using within-subject design with three different levels of parallax and six different levels of ID. SEM proved that ID had significant direct effects on EMT, NF, and FD also a significant indirect effect on NF. However, ID was found not a strong predictor for AC. SEM also proved that parallax had significant direct effects on EMT, NF, FD, TFF, and AC. Apart from the direct effect, parallax also had significant indirect effects on NF and AC. Regarding the interrelation-ship among dependent variables, there were significant indirect effects of FD and TFF on AC. Our results concluded that higher AC was achieved by lowering parallax (at the screen), longer EMT, higher NF, longer FD, and longer TFF. Practitioner Summary: The SEM could provide valuable theoretical foundations of the interrelationship among eye movement parameters for VR researchers and human-virtual-reality interface developers especially for predicting eye gaze accuracy.

Influence of social presence on eye movements in visual search tasks

This study employed an eye-tracking technique to investigate the influence of social presence on eye movements in visual search tasks. A total of 20 male subjects performed visual search tasks in a 2 (target presence: present vs. absent) × 2 (task complexity: complex vs. simple) × 2 (social presence: alone vs. a human audience) within-subject experiment. Results indicated that the presence of an audience could evoke a social facilitation effect on response time in visual search tasks. Compared with working alone, the participants made fewer and shorter fixations, larger saccades and shorter scan path in simple search tasks and more and longer fixations, smaller saccades and longer scan path in complex search tasks when working with an audience. The saccade velocity and pupil diameter in the audience-present condition were larger than those in the working-alone condition. No significant change in target fixation number was observed between two social presence conditions. Practitioner Summary: This study employed an eye-tracking technique to examine the influence of social presence on eye movements in visual search tasks. Results clarified the variation mechanism and characteristics of oculomotor scanning induced by social presence in visual search.

Using a sharp instrument to parse apart strategy and consistency: an evaluation of PPT and its assumptions

Potential Performance Theory (PPT) is a general theory for parsing observed performance into the underlying strategy and the consistency with which it is used. Although empirical research has supported that PPT is useful, it is desirable to have more information about the bias and standard errors of PPT findings. It also is beneficial to know the effects of violations of PPT assumptions. The authors present computer simulations that evaluate bias and standard errors at varying levels of strategy, consistency, and number of trials per participant. The simulations show that, when the assumptions are true, there is very little bias and the standard errors are low when there are moderate or large numbers of trials per participant (e.g., N=50 or N=100). But when the independence assumption is violated, PPT provides biased findings, although the bias is quite small unless the violations are large.

Potential performance theory (PPT): describing a methodology for analyzing task performance

Based on potential performance theory (PPT), a methodological paradigm is developed that allows for individual-level analyses. The proposed methodology distinguishes among observed performance, strategy, and consistency, with the idea that changes in observed performance can be caused by changes in strategy or consistency. Equations are presented that allow the computation of strategy and consistency scores for groups and individuals, with the goal of enabling researchers to find the reasons why performance improves or does not improve. More specifically, people may (1) develop better strategies, (2) use them more consistently, (3) both, or (4) neither. It is even possible to have strategy-consistency trade-offs, as individuals focus on one at the expense of the other. Data obtained from an experiment illustrate these possibilities.

A breadth-first survey of eye-tracking applications

Eye-tracking applications are surveyed in a breadth-first manner, reporting on work from the following domains: neuroscience, psychology, industrial engineering and human factors, marketing/advertising, and computer science. Following a review of traditionally diagnostic uses, emphasis is placed on interactive applications, differentiating between selective and gaze-contingent approaches.

Deformation of the useful visual field with state of vigilance, task priority, and central task complexity

In a dual-task situation, peripheral perception can deteriorate due to different variables related to the experimental situation, such as central task complexity and the relative priority given to the two tasks. Recent studies have also shown that individual characteristics (such as the state of vigilance) can alter the useful visual field. The ability to perceive signals presented at different places in the visual field decreases in situations that lead to episodes of low vigilance. In Exp. 1, 27 subjects (18-29 years) had to perform a monotonous and prolonged dual-monitoring task involving central and peripheral vision. The test was carried out with two different sets of instructions regarding priority: the more important task was either the central task or the peripheral one. In Exp. 2, 18 subjects (18-30 years) performed the same test, but this time with two levels of complexity of the central task, either a simple monitoring activity or the same monitoring task coupled with a counting activity. Elliptical interpolation of the data enabled assessment of the deformation of the useful visual field in both experiments. The analysis of the parameters of the elliptical model indicated that the useful visual field mainly shrinks on the vertical axis, as the individual becomes drowsy. The useful visual field also shrinks on the horizontal axis when the peripheral task has priority and the monitoring activity is prolonged, or when the central task is complex.

Feedback strategies for visual search in airframe structural inspection

Feedback of information has consistently shown positive results in human inspection, provided it is given in a timely and appropriate manner. Feedback serves as the basis of most training schemes; traditionally this has been performance feedback. Other forms of feedback which provide strategy information rather than performance information may have a role in improving inspection. This study compared performance feedback and cognitive feedback in a realistic simulation of an aircraft structural inspection task. Performance (time, errors) feedback showed the greatest improvements in performance measures. Cognitive feedback enhanced efficiency measures of search strategy. When cognitive feedback consisted of visual representations of the path and the coverage of the search sequence, subjects also were able to use this task information to improve their search performance.

Relations between individual differences in oculomotor resting states and visual inspection performance

Individual differences in the oculomotor resting states (dark vergence and dark focus) have previously been linked to subjective and visual consequences of near visual work. The present experiment investigated whether these resting states are related also to performance on a near visual inspection task. Dark vergence and dark focus were measured in 38 students before and after they spent 40 min searching for a target letter among distractor letters on a video display terminal at a distance of 20 cm. Subjects with relatively near dark vergence positions performed the inspection task significantly more quickly than subjects with relatively far dark vergence positions. Also, subjects who showed a relatively large inward shift in dark vergence tended to perform quickly. Inspection performance was not related to individual differences in dark focus. These results extend existing oculomotor theory and suggest that the performance of visual inspectors is maximized when the mismatch between the task distance and their dark vergence posture is minimized.

Expertise, visual search, and information pick-up in squash

The visual search characteristics of expert and novice squash players were compared in two experiments. In the first experiment subjects were required to predict the forthcoming direction and force of an opponent's stroke from a film display. This film display was designed to simulate the normal display available to the defending player in squash and involved the use of variable temporal cut-offs to force the subjects to use advance cues in their prediction. Systematic differences in the information pick-up of the experts and novices were observed on the film task but these differences were achieved with only relatively minor between-group variations in visual search strategy. In the second experiment, set in the natural field setting, no expert-novice differences in either fixation distribution, order, or duration were observed on a comparable prediction task. This provided further support for the conclusion that the limiting factor in the perceptual performance of the novices is not an inappropriate search strategy but rather an inability to make full use of the information available from fixated display features. Some practical implications of these findings for the squash coach and player are considered.

Training of efficient oculomotor strategies enhances skill acquisition

The present study investigated the hypothesis that efficient oculomotor behaviours can be acquired through practice on a series of simple tasks and can be transferred subsequently to a complex visuomotor task, such as a video game. Each of two groups of subjects were exposed to a different set of simple tasks, or drills. One group, the efficient eye movement experimental group, received training designed to minimize eye movements and optimize scan path behaviours, whereas a second group of subjects, the inefficient eye movement experimental group, received training designed to increase the frequency of eye movements. Oculomotor training was interspersed with practice on the video game. Performance of these two experimental groups in the video game was compared to a control group playing the video game but receiving no specific training and matched for total time in the experiment. The group receiving efficient oculomotor training exhibited significantly superior performance in the video game and fewer foveations than either the inefficient or control groups, which did not differ from each other. Overall there was a significant inverse correlation between the number of foveations in the game and game score. The results of this study are discussed in terms of their implications for the importance of oculomotor training in the acquisition of any complex perceptual motor task.

The distribution of fixation durations in infants and naive adults

The distributions of durations of fixations from infants and free-viewing adults are shown to be basically exponential for different stimulus conditions. It is found that fixation duration can be divided into two periods. One, the alpha-period, is a refractory period during which a saccade does not occur and fluctuates across fixations. The other, the beta-period, is a random variable intrinsic to each fixation and constitutes a waiting-time for a saccade that occurs with constant probability per unit time. It is shown that mean duration decreases when stimulus size increases. These results suggest that fixations are terminated by saccades triggered by non-foveal stimulation.

A descriptive model of visual search

This study used the corneal reflection technique to investigate causes of miscounting in a dot-counting inspection task. An analysis of subjects' eye movements showed that there were two causes of miscounting: making fewer eye movements than the number of objects to be counted and overlooking objects present in the boundary of the visual field. The type of miscounting depended on the number of dots to be counted and the time allotted. Search process trade-off curves were developed that show the proportion of the two processes in a trial. These curves were incorporated into a descriptive model of visual search.

Eye movements and industrial inspection

A brief survey is given of the eye movement parameters which contribute to visual search strategies. The literature on eye movements and industrial inspection is reviewed and some recent studies carried out at the University of Birmingham into the eye movements underlying four inspection tasks are described. These tasks included the inspection of tin cans, electrical edge connectors, men's briefs and woven fabric.

The use of performance measures on individual examiners in inspection schemes

The paper is a summary of the more common measures that have been used, or suggested for use, in industry. A list of advantages and disadvantages for each measure is given, to indicate its value. Some general criteria for selecting a measure, and methods for obtaining the measure, are considered.

Factors affecting visual inspection accuracy

A four-fold classification of factors which might influence the extent of inspector accuracy is provided. It is emphasized that the influence of these factors has been mainly evaluated in the context of laboratory tasks which simulate real inspection tasks to a varying degree. For each of the four classes of factors one has been selected to illustrate its contribution to reducing inspector error. These are the inspector's visual acuity, the work-place lighting conditions, the time available for inspection and the provision of feedback or knowledge of results to the inspector. There is now sufficient evidence to confirm the advantages that can follow from careful consideration being given to these factors when designing or modifying industrial inspection tasks.

Aspects of inspection in a knitwear company

The paper presents some of the results of a preliminary study on inspection performance in industry. Four data-gathering exercises were carried out; two concerned with measuring the accuracy of the examiners, one attempted to elucidate some of the differences between 'good' and 'bad' examiners in terms of their perceptions and knowledge of the task, and one presented some of the results to management representatives for comment. The results are discussed briefly, and a number of general conclusions drawn. Examiners' detection performance for faults is of the order of 50%, in a production process where the fault rate is of the order of 50%. It is believed that part of the cause for the above performance is due to organisational aspects of the job design. Communication of relevant information regarding the above is virtually non-existent, which has allowed the situation to continue as it is, and has allowed the organisation to believe that a much better state of affair exists. This company is not unusual in the industry in the above respects.