Cost-efficient measurement strategies for posture observations based on video recordings

Cost and statistical efficiency of posture assessment by inclinometry and observation, exemplified by paper mill work

Postures at work are paramount in ergonomics. They can be determined using observation and inclinometry in a variety of measurement scenarios that may differ both in costs associated with collecting and processing data, and in efficiency, i.e. the precision of the eventual outcome. The trade-off between cost and efficiency has rarely been addressed in research despite the obvious interest of obtaining precise data at low costs. Median trunk and upper arm inclination were determined for full shifts in 28 paper mill workers using both observation and inclinometry. Costs were estimated using comprehensive cost equations; and efficiency, i.e. the inverted standard deviation of the group mean, was assessed on basis of exposure variance components. Cost and efficiency were estimated in simulations of six sampling scenarios: two for inclinometry (sampling from one or three shifts) and four for observation (one or three observers rating one or three shifts). Each of the six scenarios was evaluated for 1 through 50 workers. Cost-efficiency relationships between the scenarios were intricate. As an example, inclinometry was always more cost-efficient than observation for trunk inclination, except for observation strategies involving only few workers; while for arm inclination, observation by three observers of one shift per worker outperformed inclinometry on three shifts up to a budget of €20000, after which inclinometry prevailed. At a budget of €10000, the best sampling scenario for arm inclination was 2.5 times more efficient than the worst. Arm inclination could be determined with better cost-efficiency than trunk inclination. Our study illustrates that the cost-efficiency of different posture measurement strategies can be assessed and compared using easily accessible diagrams. While the numeric examples in our study are specific to the investigated occupation, exposure variables, and sampling logistics, we believe that inclinometry will, in general, outperform observation. In any specific case, we recommend a thorough analysis, using the comparison procedure proposed in the present study, of feasible strategies for obtaining data, in order to arrive at an informed decision support.

Reliability and Validity of Six Selected Observational Methods for Risk Assessment of Hand Intensive and Repetitive Work

Risk assessments of hand-intensive and repetitive work are commonly done using observational methods, and it is important that the methods are reliable and valid. However, comparisons of the reliability and validity of methods are hampered by differences in studies, e.g., regarding the background and competence of the observers, the complexity of the observed work tasks and the statistical methodology. The purpose of the present study was to evaluate six risk assessment methods, concerning inter- and intra-observer reliability and concurrent validity, using the same methodological design and statistical parameters in the analyses. Twelve experienced ergonomists were recruited to perform risk assessments of ten video-recorded work tasks twice, and consensus assessments for the concurrent validity were carried out by three experts. All methods' total-risk linearly weighted kappa values for inter-observer reliability (when all tasks were set to the same duration) were lower than 0.5 (0.15-0.45). Moreover, the concurrent validity values were in the same range with regards to total-risk linearly weighted kappa (0.31-0.54). Although these levels are often considered as being fair to substantial, they denote agreements lower than 50% when the expected agreement by chance has been compensated for. Hence, the risk of misclassification is substantial. The intra-observer reliability was only somewhat higher (0.16-0.58). Regarding the methods ART (Assessment of repetitive tasks of the upper limbs) and HARM (Hand Arm Risk Assessment Method), it is worth noting that the work task duration has a high impact in the risk level calculation, which needs to be taken into account in studies of reliability. This study indicates that when experienced ergonomists use systematic methods, the reliability is low. As seen in other studies, especially assessments of hand/wrist postures were difficult to rate. In light of these results, complementing observational risk assessments with technical methods should be considered, especially when evaluating the effects of ergonomic interventions.

The non-explicit observational method is reproducible and valid in the analysis of occupational biomechanical exposure of workers

BACKGROUND: An analysis of workers’ exposure to biomechanical risk factors in the workplace with a high methodological quality allows for stronger evidence of the relationship between risk factors and musculoskeletal disorders. OBJECTIVE: To evaluate the measurement properties of non-explicit observational methods. METHODS: Psychometric study design that included 50 workers in an analysis of occupational tasks (n = 50 video tasks) using a non-explicit observational method, the Rapid Entire Body Assessment (REBA) method, and a workers’ self-report on their perception of their biomechanical occupational exposure. The reliability was tested by a non-explicit method and the REBA method. The validity of the non-explicit method was tested using the REBA method and the workers’ self-report, according to COSMIN guidelines. RESULTS: The intra- and inter-evaluator reliability of the non-explicit observational method ranged from moderate to strong (ICC2.1  = 0.45 to 0.87), and the agreement was acceptable (SEM = 0.60 to 2.79), expect for neck region. The REBA method showed intra-evaluator reliability to be moderate to excellent (ICC2.1  = 0.50 to 1.00), inter-evaluator reliability to be poor to strong (ICC2.1  = –0.17 to 0.83), and intra- and inter-evaluator agreement to be poor to moderate (SEM = 0.00 to 0.74). The concurrent validity between the non-explicit and REBA methods showed a strong positive correlation. CONCLUSION: The non-explicit observational method of biomechanical exposure analysis presented reproducible and valid measurement properties. Methods that present better measurement properties provide professionals with a better basis for analysis and assist in decision-making to reduce or eliminate risk exposure.

Exploring ergonomists' experiences after participation in a theoretical and practical research project on observational risk assessment tools

Objective. The aim of this qualitative study was to explore how ergonomists experienced an e-learning concept as a tool for knowledge translation; furthermore, to explore what, if any, impact the knowledge translation had regarding the ergonomists' work with risk assessments. Methods. Twelve Swedish ergonomists employed in the occupational health service (OHS) participated in a research project, which included an e-learning program in risk assessment training. Focus group interviews and individual interviews were used for data collection. Results. The ergonomists appreciated the e-learning concept, e.g., its flexibility enabled them to decide when and where to practice. The concept was considered feasible within the context of the OHS. The ergonomists experienced an increased knowledge of different observation-based risk assessment tools, which expanded their professional toolboxes. Additionally, they began to reflect more regarding the reliability of risk assessment tools and how to enhance quality in risk assessment assignments. Conclusion. This study showed that e-learning may comprise an efficient knowledge translation for improved risk assessments in the OHS. The program contributed to changes in ergonomists' risk assessment procedures, e.g., in the selection of tools, increasing the number of observers, employing a participatory approach and more often actively involving stakeholders during the risk assessment process.

Detection of kneeling and squatting during work using wireless triaxial accelerometers

Occupational kneeling and squatting are well-documented risk factors for knee disorders. A method using 3 wireless accelerometers to detect and discriminate kneeling and squatting during work were developed based on data from a semi-standardised laboratory protocol. The method was tested for validity under free-living working conditions. The developed method showed high sensitivity (88-99%) and specificity (98-99%) for detection of kneeling and squatting during the semi-standardised laboratory conditions. During free-living working conditions, kneeling showed very high sensitivity (94%) and specificity (99%), while squatting results were non-conclusive due to limited duration of squatting during the free-living working conditions. This method shows great promise for long-term technical measurement of kneeling and squatting during normal working conditions using wireless accelerometers. The method opens up possibilities for using technical measurements to provide valid exposure assessments and intervention evaluations of kneeling and squatting, as well as increased feasibility for technical measurements in large cohort studies. Practitioner summary: Quantification of kneeling and squatting during work is important for prevention, but limited by either imprecise or costly methods. This study developed and validated an inexpensive wireless accelerometer-based measurement method that can be used by practitioners and researchers for long-term measurements of kneeling and squatting during free-living working conditions.

The Quick Exposure Check (QEC) - Inter-rater reliability in total score and individual items

The development of musculoskeletal disorders has been linked to various risk factors in the work environment including lifting heavy loads, machine and materials handling, work postures, repetitive work, work with handheld vibrating tools, and work stress. The Quick Exposure Check (QEC) was designed to assess exposure to work-related musculoskeletal risk factors affecting the back, shoulder/arm, wrist/hand, and neck. We investigated the inter-rater reliability of the summary scores and individual items of the QEC by comparing two simultaneous assessments of 51 work tasks, performed by 14 different workers. The work tasks were mainly "light" to "moderately heavy". For total scores, the level of disagreement for shoulder/arm had a Relative Position of 0.13 (95% CI: 0.02; 0.23) and no statistically significant random disagreement. Percentage agreement was 63-100% for individual items and 71-88% for total score. Weighted Kappa of agreement for the individual items rated by the assessors were -0.94-0.77; highest for back motion, and lowest for wrist/hand position. The Swedish translation of the Quick Exposure Check has moderate to very good inter-rater reliability with fair to slight levels of systematic disagreement. There was no statistically significant random disagreement.

Correctness of Self-Reported Task Durations: A Systematic Review

Objectives

Duration of tasks in a job is an essential interest in occupational epidemiology. Such duration is frequently measured using self-reports, which may, however, be associated with both bias and random errors. The present systematic literature review examines the correctness of self-reported durations of tasks, i.e. the extent to which they differ from more valid reference data due to either systematic or random errors, and factors influencing this correctness, with particular emphasis on the assessment of exposures of relevance to musculoskeletal disorders.

Methods

The search for relevant studies included the databases ISI Web of Science, MEDLINE, EBSCO HOST, Proquest, and Psycnet.

Results

Thirty-two articles were identified; of which, 23 examined occupational tasks and 9 examined non-occupational tasks. Agreement between self-reports and a more correct reference was reported for, in total, 182 tasks. Average proportional errors were, for most tasks, between -50% (i.e. underestimations) and +100%, with a dominance of overestimations; 22% of all results considered overestimations of 100% or more. For 15% of the 182 reported tasks, the mean difference between the self-reported and the reference duration value was <5%, and 20% of the 182 mean differences were between 5 and 20%. In general, respondents were able to correctly distinguish tasks of a longer duration from shorter tasks, even though the actual durations were not correct. A number of factors associated with the task per se appeared to influence agreement between self-reports and reference data, including type of task, true task duration, task pattern across time (continuous versus discontinuous), and whether the addressed task is composed of subtasks. The musculoskeletal health status of the respondent did not have a clear effect on the ability to correctly report task durations. Studies differed in key design characteristics and detail of information reported, which hampers a formal aggregation of results.

Conclusions

The correctness of self-reported task durations is, at the best, moderate at the individual level, and this may present a significant problem when using self-reports in task-based assessment of individual job exposures. However, average self-reports at the group level appear reasonably correct and may thus be a viable method in studies addressing, for instance, the relative occurrence of tasks in a production system. Due to the disparity of studies, definite conclusions on the quantitative effect on agreement of different modifiers are not justified, and we encourage future studies specifically devoted to understanding and controlling sources of bias in self-reported task durations. We also encourage studies developing decision support for when to apply or avoid self-reports to measure task durations, depending on study purpose and occupational setting.

Uncertainty in monetary cost estimates for assessing working postures using inclinometry, observation or self-report

OBJECTIVE

To assess uncertainty in cost estimates for collecting posture data by inclinometry, observations and self-report.

METHOD

In a study addressing physical workloads at a paper mill, costs were calculated for measuring postures of twenty-eight workers during three shifts. Uncertainty in costs was assessed for all three methods as the range between an assumed best case (lowest cost) and worst case (highest cost) using scenario analysis.

RESULTS

The cost for observation was larger, but also more uncertain (€16506 and €89552 in the best and worst case, respectively) than that of inclinometry (€7613 - €45896). Self-report costs were both lower and less uncertain (€3743 - €23368).

CONCLUSIONS

The extent of uncertainty in cost estimates implies that observation could be less expensive than inclinometry, e.g., in a scenario where experienced observers could use existing software, while inclinometers would have to be purchased. We propose adding uncertainty assessments to cost estimates when selecting a method for measuring working postures, and offer guidance in how to proceed in a specific setting.

A Fitting Approach to Construct and Measurement Alignment

Many phenomena of interest to management and psychology scholars are dynamic and change over time. One of the primary impediments to the examination of dynamic phenomena has been challenges associated with collecting data at a sufficient frequency and duration to accurately model such changes. Emerging technologies that produce nearly continuous streams of big data offer great promise to address those challenges; however, they introduce new methodological challenges and construct validity concerns. We seek to integrate the emerging big data technologies into the existing repertoire of measurement techniques and advance an iterative process to enhance their measurement fit. First, we provide an overview of dynamic constructs and temporal frameworks, highlighting their measurement implications. Second, we discuss different data streams and feature emerging technologies that leverage big data as a means to index dynamic constructs. Third, we integrate the previous sections and advance an iterative approach to achieving measurement fit, highlighting factors that make some measurement choices more suitable and viable than others. In so doing, we hope to accelerate the advancement of dynamic theories and methods.

A practical guidance for assessments of sedentary behavior at work: A PEROSH initiative

Sedentary behavior is defined as sitting or lying with low energy expenditure. Humans in industrialized societies spend an increasing amount of time in sedentary behaviors every day. This has been associated with detrimental health outcomes. Despite a growing interest in the health effects of sedentary behavior at work, associations remain unclear, plausibly due to poor and diverse methods for assessing sedentary behavior. Thus, good practice guidance for researchers and practitioners on how to assess occupational sedentary behavior are needed. The aim of this paper is to provide a practical guidance for practitioners and researchers on how to assess occupational sedentary behavior. Ambulatory systems for use in field applications (wearables) are a promising approach for sedentary behavior assessment. Many different small-size consumer wearables, with long battery life and high data storage capacity are commercially available today. However, no stand-alone commercial system is able to assess sedentary behavior in accordance with its definition. The present paper offers decision support for practitioners and researchers in selecting wearables and data collection strategies for their purpose of study on sedentary behavior. Valid and reliable assessment of occupational sedentary behavior is currently not easy. Several aspects need to be considered in the decision process on how to assess sedentary behavior. There is a need for development of a cheap and easily useable wearable for assessment of occupational sedentary behavior by researchers and practitioners.

Inter- and intra- observer reliability of risk assessment of repetitive work without an explicit method

A common way to conduct practical risk assessments is to observe a job and report the observed long term risks for musculoskeletal disorders. The aim of this study was to evaluate the inter- and intra-observer reliability of ergonomists' risk assessments without the support of an explicit risk assessment method. Twenty-one experienced ergonomists assessed the risk level (low, moderate, high risk) of eight upper body regions, as well as the global risk of 10 video recorded work tasks. Intra-observer reliability was assessed by having nine of the ergonomists repeat the procedure at least three weeks after the first assessment. The ergonomists made their risk assessment based on his/her experience and knowledge. The statistical parameters of reliability included agreement in %, kappa, linearly weighted kappa, intraclass correlation and Kendall's coefficient of concordance. The average inter-observer agreement of the global risk was 53% and the corresponding weighted kappa (K_w) was 0.32, indicating fair reliability. The intra-observer agreement was 61% and 0.41 (K_w). This study indicates that risk assessments of the upper body, without the use of an explicit observational method, have non-acceptable reliability. It is therefore recommended to use systematic risk assessment methods to a higher degree.

Ergonomic analysis of construction worker's body postures using wearable mobile sensors

Construction jobs are more labor-intensive compared to other industries. As such, construction workers are often required to exceed their natural physical capability to cope with the increasing complexity and challenges in this industry. Over long periods of time, this sustained physical labor causes bodily injuries to the workers which in turn, conveys huge losses to the industry in terms of money, time, and productivity. Various safety and health organizations have established rules and regulations that limit the amount and intensity of workers' physical movements to mitigate work-related bodily injuries. A precursor to enforcing and implementing such regulations and improving the ergonomics conditions on the jobsite is to identify physical risks associated with a particular task. Manually assessing a field activity to identify the ergonomic risks is not trivial and often requires extra effort which may render it to be challenging if not impossible. In this paper, a low-cost ubiquitous approach is presented and validated which deploys built-in smartphone sensors to unobtrusively monitor workers' bodily postures and autonomously identify potential work-related ergonomic risks. Results indicates that measurements of trunk and shoulder flexions of a worker by smartphone sensory data are very close to corresponding measurements by observation. The proposed method is applicable for workers in various occupations who are exposed to WMSDs due to awkward postures. Examples include, but are not limited to industry laborers, carpenters, welders, farmers, health assistants, teachers, and office workers.

3D peak and cumulative low back and shoulder loads and postures during greenhouse pepper harvesting using a video-based approach

BACKGROUND

In agricultural field work many tasks have been cited as high priority risk factors for the development of work-related musculoskeletal disorders (WRMDs). Although video-based biomechanical approaches have been effective in documenting the physical demands and risks associated with various occupational and non-occupational tasks, to date, this method has yet to be used to document jobs such as crop harvesting in a greenhouse environment.

OBJECTIVE

To document and assess the postural characteristics and 3D peak and cumulative low back and shoulder loads associated with greenhouse pepper harvesting using a video-based posture sampling approach.

METHODS

Nine male (28.2 (4.1) years) pepper harvesters from a greenhouse in Southwestern Ontario, Canada were videotaped during a normal shift. 3DMatch was used to document working trunk and shoulder postures, from which 3D peak and cumulative forces and moments were quantified.

RESULTS

On average, workers spent the majority of their time in neutral trunk postures (lateral bend: 99.1%; axial twist: 59.9%; flexion: 89.8%). Consistent results were found for the left and right shoulder, with the arms held in a neutral flexion posture 50% of the time or more. Four participants experienced peak L4/L5 compression forces (between 4116.3 N and 5937.0 N) which exceeded the NIOSH Action Limit (3400 N) during the cart pushing/pulling task, but remained below the threshold during picking. Mean cumulative L4/L5 extension and shoulder flexion moments ranged in magnitude from 18.5 Nm to 28.2 Nm, and between 19.4 Nm and 23.2 Nm, respectively, across all tasks.

CONCLUSIONS

The postural characteristics and biomechanical loads associated with greenhouse pepper harvesting were quantified with a video-based biomechanical approach. Further investigations of the physical risk factors for low back and shoulder musculoskeletal disorders is warranted in pepper harvesting, given the postures and loads documented in this study.

Observer variability in posture assessment from video recordings: The effect of partly visible periods

Observers rank partly visible postures on video frames differently than fully visible postures, but it's not clear if this is due to differences in observer perception. This study investigated the effect of posture visibility on between-observer variability in assessments of trunk and arm posture. Trained observers assessed trunk and arm postures from video recordings of 84 pulp mill shifts using a work sampling approach; postures were also categorized as 'fully' or 'partly' visible. Between-worker, between-day, and between-observer variance components and corresponding confidence intervals were calculated. Although no consistent gradient was seen for the trunk, right upper arm posture showed smaller between-observer variance when all observers rated a posture as fully visible. This suggests that, partly-visible data, especially when observers disagree as to the level of visibility, introduces more between-observer variability when compared to fully visible data. Some previously-identified differences in daily posture summaries may be related to this phenomenon.

Observer performance in estimating upper arm elevation angles under ideal viewing conditions when assisted by posture matching software

Selecting a suitable body posture measurement method requires performance indices of candidate tools. Such data are lacking for observational assessments made at a high degree of resolution. The aim of this study was to determine the performance (bias and between- and within-observer variance) of novice observers estimating upper arm elevation postures assisted by posture matching software to the nearest degree from still images taken under ideal conditions. Estimates were minimally biased from true angles: the mean error across observers was less than 2°. Variance between observers was minimal. Considerable variance within observers, however, underlined the risk of relying on single observations. Observers were more proficient at estimating 0° and 90° postures, and less proficient at 60°. Thus, under ideal visual conditions observers, on average, proved proficient at high resolution posture estimates; further investigation is required to determine how non-optimal image conditions, as would be expected from occupational data, impact proficiency.

Reliability and criterion validity of an observation protocol for working technique assessments in cash register work

We evaluated the intra- and inter-observer reliability and criterion validity of an observation protocol, developed in an iterative process involving practicing ergonomists, for assessment of working technique during cash register work for the purpose of preventing upper extremity symptoms. Two ergonomists independently assessed 17 15-min videos of cash register work on two occasions each, as a basis for examining reliability. Criterion validity was assessed by comparing these assessments with meticulous video-based analyses by researchers. Intra-observer reliability was acceptable (i.e. proportional agreement >0.7 and kappa >0.4) for 10/10 questions. Inter-observer reliability was acceptable for only 3/10 questions. An acceptable inter-observer reliability combined with an acceptable criterion validity was obtained only for one working technique aspect, 'Quality of movements'. Thus, major elements of the cashiers' working technique could not be assessed with an acceptable accuracy from short periods of observations by one observer, such as often desired by practitioners. Practitioner Summary: We examined an observation protocol for assessing working technique in cash register work. It was feasible in use, but inter-observer reliability and criterion validity were generally not acceptable when working technique aspects were assessed from short periods of work. We recommend the protocol to be used for educational purposes only.

Toward Unobtrusive Patient Handling Activity Recognition for Injury Reduction Among At-Risk Caregivers

Nurses regularly perform patient handling activities. These activities with awkward postures expose healthcare providers to a high risk of overexertion injury. The recognition of patient handling activities is the first step to reduce injury risk for caregivers. The current practice on workplace activity recognition is based on human observational approach, which is neither accurate nor projectable to a large population. In this paper, we aim at addressing these challenges. Our solution comprises a smart wearable device and a novel spatio-temporal warping (STW) pattern recognition framework. The wearable device, named Smart Insole 2.0, is equipped with a rich set of sensors and can provide an unobtrusive way to automatically capture the information of patient handling activities. The STW pattern recognition framework fully exploits the spatial and temporal characteristics of plantar pressure by calculating a novel warped spatio-temporal distance, to quantify the similarity for the purpose of activity recognition. To validate the effectiveness of our framework, we perform a pilot study with eight subjects, including eight common activities in a nursing room. The experimental results show the overall classification accuracy achieves 91.7%. Meanwhile, the qualitative profile and load level can also be classified with accuracies of 98.3% and 92.5%, respectively.

A Comparison of Two Strategies for Building an Exposure Prediction Model

Cost-efficient assessments of job exposures in large populations may be obtained from models in which 'true' exposures assessed by expensive measurement methods are estimated from easily accessible and cheap predictors. Typically, the models are built on the basis of a validation study comprising 'true' exposure data as well as an extensive collection of candidate predictors from questionnaires or company data, which cannot all be included in the models due to restrictions in the degrees of freedom available for modeling. In these situations, predictors need to be selected using procedures that can identify the best possible subset of predictors among the candidates. The present study compares two strategies for selecting a set of predictor variables. One strategy relies on stepwise hypothesis testing of associations between predictors and exposure, while the other uses cluster analysis to reduce the number of predictors without relying on empirical information about the measured exposure. Both strategies were applied to the same dataset on biomechanical exposure and candidate predictors among computer users, and they were compared in terms of identified predictors of exposure as well as the resulting model fit using bootstrapped resamples of the original data. The identified predictors were, to a large part, different between the two strategies, and the initial model fit was better for the stepwise testing strategy than for the clustering approach. Internal validation of the models using bootstrap resampling with fixed predictors revealed an equally reduced model fit in resampled datasets for both strategies. However, when predictor selection was incorporated in the validation procedure for the stepwise testing strategy, the model fit was reduced to the extent that both strategies showed similar model fit. Thus, the two strategies would both be expected to perform poorly with respect to predicting biomechanical exposure in other samples of computer users.

Partly visible periods in posture observation from video: prevalence and effect on summary estimates of postures in the job

This paper investigated the extent to which observers rated clearly visible postures on video differently from partly visible postures, and whether visibility affected full-shift posture summaries. Trunk and upper arm postures were observed from 10,413 video frames representing 80 shifts of baggage handling; observers reported postures as fully or only partly visible. Postures were summarized for each shift into several standard metrics using all available data, only fully visible frames, or only partly visible frames. 78% of trunk and 70% of upper arm postural observations were inferred. When based on all data, mean and 90th percentile trunk postures were 1.8° and 5.6° lower, respectively, than when based only on fully visible situations. For the arm; differences in mean and 90th percentile were 0.7° and 8.2°. Daily posture summaries were significantly influenced by whether partly visible postures are included or not.

Is what you see what you get? Standard inclinometry of set upper arm elevation angles

Previous research suggests inclinometers (INC) underestimate upper arm elevation. This study was designed to quantify possible bias in occupationally relevant postures, and test whether INC performance could be improved using calibration. Participants were meticulously positioned in set arm flexion and abduction angles between 0° and 150°. Different subject-specific and group-level regression models comprising linear and quadratic components describing the relationship between set and INC-registered elevation were developed using subsets of data, and validated using additional data. INC measured arm elevation showed a downward bias, particularly above 60°. INC data adjusted using the regression models were superior to unadjusted data; a subject-specific, two-point calibration based on measurements at 0° and 90° gave results closest to the 'true' set angles. Thus, inclinometer measured arm elevation data required calibration to arrive at 'true' elevation angles. Calibration to a common measurement scale should be considered when comparing arm elevation data collected using different methods.

Statistical performance of observational work sampling for assessment of categorical exposure variables: a simulation approach illustrated using PATH data

Objectives:

Observational work sampling is often used in occupational studies to assess categorical biomechanical exposures and occurrence of specific work tasks. The statistical performance of data obtained by work sampling is, however, not well understood, impeding informed measurement strategy design. The purpose of this study was to develop a procedure for assessing the statistical properties of work sampling strategies evaluating categorical exposure variables and to illustrate the usefulness of this procedure to examine bias and precision of exposure estimates from samples of different sizes.

Methods:

From a parent data set of observations on 10 construction workers performing a single operation, the probabilities were determined for each worker of performing four component tasks and working in four mutually exclusive trunk posture categories (neutral, mild flexion, severe flexion, twisted). Using these probabilities, 5000 simulated data sets were created via probability-based resampling for each of six sampling strategies, ranging from 300 to 4500 observations. For each strategy, mean exposure and exposure variability metrics were calculated at both the operation level and task level and for each metric, bias and precision were assessed across the 5000 simulations.

Results:

Estimates of exposure variability were substantially more uncertain at all sample sizes than estimates of mean exposures and task proportions. Estimates at small sample sizes were also biased. With only 600 samples, proportions of the different tasks and of working with a neutral trunk posture (the most common) were within 10% of the true target value in at least 80% of all the simulated data sets; rarer exposures required at least 1500 samples. For most task-level mean exposure variables and for all operation-level and task-level estimates of exposure variability, performance was low, even with 4500 samples. In general, the precision of mean exposure estimates did not depend on the exposure variability between workers.

Conclusions:

The suggested probability-based simulation approach proved to be versatile and generally suitable for assessing bias and precision of data collection strategies using work sampling to estimate categorical data. The approach can be used in both real and hypothetical scenarios, in ergonomics, as well as in other areas of occupational epidemiology and intervention research. The reported statistical properties associated with sample size are likely widely relevant to studies using work sampling to assess categorical variables.

Data processing costs for three posture assessment methods

Background

Data processing contributes a non-trivial proportion to total research costs, but documentation of these costs is rare. This paper employed a priori cost tracking for three posture assessment methods (self-report, observation of video, and inclinometry), developed a model describing the fixed and variable cost components, and simulated additional study scenarios to demonstrate the utility of the model.

Methods

Trunk and shoulder postures of aircraft baggage handlers were assessed for 80 working days using all three methods. A model was developed to estimate data processing phase costs, including fixed and variable components related to study planning and administration, custom software development, training of analysts, and processing time.

Results

Observation of video was the most costly data processing method with total cost of € 30,630, and was 1.2-fold more costly than inclinometry (€ 26,255), and 2.5-fold more costly than self-reported data (€ 12,491). Simulated scenarios showed altering design strategy could substantially impact processing costs. This was shown for both fixed parameters, such as software development and training costs, and variable parameters, such as the number of work-shift files processed, as well as the sampling frequency for video observation. When data collection and data processing costs were combined, the cost difference between video and inclinometer methods was reduced to 7%; simulated data showed this difference could be diminished and, even, reversed at larger study sample sizes. Self-report remained substantially less costly under all design strategies, but produced alternate exposure metrics.

Conclusions

These findings build on the previously published data collection phase cost model by reporting costs for post-collection data processing of the same data set. Together, these models permit empirically based study planning and identification of cost-efficient study designs.