The Effectiveness of Educational Training or Multicomponent Programs to Prevent the Use of Physical Restraints in Nursing Home Settings: A Systematic Review and Meta-Analysis of Experimental Studies

Nursing students' experiences regarding physical restraint use in long-term care facilities: A qualitative descriptive study

BACKGROUND

Despite many harmful effects, physical restraints are still used in long-term care facilities. Most existing studies have focused on staff. Nursing students observe staff's use of restraints during gerontological nursing practicums, but there are few studies on nursing students' experiences regarding restraint use in long-term care settings.

OBJECTIVE

This study aimed to explore nursing students' experiences with physical restraint use in order to enhance nursing education and improve care quality in long-term care facilities.

METHODS

Using convenience sampling method, three nursing schools from three provinces were recruited. Twenty-six senior undergraduate nursing students who had taken a gerontological nursing practicum course participated in this study. A qualitative descriptive method was utilized to provide a clear account of the students' experiences. In-depth interviews were conducted using a semi-structured interview guide. Thematic analysis was used for data analysis.

RESULTS

Four themes were identified, which included overuse of restraints, ambivalent response to restraints, becoming accustomed to restraints, and lack of education regarding restraints. Students frequently observed the use of various restraints, which elicited both negative and positive responses, ultimately leading to their desensitization to the overuse of restraints. They expressed a lack of knowledge and educational needs regarding restraint reduction.

CONCLUSION

Nursing students encountered the overuse of various restraints, exhibited ambivalent responses, and became desensitized to this practice in long-term care facilities. They perceived a lack of education and educational needs regarding restraint reduction. This study adds important new knowledge to existing literature and provides important insights into restraint use in long-term care facilities. Future studies need to develop and evaluate educational programs for restraint-free and person-centered care targeting nursing students. Long-term care facilities should offer organizational support and implement continuous mandatory training to promote restraint-free care.

Nursing Ethical Decision Making on Adult Physical Restraint: A Scoping Review

OBJECTIVE

to map the existing knowledge on nursing ethical decision making in the physical restraint of hospitalised adults. (1) Background: physical restraint is a technique that conditions the free movement of the body, with risks and benefits. The prevalence of physical restraint in healthcare suffers a wide variation, considering the environment or pathology, and it raises ethical issues that hinders decision making. This article intends to analyse and discuss this problem, starting from a literature review that will provoke a grounded discussion on the ethical and legal aspects. Inclusion criteria are: studies on physical restraint (C) and ethical nursing decision making (C) in hospitalized adults (P); (2) methods: a three-step search strategy was used according to the JBI. The databases consulted were CINAHL Plus with Full Text (EBSCOhost), MEDLINE Full Text (EBSCOhost), Nursing and Allied Health Collection: Comprehensive and Cochrane Database of Systematic Reviews (by Cochrane Library, RCAAP and Google Scholar. All articles were analysed by two independent reviewers; (3) results: according to the inclusion criteria, 18 articles were included. The categories that influence ethical decision in nursing are: consequence of the decision, the context, the nature of the decision in terms of its complexity, the principles of the ethical decision in nursing, ethical issues and universal values; (4) conclusions: the findings of this review provide evidence that there is extensive knowledge regarding nursing ethical decision making in adult physical restriction, also, it is considered an ethical issue with many associated assumptions. In this article we aim to confront all these issues from a legal perspective.

Physical restraints in nursing homes: A qualitative study with multiple stakeholders

AIM

This study aims to understand the perceptions regarding physical restraints of the elder-care professional's stakeholders.

DESIGN

A qualitative methodology was employed.

METHODS

Semi-structured interviews were conducted with a convenient sample of 19 participants, which included nursing homes' managers, nurses and physicians; law, ethics, quality or patient rights' protection experts in care and public servers with responsibilities in the field. The data were collected, recorded and verbatim transcribed. A thematic analysis approach was used to analyse the data.

RESULTS

Three main themes emerged: the use of restraints, organizational issues and regulation. Although professionals involved in nursing care agree that improvements have been made, they highlight the negative impact of restraints and the need for a change in culture about their use. Yet, they have concerns about the 'zero restraints' feasibility, with divergent views on the need for a stronger regulatory framework.

District nurses' experiences with involuntary treatment in dementia care at home: a qualitative descriptive study

BACKGROUND

Research shows that half of person(s) living with dementia (PLWD) receive care which they resist and/or have not given consent to, defined as involuntary treatment. District nurses play a key role in providing this care. Knowledge about how district nurses experience involuntary treatment is lacking. Therefore, the aim of this study was to describe the experiences of district nurses who used involuntary treatment for PLWD at home.

METHODS

A qualitative descriptive design using semi-structured interviews. Sixteen district nurses with experience in involuntary treatment for PLWD were recruited through purposive sampling. Data were analysed using the Qualitative Analysis Guide of Leuven.

RESULTS

District nurses' experiences with involuntary treatment were influenced by their involvement in the decision-making process. When they were involved, they considered involuntary treatment use to be appropriate care. However, at the moment that involuntary treatment use was started, district nurses were worried that its use was unjust since they wished to respect the wishes of the PLWD. Eventually, district nurses found, from a professional perspective, that involuntary treatment use was necessary, and that safety outweighed the autonomy of the PLWD. District nurses experienced dealing with this dilemma as stressful, due to conflicting values. If district nurses were not involved in the decision-making process regarding the use of involuntary treatment, family caregivers generally decided on its use. Often, district nurses perceived this request as inappropriate dementia care and they first tried to create a dialogue with the family caregivers to reach a compromise. However, in most cases, family caregivers stood by their request and the district nurse still provided involuntary treatment and found this difficult to tolerate.

CONCLUSIONS

Our results show that district nurses experience involuntary treatment use as stressful due to dealing with obverse values of safety versus autonomy. To prevent involuntary treatment use and obverse values, we need to increase their ethical awareness, communication skills, knowledge and skills with person-centred care so they can deal with situations that can evolve into involuntary treatment use in a person-centred manner.

Professional caregivers' perceived barriers hindering the prevention and reduction of involuntary treatment among older persons receiving long-term care: A mixed methods study

AIMS

To gain insights into the barriers towards the prevention and/or reduction of involuntary treatment in long-term geriatric care.

DESIGN

Mixed methods.

BACKGROUND

Measures to which a person resists and/or does not provide consent for are defined as involuntary treatment. The use of involuntary treatment violates the autonomy of (older) persons and causes more harm than benefit. Moreover, it contradicts the values of person-centred care. Nevertheless, its use among people living with dementia (PLWD) is still common practice.

METHODS

We conducted a cross-sectional, mixed methods study, including an online survey for professional caregivers and a semistructured focus group interview with professional caregivers.

RESULTS

A total of 218 participants completed the questionnaire. The percentage of participants who perceived barriers in one of the 22 survey items ranged from 15% to 42%. Lack of time, the experienced need to use involuntary treatment, uncertainty about responsibilities of stakeholders and a lack of knowledge on methods to prevent and/or reduce the use of involuntary treatment were most seen as barriers. Nursing staff perceived a lack of time hindering them in the prevention or reduction of involuntary treatment more often than other professional caregivers. Working in home care and having no former experience with involuntary treatment usage increased perceived barriers. Participants of the focus group interview confirmed these findings and added that professional caregivers in general lack awareness on the concept of involuntary treatment.

CONCLUSIONS

One out of four professional caregivers experiences barriers hindering prevention and/or reduction of involuntary treatment. More research is needed to gain a better understanding of how professional caregivers can be supported to remove barriers and, consequently, prevent and/or reduce the use of involuntary treatment.

RELEVANCE TO CLINICAL PRACTICE

Professional caregivers experience many barriers towards the prevention and reduction of involuntary treatment. Future initiatives should aim to remove the perceived barriers.

Interventions for preventing and reducing the use of physical restraints for older people in all long-term care settings

BACKGROUND

Physical restraints (PR), such as bedrails and belts in chairs or beds, are commonly used for older people receiving long-term care, despite clear evidence for the lack of effectiveness and safety, and widespread recommendations that their use should be avoided. This systematic review of the efficacy and safety of interventions to prevent and reduce the use of physical restraints outside hospital settings, i.e. in care homes and the community, updates our previous review published in 2011.

OBJECTIVES

To evaluate the effects of interventions to prevent and reduce the use of physical restraints for older people who require long-term care (either at home or in residential care facilities) SEARCH METHODS: We searched ALOIS, the Cochrane Dementia and Cognitive Improvement Group's register, MEDLINE (Ovid Sp), Embase (Ovid SP), PsycINFO (Ovid SP), CINAHL (EBSCOhost), Web of Science Core Collection (ISI Web of Science), LILACS (BIREME), ClinicalTrials.gov and the World Health Organization's meta-register, the International Clinical Trials Registry Portal, on 3 August 2022.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and controlled clinical trials (CCTs) that investigated the effects of interventions intended to prevent or reduce the use of physical restraints in older people who require long-term care. Studies conducted in residential care institutions or in the community, including patients' homes, were eligible for inclusion. We assigned all included interventions to categories based on their mechanisms and components.

DATA COLLECTION AND ANALYSIS

Two review authors independently selected the publications for inclusion, extracted study data, and assessed the risk of bias of all included studies. Primary outcomes were the number or proportion of people with at least one physical restraint, and serious adverse events related to PR use, such as death or serious injuries. We performed meta-analyses if necessary data were available. If meta-analyses were not feasible, we reported results narratively. We used GRADE methods to describe the certainty of the evidence.

MAIN RESULTS

We identified six new studies and included 11 studies with 19,003 participants in this review update. All studies were conducted in long-term residential care facilities. Ten studies were RCTs and one study a CCT. All studies included people with dementia. The mean age of the participants was approximately 85 years. Four studies investigated organisational interventions aiming to implement a least-restraint policy; six studies investigated simple educational interventions; and one study tested an intervention that provided staff with information about residents' fall risk. The control groups received usual care only in most studies although, in two studies, additional information materials about physical restraint reduction were provided. We judged the risk of selection bias to be high or unclear in eight studies. Risk of reporting bias was high in one study and unclear in eight studies. The organisational interventions intended to promote a least-restraint policy included a variety of components, such as education of staff, training of 'champions' of low-restraint practice, and components which aimed to facilitate a change in institutional policies and culture of care. We found moderate-certainty evidence that organisational interventions aimed at implementation of a least-restraint policy probably lead to a reduction in the number of residents with at least one use of PR (RR 0.86, 95% CI 0.78 to 0.94; 3849 participants, 4 studies) and a large reduction in the number of residents with at least one use of a belt for restraint (RR 0.54, 95% CI 0.40 to 0.73; 2711 participants, 3 studies). No adverse events occurred in the one study which reported this outcome. There was evidence from one study that organisational interventions probably reduce the duration of physical restraint use. We found that the interventions may have little or no effect on the number of falls or fall-related injuries (low-certainty evidence) and probably have little or no effect on the number of prescribed psychotropic medications (moderate-certainty evidence). One study found that organisational interventions result in little or no difference in quality of life (high-certainty evidence) and another study found that they may make little or no difference to agitation (low-certainty evidence). The simple educational interventions were intended to increase knowledge and change staff attitudes towards PR. As well as providing education, some interventions included further components to support change, such as ward-based guidance. We found pronounced between-group baseline imbalances in PR prevalence in some of the studies, which might have occurred because of the small number of clusters in the intervention and control groups. One study did not assess bedrails, which is the most commonly used method of restraint in nursing homes. Regarding the number of residents with at least one restraint, the results were inconsistent. We found very-low certainty evidence and we are uncertain about the effects of simple educational interventions on the number of residents with PR. None of the studies assessed or reported any serious adverse events. We found moderate-certainty evidence that simple educational interventions probably result in little or no difference in restraint intensity and may have little or no effect on falls, fall-related injuries, or agitation (low-certainty evidence each). Based on very low-certainty evidence we are uncertain about the effects of simple educational interventions on the number of participants with a prescription of at least one psychotropic medication. One study investigated an intervention that provided information about residents' fall risk to the nursing staff. We found low-certainty evidence that providing information about residents' fall risk may result in little or no difference in the mean number of PR or the number of falls. The study did not assess overall adverse events.

AUTHORS' CONCLUSIONS

Organisational interventions aimed to implement a least-restraint policy probably reduce the number of residents with at least one PR and probably largely reduce the number of residents with at least one belt. We are uncertain whether simple educational interventions reduce the use of physical restraints, and interventions providing information about residents' fall risk may result in little to no difference in the use of physical restraints. These results apply to long-term care institutions; we found no studies from community settings.

Theories for interventions to reduce physical and verbal abuse: A mixed methods review of the health and social care literature to inform future maternity care

Despite global attention, physical and verbal abuse remains prevalent in maternity and newborn healthcare. We aimed to establish theoretical principles for interventions to reduce such abuse. We undertook a mixed methods systematic review of health and social care literature (MEDLINE, SocINDEX, Global Index Medicus, CINAHL, Cochrane Library, Sept 29th 2020 and March 22nd 2022: no date or language restrictions). Papers that included theory were analysed narratively. Those with suitable outcome measures were meta-analysed. We used convergence results synthesis to integrate findings. In September 2020, 193 papers were retained (17,628 hits). 154 provided theoretical explanations; 38 were controlled studies. The update generated 39 studies (2695 hits), plus five from reference lists (12 controlled studies). A wide range of explicit and implicit theories were proposed. Eleven non-maternity controlled studies could be meta-analysed, but only for physical restraint, showing little intervention effect. Most interventions were multi-component. Synthesis suggests that a combination of systems level and behavioural change models might be effective. The maternity intervention studies could all be mapped to this approach. Two particular adverse contexts emerged; social normalisation of violence across the socio-ecological system, especially for 'othered' groups; and the belief that mistreatment is necessary to minimise clinical harm. The ethos and therefore the expression of mistreatment at each level of the system is moderated by the individuals who enact the system, through what they feel they can control, what is socially normal, and what benefits them in that context. Interventions to reduce verbal and physical abuse in maternity care should be locally tailored, and informed by theories encompassing all socio-ecological levels, and the psychological and emotional responses of individuals working within them. Attention should be paid to social normalisation of violence against 'othered' groups, and to the belief that intrapartum maternal mistreatment can optimise safe outcomes.

The optimal intervention for preventing physical restraints among older adults living in the nursing home: A systematic review

AIM

This study aimed to evaluate the effectiveness of restraint reduction programs for nursing home care providers in enforcing physical restraint on residents and identify the best strategies for such programs.

DESIGN

Systematic Review.

METHODS

We searched for randomized controlled trials published until February 2021 for systematic review. The systematic review captured multifactorial interventions, education and consultation measures, including nursing home residents' and care providers' results. Study quality was assessed using the Cochrane Collaboration criteria.

RESULTS

In all seven trials, the interventions were led by a nurse specialist or unit leader and targeted at care providers. Five of the restraint reduction programs effectively reduced the rate of physical restraint use; two increased knowledge of restraint reduction for care providers; and one each promoted positive attitudes and behaviours. Duration of at least 6 weeks significantly improved the knowledge of care providers.

Effects and implementation of a minimized physical restraint program for older adults in nursing homes: A pilot study

Purpose

Physical restraint (PR) reduction interventions are currently exploring in developed regions with well-established welfare systems, whereas developing countries with fast population aging have not attracted enough attention. This China's pilot study evaluated the effects of a minimized PR program on restraint reduction and nursing assistants' knowledge, attitudes, intention, and practice toward PR and explored nursing assistants' experience of the program.

Patients and methods

This was a one-group, pretest, and posttest pilot trial with a nested qualitative descriptive study. A minimized PR program was obtained by summarizing the best evidence and was implemented in one Chinese nursing home with 102 older adults from December 18, 2020, to March 21, 2021. An educational program including three theoretical lectures and one operation training was first conducted for nursing assistants one-month period. The primary outcome was PR rate at 3 months. The secondary outcomes contained duration of restraints, types of restraints, the rate of correct PR use, the incidence of falls and/or fall-related injuries, and antipsychotics use at 3 months. Data on PR use and older adults' characteristics were collected through physical restraints observation forms and older adults' medical records. Nursing assistants' knowledge, attitude, intention, and practice toward PR were measured using the Staff Knowledge, Attitudes, and Practices Questionnaire regarding PR at 1 month. A semi-structured interview for two administrative staff and a focus group discussion with 13 nursing assistants were analyzed using content analysis to explore perspectives of intervention implementation at 3 months.

Results

There were a significant increase in knowledge, attitude, and practice and a decrease in intention of nursing assistants after 1-month educational intervention (P < 0.001). Furthermore, only the rate of correct PR increased and the duration of restraint in the daytime decreased significantly at 3 months (P < 0.05). There were no significant effects on PR rate and other secondary outcomes at follow-up. Qualitatively, nursing assistants demonstrated overtly supportive perspectives and that assistance from the program enhanced their knowledge and practice. They noted several challenges that impeded implementation.

Conclusion

The intervention has acknowledged some benefits and was valued by nursing assistants. Implementation barriers should be addressed before delivering in larger trials.

World guidelines for falls prevention and management for older adults: a global initiative

BACKGROUND

falls and fall-related injuries are common in older adults, have negative effects on functional independence and quality of life and are associated with increased morbidity, mortality and health related costs. Current guidelines are inconsistent, with no up-to-date, globally applicable ones present.

OBJECTIVES

to create a set of evidence- and expert consensus-based falls prevention and management recommendations applicable to older adults for use by healthcare and other professionals that consider: (i) a person-centred approach that includes the perspectives of older adults with lived experience, caregivers and other stakeholders; (ii) gaps in previous guidelines; (iii) recent developments in e-health and (iv) implementation across locations with limited access to resources such as low- and middle-income countries.

METHODS

a steering committee and a worldwide multidisciplinary group of experts and stakeholders, including older adults, were assembled. Geriatrics and gerontological societies were represented. Using a modified Delphi process, recommendations from 11 topic-specific working groups (WGs), 10 ad-hoc WGs and a WG dealing with the perspectives of older adults were reviewed and refined. The final recommendations were determined by voting.

RECOMMENDATIONS

all older adults should be advised on falls prevention and physical activity. Opportunistic case finding for falls risk is recommended for community-dwelling older adults. Those considered at high risk should be offered a comprehensive multifactorial falls risk assessment with a view to co-design and implement personalised multidomain interventions. Other recommendations cover details of assessment and intervention components and combinations, and recommendations for specific settings and populations.

CONCLUSIONS

the core set of recommendations provided will require flexible implementation strategies that consider both local context and resources.

Attitudes of Nursing Staff in Hospitals towards Restraint Use: A Cross-Sectional Study

The attitude of nursing staff towards restraint use can be decisive for whether restraints are used. So far, nursing staff’s attitudes have been studied primarily in long-term and mental health care settings, while findings from somatic acute care hospital settings are largely lacking. Therefore, we aimed to investigate (a) the attitudes of hospital nursing staff towards restraint use, and (b) the construct validity and reliability of a measurement instrument for use in hospital settings that was developed and validated in long-term care settings (Maastricht Attitude Questionnaire (MAQ)). Using a cross-sectional design, the attitudes of 180 nursing staff towards restraint use were assessed. The data were analysed descriptively and by means of regression analysis and factor analysis. We found that nursing staff in hospitals have a neutral attitude towards restraint use and that the MAQ, with minor adaptations, can be used in hospital settings, although further testing is recommended. Neutral attitudes of nursing staff have also been observed in long-term and mental health care settings, where changing attitudes were found to be challenging. Interventions at the national level (e.g., legal regulations) and management level (e.g., providing alternatives and changing institutional culture) are suggested.

Difference of Physical Restraint Knowledge, Attitudes and Practice Between Nurses and Nursing Assistants in Long-Term Care Facilities: A Cross-Sectional Study

Background

Purpose

Methods

Results

Conclusion

A Methodological Quality Evaluation of Meta-Analyses on Nursing Home Research: Overview and Suggestions for Future Directions

(1) Background: The nursing home (NH) research field lacks quality reporting about meta-analyses (MAs), and most gradings of MA evidence are biased on analyzing the effectiveness of independent variables in randomized control trials. (2) Objectives: This study aimed to perform a critical methodological review of MAs in the NH research field. (3) Methods: We searched the articles from four databases (PubMed, MEDLINE, CINAHL, and PsycINFO) until 15th January 2021. We reviewed a total of 41 published review articles in the NH research field. (4) Results: The studies primarily fell into the following categories: medicine (17/41), nursing (7/41), and psychiatry or psychology (6/41); 36.6% of the reviewed studies did not use any validated MA guidelines. The lowest correctly reported PRISMA 2000 guideline item was protocol and registration (14.6%), and more than 50% of articles did not report risk of bias. Moreover, 78.0% of studies did not describe missing reports of effect size formula. (5) Discussion: NH researchers must follow appropriate and updated guidelines for their MAs in order to provide validated reviews, as well as consider statistical issues such as the complexity of interventions, proper grouping, and scientific effect-size calculations to improve the quality of their study. Future quality review studies should investigate more diverse studies.

Between Restrictive and Supportive Devices in the Context of Physical Restraints: Findings from a Large Mixed-Method Study Design

Physical restraints are still a common problem across healthcare settings: they are triggered by patient-related factors, nurses, and context-related factors. However, the role of some devices (e.g., bed rails), and those applied according to relatives'/patients' requests have been little investigated to date. A mixed-method study in 2018, according to the Good Reporting of a Mixed Methods Study criteria was performed. In the quantitative phase, patients with one or more physical restraint(s) as detected through observation of a single index day in 37 Italian facilities (27 long-term, 10 hospital units, =4562 patients) were identified. Then, for each patient with one or more restraint(s), the nurse responsible was interviewed to gather purposes and reasons for physical restraints use. A thematic analysis of the narratives was conducted to (a) clarify the decision-making framework that had been used and (b) to assess the differences, if any, between hospital and long-term settings. The categories 'Restrictive' and 'Supportive' devices aimed at 'Preventing risks' and at 'Promoting support', respectively, have emerged. Reasons triggering 'restrictive devices' involved patients' risks, the health professionals' and/or the relatives' concerns. In contrast, the 'supportive' ones were triggered by patients' problems/needs. 'Restrictive' and 'Supportive' devices were applied based on the decision of the team or through a process of shared decision-making involving relatives and patients. According to the framework that emerged, long-term care patients are at increased risk of being treated with 'restrictive devices' (Odds Ratio 1.87, Confidence Interval 95% 1.44; 2.43; p < 0.001) as compared to those hospitalized. This study contributes to the improvement in knowledge of the definition, classification and measurement of physical devices across settings.

The Use of Physical Restraints on Geriatric Patients: Culture and Attitudes among Healthcare Professionals at Intermediate Care Hospitals in Majorca. A Qualitative Study Protocol

The use of physical restraints is a common practice in the care of hospitalised and institutionalised elderly people. This use is determined by factors related to the patients, their families, the healthcare professionals, the institution, and prevailing social values. Today, however, this practice is often questioned because of its physical, psychological, moral, ethical, and legal repercussions. The present study explores attitudes among healthcare professionals towards the physical restraint of geriatric patients in intermediate care hospitals in Majorca. This study is based on a qualitative design, combining an ethnomethodological approach with critical discourse analysis. The theoretical framework is drawn from Foucault’s work in this field and from Haslam’s theory of mechanisation. Individual interviews will be conducted with physicians, nurses, and nursing assistants at intermediate care hospitals in Majorca. The analysis will focus on these professionals’ knowledge, attitudes, and practices regarding the use of such measures, seeking to identify the factors, especially institutional factors, that determine the use of restraints. It is essential to determine the prevailing culture among healthcare professionals regarding the use of physical restraints on geriatric patients in order to design and propose a more dignified health care model in which such restraints are eliminated.

Effects of a Web-Based Educational Program Regarding Physical Restraint Reduction in Long-Term Care Settings on Nursing Students: A Cluster Randomized Controlled Trial

Physical restraint is still frequently used in many countries. However, a lack of education hinders physical restraint reduction in long-term care facilities. No study has yet to examine the effects of physical restraint reduction education on nursing students. This study aimed to evaluate the effects of a web-based educational program of physical restraint reduction on nursing students’ knowledge and perceptions. A cluster randomized controlled and single-blind design was used. This study was conducted at four nursing schools in South Korea. A total of 169 undergraduate nursing students completed this study. Using random allocation, two nursing schools (85 students) were allocated as the experimental group and the other two schools (84 students) as the control group. The experimental group received the web-based educational program, and the control group did not receive the educational program. Data were collected immediately before and after the web-based educational program. The experimental group’s knowledge and perceptions significantly improved between pre-test and post-test. The analysis of covariance showed statistically significant differences between groups in knowledge (p < 0.001) and perceptions (p < 0.001) over time, revealing positive effects of the web-based educational program. The web-based educational program regarding physical restraint reduction positively affected nursing students’ knowledge and perceptions. Future studies are required to examine the educational program’s longitudinal effects with more rigorous measurements and research methods.