Wearable Immersive Virtual Reality Device for Promoting Physical Activity in Parkinson's Disease Patients

Remote Digital Technologies for the Early Detection and Monitoring of Cognitive Decline in Patients With Type 2 Diabetes: Insights From Studies of Neurodegenerative Diseases

Type 2 diabetes (T2D) is a risk factor for cognitive decline. In neurodegenerative disease research, remote digital cognitive assessments and unobtrusive sensors are gaining traction for their potential to improve early detection and monitoring of cognitive impairment. Given the high prevalence of cognitive impairments in T2D, these digital tools are highly relevant. Further research incorporating remote digital biomarkers of cognition, behavior, and motor functioning may enable comprehensive characterizations of patients with T2D and may ultimately improve clinical care and equitable access to research participation. The aim of this commentary article is to review the feasibility, validity, and limitations of using remote digital cognitive tests and unobtrusive detection methods to identify and monitor cognitive decline in neurodegenerative conditions and apply these insights to patients with T2D.

An Exploratory Study on the Effects of Souchard Postural Gymnastics in Parkinson's Disease Patients with Camptocormia: A Quasi-Experimental Approach

Background/Objective: Parkinson's disease (PD), a prevalent neurodegenerative disorder, leads to motor and non-motor impairments, affecting quality of life. Camptocormia can be one of the motor signs of PD, characterized by a severe and abnormal forward flexion of the thoracolumbar spine that typically occurs when walking or standing. The following study aims to verify whether postural gymnastics can be an effective treatment for trunk control, balance, activities of daily living, and general well-being in patients with early-stage PD and camptocormia. Methods: Nine participants (mean age 67.7 ± 7.8) with early PD (Hoehn and Yahr Scale ≤ 2) received 10 biweekly physiotherapy sessions. Outcomes were measured using the Parkinson's Disease Questionnaire (PDQ-39) and Berg Balance Scale (BBS) along with trunk mobility and muscle tests according to the Medical Research Council (MRC) scale. Results: Statistically significant results were noted in the PDQ-39 mobility, ADLs and emotional well-being subscales and in the BBS; statistically significant improvements were also seen in trunk mobility and muscle strength. Conclusions: This study shows that the postural gymnastic treatment, according to Souchard, in patients with PD's camptocormia has obtained good results and has the potential timprove mobility and balance, encouraging and motivating patients in their rehabilitation journeys.

Exergames and Immersive Virtual Reality as a Novel Therapy Approach in Multiple Sclerosis: Randomised Feasibility Study

Background: Multiple sclerosis is a chronic, inflammatory, neurodegenerative autoimmune disease caused by myelin loss in the central nervous system, which leads to motor and non-motor problems. The main objective of this study was to explore whether an immersive virtual reality (IVR) exercise programme would be feasible as a form of physical therapy for people with MS (pwMS). Methods: 18 participants (13 women; 45.06 years) were assigned to an experimental group (EG, n = 8) and a control group (CG, n = 10). The EG took part in a twice-weekly IVR exergame physical therapy programme-ExeRVIEM programme. A randomised, single-blind clinical trial was conducted and was registered in clinicaltrials (NCT05870254). Results: The intervention was feasible and safe. The participants completed the programme with no adverse effects (no symptoms on the Simulator Sickness Questionnaire), high usability (System Usability Scale 90.31%), and outstandingly positive post-game experiences (Game Experience Questionnaire 3.10/4). In addition, the GE significantly improved several of their functional capacities: increased lower limb strength (Five Times Sit-to-Stand Test p = 0.042), improved functional mobility, and reduced fall risk (Timed Up and Go Test-simple p = 0.009; Timed Up and Go Test-cognitive p = 0.003). There were no statistically significant differences between the groups. Conclusions: The findings support that the use of exergames and IVR as physical therapy in pwMS is feasible and safe. Furthermore, there is the suggestion of possible benefits to participants' functional abilities, all of which position IVR as a promising tool for the rehabilitation of this neurodegenerative pathology affecting young adults.

A Review of Recent Advances in Cognitive-Motor Dual-Tasking for Parkinson's Disease Rehabilitation

BACKGROUND

Parkinson's disease is primarily characterized by the degeneration of motor neurons, leading to significant impairments in movement. Initially, physical therapy was predominantly employed to address these motor issues through targeted rehabilitation exercises. However, recent research has indicated that cognitive training can enhance the quality of life for patients with Parkinson's. Consequently, some researchers have posited that the simultaneous engagement in computer-assisted motor and cognitive dual-task (CADT) may yield superior therapeutic outcomes.

METHODS

A comprehensive literature search was performed across various databases, and studies were selected following PRISMA guidelines, focusing on CADT rehabilitation interventions.

RESULTS

Dual-task training enhances Parkinson's disease (PD) rehabilitation by automating movements and minimizing secondary task interference. The inclusion of a sensor system provides real-time feedback to help patients make immediate adjustments during training. Furthermore, CADT promotes more vigorous participation and commitment to training exercises, especially those that are repetitive and can lead to patient boredom and demotivation. Virtual reality-tailored tasks, closely mirroring everyday challenges, facilitate more efficient patient adaptation post-rehabilitation.

CONCLUSIONS

Although the current studies are limited by small sample sizes and low levels, CADT rehabilitation presents as a significant, effective, and potential strategy for PD.

The IntegraPark Study: An Opportunity to Facilitate High-Intensity Exercise with Immersive Virtual Reality in Parkinson's Disease Patients

BACKGROUND

high-intensity exercise is a feasible and effective modality in the early stages of Parkinson's disease (PD). However, there are only a few studies that have carried out this type of intervention in customizable immersive virtual reality (IVR) environments. We explore the feasibility and effects of IVR-based high-intensity training through rowing and cycling exercises on the functional capacity, quality of life, and progression of PD.

METHODS

a total of 12 participants (61.50 ± 10.49 years old; 41.7% female, 58.3% male; stages I-III) were part of the study, which consisted of interventions of rowing and cycling in an IVR commercial exergame (25 min; twice per week for 14 weeks). The main variables measured were functional capacity, handgrip strength, functional mobility (TUG), functional lower-limb strength (FTSST), aerobic capacity (2-min step test), quality of life (PDQ-39), and Parkinson's disease progression (MDS-UPDRS).

RESULTS

the results showed a general improvement in handgrip strength in both hands (p = 0.008; d = 0.28), FTSST (p = 0.029; d = 0.96), and TUG times (p = 0.152; d = 0.22). Aerobic capacity, assessed by a 2-min step test, showed enhanced scores (p = 0.031; d = 0.78). Related to the PDQ-39, all dimensions of the scale were enhanced, highlighting activities of daily living (p = 0.047; d = 0.29) and bodily discomfort (p = 0.041; d = 0.37). Finally, the main symptoms of the disease were reduced, with an improvement in the parameters that show a better incidence of disease progression, such as Part IA and IB (p = 0.013; d = 0.29 and p = 0.021; d = 0.25, respectively), Part II (p = 0.021; d = 0.23), Part III (p = 0.040; d = 0.39), and Part IV (p = 0.013; d = 0.39).

CONCLUSIONS

the therapeutic exercise (rowing and cycling), when carried out at a high intensity and in a personalized IVR scenario, appear to be a feasible and safe modality for patients with stages I-III of PD, improving their functional capacity, quality of life, and disease progression.

The Use of Head-Mounted Display Systems for Upper Limb Kinematic Analysis in Post-Stroke Patients: A Perspective Review on Benefits, Challenges and Other Solutions

In recent years, there has been a notable increase in the clinical adoption of instrumental upper limb kinematic assessment. This trend aligns with the rising prevalence of cerebrovascular impairments, one of the most prevalent neurological disorders. Indeed, there is a growing need for more objective outcomes to facilitate tailored rehabilitation interventions following stroke. Emerging technologies, like head-mounted virtual reality (HMD-VR) platforms, have responded to this demand by integrating diverse tracking methodologies. Specifically, HMD-VR technology enables the comprehensive tracking of body posture, encompassing hand position and gesture, facilitated either through specific tracker placements or via integrated cameras coupled with sophisticated computer graphics algorithms embedded within the helmet. This review aims to present the state-of-the-art applications of HMD-VR platforms for kinematic analysis of the upper limb in post-stroke patients, comparing them with conventional tracking systems. Additionally, we address the potential benefits and challenges associated with these platforms. These systems might represent a promising avenue for safe, cost-effective, and portable objective motor assessment within the field of neurorehabilitation, although other systems, including robots, should be taken into consideration.

Exercise Responses During Outdoor Versus Virtual Reality Indoor Arm+FES-Leg Cycling in Individuals with Spinal Cord Injury

Background: Virtual reality (VR)-enhanced indoor hybrid cycling in people with spinal cord injury (SCI) can be comparable to outdoor hybrid cycling. Method: Eight individuals with chronic thoracic-lesion SCI performed voluntary arm and electrically assisted leg cycling on a hybrid recumbent tricycle. Exercises were conducted outdoors and indoors incorporating VR technology in which the outdoor environment was simulated on a large flat screen monitor. Electrical stimulation was applied bilaterally to the leg muscle groups. Oxygen uptake (VO2), heart rate, energy expenditures, and Ratings of Perceived Exertion were measured over a 30-minute outdoor test course that was also VR-simulated indoors. Immediately after each exercise, participants completed questionnaires to document their perceptual-psychological responses. Results: Mean 30-minute VO2 was higher for indoor VR exercise (average VO2-indoor VR-exercise: 1316 ± mL/min vs. outdoor cycling: 1255 ± 53 mL/min; highest VO2-indoor VR-exercise: 1615 ± 67 mL/min vs. outdoor cycling: 1725 ± 67 mL/min). Arm and leg activity counts were significantly higher during indoor VR-assisted hybrid functional electrical stimulation (FES) cycling than outdoors; 42% greater for the arms and 23% higher for the legs (P < 0.05). Similar responses were reported for exercise effort and perceptual-psychological outcomes during both modes. Conclusion: This study proposes that combining FES and VR technology provides new opportunities for physical activity promotion or exercise rehabilitation in the SCI population, since these modes have similar "dose-potency" and self-perceived effort. Human Research Ethics Committee of the University of Sydney Ref. No. 01-2010/12385.

Study of the Possibility of Using Virtual Reality Application in Rehabilitation among Elderly Post-Stroke Patients

Thanks to medical advances, life expectancy is increasing. With it comes an increased incidence of diseases, of which age is a risk factor. Stroke is among these diseases, and is one of the causes of long-term disability. The opportunity to treat these patients is via rehabilitation. A promising new technology that can enhance rehabilitation is virtual reality (VR). However, this technology is not widely used by elderly patients, and, moreover, the elderly often do not use modern technology at all. It therefore becomes a legitimate question whether elderly people will be able to use virtual reality in rehabilitation. This article presents a rehabilitation application dedicated to patients with upper limb paresis and unilateral spatial neglect (USN). The application was tested on a group of 60 individuals including 30 post-stroke patients with an average age of 72.83 years. The results of the conducted study include a self-assessment by the patients, the physiotherapist's evaluation, as well as the patients' performance of the exercise in VR. The study showed that elderly post-stroke patients are able to use virtual reality applications, but the ability to correctly and fully perform an exercise in VR depends on several factors. One of them is the ability to make logical contact (p = 0.0001 < 0.05). However, the study presented here shows that the ability to use VR applications does not depend on age but on mental and physical condition, which gives hope that virtual reality applications can be used in post-stroke rehabilitation among patients of all ages.

The most used questionnaires for evaluating the usability of robots and smart wearables: A scoping review

Background

As the field of robotics and smart wearables continues to advance rapidly, the evaluation of their usability becomes paramount. Researchers may encounter difficulty in finding a suitable questionnaire for evaluating the usability of robotics and smart wearables. Therefore, the aim of this study is to identify the most commonly utilized questionnaires for assessing the usability of robots and smart wearables.

Methods

A comprehensive search of databases, including PubMed, Web of Science, and Scopus, was conducted for this scoping review. Two authors performed the selection of articles and data extraction using a 10-field data extraction form. In cases of disagreements, a third author was consulted to reach a consensus. The inclusions were English-language original research articles that utilized validated questionnaires to assess the usability of healthcare robots and smart wearables. The exclusions comprised review articles, non-English publications, studies not focused on usability, those assessing clinical outcomes, articles lacking questionnaire details, and those using non-validated or researcher-made questionnaires. Descriptive statistics methods (frequency and percentage), were employed to analyze the data.

Results

A total of 314 articles were obtained, and after eliminating irrelevant and duplicate articles, a final selection of 50 articles was included in this review. A total of 17 questionnaires were identified to evaluate the usability of robots and smart wearables, with 10 questionnaires specifically for wearables and 7 questionnaires for robots. The System Usability Scale (50%) and Post-Study System Usability Questionnaire (19.44%) were the predominant questionnaires utilized to assess the usability of smart wearables. Moreover, the most commonly used questionnaires for evaluating the usability of robots were the System Usability Scale (56.66%), User Experience Questionnaire (16.66%), and Quebec User Evaluation of Satisfaction with Assistive Technology (10%).

Conclusion

Commonly employed questionnaires serve as valuable tools in assessing the usability of robots and smart wearables, aiding in the refinement and optimization of these technologies for enhanced user experiences. By incorporating user feedback and insights, designers can strive towards creating more intuitive and effective robotic and wearable solutions.

The impact of Exergames on emotional experience: a systematic review

Background

Gamification has proven to be a significant tool for health promotion, with a particular focus on physical activities such as Exergames, which improve not only physical, but also cognitive health. However, it is still not clear what effect the practice of Exergames has on changing the emotional experience.

Purpose

The objective of this systematic review is to evaluate the impact of Exergames training on emotional experience.

Methods

A systematic search was conducted in the PUBMED and SCOPUS databases. The relevant articles were screened independently by three researchers. Data concerning emotional measures and Exergame practice were extracted for analysis.

Results

The search yielded 38 articles, of which 16 were included. Exergames were found to significantly impact happiness, anxiety, depressive symptoms, mental health-related quality of life, self-worth, self-esteem, self-efficacy, perceived behavioral control, vigor, vitality, intrinsic motivation, perceived energy, and relaxation.

Conclusion

Our review supports the evidence that the practice of physical activity through Exergames, on the emotional experience generally generates an increase in positive emotions. In this sense, the results found support both the use of Exergames as a leisure activity that promotes wellbeing and emotional regulation, as well as for health promotion, public health, and clinical practice purposes. Our review strongly supports the notion that engaging in physical activity through Exergames generally leads to an increase in positive emotions. As a result, these findings endorse the utilization of Exergames as a leisure activity to promote well-being and emotional regulation. Moreover, Exergames hold potential for health promotion, public health, and clinical practice purposes.

Areas of Research Focus and Trends in the Research on the Application of VR in Rehabilitation Medicine

OBJECTIVE

To establish the areas of research focus in the application of VR in rehabilitation medicine, analyze its themes and trends, and offer a reference for future related research in this field.

METHODS

This paper provides an in-depth analysis of the development process, areas of research focus, and research trends in the field of the application of VR in rehabilitation medicine, using the Web of Science core dataset as the source and using a bibliometric analysis with CiteSpace.

RESULTS

The application of VR in rehabilitation medicine was composed of three stages, and the research topics were reviewed from five perspectives: neurological rehabilitation, psychological treatment, pain distraction, cardiopulmonary rehabilitation, and visual-spatial disorder.

LIMITATIONS

The research data were sourced from the Web of Science core dataset only, and the data-sample size was not comprehensive.

CONCLUSIONS

Overcoming VR-technology-induced vertigo, mental disorders from the overuse of VR, individualized treatments, and integration with traditional therapy are all challenges in the application of VR in rehabilitation medicine that require research. In addition, developing VR products with better experiences, constructing standardized guidelines, and conducting more high-quality clinical studies are all future research topics related to the application of VR in rehabilitation medicine.

Immersive Virtual Reality Reaction Time Test and Relationship with the Risk of Falling in Parkinson's Disease

Immersive virtual reality (IVR) uses customized and advanced software and hardware to create a digital 3D reality in which all of the user's senses are stimulated with computer-generated sensations and feedback. This technology is a promising tool that has already proven useful in Parkinson's disease (PD). The risk of falls is very high in people with PD, and reaction times and processing speed may be markers of postural instability and functionality, cognitive impairment and disease progression. An exploratory study was conducted to explore the feasibility of reaction time tests performed in IVR as predictors of falls. A total of 26 volunteers (79.2% male; 69.73 ± 6.32 years) diagnosed with PD (1.54 ± 0.90 H&Y stage; 26.92 ± 2.64 MMSE) took part in the study. IVR intervention was feasible, with no adverse effects (no Simulator Sickness Questionnaire symptoms). IVR reaction times were related (Spearman's rho) to functionality (timed up and go test (TUG) (rho = 0.537, p = 0.005); TUG-Cognitive (rho = 0.576, p = 0.020); cognitive impairment mini mental state exam (MMSE) (rho = -0.576, p = 0.002)) and the years of the patients (rho = 0.399, p = 0.043) but not with the first PD symptom or disease stage. IVR test is a complementary assessment tool that may contribute to preventing falls in the proposed sample. Additionally, based on the relationship between TUG and reaction times, a cut-off time is suggested that would be effective at predicting the risk of suffering a fall in PD patients using a simple and quick IVR test.

Recent Advancements in Sensor Technologies for Healthcare and Biomedical Applications

Biomedical sensors are the key units of medical and healthcare systems [...].

Rehabilitation Is the Main Topic in Virtual and Augmented Reality and Physical Activity Research: A Bibliometric Analysis

Researchers' interest in finding practical applications for virtual reality (VR) and augmented reality (AR) technologies has increased as new devices have become cheaper and more accessible, being used in entertainment, healthcare, and rehabilitation fields, among others. This study aims to provide an overview of the current state of scientific literature related to VR, AR, and physical activity (PA). A bibliometric analysis of studies published between 1994 and 2022 was conducted using The Web of Science (WoS), applying the traditional bibliometric laws and using the VOSviewer software for data and metadata processing. The results revealed an exponential increase in scientific production between 2009 and 2021 (R² = 94%). The United States (USA) was the country/region with the most relevant co-authorship networks (72 papers); the most prolific author was Kerstin Witte, and the most prominent was Richard Kulpa. The most productive journal's core was composed of high-impact and open access journals. A great thematic diversity was found according to the most used keywords by the co-authors, highlighting concepts such as rehabilitation, cognition, training, and obesity. Then, the research related to this topic is in an exponential development phase, with great interest in the rehabilitation and sports sciences fields.

Acceptability, Feasibility, and Effectiveness of Immersive Virtual Technologies to Promote Exercise in Older Adults: A Systematic Review and Meta-Analysis

CONTEXT

This review aimed to synthesize the literature on the acceptability, feasibility, and effectiveness of immersive virtual technologies to promote physical exercise in older people.

METHOD

We performed a literature review, based on four databases (PubMed, CINAHL, Embase, and Scopus; last search: 30 January 2023). Eligible studies had to use immersive technology with participants aged 60 years and over. The results regarding acceptability, feasibility, and effectiveness of immersive technology-based interventions in older people were extracted. The standardized mean differences were then computed using a random model effect.

RESULTS

In total, 54 relevant studies (1853 participants) were identified through search strategies. Concerning the acceptability, most participants reported a pleasant experience and a desire to use the technology again. The average increase in the pre/post Simulator Sickness Questionnaire score was 0.43 in healthy subjects and 3.23 in subjects with neurological disorders, demonstrating this technology's feasibility. Regarding the effectiveness, our meta-analysis showed a positive effect of the use of virtual reality technology on balance (SMD = 1.05; 95% CI: 0.75-1.36; p < 0.001) and gait outcomes (SMD = 0.7; 95% CI: 0.14-0.80; p < 0.001). However, these results suffered from inconsistency and the number of trials dealing with these outcomes remains low, calling for further studies.

CONCLUSIONS

Virtual reality seems to be well accepted by older people and its use with this population is feasible. However, more studies are needed to conclude its effectiveness in promoting exercise in older people.

Hybrid Target Selections by "Hand Gestures + Facial Expression" for a Rehabilitation Robot

In this study we propose a "hand gesture + face expression" human machine interaction technique, and apply this technique to bedridden rehabilitation robot. "Hand gesture + Facial expression" interactive technology combines the input mode of gesture and facial expression perception. It involves seven basic facial expressions that can be used to determine a target selecting task, while hand gestures are used to control a cursor's location. A controlled experiment was designed and conducted to evaluate the effectiveness of the proposed hybrid technology. A series of target selecting tasks with different target widths and layouts were designed to examine the recognition accuracy of hybrid control gestures. An interactive experiment applied to a rehabilitation robot is designed to verify the feasibility of this interactive technology applied to rehabilitation robots. The experimental results show that the "hand + facial expression" interactive gesture has strong robustness, which can provide a novel guideline for designing applications in VR interfaces, and it can be applied to the rehabilitation robots.

Feasibility and Effects of an Immersive Virtual Reality Exergame Program on Physical Functions in Institutionalized Older Adults: A Randomized Clinical Trial

One of the pillars which underpins active aging is found in the performance of physical activity. While adherence to physical activity programs has traditionally been low in older people, immersive virtual reality (IVR) could provide an alternative and complementary training mode. A randomized clinical trial was conducted to explore the feasibility and effects of a 10-week IVR exergame program on physical functions of 24 institutionalized older adults who were allocated to an experimental group (EG n = 13; 85.08 ± 8.48 years) and control group (CG n = 11; 84.82 ± 8.10 years). The IVR intervention was feasible, with no adverse effects being reported (no Simulator Sickness Questionnaire symptoms; low negative experience scores on the Game Experience Questionnaire < 0.34/4), no dropouts, high adherence, and good post-gaming usability (System Usability Scale > 73.96%). The EG showed significant improvements: Tinetti scores for balance (1.84 ± 1.06; p < 0.001), gait (1.00 ± 1.08; p < 0.001), total score (2.84 ± 1.67; p < 0.001), and handgrip (4.96 ± 4.22; p < 0.001) (pre−post assessment). The CG showed significantly worsened compared to the EG: Five times sit-to-stand test, Tinetti scores for balance, gait, and total score, and the Timed Up and Go test total score (post-assessment). The findings show that the IVR intervention is a feasible method to approach a personalized exercise program and an effective way by which to improve physical function in the target population.

Immersive Virtual Reality as a Novel Physical Therapy Approach for Nonagenarians: Usability and Effects on Balance Outcomes of a Game-Based Exercise Program

Physical exercise has been recognized as an important strategy in the promotion of healthy aging. Positive effects on older adults' motor ability are brought about by engaging their motor skills and promoting sensorimotor learning and cortical plasticity. These processes could be increased with the use of immersive virtual reality (IVR) technology, since the multisensory stimulation is greater. The aim of this study was to explore the usability and balance effects of an IVR exercise program in community-dwelling nonagenarian people. A sample of 12 women were allocated to an experimental group (EG n = 6; 91.67 ± 1.63 years) and a control group (CG n = 6; 90.83 ± 2.64 years). For 10 weeks, the EG used a commercial IVR exergame three times a week. All the sample completed the program without adverse effects (without Simulator Sickness Questionnaire symptoms). Post-gaming usability was good (System Usability Scale 78.33). The EG improved some balance parameters significantly (Tinetti test: balance (10.97 %; Sig = 0.017), gait (9.23%; Sig = 0.047) and total score (10.20%; Sig = 0.014) and maintained total TUG test times (-0.45%)). There were significant differences between groups (Tinetti test: balance (Sig = 0.004) and total score (Sig = 0.0032)). We successfully demonstrated that IVR training is feasible and is an effective and personalized method to enhance balance and to reduce the risk of falls in community-dwelling nonagenarian women.

Assessment of the Relevance and Reliability of Reaction Time Tests Performed in Immersive Virtual Reality by Mixed Martial Arts Fighters

Immersive virtual reality (VR) is increasingly applied in various areas of life. The potential of this technology has also been noticed in recreational physical activity and sports. It appears that a virtual environment can also be used in diagnosing certain psychomotor abilities. The main aim of this study consisted of assessing the relevance and reliability of VR-implemented tests of simple and complex reaction time (RT) performed by mixed martial arts (MMA) fighters. Thirty-two professional MMA fighters were tested. The original test developed in the virtual environment was applied for RT assessment. The fighters’ task consisted of reacting to the lighting up of a virtual disc situated in front of them by pushing a controller button. The relevance of the test task was estimated by juxtaposing the obtained results with the classic computer test used for measuring simple and complex reactions, while its reliability was assessed with the intraclass correlation procedure. Significant relationships found between the results of VR-implemented tests and computer-based tests confirmed the relevance of the new tool for the assessment of simple and complex RT. In the context of their reliability, RT tests in VR do not differ from tests conducted with the use of standard computer-based tools. VR technology enables the creation of tools that are useful in diagnosing psychomotor abilities. Reaction time tests performed by MMA fighters with the use of VR can be considered relevant, and their reliability is similar to the reliability obtained in computer-based tests.