Benefits of and barriers to involving users in medical device technology development and evaluation

Framework of the strengths and challenges of clinically integrated trials: An expert panel report

The limitations of the explanatory clinical trial framework include the high expense of implementing explanatory trials, restrictive entry criteria for participants, and redundant logistical processes. These limitations can result in slow evidence generation that is not responsive to population health needs, yielding evidence that is not generalizable. Clinically integrated trials, which integrate clinical research into routine care, represent a potential solution to this challenge and an opportunity to support learning health systems. The operational and design features of clinically integrated trials include a focused scope, simplicity in design and requirements, the leveraging of existing data structures, and patient participation in the entire trial process. These features are designed to minimize barriers to participation and trial execution and reduce additional research burdens for participants and clinicians alike. Broad adoption and scalability of clinically integrated trials are dependent, in part, on continuing regulatory, healthcare system, and payer support. This analysis presents a framework of the strengths and challenges of clinically integrated trials and is based on a multidisciplinary expert "Think Tank" panel discussion that included representatives from patient populations, academia, non-profit funding agencies, the U.S. Food and Drug Administration, and industry.

Lessons learned from investigating patients' and physiotherapists' perspectives on the design of a telerehabilitation platform

PURPOSE

Home self-rehabilitation exercises for musculoskeletal conditions are a valuable complement to rehabilitation plans. Telerehabilitation systems using artificial intelligence can provide reliable solutions and empower patients by providing them with guidance and motivating them to engage in rehabilitation plans and activities. This study aims to understand the patient's and physiotherapist's perspective on the requirements of effective face-to-face physiotherapy sessions to inspire the design of a telerehabilitation platform to be used in home settings.

METHODS

The authors used an ethnography-informed approach through observation and semi-structured interviews with patients (n = 13) and physiotherapists (n = 10) in two outpatient rehabilitation clinics. The AEIOU framework was used to structure and analyse the observation. Thematic analysis was used to code and analyse the data collected from the observations and the interviews.

RESULTS

Patients' and physiotherapists' perspectives emphasise the need for exercise instruction clarity, evolution monitoring, and feedback. In the absence of the physiotherapist, in home settings, patients feel insecure and fear execution difficulties and limited exercise instructions, while physiotherapists struggle with controlling patients' home exercise performance. Telerehabilitation is seen as an opportunity to move further into home self-rehabilitation programs.

CONCLUSIONS

Besides home exercise monitoring and guidance, telerehabilitation platforms must allow personalization and effective communication between patients and physiotherapists.

A usability study on mobile EMG-guided wrist extension training in subacute stroke patients-MyoGuide

BACKGROUND

Effective stroke rehabilitation requires high-dose, repetitive-task training, especially during the early recovery phase. However, the usability of upper-limb rehabilitation technology in acute and subacute stroke survivors remains relatively unexplored. In this study, we introduce subacute stroke survivors to MyoGuide, a mobile training platform that employs surface electromyography (sEMG)-guided neurofeedback training that specifically targets wrist extension. Notably, the study emphasizes evaluating the platform's usability within clinical contexts.

METHODS

Seven subacute post-stroke patients (1 female, mean age 53.7 years, mean time post-stroke 58.9 days, mean duration per training session 48.9 min) and three therapists (one for eligibility screening, two for conducting training) participated in the study. Participants underwent ten days of supervised one-on-one wrist extension training with MyoGuide, which encompassed calibration, stability assessment, and dynamic tasks. All training records including the Level of Difficulty (LoD) and Stability Assessment Scores were recorded within the application. Usability was assessed through the System Usability Scale (SUS) and participants' willingness to continue home-based training was gauged through a self-developed survey post-training. Therapists also documented the daily performance of participants and the extent of support required.

RESULTS

The usability analysis yielded positive results, with a median SUS score of 82.5. Compared to the first session, participants significantly improved their performance at the final session as indicated by both the Stability Assessment Scores (p = 0.010, mean = 229.43, CI = [25.74-433.11]) and the LoD (p < 0.001; mean: 45.43, CI: [25.56-65.29]). The rate of progression differed based on the initial impairment levels of the patient. After training, participants expressed a keen interest in continuing home-based training. However, they also acknowledged challenges related to independently using the Myo armband and software.

CONCLUSIONS

This study introduces the MyoGuide training platform and demonstrates its usability in a clinical setting for stroke rehabilitation, with the assistance of a therapist. The findings support the potential of MyoGuide for wrist extension training in patients across a wide range of impairment levels. However, certain usability challenges, such as donning/doffing the armband and navigating the application, need to be addressed to enable independent MyoGuide training requiring only minimal supervision by a therapist.

The OdonAssist inflatable device for assisted vaginal birth-the ASSIST II study (United Kingdom)

BACKGROUND

Decreasing rates of assisted vaginal birth have been paralleled with increasing rates of cesarean deliveries over the last 40 years. The OdonAssist is a novel device for assisted vaginal birth. Iterative changes to clinical parameters, device design, and technique have been made to improve device efficacy and usability.

OBJECTIVE

This study aimed to determine if the feasibility, safety, and efficacy of the OdonAssist device were sufficient to justify conducting a future randomized controlled trial.

STUDY DESIGN

An open-label nonrandomized study of 104 participants having a clinically indicated assisted vaginal birth using the OdonAssist was undertaken at Southmead Hospital, Bristol, United Kingdom. Data were also collected from participants who consented to participate in the study but for whom trained OdonAssist operators were not available, providing a nested cohort. The primary clinical outcome was the proportion of births successfully expedited with the OdonAssist. Secondary outcomes included clinical, patient-reported, operator-reported, device and health care utilization. Neonatal outcome data were reviewed at day 28, and maternal outcomes were investigated up to day 90. Given that the number of successful OdonAssist births was ≥61 out of 104, the hypothesis of a poor rate of 50% was rejected in favor of a good rate of ≥65%.

RESULTS

Between August 2019 and June 2021, 941 (64%) of the 1471 approached, eligible participants consented to participate. Of these, 104 received the OdonAssist intervention. Birth was assisted in all cephalic vertex fetal positions, at all stations ≥1 cm below the ischial spines (with or without regional analgesia). The OdonAssist was effective in 69 of the 104 (66%) cases, consistent with the hypothesis of a good efficacy rate. There were no serious device-related maternal or neonatal adverse reactions, and there were no serious adverse device effects. Only 4% of neonatal soft tissue bruising in the successful OdonAssist group was considered device-related, as opposed to 20% and 23% in the unsuccessful OdonAssist group and the nested cohort, respectively. Participants reported high birth perception scores. All practitioners found the device use to be straightforward.

CONCLUSION

Recruitment to an interventional study of a new device for assisted vaginal birth is feasible; 64% of eligible participants were willing to participate. The success rate of the OdonAssist was comparable to that of the Kiwi OmniCup when introduced in the same unit in 2002, meeting the threshold for a randomized controlled trial to compare the OdonAssist with current standard practice. There were no disadvantages of study participation in terms of maternal and neonatal outcomes. There were potential advantages of using the OdonAssist, particularly reduced neonatal soft tissue injury. The same application technique is used for all fetal positions, with all operators deeming the device straightforward to use. This study provides important data to inform future study design.

Healthcare professionals' perspectives on development of assistive technology using the comprehensive assistive technology model

The implementation of technology in healthcare shows promising results and provides new opportunities in rehabilitation. However, the adoption of technology into daily care is largely dependent on the acceptance rate of end-users. This study aims to gather information from healthcare professionals on the development of new assistive technology that match users' needs using the Comprehensive Assistive Technology model. In total 27 healthcare professionals (12 occupational therapists, 8 physiotherapists, 3 nurses, 2 allied health directors, a physician and a speech therapist) attended one of four online focus group discussions. These focus group discussions were structured using a question guide based on three predefined scenarios. Recordings were transcribed and data was analyzed using a thematic analysis (NVivo). Major themes identified in this study were safety, price and usability. Healthcare professionals focused on both functional capabilities of the user, as well as behavioral aspects of usability and attitude toward technology. Furthermore, the need for assistive technology that were catered toward the limitations in activity and user experience, was highlighted extensively. Based on information gathered from healthcare professionals a user-centered approach in development of safe, low-cost devices that maximize both functional outcomes and user acceptance, could potentially increase the adoption of new technology in rehabilitation.

Telehealth in Cancer Care: Inequities, Barriers, and Opportunities

ABSTRACT

Telecommunications technology began to be integrated into health care delivery by the mid-1900s, with the goal of increasing access to care including access to cancer care.There have been at least 3 significant telehealth expansion periods, with the most recent related to the COVID-19 pandemic. Technology uptake increased in the 1990s as quality improved, costs came down, and usability factors were addressed. As telehealth practice transitioned to use of personal devices, the COVID-19 pandemic arose, and necessity compelled widespread telehealth uptake. Most patients and clinicians entered the pandemic with little if any telehealth experience and often no training on using personal devices to access health care. Teleoncology data reveal cancer care feasibility and acceptability with generally high levels of satisfaction for both patients and clinicians. Sustaining the progress made in telehealth uptake requires ongoing insurance coverage with parity in coverage, licensure facilitation, and ongoing development of technology that is easy to use. In addition, to tele-cancer care appointments, the technology may be used for care coordination, education, and increased access to cancer clinical trials.

Usability evaluation of emergency information systems in educational hospitals in Kerman, Iran

BACKGROUND

Smart and practical health information systems and applications with fewer errors are crucial for healthcare facilities. One method that ensures the proper design of health information systems (HIS) and applications is usability evaluation.

OBJECTIVE

This study aimed to evaluate the usability of the emergency information systems used at the emergency departments of four educational hospitals in Kerman, Iran.

METHOD

This study was conducted in two phases. In the first phase, the information systems' errors and shortages were identified using a semi-structured questionnaire by users (nurses and the IT staff). In the second phase, based on the results of the first phase, two questionnaires were designed for each group of users to their opinions about the usability of the emergency information systems.

RESULTS

The average score of "reducing and facilitating user's daily activities" was significantly different among hospitals (p = 0.03). Shahid Beheshti Hospital obtained the lowest usability score (17.5), and Afzalipour Hospital received the highest usability score (21.75). Moreover, the average score in "use of the HIS" for nurses and IT staff was 2.93 and 3.54 on a scale of 5, respectively.

CONCLUSION

Usability evaluation of health information systems is essential to ensure that these systems provide sufficient and accurate information and requirements for users and health care providers. Also, modifying health information systems based on the user views and expectations improves the quality of the system and user-system Interaction.

An evaluation of 3D printable elastics for post stroke dynamic hand bracing: a pilot study

The rise of 3D printing allows unprecedented customization of rehabilitation devices, and with an ever-expanding library of 3D printable (3DP) materials, the spectrum of attenable rehabilitation devices is likewise expanding. The current pilot study explores feasibility of using 3DP elastic materials to create dynamic hand orthoses for stroke survivors. A dynamic orthosis featuring a replaceable finger component was fabricated using 3DP elastic materials. Duplicates of the finger component were printed using different materials ranging from low stiffness (low elastic modulus) to relatively high stiffness (high elastic modulus). Five stroke survivors with predominantly moderate hand impairment were recruited to evaluate usability and impact of orthoses on upper extremity function and biomechanics. No significant differences in usability were found between 3D-printed orthoses and a commercial orthosis. Increases in stiffness of the 3DP material reduced pincer force (p = .0041) and the BBT score (p = .043). In comparison, the commercial orthosis did not reduce pincer force but may reduce BBT score to a degree that is clinically significant (p = .0002). While preliminary, these findings suggest that a dynamic orthosis is a feasible clinical application of 3DP elastic materials, and future study is warranted.

Women's preferences for a new contraceptive under development: an exploratory study

Objective

Currently available contraceptive methods do not meet the needs of all users. We sought to explore preferences of potential end-users regarding an on-demand, non-hormonal female contraceptive currently under development, using a web-based survey.

Study design

We recruited respondents for an exploratory survey via web link on Amazon Mechanical Turk (MTurk). Individuals were eligible if they were 18-44 years of age, identified as cis-gender female, were English-speaking, not pregnant, and had used barrier contraception previously. Respondents provided demographic characteristics and a basic reproductive history. We then provided a brief description of the potential contraceptive. Respondents were asked about their interest in the proposed contraceptive and preferences for method attributes.

Results

A total of 500 respondents completed the survey. Three-quarters of respondents were <35 years of age and 48.2% were currently using a barrier contraceptive method. Three-fourths of respondents (73.8%) expressed interest in using the contraceptive under development. The majority wanted the method to be small (≤2 inches), rod-shaped, and low cost (<$5 per use). More than half (59.4%) said it was important to be able to use the method without partners' knowledge. The most reported potential concerns were vaginal irritation (51.6%) and lack of effectiveness (46.4%). Sixty percent of respondents were confident they could use the method correctly.

Discussion

Available contraceptive methods lack attributes preferred by some users. Development of new contraceptives frequently does not involve end-user input early in the development process. Individuals in this sample displayed interest in the proposed contraceptive and expressed preferences that can inform the further development of this method.

The evolution of technical prerequisites and local boundary conditions for optimization of mitral valve interventions-Emphasis on skills development and institutional risk performance

This viewpoint report describes how the evolution of transcatheter mitral valve intervention (TMVI) is influenced by lessons learned from three evolutionary tracks: (1) the development of treatment from mitral valve surgery (MVS) to transcutaneous procedures; (2) the evolution of biomedical engineering for research and development resulting in predictable and safe clinical use; (3) the adaptation to local conditions, impact of transcatheter aortic valve replacement (TAVR) experience and creation of infrastructure for skills development and risk management. Thanks to developments in computer science and biostatistics, an increasing number of reports regarding clinical safety and effectiveness is generated. A full toolbox of techniques, devices and support technology is now available, especially in surgery. There is no doubt that the injury associated with a minimally invasive access reduces perioperative risks, but it may affect the effectiveness of the treatment due to incomplete correction. Based on literature, solutions and performance standards are formulated with an emphasis in technology and positive outcome. Despite references to Heart Team decision making, boundary conditions such as hospital infrastructure, caseload, skills training and perioperative risk management remain underexposed. The role of Biomedical Engineering is exclusively defined by the Research and Development (R&D) cycle including the impact of human factor engineering (HFE). Feasibility studies generate estimations of strengths and safety limitations. Usability testing reveals user friendliness and safety margins of clinical use. Apart from a certification requirement, this information should have an impact on the definition of necessary skills levels and consequent required training. Physicians Preference Testing (PPT) and use of a biosimulator are recommended. The example of the interaction between two Amsterdam heart centers describes the evolution of a professional ecosystem that can facilitate innovation. Adaptation to local conditions in terms of infrastructure, referrals and reimbursement, appears essential for the evolution of a complete mitral valve disease management program. Efficacy of institutional risk management performance (IRMP) and sufficient team skills should be embedded in an appropriate infrastructure that enables scale and offers complete and safe solutions for mitral valve disease. The longstanding evolution of mitral valve therapies is the result of working devices embedded in an ecosystem focused on developing skills and effective risk management actions.

Increasing acceptance of medical AI: The role of medical staff participation in AI development

BACKGROUND

Medical artificial intelligence (AI) in varying degrees has exerted significant influence on many medical fields, especially in the midst of the COVID-19 pandemic. However, little is known regarding how to address the reluctance of medical staff to use AI technology. While recent research has highlighted the importance of medical staff participation in the development of AI, the current understanding of influence of medical staff participation on acceptance of AI is limited.

OBJECTIVES

To provide insights into the mechanism that how medical staff participation impacts on the medical staff's acceptance of AI and to examine the moderating effect of speciesism.

METHODS

This study was conducted from 6th August to 3rd September. Data was collected from doctors and nurses and a total of 288 valid questionnaires were obtained. Smart PLS 3.2.8 was used as partial least square (PLS) software to validate the research model.

RESULTS

The study determined that medical staff participation had a significant impact on acceptance of medical AI-IDT (β = 0.35, p ≤ 0.001) and acceptance of medical AI-ADT (β = 0.44, p ≤ 0.001). The results also show that AI self-efficacy and AI anxiety have significant mediating effects and speciesism has significant moderating effects among the theoretical model.

CONCLUSIONS

This study provides insights into ways to explore influence factors of acceptance of AI based on user participation perspective. The results indicate that medical staff participation enhances acceptance of medical AI through the cognitive path (i.e., AI self-efficacy) and the affective path (i.e., AI anxiety). These results have practical implications for how organizations assist the staff to accommodate themselves to AI technology in the future.

Satisfaction analysis of overground gait exoskeletons in people with neurological pathology. a systematic review

BACKGROUND

People diagnosed with neurological pathology may experience gait disorders that affect their quality of life. In recent years, research has been carried out on a variety of exoskeletons in this population. However, the satisfaction perceived by the users of these devices is not known. Therefore, the objective of the present study is to evaluate the satisfaction perceived by users with neurological pathology (patients and professionals) after the use of overground exoskeletons.

METHODS

A systematic search of five electronic databases was conducted. In order to be included in this review for further analysis, the studies had to meet the following criteria: [1] the study population was people diagnosed with neurological pathology; [2] the exoskeletons had to be overground and attachable to the lower limbs; and [3]: the studies were to include measures assessing either patient or therapist satisfaction with the exoskeletons.

RESULTS

Twenty-three articles were selected, of which nineteen were considered clinical trials. Participants diagnosed with stroke (n = 165), spinal cord injury (SCI) (n = 102) and multiple sclerosis (MS) (n = 68). Fourteen different overground exoskeleton models were analysed. Fourteen different methods of assessing patient satisfaction with the devices were found, and three ways to evaluate it in therapists.

CONCLUSION

Users' satisfaction with gait overground exoskeletons in stroke, SCI and MS seems to show positive results in safety, efficacy and comfort of the devices. However, the worst rated aspects and therefore those that should be optimized from the users' point of view are ease of adjustment, size and weight, and ease of use.

Patient engagement in a national research network: barriers, facilitators, and impacts

BACKGROUND

Little is known about patient engagement in the context of large teams or networks. Quantitative data from a larger sample of CHILD-BRIGHT Network members suggest that patient engagement was beneficial and meaningful. To extend our understanding of the barriers, facilitators, and impacts identified by patient-partners and researchers, we conducted this qualitative study.

METHODS

Participants completed semi-structured interviews and were recruited from the CHILD-BRIGHT Research Network. A patient-oriented research (POR) approach informed by the SPOR Framework guided the study. The Guidance for Reporting Involvement of Patients and the Public (GRIPP2-SF) was used to report on involvement of patient-partners. The data were analyzed using a qualitative, content analysis approach.

RESULTS

Twenty-five CHILD-BRIGHT Network members (48% patient-partners, 52% researchers) were interviewed on their engagement experiences in the Network's research projects and in network-wide activities. At the research project level, patient-partners and researchers reported similar barriers and facilitators to engagement. Barriers included communication challenges, factors specific to patient-partners, difficulty maintaining engagement over time, and difficulty achieving genuine collaboration. Facilitators included communication (e.g., open communication), factors specific to patient-partners (e.g., motivation), and factors such as respect and trust. At the Network level, patient-partners and researchers indicated that time constraints and asking too much of patient-partners were barriers to engagement. Both patient-partners and researchers indicated that communication (e.g., regular contacts) facilitated their engagement in the Network. Patient-partners also reported that researchers' characteristics (e.g., openness to feedback) and having a role within the Network facilitated their engagement. Researchers related that providing a variety of activities and establishing meaningful collaborations served as facilitators. In terms of impacts, study participants indicated that POR allowed for: (1) projects to be better aligned with patient-partners' priorities, (2) collaboration among researchers, patient-partners and families, (3) knowledge translation informed by patient-partner input, and (4) learning opportunities.

CONCLUSION

Our findings provide evidence of the positive impacts of patient engagement and highlight factors that are important to consider in supporting engagement in large research teams or networks. Based on these findings and in collaboration with patient-partners, we have identified strategies for enhancing authentic engagement of patient-partners in these contexts.

Design recommendations for exoskeletons: Perspectives of individuals with spinal cord injury

OBJECTIVE

This study investigated the expectations of individuals with spinal cord injury (SCI) regarding exoskeletons.

DESIGN

The survey consisted out of questions regarding multiple aspects of exoskeleton technology.

SETTING

An online survey was distributed via the monthly newsletter of the Dutch Patient Association for Spinal Cord Injury (SCI).

PARTICIPANTS

Individuals with SCI who are members of the Dutch Patient Association for SCI.

OUTCOME MEASURES

General impression of exoskeleton technology, expectations regarding capabilities and user-friendliness, training expectations and experiences, future perspectives and points of improvement.

RESULTS

The survey was filled out by 95 individuals with SCI, exoskeletons were considered positive and desirable by 74.7%. About 11 percent (10.5%) thought one could ambulate faster, or just as fast, while wearing an exoskeleton as able-bodied people. Furthermore, 18.9% expected not to use a wheelchair or walking aids while ambulating with the exoskeleton. Twenty-five percent believed that exoskeletons could replace wheelchairs. Some main points of improvement included being able to wear the exoskeleton in a wheelchair and while driving a car, not needing crutches while ambulating, and being able to put the exoskeleton on by oneself.

CONCLUSION

Individuals with SCI considered exoskeletons as a positive and desirable innovation. But based on the findings from the surveys, major points of improvement are necessary for exoskeletons to replace wheelchairs in the future. For future exoskeleton development, we recommend involvement of individuals with SCI to meet user expectations and improve in functionality, usability and quality of exoskeletons.

Taking shared decision making for prostate cancer to the next level: Requirements for a Dutch treatment decision aid with personalized risks on side effects

BACKGROUND

Different curative treatment modalities need to be considered in case of localized prostate cancer, all comparable in terms of survival and recurrence though different in side effects. To better inform patients and support shared decision making, the development of a web-based patient decision aid including personalized risk information was proposed. This paper reports on requirements in terms of content of information, visualization of risk profiles, and use in practice.

METHODS

Based on a Dutch 10-step guide about the setup of a decision aid next to a practice guideline, an iterative and co-creative design process was followed. In collaboration with various groups of experts (health professionals, usability and linguistic experts, patients and the general public), research and development activities were continuously alternated.

RESULTS

Content requirements focused on presenting information only about conventional treatments and main side effects; based on risk group; and including clear explanations about personalized risks. Visual requirements involved presenting general and personalized risks separately; through bar charts or icon arrays; and along with numbers or words, and legends. Organizational requirements included integration into local clinical pathways; agreement about information input and output; and focus on patients' numeracy and graph literacy skills.

CONCLUSIONS

The iterative and co-creative development process was challenging, though extremely valuable. The translation of requirements resulted in a decision aid about four conventional treatment options, including general or personalized risks for erection, urinary and intestinal problems that are communicated with icon arrays and numbers. Future implementation and validation studies need to inform about use and value in practice.

Modeling users’ and practitioners’ intention for continued usage of the Internet of Medical Devices (IoMD): an empirical investigation

Purpose

The purpose of this paper is to identify the antecedents of continued usage intentions in the connected devices ecosystem in health care by analyzing the users' and physicians' expectations in a new ecosystem where one prefers to connect digitally rather than physically.

Design/methodology/approach

This is a unique study in which data was collected from 242 doctors and 215 end-users to gauge the expectations from the connected devices in health care. Further, these responses were hypothesised using UTAUT-2 and ECT theories to analyze general users’ and professional users’ or doctors’ expectations for continued usage in connected devices ecosystem in the health-care ecosystem.

Findings

Performance expectancy, social influence, facilitating conditions and price value emerged as significant predictors of satisfaction in both user groups. But habit and hedonic motivation reflected an insignificant impact on user satisfaction. Surprisingly, effort expectancy emerged as a significant factor for end-user satisfaction, and this became insignificant for professional user satisfaction. Satisfaction was positively related to continued usage for both user groups, and app quality has a positive impact on all the predictors.

Practical implications

To the best of the authors’ knowledge, this is the first comparative study to understand the factors which influence consumer behavior leading to a holistic model and can be imbibed for creating a better customer experience in an era where we are more comfortable connecting digitally rather than physically.

Originality/value

This study has used the Unified Theory of Acceptance and Use of Technology-2 model and expectation confirmation theory to analyze the key factors influencing the intentions for continued usage of devices in the Internet of Medical Devices setup.

The cultural adaptation of the go wish card game for use in Flanders, Belgium: a public health tool to identify and discuss end-of-life preferences

Background

Public health tools like the Go Wish card game from the US, have been found useful to support people in reflecting on their end-of-life preferences, but a cultural adaptation is essential for their success. In the present study, we explore the necessary cultural adaptations to the Go Wish cards by applying an extensive, systematic, and community-engaging negotiating procedure to facilitate the use of the cards in the general population of Flanders, Belgium.

Methods

We used an iterative cultural adaptation process with repeated discussions with various community organizations and representatives of minority and religious groups. After that, the cards were evaluated by 12 healthcare professionals in relation to: linguistic equivalence to the original version, applicability, comprehensibility, and relevance per card. Additional testing with potential users preceded final adjustments.

Results

We found that stakeholders were keen to engage throughout the process of cultural adaptation and we were able to make a range of cultural adaptations for the use of the cards in Flanders. All original statements were rephrased from passive to more active statements. Sixteen out of 36 cards were adjusted to make them more culturally appropriate for use in Flanders, e.g., “to meet with clergy or a chaplain” to “having a spiritual counselor as support.” Three new cards were added: two with statements appropriate to the Belgian patient rights and euthanasia legislation and one extra Wild Card. Potential users (n = 33) felt that the cards supported conversations about end-of-life preferences.

Conclusion

By making community engagement a cornerstone of our adaption process, we developed a card set that potential end-users considered a supportive public health tool for reflecting and discussing end-of-life values and preferences. The described process is particularly valuable for culturally adapt interventions, especially given that community engagement in adapting interventions is essential to creating grounded interventions.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-14523-9.

Clinician perspectives on the implementation of inpatient cycling-based exergames for children with cerebral palsy: A qualitative study

OBJECTIVE

To understand the perspectives of key stakeholder clinicians in implementing inpatient cycling-based exergames for children with cerebral palsy (CP) into pediatric rehabilitation.

METHODS

Sixteen clinicians (nurses, physiotherapists, recreational therapists) that participated in a study exploring the feasibility of implementing cycling-based exergames for inpatient children with CP were interviewed. Clinicians' responses were coded using the Theoretical Domains Framework (TDF). Beliefs were generated from each response and relevant domains were identified.

RESULTS

Ten domains from the TDF were identified as relevant. Key enablers to clinician participation in future implementation included revision of clinician roles and responsibilities, the belief that children with CP will benefit from exergames, and the belief in potential applicability to other pediatric populations. Barriers included clinician limited time and exergame responsibilities not aligning with perceived clinician roles.

CONCLUSIONS

This study identifies key barriers and enablers that future inpatient pediatric rehabilitation settings should consider when incorporating exergames into rehabilitation practice.

A user preference analysis of commercial breath ketone sensors to inform the development of portable breath ketone sensors for diabetes management in young people

Background

Portable breath ketone sensors may help people with Type 1 Diabetes Mellitus (T1DM) avoid episodes of diabetic ketoacidosis; however, the design features preferred by users have not been studied. We aimed to elucidate breath sensor design preferences of young people with T1DM (age 12 to 16) and their parents to inform the development of a breath ketone sensor prototype that would best suit their diabetes management needs.

Research designs and methods

To elicit foundational experiences from which design preference ideas could be generated, two commercially available breath ketone sensors, designed for ketogenic diet monitoring, were explored over one week by ten young people with T1DM. Participants interacted with the breath ketone sensing devices, and undertook blood ketone testing, at least twice daily for five days to simulate use within a real life and ambulatory care setting. Semi-structured interviews were conducted post-testing with the ten young participants and their caregivers (n = 10) to elicit preferences related to breath sensor design and use, and to inform the co-design of a breath ketone sensor prototype for use in T1DM self-management. We triangulated our data collection with key informant interviews with two diabetes educators working in pediatric care about their perspectives related to young people using breath ketone sensors.

Results

Participants acknowledged the non-invasiveness of breath sensors as compared to blood testing. Affordability, reliability and accuracy were identified as prerequisites for breath ketone sensors used for diabetes management. Design features valued by young people included portability, ease of use, sustainability, readability and suitability for use in public. The time required to use breath sensors was similar to that for blood testing. The requirement to maintain a 10-second breath exhalation posed a challenge for users. Diabetes educators highlighted the ease of use of breath devices especially for young people who tended to under-test using blood ketone strips.

Conclusions

Breath ketone sensors for diabetes management have potential that may facilitate ketone testing in young people. Our study affirms features for young people that drive usability of breath sensors among this population, and provides a model of user preference assessment.

Preference Testing in Medical Devices: Current Framework and Regulatory Gaps

Preference testing is a valuable source of information that can be provided by both healthcare professionals (HCPs) and patients (users). It can be used to improve the design and development of medical devices by feeding into device usability and, ultimately, risk management. Furthermore, it can aid with selecting the most appropriate clinical endpoints to be used in the clinical evaluation of a device and increase patient engagement by incorporating patient-relevant outcomes. Preference testing is widely conducted in the food industry but is not widespread in the medical field due to limited guidelines and a lack of regulatory framework. As such, manufacturers may be unaware of the benefits of preference testing and fail to take full advantage of it, or conversely, may use inappropriate methodology and/or analyses and consequently fail to collect meaningful data. In this position paper, we aim to highlight the benefits and uses of preference testing, along with potential methods that could be used for preference testing of medical devices. A key step towards the wider implementation of preference testing in medical devices is for the publication of international standards and guidelines for the collection, assessment, and implementation of preference data into the life cycle of a medical device.

Design and Preliminary Evaluation of a Robot-assisted Assessment-driven Finger Proprioception Therapy

Neurological injuries such as stroke often lead to motor and somatosensory impairments of the hand. Deficits in somatosensation, especially proprioception, result in difficulties performing activities of daily living involving fine motor tasks. However, it is challenging to accurately detect those impairments due to the limitations of clinical assessments. Hence therapies rarely focus on proprioception specifically, while such training could promote functional benefits. In this work we propose and preliminarily evaluate a robot-assisted, assessment-driven therapy of finger proprioception. We designed and implemented two therapeutic exercises, one targeting passive and the other active position sense. The difficulty level of the therapy exercises was adapted to each patient's proprioceptive impairment. We evaluated the exercises and their usability with 7 stroke participants and 8 clinicians in a 45-minutes protocol. We found that the exercises were feasible for stroke participants, as 5 individuals progressed in difficulty levels over multiple exercise repetitions, indicating adequacy of the adaptation algorithm. Moreover, usability was rated mostly as satisfactory by the patients (System Usability Scale = 73), and they also found the exercises interesting. Clinicians rated the exercises as difficult but clinically meaningful. Overall, these promising preliminary results pave the way for further development and validation of the proposed therapy approach.

Systems thinking and designerly tools for medical device design in engineering curricula

Background

In this paper we focus on medical device development (MDD) in Industrial Design Engineering (IDE) academia. We want to find which methods our MDD-students currently use, where our guidance has shortcomings and where it brings added value.

Methods

We have analysed 19 master and 3 doctoral MDD-theses in our IDE curriculum. The evaluation focusses around four main themes: 1) regulatory 2) testing 3) patient-centricity and 4) systemic design.

Results

Regulatory aspects and medical testing procedures seem to be disregarded frequently. We assume this is because of a lack of MDD experience and the small thesis timeframe. Furthermore, many students applied medical-oriented systemic tools, which enhances multiperspectivism. However, we found an important lack in the translation to the List of Specifications and to business models of these medical devices. Finally, students introduced various participatory techniques, but seem to struggle with implementing this in the setting of evidence-based medicine.

Publicly Available, Interactive Web-Based Tools to Support Advance Care Planning: Systematic Review

Background

There is an increasing number of interactive web-based advance care planning (ACP) support tools, which are web-based aids in any format encouraging reflection, communication, and processing of publicly available information, most of which cannot be found in the peer-reviewed literature.

Objective

This study aims to conduct a systematic review of web-based ACP support tools to describe the characteristics, readability, and quality of content and investigate whether and how they are evaluated.

Methods

We systematically searched the web-based gray literature databases OpenGrey, ClinicalTrials.gov, ProQuest, British Library, Grey Literature in the Netherlands, and Health Services Research Projects in Progress, as well as Google and app stores, and consulted experts using the following eligibility criteria: web-based, designed for the general population, accessible to everyone, interactive (encouraging reflection, communication, and processing of information), and in English or Dutch. The quality of content was evaluated using the Quality Evaluation Scoring Tool (score 0-28—a higher score indicates better quality). To synthesize the characteristics of the ACP tools, readability and quality of content, and whether and how they were evaluated, we used 4 data extraction tables.

Results

A total of 30 tools met the eligibility criteria, including 15 (50%) websites, 10 (33%) web-based portals, 3 (10%) apps, and 2 (7%) with a combination of formats. Of the 30 tools, 24 (80%) mentioned a clear aim, including 7 (23%) that supported reflection or communication, 8 (27%) that supported people in making decisions, 7 (23%) that provided support to document decisions, and 2 (7%) that aimed to achieve all these aims. Of the 30 tools, 7 (23%) provided information on the development, all of which were developed in collaboration with health care professionals, and 3 (10%) with end users. Quality scores ranged between 11 and 28, with most of the lower-scoring tools not referring to information sources.

Conclusions

A variety of ACP support tools are available on the web, varying in the quality of content. In the future, users should be involved in the development process of ACP support tools, and the content should be substantiated by scientific evidence.

Trial Registration

PROSPERO CRD42020184112; https://tinyurl.com/mruf8b43

A Remote Patient-Monitoring System for Intensive Care Medicine: Mixed Methods Human-Centered Design and Usability Evaluation

Background

Continuous monitoring of vital signs is critical for ensuring patient safety in intensive care units (ICUs) and is becoming increasingly relevant in general wards. The effectiveness of health information technologies such as patient-monitoring systems is highly determined by usability, the lack of which can ultimately compromise patient safety. Usability problems can be identified and prevented by involving users (ie, clinicians).

Objective

In this study, we aim to apply a human-centered design approach to evaluate the usability of a remote patient-monitoring system user interface (UI) in the ICU context and conceptualize and evaluate design changes.

Methods

Following institutional review board approval (EA1/031/18), a formative evaluation of the monitoring UI was performed. Simulated use tests with think-aloud protocols were conducted with ICU staff (n=5), and the resulting qualitative data were analyzed using a deductive analytic approach. On the basis of the identified usability problems, we conceptualized informed design changes and applied them to develop an improved prototype of the monitoring UI. Comparing the UIs, we evaluated perceived usability using the System Usability Scale, performance efficiency with the normative path deviation, and effectiveness by measuring the task completion rate (n=5). Measures were tested for statistical significance using a 2-sample t test, Poisson regression with a generalized linear mixed-effects model, and the N-1 chi-square test. P<.05 were considered significant.

Results

We found 37 individual usability problems specific to monitoring UI, which could be assigned to six subcodes: usefulness of the system, response time, responsiveness, meaning of labels, function of UI elements, and navigation. Among user ideas and requirements for the UI were high usability, customizability, and the provision of audible alarm notifications. Changes in graphics and design were proposed to allow for better navigation, information retrieval, and spatial orientation. The UI was revised by creating a prototype with a more responsive design and changes regarding labeling and UI elements. Statistical analysis showed that perceived usability improved significantly (System Usability Scale design A: mean 68.5, SD 11.26, n=5; design B: mean 89, SD 4.87, n=5; P=.003), as did performance efficiency (normative path deviation design A: mean 8.8, SD 5.26, n=5; design B: mean 3.2, SD 3.03, n=5; P=.001), and effectiveness (design A: 18 trials, failed 7, 39% times, passed 11, 61% times; design B: 20 trials, failed 0 times, passed 20 times; P=.002).

Conclusions

Usability testing with think-aloud protocols led to a patient-monitoring UI with significantly improved usability, performance, and effectiveness. In the ICU work environment, difficult-to-use technology may result in detrimental outcomes for staff and patients. Technical devices should be designed to support efficient and effective work processes. Our results suggest that this can be achieved by applying basic human-centered design methods and principles.

Trial Registration

ClinicalTrials.gov NCT03514173; https://clinicaltrials.gov/ct2/show/NCT03514173

Chronic pain self-management in middle-aged and older adults: A collective intelligence approach to identifying barriers and user needs in eHealth interventions

Objectives

eHealth refers to health services and health information delivered or enhanced through the internet and related technologies. The number of eHealth interventions for chronic pain self-management is increasing. However, little evidence has been found for the overall efficacy of these interventions for older adults. The aim of the current study was to use a Collective Intelligence approach to identify the barriers and specific user needs of middle-aged and older adults using eHealth for chronic pain self-management.

Methods

A Collective Intelligence workshop was conducted with middle-aged and older adults to generate, clarify, select, and structure ideas in relation to barriers to eHealth use and specific design requirements for the purposes of chronic pain self-management. Prior to attending the workshop, participants received a trigger question requesting the identification of five barriers to eHealth use for chronic pain self-management. These barriers were categorised and presented to the group along with barrier-related scenarios and user need prompts, resulting in the generation of a set of ranked barriers and a set of user needs.

Results

A total of 78 barriers were identified, from which six categories emerged: Content, Support, Technological, Personal, Computer Literacy and Accessibility. Additional idea-writing and group reflection in response to these barriers revealed 97 user needs.

Conclusion

This is the first study to use Collective Intelligence methods to investigate barriers to eHealth technology use and the specific user needs of middle-aged and older adults in the context of chronic pain self-management. The results of the current study provide a platform for the design and development of enhanced eHealth interventions for this population.

Barriers and Benefits of Information Communication Technologies Used by Health Care Aides

BACKGROUND

Although information and communication technologies (ICT) are becoming more common among health care providers, there is little evidence on how ICT can support health care aides. Health care aides, also known as personal care workers, are unlicensed service providers who encompass the second largest workforce, next to nurses, that provide care to older adults in Canada.

OBJECTIVE

The purpose of this literature review is to examine the range and extent of barriers and benefits of ICT used by health care workers to manage and coordinate the care-delivery workflow for their clients.

METHODS

We conducted a literature review to examine the range and extent of ICT used by health care aides to manage and coordinate their care delivery, workflow, and activities. We identified 8,958 studies of which 40 were included for descriptive analyses.

RESULTS

We distinguished the following five different purposes for the use and implementation of ICT by health care aides: (1) improve everyday work, (2) access electronic health records for home care, (3) facilitate client assessment and care planning, (4) enhance communication, and (5) provide care remotely. We identified 128 barriers and 130 benefits related to adopting ICT. Most of the barriers referred to incomplete hardware and software features, time-consuming ICT adoption, heavy or increased workloads, perceived lack of usefulness of ICT, cost or budget restrictions, security and privacy concerns, and lack of integration with technologies. The benefits for health care aides' adoption of ICT were improvements in communication, support to workflows and processes, improvements in resource planning and health care aides' services, and improvements in access to information and documentation.

CONCLUSION

Health care aides are an essential part of the health care system. They provide one-on-one care to their clients in everyday tasks. Despite the scarce information related to health care aides, we identified many benefits of ICT adoption.

Co-development and Usability Testing of Research 101: A Patient-Oriented Research Curriculum in Child Health (PORCCH) E-Learning Module for Patients and Families

BACKGROUND

Engaging patients and families as research partners increases the relevance, quality, and impact of child health research. However, those interested in research engagement may feel underequipped to meaningfully partner. We sought to co-develop an online learning (e-learning) module, "Research 101," to support capacity-development in patient-oriented child health research amongst patients and families.

METHODS

Module co-development was co-led by a parent and researcher, with guidance from a diverse, multi-stakeholder steering committee. A mixed-methods usability testing approach, with three iterative cycles of semi-structured interviews, observations, and questionnaires, was used to refine and evaluate the e-learning module. Module feedback was collected during testing and a post-module interview, and with the validated System Usability Scale (SUS), and satisfaction, knowledge, and self-efficacy questionnaires. Transcripts and field notes were analyzed through team discussion and thematic coding to inform module revisions.

RESULTS

Thirty participants fully tested Research 101, and another 15 completed confirmatory usability testing (32 caregivers, 6 patients, and 7 clinician-researchers). Module modifications pertaining to learner-centered design, content, aesthetic design, and learner experience were made in each cycle. SUS scores indicated the overall usability of the final version was "excellent." Participants' knowledge of patient-oriented research and self-efficacy to engage in research improved significantly after completing Research 101 (p < 0.01).

CONCLUSIONS

Co-development and usability testing facilitated the creation of an engaging and effective resource to support the scaling up of patient-oriented child health research capacity. The methods and findings of this study may help guide the integration of co-development and usability testing in creating similar resources.

An analysis of usability evaluation practices and contexts of use in wearable robotics

BACKGROUND

User-centered design approaches have gained attention over the past decade, aiming to tackle the technology acceptance issues of wearable robotic devices to assist, support or augment human capabilities. While there is a consensus that usability is key to user-centered design, dedicated usability evaluation studies are scarce and clear evaluation guidelines are missing. However, the careful consideration and integration of user needs appears to be essential to successfully develop an effective, efficient, and satisfactory human-robot interaction. It is primarily the responsibility of the developer, to ensure that this users involvement takes place throughout the design process.

METHODS

Through an online survey for developers of wearable robotics, we wanted to understand how the design and evaluation in actual daily practice compares to what is reported in literature. With a total of 31 questions, we analyzed the most common wearable robotic device applications and their technology maturity, and how these influence usability evaluation practices.

RESULTS

A total of 158 responses from a heterogeneous population were collected and analyzed. The dataset representing contexts of use for augmentation (16.5%), assistance (38.0%), therapy (39.8%), as well as few other specific applications (5.7%), allowed for an insightful analysis of the influence of technology maturity on user involvement and usability evaluation. We identified functionality, ease of use, and performance as the most evaluated usability attributes and could specify which measures are used to assess them. Also, we could underline the frequent use of qualitative measures alongside the expected high prevalence of performance-metrics. In conclusion of the analysis, we derived evaluation recommendations to foster user-centered design and usability evaluation.

CONCLUSION

This analysis might serve as state-of-the-art comparison and recommendation for usability studies in wearable robotics. We believe that by motivating for more balanced, comparable and user-oriented evaluation practices, we may support the wearable robotics field in tackling the technology acceptance limitations.

Usability and Acceptance of an Interactive Tablet-Based Exercise Application: A Mixed Methods Study

Purpose: To investigate usability and acceptance of a newly developed interactive, tablet-based exercise application (app) and to explore personal opinions of therapists when using this app in the clinical setting.

Methods: Twenty participants (10 therapists and 10 inactive healthy adults) tested usability of this app performing different test tasks, using the think aloud method, and rated overall satisfaction with the System Usability Scale and acceptance with a modified Technology Acceptance Model Questionnaire. For a secondary objective, personal opinions of therapists were evaluated with two focus groups, one for team leaders and one for team members.

Results: Overall, the app was judged to be usable. Effectiveness varied between 73 and 90%, overall satisfaction between 70.5 and 85.5/100 points and acceptance between 74 and 80%. Team leader and team member focus groups considered the app as providing a great opportunity for therapy extension, especially because of its blended character. Barriers to its implementation were seen in the existing clinical working processes, personal attitudes of therapists and uncertainty of who would cover expenses for this new form of therapy. Some improvements such as using videos instead of photos, the integration of more interactive tools and the possibility to add additional exercises were suggested in both settings.

Conclusion: The app showed high acceptance and usability in trainees and therapists, although some ideas for upgrading functions were formulated. Before this app can be used in clinical practice, feasibility of this blended approach should be evaluated in a clinical setting.

Bringing Your Idea to the Market: A Primer for Plastic Surgeons

SUMMARY

The progress of biotechnology, medical instruments, and applied sciences contributes to a rapidly expanding space for the advancement of the medical field. Surgeons experience first-hand the limitations of current medical devices and thus have unique insight into problems that could be solved with new products. The process of turning an idea into a product capable of success in the marketplace, however, is often unfamiliar to surgeons. The authors seek to illuminate this process and provide an ordered list of tasks that can make bringing ideas to market more achievable for surgeons. The first step in this process is the generation and protection of a new idea. Next, the process of making an idea into a product is outlined. This phase involves team assembly, business planning, and product development. Market research and valuation are key to understanding how a product can be applied in the market, and meticulous research during this phase allows for informed decision-making that will help secure funding down the road. Finally, various options for financing are discussed and compared to help surgeon-entrepreneurs find an option that best fits their project, and steps to maximize leverage are described. The development of new products can be a complicated process for surgeons. Organized into four phases, with ordered instructional steps to advance through each phase, the process of bringing an idea to the market is clarified. Facilitating this process will possibly contribute to the continual improvement of medical and surgical abilities through the introduction of new devices and technologies.

Rationale and Methods of Evaluation for ACHO, A New Virtual Assistant to Improve Therapeutic Adherence in Rural Elderly Populations: A User-Driven Living Lab

Low therapeutic adherence is a concern for health professionals as it decreases therapeutic efficiency while increasing costs, especially in elderly populations. To increase therapeutic adherence in elderly populations, the technology applied in the medical devices that are used must be adapted to improve usability. This paper outlines the rationale behind, and methods applied to assess the usability of, ACHO (Assistant on Care and Health Offline), a voice assistant that provides elderly patients with reminders of medical appointments to attend and when they need to take their medication. This work is a descriptive, cross-sectional, observational study, and will include a three-phase (analysis, testing and refinement) multidimensional usability analysis of an initial prototype, in the setting of a user-driven Living Lab, which enables the needs and characteristics of the end users to be identified and incorporated into the prototype with each iteration, in which a multidisciplinary team of researchers and users will participate as co-creators. This methodology will allow us to develop a better prototype, increasing usability and, thus, increasing therapeutic adherence.

Towards a Platform for Robot-Assisted Minimally-Supervised Therapy of Hand Function: Design and Pilot Usability Evaluation

BACKGROUND

Robot-assisted therapy can increase therapy dose after stroke, which is often considered insufficient in clinical practice and after discharge, especially with respect to hand function. Thus far, there has been a focus on rather complex systems that require therapist supervision. To better exploit the potential of robot-assisted therapy, we propose a platform designed for minimal therapist supervision, and present the preliminary evaluation of its immediate usability, one of the main and frequently neglected challenges for real-world application. Such an approach could help increase therapy dose by allowing the training of multiple patients in parallel by a single therapist, as well as independent training in the clinic or at home.

METHODS

We implemented design changes on a hand rehabilitation robot, considering aspects relevant to enabling minimally-supervised therapy, such as new physical/graphical user interfaces and two functional therapy exercises to train hand motor coordination, somatosensation and memory. Ten participants with chronic stroke assessed the usability of the platform and reported the perceived workload during a single therapy session with minimal supervision. The ability to independently use the platform was evaluated with a checklist.

RESULTS

Participants were able to independently perform the therapy session after a short familiarization period, requiring assistance in only 13.46 (7.69-19.23)% of the tasks. They assigned good-to-excellent scores on the System Usability Scale to the user-interface and the exercises [85.00 (75.63-86.88) and 73.75 (63.13-83.75) out of 100, respectively]. Nine participants stated that they would use the platform frequently. Perceived workloads lay within desired workload bands. Object grasping with simultaneous control of forearm pronosupination and stiffness discrimination were identified as the most difficult tasks.

DISCUSSION

Our findings demonstrate that a robot-assisted therapy device can be rendered safely and intuitively usable upon first exposure with minimal supervision through compliance with usability and perceived workload requirements. The preliminary usability evaluation identified usability challenges that should be solved to allow real-world minimally-supervised use. Such a platform could complement conventional therapy, allowing to provide increased dose with the available resources, and establish a continuum of care that progressively increases therapy lead of the patient from the clinic to the home.

Use of the ADAPTE method to develop a clinical guideline for the improvement of psychoses and schizophrenia care: Example of involvement and participation of patients and family caregivers

Introduction

The aim of this study is to analyse different ways of participation during the development of a clinical guideline to improve the early detection of psychosis and to deploy a comprehensive treatment plan to improve prognosis and social integration.

Materials and method

The clinical guideline was developed using the ADAPTE method with the participation of 40 authors and 80 external reviewers. The process was divided into three major phases: set up, adaptation and finalization. During adaptation and completion, a total of 44 patients and 18 family caregivers were involved.

Results and conclusions

The different roles assumed by the patients and their family caregivers were described, depending on the panel in which they participated, with diverse grades of complexity: a user as author, integration of the results of qualitative research with the participation of local users and family caregivers, 13 users as individual external reviewers and the participation of users and caregiver organizations in the external review. In the guideline, contributions from patients during the qualitative research were included in an innovative way, placing them just behind the recommendations. On the other hand, the results of the family caregivers’ study were included in a specific area of uncertainty. Further, the expressed point of view was considered as the collective demands of users and family caregivers’ organizations in the cost‐benefit analysis made by the organizing committee. There were diverse ways to conduct direct patient participation during the guideline development, ensuring that their individual experiences contributed significantly to the final version.

A New Method for Structured Integration of User Needs in Two Health Technology Development Projects: Action Sheets

An early integration of users and stakeholders is needed for a successful innovation process. Nonetheless, the integration of users is often hard to realize - especially when dealing with persons with chronic diseases. In addition, patients or users in general often are not able to formulate the requirements in a technical manner. Therefore, even if user requirements are collected, it is not certain that the developers know or understand 'what is really wanted'. To overcome these 'gaps', we have developed so-called Action Sheets (AS). This article presents the use of AS in two projects: the development of health technologies for people with cancer (INFOPAT) and dementia (QuartrBack). Depending on the project context, group sessions were conducted with different stakeholders to identify the needs of (potential) users. Within the INFOPAT project, ten focus groups were conducted with patients, physicians and other healthcare professionals. In QuartrBack stakeholders like e.g. care professionals, technical assistance organizations and citizens participated in two focus groups and three world cafés. Their requirements were then 'fed' into the technology development by the use of AS. AS appear to be a promising tool to make user needs based on social values more tangible and implementable into technology development processes. In addition, it shows up that four phases seem to be necessary for transferring identified user and stakeholder needs into AS, which can therefore be seen as essential to translate non-technically formulated requirements into technically feasible ones. The case study shows as lessons learned that despite the successful integration of user needs, context-sensitive adjustments are still necessary.

Integrating Key User Characteristics in User-Centered Design of Digital Support Systems for Seniors' Physical Activity Interventions to Prevent Falls: Protocol for a Usability Study

Background

The goal of user-centered design (UCD) is to understand the users’ perspective and to use that knowledge to shape more effective solutions. The UCD approach provides insight into users’ needs and requirements and thereby improves the design of the developed services. However, involving users in the development process does not guarantee that feedback from different subgroups of users will shape the development in ways that will make the solutions more useful for the entire target user population.

Objective

The aim of this study was to describe a protocol for systematic analysis and prioritization of feedback from user subgroups in the usability testing of a digital motivation support for fall-preventive physical activity (PA) interventions in seniors (aged 65 years and older). This protocol can help researchers and developers to systematically exploit feedback from relevant user subgroups in UCD.

Methods

Gender, PA level, and level of technology experience have been identified in the literature to influence users’ experience and use of digital support systems for fall-preventive PA interventions in seniors. These 3 key user characteristics were dichotomized and used to define 8 (ie, 2³) possible user subgroups. The presented method enables systematic tracking of the user subgroups’ contributions in iterative development. The method comprises (1) compilation of difficulties and deficiencies in the digital applications identified in usability testing, (2) clustering of the identified difficulties and deficiencies, and (3) prioritization of deficiencies to be rectified. Tracking user subgroup representation in the user feedback ensures that the development process is prioritized according to the needs of different subgroups. Mainly qualitative data collection methods are used.

Results

A protocol was developed to ensure that feedback from users representing all possible variants of 3 selected key user characteristics (gender, PA level, and level of technology experience) is considered in the iterative usability testing of a digital support for seniors’ PA. The method was applied in iterative usability testing of two digital applications during spring/summer 2018. Results from the study on the users’ experiences and the iterative modification of the digital applications are expected to be published during 2021.

Conclusions

Methods for systematic collection, analysis, and prioritization of feedback from user subgroups might be particularly important in heterogenous user groups (eg, seniors). This study can contribute to identifying and improving the understanding of potential differences between user subgroups of seniors in their use and experiences of digital support for fall-preventive PA interventions. This knowledge may be relevant for developing digital support systems that are appropriate, useful, and attractive to users and for enabling the design of digital support systems that target specific user subgroups (ie, tailoring of the support). The protocol needs to be further used and investigated in order to validate its potential value.

International Registered Report Identifier (IRRID)

RR1-10.2196/20061

Design thinking as an approach for innovation in healthcare: systematic review and research avenues

Design thinking has been increasingly adopted as an approach to support innovation in healthcare. Recent publications report design thinking application to various innovation projects, across medical specialties, including paediatrics, psychiatry, radiology, gastroenterology, oncology, orthopaedics and surgery, as well as to innovation in hospital operations and healthcare management. Current literature in the area typically focuses on single case descriptions. With the recent increase in the number of cases, there is an opportunity to assess multiple cases to identify patterns and avenues for further research. This study provides a systematic review of published design thinking projects in healthcare. The aim of the study is to provide an overview of how design thinking has been applied in the healthcare sector. Data collection was based on Institute of Scientific Information (ISI) Web of Science, PubMed and Scopus databases. The systematic review followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A total of 32 original pieces of research was selected for analysis, being classified and assessed. The paper presents current status of research and practice from various perspectives, including the design thinking progression phase—inspiration, ideation, implementation—and the prevalence of design thinking tools. Avenues for further research include the need to increase focus on the inspiration phase, the opportunity for platforms for leveraging the integration of individuals in innovation projects, and the opportunity to enhance the role of lead users in healthcare innovation.

Clinicians' perspectives on inertial measurement units in clinical practice

Inertial measurement units (IMUs) have been increasingly popular in rehabilitation research. However, despite their accessibility and potential advantages, their uptake and acceptance by health professionals remain a big challenge. The development of an IMU-based clinical tool must bring together engineers, researchers and clinicians. This study is part of a developmental process with the investigation of clinicians’ perspectives about IMUs. Clinicians from four rehabilitation centers were invited to a 30-minute presentation on IMUs. Then, two one-hour focus groups were conducted with volunteer clinicians in each rehabilitation center on: 1) IMUs and their clinical usefulness, and 2) IMUs data analysis and visualization interface. Fifteen clinicians took part in the first focus groups. They expressed their thoughts on: 1) categories of variables that would be useful to measure with IMUs in clinical practice, and 2) desired characteristics of the IMUs. Twenty-three clinicians participated to the second focus groups, discussing: 1) functionalities, 2) display options, 3) clinical data reported and associated information, and 4) data collection duration. Potential influence of IMUs on clinical practice and added value were discussed in both focus groups. Clinicians expressed positive opinions about the use of IMUs, but their expectations were high before considering using IMUs in their practice.

"I felt like a TRIO champion": end-user perspectives on their role as co-designers of multi-purpose technologies

Background: The likelihood that research will be relevant to and accepted by end-users and their communities is enhanced when the perspectives of both the "researchers" and the "researched" are considered. The Tablets, Ring, Injections as Options (TRIO) Study, conducted with young women in Kenya and South Africa, assessed the acceptability and preferences of three placebo-only multi-purpose technology (MPT) forms for prevention of HIV and unintended pregnancy. The objective of this analysis was to assess whether, and if so how, the women participating in the TRIO Study perceived themselves as co-designers of the three MPT products. Methods: We conducted 55 in-depth interviews, 6 focus group discussions, and 5 dissemination workshops with TRIO Study participants. Woven throughout these activities were questions and opportunities for participants to reflect on their role in the study, and to what extent they identified with their role as a co-designer. Qualitative data from these activities were analyzed thematically. Results: The analysis revealed four key themes about what resulted in the women's views as co-designers: altruism, respectful treatment, agency, and reciprocity. The women were aware of their role in determining what end-users would and would not prefer and were motivated by a desire to help themselves and others. They recognized their role as co-designers and cited being treated well by study staff, being given a chance to make choices during the study period, and being recognized as equal partners of the researchers as the main reasons. Conclusions: If prevention products are going to be successfully developed, end-users and researchers must work hand in hand. Engaging participants meaningfully as co-designers in product development research can be a powerful tool in the effort to ensure new prevention products brought to market are acceptable to the population of interest.

Factors Influencing Private Hospitals' Participation in the Innovation of Biomedical Engineering Industry: A Perspective of Evolutionary Game Theory

The innovation of the biomedical engineering (BME) industry is inseparable from its cooperation with medical institutions. China has considerable medical institutions. Although private hospitals account for more than half of Chinese medical institutions, they rarely participate in biomedical engineering industry innovation. This paper analyzed the collaborative relationship among biomedical engineering enterprises, universities, research institutes, public hospitals and private hospitals through evolutionary game theory and discussed the influence of different factors on the collaborative innovation among them. A tripartite evolutionary game model is established which regards private hospitals as a stakeholder. The results show that (1) the good credit of private hospitals has a positive effect on their participation in collaborative innovation; (2) it is helpful for BME collaborative innovation to enhance the collaborative innovation ability of partners; (3) the novelty of innovation projects has an impact on BME collaborative innovation. The specific impacts depend on the revenue, cost and risk allocation ratio of innovation partners; (4) the higher the practicability of innovation projects, the more conducive to collaborative innovation.

The Importance of User Involvement: A Systematic Review of Involving Older Users in Technology Design

BACKGROUND AND OBJECTIVES

There is a lack of understanding of how older adults' involvement and participation matters in actual design practice. This systematic literature review investigates existing empirical studies involving older users during the design of technologies and explores the nature and consequences of involving older people.

RESEARCH DESIGN AND METHODS

Our literature review is informed by the guidelines of the PRISMA statement. We examined the included studies by means of thematic content analysis to identify the nature of older users' involvement and existing evidence on what consequences it has.

RESULTS

In total, 40 empirical studies published in the period 2014-2018 are included in the review. Most empirical studies involve older people from local networks, with underlying stereotypical images and at lower levels of participation. The results reveal three main consequences of involving older users: learning, adjusted design, and an increased sense of participation. Furthermore, we found that user involvement is a structured process whose outcomes are contingent on a range of premises.

DISCUSSION AND IMPLICATIONS

Synthesizing the results, we develop the concept of user involvement and present an analytical framework. Our results have implications for researchers and policy makers, since they throw into question the widely held assumption that involving older people inevitably yields beneficial outcomes.

Exoskeleton use in post-stroke gait rehabilitation: a qualitative study of the perspectives of persons post-stroke and physiotherapists

Background

Wearable powered exoskeletons are a new and emerging technology developed to provide sensory-guided motorized lower limb assistance enabling intensive task specific locomotor training utilizing typical lower limb movement patterns for persons with gait impairments. To ensure that devices meet end-user needs it is important to understand and incorporate end-users perspectives, however research in this area is extremely limited in the post-stroke population. The purpose of this study was to explore in-depth, end-users perspectives, persons with stroke and physiotherapists, following a single-use session with a H2 exoskeleton.

Methods

We used a qualitative interpretive description approach utilizing semi-structured face to face interviews, with persons post-stroke and physiotherapists, following a 1.5 h session with a H2 exoskeleton.

Results

Five persons post-stroke and 6 physiotherapists volunteered to participate in the study. Both participant groups provided insightful comments on their experience with the exoskeleton. Four themes were developed from the persons with stroke participant data: (1) Adopting technology; (2) Device concerns; (3) Developing walking ability; and, (4) Integrating exoskeleton use. Five themes were developed from the physiotherapist participant data: (1) Developer-user collaboration; (2) Device specific concerns; (3) Device programming; (4) Patient characteristics requiring consideration; and, (5) Indications for use.

Conclusions

This study provides an interpretive understanding of end-users perspectives, persons with stroke and neurological physiotherapists, following a single-use experience with a H2 exoskeleton. The findings from both stakeholder groups overlap such that four over-arching concepts were identified including: (i) Stakeholder participation; (ii) Augmentation vs. autonomous robot; (iii) Exoskeleton usability; and (iv) Device specific concerns. The end users provided valuable perspectives on the use and design of the H2 exoskeleton, identifying needs specific to post-stroke gait rehabilitation, the need for a robust evidence base, whilst also highlighting that there is significant interest in this technology throughout the continuum of stroke rehabilitation.

Digital neuropsychological assessment: Feasibility and applicability in patients with acquired brain injury

INTRODUCTION

Digital neuropsychological assessment (d-NPA) has several advantages over paper-and-pencil tests in neuropsychological assessment, such as a more standardized stimulus presentation and response acquisition. We investigated (1) the feasibility and user-experience of a d-NPA in patients with acquired brain injury (ABI) and healthy controls; (2) the applicability of conventional paper-and-pencil norms on digital tests; and (3) whether familiarity with a tablet would affect test performance on a tablet.

METHOD

We administered a d-NPA in stroke patients (n = 59), traumatic brain injury patients (n = 61) and healthy controls (n = 159). The neuropsychological tests were presented on a tablet and participants used a pencil stylus to respond. We examined the completion rate to assess the feasibility, and a semi-structured interview was conducted to examine the user-experience. The applicability of conventional norms was examined by the number of healthy controls performing <10^th percentile, which was expected to be no more than 10%. The effect of tablet familiarity on test performance was examined with a regression-based model.

RESULTS

Overall, 94% of patients completed the d-NPA. The d-NPA was considered pleasant by patients and healthy controls. Conventional norms that exist for paper-and-pencil tests were not applicable on the digital version of the tests, as up to 34% of healthy controls showed an abnormal performance on half of the tests. Tablet familiarity did not affect test performance on a tablet, indicating that participants who were more experienced with working with a tablet did not perform better on digital tests.

CONCLUSIONS

The administration of a d-NPA is feasible in patients with ABI. Familiarity with a tablet did not impact test performance, which is particularly important in neuropsychological assessment. Future research should focus on developing norms in order to implement a d-NPA in clinical practice.

Building an innovation system of medical devices in China: Drivers, barriers, and strategies for sustainability

Objectives

This article aimed to discuss the emergence of medical device sector in China from a sectoral innovation system perspective, to explore the drivers and barriers to the successful building of an innovation system of medical devices, and to highlight the policy implications and suggestions for sustainable innovation of medical devices.

Methods

A theoretical framework of sectoral systems of innovation was applied in the analysis of data, and materials were collected from multiple sources with particular attention paid to the evolutionary phases, structure, and function of the innovation system.

Results

The evolution of medical device sector in China could be divided into four phases: initialization (1960s-1970s); exploration (1980s); steady growth (1990s); and rapid growth (since 2000). Through analyzing the innovation system's structural components of technology, actors, and networking, as well as institutions, this study indicated that the government policy decision was the most important driver that affected the virtuous cycle of the Chinese medical device innovation system, followed by market demand and entrepreneurial activities. However, barriers against the innovation cycle such as knowledge base development and diffusion, legitimacy, and resource mobilization still remained.

Conclusion

In its endeavor to build an innovation system, the Chinese medical device sector had made some progress in meeting the local medical demands and improving its industrial competence. Although a Chinese innovation system for medical devices was initiated under the guidance of the government, knowledge advancement and diffusion had become the main challenges for the sustainability of innovation in this sector. The future development depends on China's effort and ability to establish education and health research systems specific to medical devices.

Impact of Design on Medical Device Safety

The growing number of emerging medical technologies and sophistication of modern medical devices (MDs) that improve both survival and quality of life indexes are often challenged by alarming cases of vigilance data cover-up and lack of sufficient pre- and post-authorization controls. Combining Quality with Risk Management processes and implementing them as early as possible in the design of MDs has proven to be an effective strategy to minimize residual risk. This article aims to discuss how the design of MDs interacts with their safety profile and how this dipole of intended performance and safety may be supported by Human Factors Engineering (HFE) throughout the Total Product Life-Cycle (TPLC) of an MD in order to capitalize on medical technologies without exposing users and patients to unnecessary risks.

User-centred design and evaluation of a tele-operated echocardiography robot

We present the collected findings of a user-centred approach for developing a tele-operated robot for remote echocardiography examinations. During the three-year development of the robot, we involved users in all development stages of the robot, to increase the usability of the system for the doctors. For requirement compilation, we conducted a literature review, observed two traditional examinations, arranged focus groups with doctors and patients, and conducted two online surveys. During the development of the robot, we regularly involved doctors in usability tests to receive feedback from them on the user interface for the robot and on the robot’s hardware. For evaluation of the robot, we conducted two eye tracking studies. In the first study, doctors executed a traditional echocardiography examination. In the second study, the doctors conducted a remote examination with our robot. The results of the studies show that all doctors were able to successfully complete a correct ultrasonography examination with the tele-operated robot. In comparison to a traditional examination, the doctors on average only need a short amount of additional time to successfully examine a patient when using our remote echocardiography robot. The results also show that the doctors fixate considerably more often, but with shorter fixation times, on the USG screen in the traditional examination compared to the remote examination. We found further that some of the user-centred design methods we applied had to be adjusted to the clinical context and the hectic schedule of the doctors. Overall, our experience and results suggest that the usage of user-centred design methodology is well suited for developing medical robots and leads to a usable product that meets the end users’ needs.

Filling the Gap: A Correlation between Objective and Subjective Measures of Injectability

Various injectable biomaterials are developed for the minimally invasive delivery of therapeutics. Typically, a mechanical tester is used to ascertain the force required to inject these biomaterials through a given syringe-needle system. However, currently there is no method to correlate the force measured in the laboratory to the perceived effort required to perform that injection by the end user. In this article, the injection force (F) for a variety of biomaterials, displaying a range of rheological properties, is compared with the effort scores from a 50 person panel study. The maximum injection force measured at crosshead speed 1 mm s^-1 is a good proxy for injection effort, with an R² of 0.89. This correlation leads to the following conclusions: participants can easily inject 5 mL of substance for F < 12 N; considerable effort is required to inject 5 mL for 12 N < F < 38 N; great effort is required and <5 mL can be injected for 38 N < F < 64 N; and materials are entirely non-injectable for F > 64 N. These values may be used by developers of injectable biomaterials to make decisions about formulations and needle sizes early in the translational process.

Complexity Stage Model of the Medical Device Development Based on Economic Evaluation—MedDee

The development of a new product is essential for the progress and success of any company. The medical device market is very specific, which is challenging. Therefore, this paper assesses an economic model for medical device evaluation using the economic, health, technology regulatory, and present market knowledge to enable the cost–time conception for any applicant. The purpose of this study is to propose a comprehensive stage model of the medical device development to subsequently describe the financial expenditure of the entire development process. The identification of critical steps was based on the literature review, and analysis, and a comparison of the available medical device development stages and directives. Furthermore, a preliminary assessment of the medical device development steps and procedures on the basis of the interviews was performed. Six interviews were conducted with an average duration of one hour, focusing on areas: relevance and level of detail of the medical device development stages, involvement of economic methods, and applicability of the proposed model. Subsequently, the improvement and modification of the medical device investment process, based on respondents’ responses, were conducted. The authors have proposed the complexity model MedDee—Medical Devices Development by Economic Evaluation. This model is comprised of six phases: initiation, concept, design, production, final verification, and market disposition in which the economic methods are incorporated.

User-centered Design and Evaluation of Physical Interfaces for an Exoskeleton for Paraplegic Users

Over the last decade, the use of wearable exoskeletons for human locomotion assistance has become more feasible. The VariLeg powered lower limb robotic exoskeleton is an example of such systems, potentially enabling paraplegic users to perform upright activities of daily living. The acceptance of this type of robotic assistive technologies is often still affected by limited usability, in particular regarding the physical interface between the exoskeleton and the user (here referred to as pilot). In this study, we proposed and evaluated a novel pilot attachment system (PAS), which was designed based on user-centered design with experienced paraplegic exoskeleton users. Subjective assessments to compare usability aspects of the initial and the redesigned physical interfaces were conducted with two paraplegic and five healthy pilots. The redesigned PAS showed a 45% increase in the system usability scale (SUS), normalized to the PAS of a commercial exoskeleton assessed in the same manner. Pain rating scales assessed with healthy pilots indicated an increased comfort using the redesigned PAS while performing several activities of daily living. Overall, an improvement in usability relative to the initial PAS was achieved through intensified user evaluation and individual needs assessments. Hence, a user-centered design of physical body-machine interfaces has the potential to positively influence the usability and acceptance of lower limb exoskeletons for paraplegic users.

Questionnaires or Inner Feelings: Who Measures the Engagement Better?

This work proposes an innovative method for evaluating users’ engagement, combining the User Engagement Scale (UES) questionnaire and a facial expression recognition (FER) system, active research topics of increasing interest in the human–computer interaction domain (HCI). The subject of the study is a 3D simulator that reproduces a virtual FabLab in which users can approach and learn 3D modeling software and 3D printing. During the interaction with the virtual environment, a structured-light camera acquires the face of the participant in real-time, to catch its spontaneous reactions and compare them with the answers to the UES closed-ended questions. FER methods allow overcoming some intrinsic limits in the adoption of questioning methods, such as the non-sincerity of the interviewees and the lack of correspondence with facial expressions and body language. A convolutional neural network (CNN) has been trained on the Bosphorus database (DB) to perform expression recognition and the classification of the video frames in three classes of engagement (deactivation, average activation, and activation) according to the model of emotion developed by Russell. The results show that the two methodologies can be integrated to evaluate user engagement, to combine weighted answers and spontaneous reactions and to increase knowledge for the design of the new product or service.