Development and content validation of the Telenursing Interaction and Satisfaction Questionnaire (TISQ)

Interaction between telenurses and callers - A deductive analysis of content and timing in telephone nursing calls

OBJECTIVES

To explore the content and timing of verbal interaction between telephone nurses and callers, and to suggest areas for improvement.

METHODS

Transcribed telephone conversations (n = 30) to a national nurse-led advisory service were analyzed using deductive content analysis. Categorization of data was based on components of interaction in the Interaction Model of Client Heath Behavior (IMCHB): health information, affective support, decisional control, and professional-technical competencies. The content was described both quantitatively, based on word count, and qualitatively, using descriptions and exemplars. Transcripts were also coded according to five phases in the conversation process: opening, listening, analyzing, motivating, and ending. The distribution of interaction components among phases was explored.

RESULTS

Interaction primarily focused on health information, particularly during the listening and analyzing phases. Telenurses based their advice on medical facts and guided callers through the conversation process. Callers' emotions and reflections on advice were rarely discussed.

CONCLUSIONS

Health information dominate conversations. Interaction can be further developed, particularly with respect to acknowledging callers' emotional responses, their reactions to advice, and ensuring clarity in exchange of health information.

PRACTICE IMPLICATIONS

Findings offer valuable guidance for future development of interaction in telenursing.

The telephone nursing dialogue process: an integrative review

BACKGROUND

Telephone nursing involves triage, advice, and care management provided by a nurse over the telephone. The telephone nursing dialogue process has been used clinically in telephone nursing in Sweden for several years to structure the communication and ensure a safe assessment and advice. Studies are needed to determine whether there is sufficient scientific evidence to support the method.

AIM

To describe the scientific basis of the phases of the telephone nursing dialogue process.

DESIGN

This was an integrative review.

METHODS

The literature searches were performed in August 2023, in the PubMed, CINAHL, Cochrane Database of Systematic Reviews and SwePUB databases. Sixty-two articles were included. Data was sorted deductively according to the five phases of the telephone nursing dialogue process and categorized inductively to form subcategories describing the content of each phase.

RESULT

All five phases in the telephone nursing dialogue process were supported by a range of articles (n = 32-50): Opening (n = 32), Listening (n = 45), Analysing (n = 50), Motivating (n = 48), and Ending (n = 35). During the opening of the call, the nurse presents herself, welcomes the caller and establishes a caring relationship. In the listening phase, the nurse invites the caller to tell their story, listens actively and confirms understanding. During the analyzing phase, the nurse gathers, assesses, and verifies information. In the motivating phase, the nurse reaches a final assessment, informs the caller, gives advice and creates a mutual agreement and understanding while supporting the caller. Ultimately, the nurse ends the call after checking for mutual agreement and understanding, giving safety-net advice, deciding on whether to keep monitoring the caller and rounding off the call.

CONCLUSION

The phases of the telephone nursing dialogue process as described in the scientific literature are well aligned with the theoretical descriptions of the telephone nursing dialogue process.

Psychometric evaluation of the Telenursing Interaction and Satisfaction Scale

AIMS AND OBJECTIVES

Interaction between caller and telenurse in telenursing is important for caller satisfaction and subsequent compliance. Despite this, satisfaction measures with focus on interaction in telenursing are scarce and rarely anchored in nursing theory. The aim was to evaluate the psychometric properties of the Telenursing Interaction and Satisfaction Scale (TISS) with focus on data quality, factor structure, convergent validity, and reliability.

METHODOLOGICAL DESIGN AND JUSTIFICATION

This psychometric study was based on cross-sectional data.

RESEARCH METHODS, INSTRUMENTS, AND/OR INTERVENTIONS

Callers to the National Medical Advisory Service in Sweden (n = 616) completed the 60-item Telenursing Interaction and Satisfaction Questionnaire based on Cox's Interaction Model of Client Health Behavior. Twenty-five of these items were selected to form the TISS in four subscales according to the model. Data quality was evaluated in terms of missing data patterns and score distributions. The factor structure was evaluated with confirmatory factor analysis for ordinal data, convergent validity with Spearman correlations, internal consistency with ordinal alpha, scale reliability with composite reliability coefficients, and test-retest reliability with intraclass correlations.

RESULTS

The amount of missing data was acceptable and equally distributed. Data deviated significantly from a normal distribution. All response options were endorsed. The factor analysis confirmed the hypothesised four-factor structure; factor loadings ranged from 0.56 to 0.97 and factor correlations were high (0.88-0.96). Internal consistency (ordinal alpha = 0.82-0.97), scale reliability (0.88-0.99), and test-retest reliability (ICC = 0.77-0.86) were satisfactory for all scales.

STUDY LIMITATIONS

The study design did not allow drop-out analysis.

CONCLUSIONS

The TISS showed satisfactory psychometric properties in the study sample. It provides a measure that enables quantitative measurement of caller satisfaction with interaction in telenursing.

Telenursing: The view of care professionals in selected EU countries. A pilot study

Background

With the growth of digital nursing, several studies have focused on recording patients' views on remote care, or specialised nurse staffing aspects. This is the first international survey on telenursing focused exclusively on clinical nurses that analyses the dimensions of usefulness, acceptability, and appropriateness of telenursing from the staff point of view.

Methods

A previously validated structured questionnaire including demographic variables, 18 responses with a Likert-5 scale, three dichotomous questions, and one overall percentual estimation of holistic nursing care susceptible to being undertaken by telenursing, was administered (from 1 September to 30 November 2022) to 225 clinical and community nurses from three selected EU countries. Data analysis: descriptive data, classical and Rasch testing.

Results

The results show adequacy of the model for measurement of the domains of usefulness, acceptability, and appropriateness of telenursing (overall Cronbach's alpha 0.945, Kaiser-Meyer-Olkin 0.952 and Bartlett's p < 0.001). Answers in favour of telenursing ranked 4 out of 5 in Likert scale, both globally and by the three domains. Rasch: reliability coefficient 0.94, Warm's main weighted likelihood estimate reliability 0.95. In the ANOVA analysis, the results for Portugal were significantly higher than those for Spain and Poland, both overall and for each of the dimensions. Respondents with bachelor's, master's and doctoral degrees score significantly higher than those with certificates or diplomas. Multiple regression did not yield additional data of interest.

Conclusions

The tested model proved to be valid, but although the majority of nurses are in favour of telenursing, given the nature of the care, which is mainly face-to-face, according to the respondents, the chances of carrying out their activities by telenursing is only 35.3%. The survey provides useful information on what can be expected from the implementation of telenursing and the questionnaire proves to be a useful tool to be applied in other countries.

Telenursing: A Concept Analysis

The national nursing shortage is affecting hospital leaders in their ability to employ nursing staff. Nursing staffing shortages contribute to extended nurse-to-patient ratios and increased workload for staff. Increased workload contributes to missed nursing care and correlates with increased patient length of stay, readmission rates, patient safety errors, and hospital-acquired infections. Telehealth services have shown initial improvements in care quality outcomes but have not addressed nursing workload or nursing shortages. Telenursing has potential to provide additional nursing support to offset the workloads of bedside nursing staff and break the associated cycle of adverse outcomes. Various definitions of telenursing are present in the literature, but a concept analysis of telenursing has not been published. Understanding the concept of telenursing is necessary to integrate this concept within the context of researching nursing shortages and patient and nurse outcomes in acute care hospitals. The author used Walker and Avant's eight-step procedure to define the concept of telenursing and present a model case, a related case, and a contrary case to describe the telenursing concept. This concept analysis helps to provide clarity around the concept of telenursing and directions for future research. Understanding the concept of telenursing is necessary to integrate this concept within the context of researching nursing shortages, nursing satisfaction, and patient and nurse outcomes in various healthcare settings.

Role of interaction for caller satisfaction in telenursing-A cross-sectional survey study

AIMS AND OBJECTIVES

The aim of this study was to explore caller satisfaction with interaction, and the association to overall satisfaction with calls.

BACKGROUND

In the era of expanding healthcare at distance, the telephone remains a common tool for the provision of nursing care. Interaction between telenurse and caller in telenursing is vital for safety, satisfaction and adherence reasons. Few studies have quantitatively explored interaction in calls and how it relates to overall satisfaction with calls.

DESIGN

Cross-sectional survey study with a deductive approach.

METHODS

A total of 466 callers to the Swedish Medical Advisory Service completed the Telenursing Interaction and Satisfaction Questionnaire. Satisfaction with four theoretically defined components of interaction were compared using repeated measures ANOVA. Associations between satisfaction with interaction and overall satisfaction with calls were evaluated with ordinal logistic regression models with and without adjustment for age, sex, health status, waiting time, time for call, main result of the call and expectations. The study followed the STROBE checklist.

RESULTS

Callers were most satisfied with affective support, followed by professional-technical competence, health information and decisional control-in that order. A summated score of satisfaction with interaction was positively and significantly associated with overall satisfaction with calls before and after adjustment for waiting time, main result of call and variables related to the individual caller.

CONCLUSIONS

Caller satisfaction with interaction is generally high but can be improved, especially regarding decisional control. Satisfaction with interaction is important for overall satisfaction with calls.

RELEVANCE TO CLINICAL PRACTICE

This study provides support for professionals at all levels in telenursing organisations to pay attention to interactional matters. The development of best practice for telenurses needs to consider all four components of interaction to enhance satisfaction with calls.

Validation of a New Telenursing Questionnaire: Testing the Test

Background: Existing surveys on telenursing refer to specific areas of nursing after the implementation of a programme, but telenursing in general has not been fully evaluated from a prospective approach. Aim: Design and statistical validation of a telenursing questionnaire. Methods: A new questionnaire was designed with 18 paired (to avoid leading) questions (Likert-5) plus three dichotomous questions (randomly ordered, inspired by existing validated tests) to analyse the dimensions of: acceptance, usefulness and appropriateness of telenursing from the nursing point of view (7 min test). The questionnaire was validated by classical tests and item response tests (Rasch) using six computer-generated databases with different response profiles (tendency to be positioned against, neutral and positioned in favour) with two degrees of agreement between each pair of responses for each option. Results: Classical testing: Cronbach’s alphas (from 0.8 to 0.95), Kaiser–Meyer–Olkin (KMO) (0.93 to 0.95) and a significant p < 0.0001 for Bartlett’s test of sphericity were obtained. Rasch analysis: Reliability coefficients (0.94). Warm’s mean weighted likelihood estimates (0.94). Extreme infit-t and outfit-t values (+1.61 to −1.98). Conclusions: Both the classical test and the Rasch approaches confirm the usefulness of the new test for assessing nurses’ positioning in relation to telenursing.

A Proposed Patient-Inclusive Methodology for Developing and Validating Telehealth Surveys that Include Social Determinants of Health

This paper discusses a method to develop and validate telehealth surveys that include social determinants of health domains. We performed a scoping review of literature on measuring social determinants of health and extracted 50 social determinants of health domains. We evaluated 14 validated telehealth surveys for questions associated with social determinants of health. We categorized the questions from the validated telehealth surveys using our extracted social determinants of health. We found that current validated telehealth-specific surveys only cover 16 (32%) of social determinants of health domains, with the most commonly evaluated domains being "Medical Needs" and "Social Connections/Isolation". Telehealth services are a valuable modality to provide care to patients. Surveying patients is integral to performing quality improvement and improving patient outcomes. Social determinants of health are important factors in determining patient outcomes. We propose an approach to validating the missing domains and evaluating survey validity.

Human Connection and Technology Connectivity: A Systematic Review of Available Telehealth Survey Instruments

CONTEXT

The current upsurge in telehealth use in palliative and hospice care warrants consideration of patient, family caregiver, and interdisciplinary palliative perspectives on telehealth modality and communication experiences. Currently, telehealth experiences and encounters are being described but not yet extensively evaluated by palliative care teams.

OBJECTIVES

To locate survey instruments available to assess telehealth interactions, to determine the content and constructs covered by the available instruments, and to describe the patient populations previously surveyed by the existing instruments.

METHODS

This study and its reporting followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines with the protocol registered in The International Prospective Register of Systematic Reviews. Three databases were searched with over 3100 articles analyzed for use of a telehealth survey instrument.

RESULTS

Twelve telehealth communication assessment instruments were identified with a mean length of 20 questions, primarily Likert-scale responses with one inclusive of free text and one qualitative inquiry survey. Three inquired only into modality, four queried communication, and five studied both modality and communication experience. Existing telehealth survey instruments are unidirectional in exploring patient or family experience, with two inclusive of provider perspectives. Participant demographics are notably underreported in telehealth experience studies with a frank lack of diversity in ethnic/racial, geographic, age, educational, and income representativeness in current telehealth survey instrument respondents.

CONCLUSION

Palliative care teams may consider familiarity with telehealth survey instrument as an essential component to progress from description of telehealth use to evaluation of telehealth encounters. Current survey instrument outcome reports do not represent inclusivity or diversity, although telehealth is now being clinically applied across settings.

Malpractice claimed calls within the Swedish Healthcare Direct: a descriptive - comparative case study

Background

Medical errors are reported as a malpractice claim, and it is of uttermost importance to learn from the errors to enhance patient safety. The Swedish national telephone helpline SHD is staffed by registered nurses; its aim is to provide qualified healthcare advice for all residents of Sweden; it handles normally about 5 million calls annually. The ongoing Covid-19 pandemic have increased call volume with approximate 30%. The aim of the present study was twofold: to describe all malpractice claims and healthcare providers’ reported measures regarding calls to Swedish Healthcare Direct (SHD) during the period January 2011–December 2018 and to compare these findings with results from a previous study covering the period January 2003–December 2010.

Methods

The study used a descriptive, retrospective and comparative design. A total sample of all reported malpractice claims regarding calls to SHD (n = 35) made during the period 2011–2018 was retrieved. Data were analysed and compared with all reported medical errors during the period 2003–2010 (n = 33).

Results

Telephone nurses’ failure to follow the computerized decision support system (CDSS) (n = 18) was identified as the main reason for error during the period 2011–2018, while failure to listen to the caller (n = 12) was the main reason during the period 2003–2010. Staff education (n = 21) and listening to one’s own calls (n = 16) were the most common measures taken within the organization during the period 2011–2018, compared to discussion in work groups (n = 13) during the period 2003–2010.

Conclusion

The proportion of malpractice claims in relation to all patient contacts to SHD is still very low; it seems that only the most severe patient injuries are reported. The fact that telephone nurses’ failure to follow the CDSS is the most common reason for error is notable, as SHD and healthcare organizations stress the importance of using the CDSS to enhance patient safety. The healthcare organizations seem to have adopted a more systematic approach to handling malpractice claims regarding calls, e.g., allowing telephone nurses to listen to their own calls instead of having discussions in work groups in response to events. This enables nurses to understand the latent factors contributing to error and provides a learning opportunity.

Development and content validation of the Telenursing Interaction and Satisfaction Questionnaire (TISQ)

Background

Caller satisfaction with telephone advice nursing (TAN) is generally high, and the interaction is essential. However, a valid questionnaire exploring caller satisfaction in TAN with focus on perceived interaction is lacking.

Objective

To develop and assess content validity and test‐retest reliability of a theoretically anchored questionnaire, the Telenursing Interaction and Satisfaction Questionnaire (TISQ), that explores caller satisfaction in TAN by focusing on perceived interaction between the caller and the telenurse.

Methods

The study was performed in three stages. First, variables relevant for patient satisfaction in health care were identified through a literature search. Variables were then structured according to the Interaction Model of Client Health Behavior (IMCHB), which provided theoretical guidance. Items relevant for a TAN context were developed through consensus discussions. Then, evaluation and refinement were performed through cognitive interviews with callers and expert ratings of the Content Validity Index (CVI). Finally, test‐retest reliability of items was evaluated in a sample of 109 individuals using intraclass correlation coefficients (ICC).

Results

The TISQ consists of 60 items. Twenty items cover perceived interaction in terms of health information, affective support, decisional control and professional/technical competence. Five items cover satisfaction with interaction and five items overall satisfaction. Remaining items reflect singularity of the caller and descriptive items of the call. The TISQ was found to exhibit good content validity, and test‐retest reliability was moderate to good (ICC = 0.39‐0.84).

Conclusions

The items in the TISQ form a comprehensive and theoretically anchored questionnaire with satisfactory content validity and test‐retest reliability.