1
|
Hux K, Knollman-Porter K, Wallace SE, Bevelhimer A, Singh Y. Modality Synchronization When People With Aphasia Read With Text-to-Speech Support. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2024; 33:1504-1512. [PMID: 38358944 DOI: 10.1044/2024_ajslp-23-00334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/17/2024]
Abstract
PURPOSE Text-to-speech (TTS) technology potentially benefits people with aphasia by presenting content through two modalities simultaneously; however, for this to help, eye fixations must synchronize with the auditory rendition of words. Researchers have yet to explore how often and to what extent people with aphasia achieve modality synchronization. This retrospective analysis examined the percent of words people with aphasia see and hear concurrently when reading passages presented via TTS technology. Text-to-speech (TTS) technology potentially benefits people with aphasia by presenting content through two modalities simultaneously; however, for this to help, eye fixations must synchronize with the auditory rendition of words. Researchers have yet to explore how often and to what extent people with aphasia achieve modality synchronization. This retrospective analysis examined the percent of words people with aphasia see and hear concurrently when reading passages presented via TTS technology. METHOD Nine adults with aphasia had their eye movements tracked while processing TTS passages at a preselected default rate of 150 words per minute. Modality synchronization occurred whenever fixation on a written word occurred during the time span beginning 300 ms before auditory presentation and ending at the next word's initiation. Correlations between standardized test scores, unsupported reading rate, and modality synchronization percentages were informative about the association of aphasia and reading impairment severity with achievement of synchronicity. RESULTS Three participants demonstrated consistent modality synchronization; average synchronicity ranged from 67% to 76% of passage words. One participant displayed inconsistent synchronization within passages and achieved an average of 58%. The remaining five participants rarely achieved synchronization, with fixations typically lagging substantially behind the auditory presentation. A significant positive correlation occurred between paragraph reading comprehension test scores and modality synchronization percentages. CONCLUSIONS A default TTS presentation rate does not result in dual modality synchronization for most people with aphasia. This lack of synchronization may contribute to inconsistencies in the benefit people with aphasia experience when provided with TTS support.
Collapse
Affiliation(s)
| | | | - Sarah E Wallace
- Department of Communication Science and Disorders, University of Pittsburgh, PA
| | - Andrew Bevelhimer
- Department of Speech Pathology and Audiology, Miami University, Oxford, OH
| | | |
Collapse
|
2
|
Wallace SE, Hux K, Knollman-Porter K, Patterson B, Brown JA. A Mixed-Methods Exploration of the Experience of People With Aphasia Using Text-to-Speech Technology to Support Virtual Book Club Participation. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2023; 32:2768-2791. [PMID: 37678193 PMCID: PMC10721254 DOI: 10.1044/2023_ajslp-23-00094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Revised: 05/25/2023] [Accepted: 07/14/2023] [Indexed: 09/09/2023]
Abstract
PURPOSE This mixed-methods research sought to examine the experience of people with aphasia who used text-to-speech (TTS) support to read a novel for virtual book club participation. METHOD Six people with chronic aphasia used a TTS system to review portions of a novel about which they conversed during eight virtual book club meetings occurring over 5 weeks. During one-on-one interactions prior to each meeting, participants answered comprehension questions and provided feedback about reading experiences. Then, during group meetings, they reviewed and discussed relevant book content and predicted upcoming content. During a structured individual interview, participants reflected on their supported reading and book club experience. RESULTS Participants reported a range of reading confidence prior to study participation, mostly influenced by decreased comprehension or reading speed. After book club participation, four participants expressed increased confidence. Some reported searching for key words and skipping difficult words as strategies additional to TTS support. All reviewed at least some book sections more than once either with or without TTS support. Highly motivated participants expressed low frustration and high reading ease and enjoyment. Perceived comprehension was roughly consistent with actual comprehension across participants. Most believed TTS support promoted faster reading than otherwise possible. Participants liked adjustable features affecting speech output rate, word or sentence highlighting, and font size. Psychosocial benefits included decreased isolation and increased friendship. CONCLUSIONS The findings extend previous evidence about perceived and actual benefits associated with TTS support. People with aphasia express positive experiences when given TTS support during book club participation.
Collapse
Affiliation(s)
- Sarah E. Wallace
- Department of Communication Science & Disorders, University of Pittsburgh, PA
| | | | | | - Briana Patterson
- Department of Communication Science & Disorders, University of Pittsburgh, PA
| | | |
Collapse
|
3
|
Knollman-Porter K, Bevelhimer A, Hux K, Wallace SE, Hughes MR, Brown JA. Eye Fixation Behaviors and Processing Time of People With Aphasia and Neurotypical Adults When Reading Narratives With and Without Text-to-Speech Support. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2023; 66:276-295. [PMID: 36538505 DOI: 10.1044/2022_jslhr-22-00298] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
BACKGROUND Researchers have used eye-tracking technology to investigate eye movements in neurotypical adults (NAs) when reading. The technology can provide comparable information about people with aphasia (PWA). Eye fixations occurring when PWA do and do not have access to text-to-speech (TTS) technology are of interest because the support improves reading comprehension and decreases processing time for at least some PWA. AIMS This study's purpose was to examine forward, regressive, and off-track eye fixations when PWA and NAs read narratives in read-only (RO) and TTS conditions. A secondary aim was to examine the influence of eye fixations on processing time. METHOD AND PROCEDURE A Tobii Dynavox Pro Spectrum eye tracker recorded eye movements of nine PWA and nine NAs while reading narratives in two conditions. Movements of interest were forward fixations; within-word, within-sentence, and previous-sentence regressive fixations; and off-track fixations. OUTCOMES AND RESULTS PWA exhibited significantly more forward and regressive fixations in the RO than TTS condition, whereas NAs showed opposite behaviors. NAs had significantly more off-track fixations in the TTS than RO condition, whereas PWA exhibited no difference across conditions. PWA took significantly longer to process content in the RO condition, whereas NAs took longer in the TTS condition. CONCLUSIONS PWA and NAs differ in important ways when processing texts with and without TTS support. Examining eye-tracking data provides a means of gaining insight into the decoding and reading comprehension challenges of PWA and helps elucidate how assistive technology can mediate these challenges.
Collapse
Affiliation(s)
| | - Andrew Bevelhimer
- Department of Speech Pathology and Audiology, Miami University, Oxford, OH
| | | | - Sarah E Wallace
- Department of Communication Science and Disorders, University of Pittsburgh, PA
| | | | | |
Collapse
|
4
|
Knollman-Porter K, Hux K, Wallace SE, Pruitt M, Hughes MR, Brown JA. Comprehension, Processing Time, and Modality Preferences When People With Aphasia and Neurotypical Healthy Adults Read Books: A Pilot Study. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2022; 31:2569-2590. [PMID: 36167067 PMCID: PMC9911119 DOI: 10.1044/2022_ajslp-22-00121] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
BACKGROUND Many people with aphasia (PWA) want to read books. Text-to-speech (TTS) technology sometimes provides comprehension and processing time benefits when PWA read short, multisentence passages. Currently, no research examines the effect of TTS support when PWA read books. AIMS This study's primary purpose was to examine comprehension accuracy and total processing time of PWA and neurotypical healthy adults (NHAs) when reading book sections in read-only versus TTS-supported conditions. A secondary aim was to examine condition preference and perceived degree of understanding by people in both participant groups. METHOD AND PROCEDURE Ten PWA and 10 NHAs alternated between read-only and TTS-supported conditions to read a book. Participants answered comprehension questions and provided feedback about their reading experience, condition preference, and desire to use TTS technology for future book reading. Outcomes and Result: Overall, PWA exhibited less accurate comprehension and slower processing times compared to NHAs in both conditions. No significant comprehension accuracy difference occurred between conditions for either group. However, four PWA exhibited a 10% or greater increase in comprehension accuracy when receiving TTS support. A significant processing time difference occurred with PWA processing text faster with TTS support, whereas NHAs did not demonstrate processing time differences. Most PWA preferred the TTS condition and expressed a desire to use TTS technology in the future. Most NHAs expressed the opposite preference. CONCLUSIONS TTS support during book reading promotes faster processing without compromising comprehension for PWA. Clinicians should discuss with PWA the relative importance of comprehension accuracy, processing time, and comfort with technology when determining whether using TTS support during book reading is desirable.
Collapse
Affiliation(s)
| | | | - Sarah E. Wallace
- Department of Communication Science and Disorders, University of Pittsburgh, PA
| | - McKenzie Pruitt
- Department of Speech Pathology and Audiology, Miami University, Oxford, OH
| | | | | |
Collapse
|
5
|
Knollman-Porter K, Brown JA, Hux K, Wallace SE, Crittenden A. Reading Comprehension and Processing Time When People With Aphasia Use Text-to-Speech Technology With Personalized Supports and Features. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2022; 31:342-358. [PMID: 34941376 PMCID: PMC9135027 DOI: 10.1044/2021_ajslp-21-00182] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 09/12/2021] [Accepted: 09/22/2021] [Indexed: 05/19/2023]
Abstract
BACKGROUND Person-centered approaches promote consistent use of supportive technology and feelings of empowerment for people with disabilities. Feature personalization is an aspect of person-centered approaches that can affect the benefit people with aphasia (PWA) derive from using text-to-speech (TTS) technology as a reading support. AIMS This study's primary purpose was to compare the comprehension and processing time of PWA when performing TTS-supported reading with preferred settings for voice, speech output rate, highlighting type, and highlighting color versus unsupported reading. A secondary aim was to examine initial support and feature preference selections, preference changes following TTS exposure, and anticipated functional reading activities for utilizing TTS technology. METHOD AND PROCEDURE Twenty PWA read passages either via written text or text combined with TTS output using personally selected supports and features. Participants answered comprehension questions, reevaluated their preference selections, and provided feedback both about feature selections and possible future TTS technology uses. OUTCOMES AND RESULTS Comprehension accuracy did not vary significantly between reading conditions; however, processing time was significantly less in the TTS-supported condition, thus suggesting TTS support promoted greater reading speed without compromising comprehension. Most participants preferred the TTS condition and several anticipated benefits when reading lengthy and difficult materials. Alterations to initial settings were relatively rare. CONCLUSIONS Personalizing TTS systems is relevant to person-centered interventions. Reading with desired TTS system supports and features promotes improved reading efficiency by PWA compared with reading without TTS support. Attending to client preferences is important when customizing and implementing TTS technology as a reading support.
Collapse
Affiliation(s)
| | - Jessica A. Brown
- Department of Speech, Language, and Hearing Sciences, University of Arizona, Tucson
| | | | - Sarah E. Wallace
- Department of Communication Science and Disorders, University of Pittsburgh, PA
| | - Allison Crittenden
- Department of Speech Pathology and Audiology, Miami University, Oxford, OH
| |
Collapse
|
6
|
Wallace SE, Hux K, Knollman-Porter K, Brown JA, Parisi E, Cain R. Reading behaviors and text-to-speech technology perceptions of people with aphasia. Assist Technol 2021; 34:599-610. [PMID: 33724912 DOI: 10.1080/10400435.2021.1904306] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022] Open
Abstract
People with aphasia often have reading impairments that affect participation in daily activities. Text-to-speech (TTS) devices are technology-based supports that can facilitate processing of written materials. The purpose of this study was to gather information about the reading behaviors and TTS technology perceptions of people with aphasia who had first learned about system features and options. Sixteen people with chronic aphasia participated in single, one-on-one instructional and guided practice sessions using TTS systems. They answered close-ended questions about current reading behaviors and materials and ways they believed these would change given TTS system access. Participants reported reading at home and community locations. Most read calendars, newspapers, magazines, and mail. Participants who did not read lengthy materials - such as newspapers, magazines, and novels - indicated their interest in these materials would likely increase given TTS support. Although participants did not predict substantial comprehension changes given TTS support, most expressed interest in the technology after learning about it. Thus, people with aphasia perceive TTS systems as helpful for comprehending lengthy materials. Given modest predictions about comprehension benefits, presenting TTS as one of several support strategies is an appropriate recommendation.
Collapse
Affiliation(s)
- Sarah E Wallace
- Department of Speech-language Pathology, Duquesne University, Pittsburgh, Pennsylvania, USA
| | - Karen Hux
- Quality Living, Inc., Omaha, Nebraska, USA
| | | | - Jessica A Brown
- Department of Speech, Language, & Hearing Sciences, University of Arizona, Tucson, Arizona, USA
| | - Elizabeth Parisi
- Department of Speech-language Pathology, Duquesne University, Pittsburgh, Pennsylvania, USA
| | - Rebecca Cain
- Department of Speech-language Pathology, Duquesne University, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
7
|
Hux K, Wallace SE, Brown JA, Knollman-Porter K. Perceptions of people with aphasia about supporting reading with text-to-speech technology: A convergent mixed methods study. JOURNAL OF COMMUNICATION DISORDERS 2021; 91:106098. [PMID: 33744768 PMCID: PMC8178192 DOI: 10.1016/j.jcomdis.2021.106098] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 02/19/2021] [Accepted: 03/08/2021] [Indexed: 05/19/2023]
Abstract
INTRODUCTION Text-to-speech (TTS) technology is a possible reading support for people with aphasia; however, adoption for functional reading remains rare, and people with aphasia may have limited knowledge about TTS. Given this situation coupled with inherent communication challenges associated with aphasia, the purpose of this convergent mixed methods study was to explore the perceptions of participants about desired features, benefits, and drawbacks of TTS technology after having engaged in one-on-one education and guided practice activities. METHODS Nineteen adults with chronic aphasia completed a single education and guided practice session followed by close-ended questions and participation in a semi-structured interview to explain preferences, concerns, beliefs, and opinions about potential TTS technology benefits and drawbacks. Three participants had previously used TTS technology for functional reading; all others had some prior exposure but did not use a system for functional purposes. RESULTS Seventeen of 19 participants expressed TTS technology interest after education and guided practice activities. Participants endorsed selection of a preferred voice, control of speech output rate, and highlighting as priority features. Frequently endorsed benefits were improved comprehension and increased reading independence; some participants believed they would succeed in reading a greater variety of materials, communicate more with others, participate in more reading activities, and/or read faster. The greatest concern was mastering device operation; other concerns related to understanding the voice output, needing another person's help for system use, and matching the speech output rate to a preferred reading rate. CONCLUSIONS Overall, most participants had positive perceptions about possible benefits afforded by TTS technology. Practitioners need to provide opportunities for people with aphasia to learn about and explore TTS systems to determine whether adoption is desired.
Collapse
Affiliation(s)
- Karen Hux
- Quality Living, Inc., Psychology Dept., Omaha, NE, United States.
| | - Sarah E Wallace
- Duquesne University, Dept. of Speech-language Pathology, Pittsburgh, PA, United States
| | - Jessica A Brown
- Univ. of Arizona, Dept. of Speech, Language, & Hearing Sciences, Tucson, AZ, United States
| | | |
Collapse
|
8
|
Brown JA, Knollman-Porter K, Hux K, Wallace SE, Deville C. Effect of Digital Highlighting on Reading Comprehension Given Text-to-Speech Technology for People with Aphasia. APHASIOLOGY 2020; 35:200-221. [PMID: 33731970 PMCID: PMC7959096 DOI: 10.1080/02687038.2020.1787728] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Accepted: 06/09/2020] [Indexed: 05/19/2023]
Abstract
BACKGROUND Many people with aphasia have a strong desire to participate in reading activities despite persistent reading challenges. Digital reading devices and text-to-speech (TTS) technology are increasing in popularity and have the potential to help people with aphasia. Systematic investigation of modifiable TTS features provides a means of exploring this potential. AIMS This study's aim was to evaluate the effect of digital highlighting synchronised with TTS auditory and written output on reading comprehension by people with aphasia and to determine their highlighting preferences. METHODS & PROCEDURES This work was registered with clinicaltrials.gov and assigned the clinical trial registry number 01446r prior to initiation of data collection. Twenty-five adults with aphasia read and listened to passages presented in three synchronised highlighting conditions: sentence highlighting, single word highlighting, and no highlighting. Participants answered comprehension questions, selected most and least preferred conditions, and provided feedback explaining highlighting preferences. OUTCOME & RESULTS Comprehension accuracy did not vary significantly across presentation conditions, but participants preferred either single word or sentence highlighting over no highlighting. CONCLUSIONS Neither word nor sentence highlighting benefitted or hindered comprehension by people with aphasia as a group, but individual differences may occur. Clinicians should attend to personal preferences when implementing digital highlighting as a reading support strategy.
Collapse
Affiliation(s)
- Jessica A. Brown
- Department of Speech, Language, and Hearing Sciences, University of Arizona, Tucson, United States
| | - Kelly Knollman-Porter
- Department of Speech Pathology and Audiology, Miami University, Oxford, United States
| | - Karen Hux
- Quality Living, Inc., Omaha, United States
| | - Sarah E. Wallace
- Department of Speech-Language Pathology, Duquesne University, Pittsburgh, United States
| | - Camille Deville
- Department of Speech Pathology and Audiology, Miami University, Oxford, United States
| |
Collapse
|