Fluency in Writing: A Multidimensional Perspective on Writing Fluency Applied to L1 and L2

It's not just a phase: Investigating text simplification in a second language from a process and product perspective

Text simplification involves making texts easier to understand, usually for lay readers. Simplifying texts is a complex task, especially when conducted in a second language. The readability of the produced texts and the way in which authors manage the different phases of the text simplification process are influenced by their writing expertise and by their language proficiency. Training on audience awareness can be beneficial for writers, but most research so far has devoted attention to first-language writers who simplify their own texts. Therefore, this study investigated the impact of text simplification training on second-language writers (university students) who simplify already existing texts. Specifically, after identifying a first and a second phase in the text simplification process (namely, two distinct series of writing dynamics), we analyzed the impact of our training on pausing and revision behavior across phases, as well as levels of readability achieved by the students. Additionally, we examined correlations between pausing behavior and readability by using keystroke logging data and automated text analysis. We found that phases of text simplification differ along multiple dimensions, even though our training did not seem to influence pausing and revision dynamics. Our training led to texts with fewer and shorter words, and with syntactically simpler sentences. The correlation analysis showed that longer and more frequent pauses at specific text locations were linked with increased readability in the same or adjacent text locations. We conclude the paper by discussing theoretical, methodological, and pedagogical implications, alongside limitations and areas for future research.

Envisioning multilingualism in source-based writing in L1, L2, and L3: The relation between source use and text quality

In this article, we report on a study that investigates how master’s students consult external sources for reading-to-write integrated tasks in their L1 (Dutch), L2 (English), and L3 (French). Two hundred and eighty master’s students in professional communication wrote synthesis texts based on three external sources, including a report, a web text, and a newspaper article in their L1 (Dutch), and in L2 (English), or L3 (French) at two moments of measurement, which were separated by an interval of 6 months. Their source use activities during the writing process were registered using Inputlog – a keylogging program. Inputlog enabled us to determine the amount of time the writers spent composing their main texts and consulting the sources (when the source consultation activities took place during the writing process, which sources were consulted most frequently, and how frequently the writers transitioned between the various sources). Final text quality was assessed holistically using pairwise comparisons (D-pac, now Comproved). Confirmatory factor analysis indicated three components that could describe source use processes in L1, L2, and L3 writing: (a) initial reading time, (b) source interaction, and (c) variance of source use throughout the writing process. Within-subject comparisons revealed that there were no improvements in the students’ text quality in L1, L2, and L3 over an academic year. Structural equation modeling indicated that the source use approach, particularly source interaction, is related to text quality, but only in L1 and L3. We provide further explanations for this variation based on language proficiency, temporal distribution of writing process, and individual differences.

Integrating Automatic Speech Recognition Technology Into Vocabulary Learning in a Flipped English Class for Chinese College Students

Although the automatic speech recognition (ASR) technology is increasingly used for commercial purposes, its impact on language learning has not been extensively studied. Underpinned by the sociocultural theory, the present work examined the effects of leveraging ASR technology to support English vocabulary learning in a tertiary flipped setting. A control group and an experimental group of college students participated in a 14-week study. Both groups had their English classes in a flipped fashion, but the experimental group was assigned with ASR-assisted oral tasks for pre-class self-learning. The pre- and post-intervention in-class task performance of both groups was audio-recorded and transcribed for data analysis. The triadic complexity-accuracy-fluency (CAF) framework was adopted to evaluate the participants' vocabulary learning. The between- and within-subjects effects were examined mainly through procedures of MANCOVA and mixed-design repeated measures ANCOVA. Results showed that on all the metrics of lexical complexity and speed fluency, the experimental group outperformed the control group, and had significant growth over time. On the other hand, the control group only improved significantly overtime on the G-index. On lexical accuracy, there was no significant difference between the two groups, and the within-subjects effect was not significant for either group. The findings lent some support to Skehan's Trade-off Hypothesis and discussions were conducted regarding the triarchic CAF framework.

Cognitive Writing Process Characteristics in Alzheimer's Disease

In this article, we explore if the observation of writing behavior can assist in the screening and follow-up of mild cognitive impairment (MCI) and mild dementia due to Alzheimer's disease (AD). To this end, we examined the extent to which overall writing process measures and pausing behavior during writing differed between 15 cognitively impaired patients and 15 age- and gender-matched healthy controls. Participants completed two typed picture description tasks that were registered with Inputlog, a keystroke logging program that captures keyboard activity during text production. The following variables were analyzed with mixed-effects models: time on task; number of characters, pauses and Pause-bursts per minute; proportion of pause time; duration of Pause-bursts; and pause time between words. For pause time between words, also the effect of pauses preceding specific word categories was analyzed. Results showed a main effect of group on all variables. In addition, for pause time between words a main effect of part-of-speech was found as well. Results indicate that writing process analysis can possibly serve as a supplementary tool for the screening and follow-up of AD.

Early prediction of writing quality using keystroke logging

Feedback is important to improve writing quality; however, to provide timely and personalized feedback is a time-intensive task. Currently, most literature focuses on providing (human or machine) support on product characteristics, especially after a draft is submitted. However, this does not assist students who struggle during the writing process. Therefore, in this study, we investigate the use of keystroke analysis to predict writing quality throughout the writing process. Keystroke data were analyzed from 126 English as a second language learners performing a timed academic summarization task. Writing quality was measured using participants’ final grade. Based on previous literature, 54 keystroke features were extracted. Correlational analyses were conducted to identify the relationship between keystroke features and writing quality. Next, machine learning models (regression and classification) were used to predict final grade and classify students who might need support at several points during the writing process. The results show that, in contrast to previous work, the relationship between writing quality and keystroke data was rather limited. None of the regression models outperformed the baseline, and the classification models were only slightly better than the majority class baseline (highest AUC = 0.57). In addition, the relationship between keystroke features and writing quality changed throughout the course of the writing process. To conclude, the relationship between keystroke data and writing quality might be less clear than previously posited.

Analyses of L2 Learners' Text Writing Strategy: Process-Oriented Perspective

Second language writing researchers have examined the affordances of Automated Writing Evaluation programs in providing immediate feedback that helps improve students' writing outputs. However, a little is known about tracking learners' process during writing essays and whether much/less pauses made by learners could predict good/poor quality of students' writing output. This article aims to address this issue by recording a case study of 8 postgraduate students' pauses during writing two types of text genre; descriptive and argumentative essays. Their pauses have been recorded using Keystroke logging program-Input Log 7.0 (Leijten and Van Waes in Writ Commun 30:358-392, 2013. https://doi.org/10.1177/0741088313491692) and their screen activities were captured by Active Presenter program. Findings revealed that the students' pauses were significantly higher in word boundary than in sentence and/or paragraph boundaries. Moreover, on word boundary, pauses before words were significantly higher than that after words for both types of text genre. Concerning pauses across text genre, students' pauses were significantly higher in the argumentative essay than that of the descriptive essay. Multiple regression revealed negative correlation between much pauses and poor quality of students' product in the descriptive essay while there was no correlation found in the argumentative essay.