1
|
Tschense M, Wallot S. Modeling items for text comprehension assessment using confirmatory factor analysis. Front Psychol 2022; 13:966347. [PMID: 36337503 PMCID: PMC9631941 DOI: 10.3389/fpsyg.2022.966347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Accepted: 09/22/2022] [Indexed: 11/17/2022] Open
Abstract
Reading is a complex cognitive task with the ultimate goal of comprehending the written input. For longer, connected text, readers generate a mental representation that serves as its basis. Due to limited cognitive resources, common models of discourse representation assume distinct processing levels, each relying on different processing mechanisms. However, only little research addresses distinct representational levels when text comprehension is assessed, analyzed or modelled. Moreover, current studies that tried to relate process measures of reading (e.g., reading times, eye movements) to comprehension did not consider comprehension as a multi-faceted, but rather a uni-dimensional construct, usually assessed with one-shot items. Thus, the first aim of this paper is to use confirmatory factor analysis (CFA) to test whether comprehension can be modelled as a uni-or multi-dimensional concept. The second aim is to investigate how well widely used one-shot items can be used to capture comprehension. 400 participants read one of three short stories of comparable length, linguistic characteristics, and complexity. Based on the evaluation of three independent raters per story, 16 wh-questions and 60 yes/no-statements were compiled in order to retrieve information at micro and inference level, and 16 main contents were extracted to capture information at the macro level in participants’ summaries. Still, only a fraction of these items showed satisfactory psychometric properties and factor loadings – a blatant result considering the common practice for item selection. For CFA, two models were set up that address text comprehension as either a one-dimensional construct (a uni-factor model with a single comprehension factor), or a three-dimensional construct reflecting the three distinct representational levels (three correlated first-order factors). Across stories and item types, model fit was consistently better for the three-factor model providing evidence for a multi-dimensional construct of text comprehension. Our results provide concrete guidance for the preparation of comprehension measurements in studies investigating the reading process.
Collapse
Affiliation(s)
- Monika Tschense
- Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Research Group for Research Methods and Evaluation, Institute of Psychology, Leuphana University Lüneburg, Lünebrug, Germany
- Research Group for Neurocognition of Music and Language, Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- *Correspondence: Monika Tschense,
| | - Sebastian Wallot
- Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Research Group for Research Methods and Evaluation, Institute of Psychology, Leuphana University Lüneburg, Lünebrug, Germany
| |
Collapse
|
2
|
Tschense M, Wallot S. Using measures of reading time regularity (RTR) to quantify eye movement dynamics, and how they are shaped by linguistic information. J Vis 2022; 22:9. [PMID: 35612847 PMCID: PMC9165877 DOI: 10.1167/jov.22.6.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
In this article, we present the concept of reading time regularity (RTR) as a measure to capture reading process dynamics. The first study is concerned with examining one of the assumptions of RTR, namely, that process measures of reading, such as eye movement fluctuations and fixation durations, exhibit higher regularity when contingent on sequentially structured information, such as texts. To test this, eye movements of 26 German native speakers were recorded during reading-unrelated and reading-related tasks. To analyze the data, we used recurrence quantification analysis and sample entropy analysis to quantify the degree of temporal structure in time series of gaze steps and fixation durations. The results showed that eye movements become more regular in reading compared to nonreading conditions. These effects were most prominent when calculated on the basis of gaze step data. In a second study, eye movements of 27 native speakers of German were recorded for five conditions with increasing linguistic information. The results replicate the findings of the first study, verifying that these effects are not due to mere differences in task instructions between conditions. Implications for the concept of RTR and for future studies using these metrics in reading research are discussed.
Collapse
Affiliation(s)
- Monika Tschense
- Institute of Psychology, Leuphana University of Lüneburg, Lüneburg, Germany.,Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.,Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.,https://orcid.org/0000-0002-2434-4516., https://www.leuphana.de/en/institutes/ifp/staff/monika-tschense.html
| | - Sebastian Wallot
- Institute of Psychology, Leuphana University of Lüneburg, Lüneburg, Germany.,Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.,https://orcid.org/0000-0002-3626-3940., https://www.leuphana.de/en/institutes/ifp/staff/sebastian-wallot.html
| |
Collapse
|
3
|
Limas JC, Corcoran LC, Baker AN, Cartaya AE, Ayres ZJ. The Impact of Research Culture on Mental Health & Diversity in STEM. Chemistry 2022; 28:e202102957. [PMID: 35075707 DOI: 10.1002/chem.202102957] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Indexed: 11/07/2022]
Abstract
The onset of COVID-19, coupled with the finer lens placed on systemic racial disparities within our society, has resulted in increased discussions around mental health. Despite this, mental health struggles in research are still often viewed as individual weaknesses and not the result of a larger dysfunctional research culture. Mental health interventions in the science, technology, engineering, and mathematics (STEM) academic community often focus on what individuals can do to improve their mental health instead of focusing on improving the research environment. In this paper, we present four aspects of research that may heavily impact mental health based on our experiences as research scientists: bullying and harassment; precarity of contracts; diversity, inclusion, and accessibility; and the competitive research landscape. Based on these aspects, we propose systemic changes that institutions must adopt to ensure their research culture is supportive and allows everyone to thrive.
Collapse
Affiliation(s)
- Juanita C Limas
- Department of Pharmacology, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | | | - Ana E Cartaya
- Department of Surgery, Center for Nanotechnology in Drug Delivery, Department of Pharmacology, McAllister Heart Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | |
Collapse
|
4
|
Urbina‐Blanco CA, Jilani SZ, Speight IR, Bojdys MJ, Friščić T, Stoddart JF, Nelson TL, Mack J, Robinson RAS, Waddell EA, Lutkenhaus JL, Godfrey M, Abboud MI, Aderinto SO, Aderohunmu D, Bibič L, Borges J, Dong VM, Ferrins L, Fung FM, John T, Lim FPL, Masters SL, Mambwe D, Thordarson P, Titirici M, Tormet‐González GD, Unterlass MM, Wadle A, Yam VW, Yang Y. A Diverse View of Science to Catalyse Change. Angew Chem Int Ed Engl 2020. [DOI: 10.1002/ange.202009834] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
| | - Safia Z. Jilani
- Department of Chemistry Georgetown University Washington DC 20057 USA
| | - Isaiah R. Speight
- Department of Chemistry Vanderbilt University Nashville TN 37235 USA
| | - Michael J. Bojdys
- Department of Chemistry, King's College, London (UK) and Department of Chemistry Humboldt-Universität zu Berlin Berlin 12489 Germany
| | - Tomislav Friščić
- Department of Chemistry McGill University Montréal QC H3A 0B8 Canada
| | - J. Fraser Stoddart
- Department of Chemistry Northwestern University Evanston IL 60208 USA
- Institute for Molecular Design and Synthesis Tianjin University Tianjin 300072 People's Republic of China
- School of Chemistry University of New South Wales Sydney NSW 2052 Australia
| | - Toby L. Nelson
- Department of Chemistry Oklahoma State University Stillwater OK 74078 USA
| | - James Mack
- Department of Chemistry University of Cincinnati Cincinnati OH 45221 USA
| | | | - Emanuel A. Waddell
- Department of Chemistry University of Alabama in Huntsville Huntsville AL 35899 USA
| | - Jodie L. Lutkenhaus
- Artie McFerrin Department of Chemical Engineering Texas A&M University College Station TX 77843 USA
| | - Murrell Godfrey
- Department of Chemistry The University of Mississippi University MS 38677 USA
| | - Martine I. Abboud
- Department of Chemistry University of Oxford Chemistry Research Laboratory Oxford OX1 3TA UK
| | | | - Damilola Aderohunmu
- Department of Chemistry Covenant University, CST, Canaanland Ota Ogun State Nigeria
| | - Lučka Bibič
- School of Pharmacy University of East Anglia Norwich NR4 7TJ UK
| | - João Borges
- Department of Chemistry CICECO—Aveiro Institute of Materials University of Aveiro Campus Universitário de Santiago Aveiro 3810-193 Portugal
| | - Vy M. Dong
- Department of Chemistry University of California Irvine CA 92697 USA
| | - Lori Ferrins
- Department of Chemistry and Chemical Biology Northeastern University Boston MA 02115 USA
| | - Fun Man Fung
- Department of Chemistry National University of Singapore Singapore 117543 Singapore
| | - Torsten John
- Leibniz Institute of Surface Engineering (IOM) Leipzig 04318 Germany
| | - Felicia P. L. Lim
- School of Pharmacy Monash University Malaysia Selangor Darul Ehsan 47500 Malaysia
| | - Sarah L. Masters
- School of Physical and Chemical Sciences University of Canterbury Christchurch 8140 New Zealand
| | - Dickson Mambwe
- Department of Chemistry University of Cape Town Rondebosch Capetown 7701 South Africa
| | - Pall Thordarson
- School of Chemistry The Australian Centre for Nanomedicine and the ARC Centre of Excellence in Convergent Bio-Nano Science and Technology The University of New South Wales Sydney NSW 2052 Australia
| | - Maria‐Magdalena Titirici
- Department of Chemical Engineering Imperial College London South Kensington Campus London SW7 2AZ UK
| | | | - Miriam M. Unterlass
- Institute of Materials Chemistry Technische Universität Wien Vienna 1060 Austria
| | - Austin Wadle
- Department of Civil & Environmental Engineering Duke University Pratt School of Engineering Durham NC 27708 USA
| | - Vivian W.‐W. Yam
- Institute of Molecular Functional Materials and Department of Chemistry The University of Hong Kong Hong Kong People's Republic of China
| | - Ying‐Wei Yang
- State Key Laboratory of Inorganic Synthesis and Preparative Chemistry International Joint Research Laboratory of Nano-Micro Architecture Chemistry (NMAC) College of Chemistry Jilin University Changchun 130012 People's Republic of China
| |
Collapse
|
5
|
Urbina‐Blanco CA, Jilani SZ, Speight IR, Bojdys MJ, Friščić T, Stoddart JF, Nelson TL, Mack J, Robinson RAS, Waddell EA, Lutkenhaus JL, Godfrey M, Abboud MI, Aderinto SO, Aderohunmu D, Bibič L, Borges J, Dong VM, Ferrins L, Fung FM, John T, Lim FPL, Masters SL, Mambwe D, Thordarson P, Titirici M, Tormet‐González GD, Unterlass MM, Wadle A, Yam VW, Yang Y. A Diverse View of Science to Catalyse Change. Angew Chem Int Ed Engl 2020; 59:18306-18310. [PMID: 33448562 PMCID: PMC7590070 DOI: 10.1002/anie.202009834] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Indexed: 12/03/2022]
Abstract
Valuing diversity leads to scientific excellence, the progress of science and most importantly, it is simply the right thing to do. We can value diversity not only in words, but also in actions.
Collapse
Affiliation(s)
| | - Safia Z. Jilani
- Department of ChemistryGeorgetown UniversityWashingtonDC20057USA
| | | | - Michael J. Bojdys
- Department of Chemistry, King's College, London (UK) and Department of ChemistryHumboldt-Universität zu BerlinBerlin12489Germany
| | | | - J. Fraser Stoddart
- Department of ChemistryNorthwestern UniversityEvanstonIL60208USA
- Institute for Molecular Design and SynthesisTianjin UniversityTianjin300072People's Republic of China
- School of ChemistryUniversity of New South WalesSydneyNSW2052Australia
| | - Toby L. Nelson
- Department of ChemistryOklahoma State UniversityStillwaterOK74078USA
| | - James Mack
- Department of ChemistryUniversity of CincinnatiCincinnatiOH45221USA
| | | | - Emanuel A. Waddell
- Department of ChemistryUniversity of Alabama in HuntsvilleHuntsvilleAL35899USA
| | - Jodie L. Lutkenhaus
- Artie McFerrin Department of Chemical EngineeringTexas A&M UniversityCollege StationTX77843USA
| | - Murrell Godfrey
- Department of ChemistryThe University of MississippiUniversityMS38677USA
| | - Martine I. Abboud
- Department of ChemistryUniversity of Oxford Chemistry Research LaboratoryOxfordOX1 3TAUK
| | | | - Damilola Aderohunmu
- Department of ChemistryCovenant University, CST, CanaanlandOtaOgun StateNigeria
| | - Lučka Bibič
- School of PharmacyUniversity of East AngliaNorwichNR4 7TJUK
| | - João Borges
- Department of ChemistryCICECO—Aveiro Institute of MaterialsUniversity of AveiroCampus Universitário de SantiagoAveiro3810-193Portugal
| | - Vy M. Dong
- Department of ChemistryUniversity of CaliforniaIrvineCA92697USA
| | - Lori Ferrins
- Department of Chemistry and Chemical BiologyNortheastern UniversityBostonMA02115USA
| | - Fun Man Fung
- Department of ChemistryNational University of SingaporeSingapore117543Singapore
| | - Torsten John
- Leibniz Institute of Surface Engineering (IOM)Leipzig04318Germany
| | - Felicia P. L. Lim
- School of PharmacyMonash University MalaysiaSelangor Darul Ehsan47500Malaysia
| | - Sarah L. Masters
- School of Physical and Chemical SciencesUniversity of CanterburyChristchurch8140New Zealand
| | - Dickson Mambwe
- Department of ChemistryUniversity of Cape TownRondeboschCapetown7701South Africa
| | - Pall Thordarson
- School of ChemistryThe Australian Centre for Nanomedicine and the ARC Centre of Excellence in Convergent Bio-Nano Science and TechnologyThe University of New South WalesSydneyNSW2052Australia
| | | | | | - Miriam M. Unterlass
- Institute of Materials ChemistryTechnische Universität WienVienna1060Austria
| | - Austin Wadle
- Department of Civil & Environmental EngineeringDuke University Pratt School of EngineeringDurhamNC27708USA
| | - Vivian W.‐W. Yam
- Institute of Molecular Functional Materials and Department of ChemistryThe University of Hong KongHong KongPeople's Republic of China
| | - Ying‐Wei Yang
- State Key Laboratory of Inorganic Synthesis and Preparative ChemistryInternational Joint Research Laboratory of Nano-Micro Architecture Chemistry (NMAC)College of ChemistryJilin UniversityChangchun130012People's Republic of China
| |
Collapse
|
6
|
Wallot S, Lee JT, Kelty-Stephen DG. Switching between reading tasks leads to phase-transitions in reading times in L1 and L2 readers. PLoS One 2019; 14:e0211502. [PMID: 30721245 PMCID: PMC6363172 DOI: 10.1371/journal.pone.0211502] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2018] [Accepted: 01/15/2019] [Indexed: 11/19/2022] Open
Abstract
Reading research uses different tasks to investigate different levels of the reading process, such as word recognition, syntactic parsing, or semantic integration. It seems to be tacitly assumed that the underlying cognitive process that constitute reading are stable across those tasks. However, nothing is known about what happens when readers switch from one reading task to another. The stability assumptions of the reading process suggest that the cognitive system resolves this switching between two tasks quickly. Here, we present an alternative language-game hypothesis (LGH) of reading that begins by treating reading as a softly-assembled process and that assumes, instead of stability, context-sensitive flexibility of the reading process. LGH predicts that switching between two reading tasks leads to longer lasting phase-transition like patterns in the reading process. Using the nonlinear-dynamical tool of recurrence quantification analysis, we test these predictions by examining series of individual word reading times in self-paced reading tasks where native (L1) and second language readers (L2) transition between random word and ordered text reading tasks. We find consistent evidence for phase-transitions in the reading times when readers switch from ordered text to random-word reading, but we find mixed evidence when readers transition from random-word to ordered-text reading. In the latter case, L2 readers show moderately stronger signs for phase-transitions compared to L1 readers, suggesting that familiarity with a language influences whether and how such transitions occur. The results provide evidence for LGH and suggest that the cognitive processes underlying reading are not fully stable across tasks but exhibit soft-assembly in the interaction between task and reader characteristics.
Collapse
Affiliation(s)
- Sebastian Wallot
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
| | - Jun Taek Lee
- Department of Psychology, Grinnell College, Grinnell, Iowa, United States of America
| | | |
Collapse
|
7
|
Wallot S. Recurrence Quantification Analysis of Processes and Products of Discourse: A Tutorial in R. DISCOURSE PROCESSES 2017. [DOI: 10.1080/0163853x.2017.1297921] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Sebastian Wallot
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| |
Collapse
|