Creating positive learning experiences with technology: A field study on the effects of user experience for digital concept mapping

Learning and assessment are increasingly mediated by digital technologies. Thus, learners’ experiences with these digital technologies are growing in importance, as they might affect learning and assessment. The present paper explores the impact of user experience on digital concept mapping. It builds on user experience theory to explain variance in the intention to use digital concept mapping tools and in concept map-based assessment scores. Furthermore, it identifies fulfillment of psychological needs as an important driver of positive experiences. In a field study in three schools and a university (N = 71), we tested two concept mapping prototypes on computers and tablets. We found that user experience is a significant factor explaining variance in intention to use. User experience also explained variance in three out of four concept mapping scores on tablets, potentially related to the lower pragmatic quality of the tablet prototypes. Fulfillment of psychological needs strongly affected perceptions of different qualities of user experience with digital concept mapping. These results indicate that user experience needs to be considered in digital concept mapping to provide a positive and successful environment for learning and assessment. Finally, we discuss implications for designers of digital learning and assessment tools.

•

User experience (UX) is a vital success factor for digital education tools.

•

Fulfillment of psychological needs defines user experience.

•

User experience is a strong predictor of intention to use.

•

User experience can explain variance in concept map scores.

•

User experience models can complement technology acceptance models.

Multidimensional Model of Environmental Attitudes: Evidence Supporting an Abbreviated Measure in Spanish

We conducted three independent studies to support the Spanish version of the Environmental Attitudes Inventory (EAI). The first study consisted of translating and pre-testing on a sample of 125 college students. The second consisted of testing the EAI on a sample of 225 university students in several undergraduate courses. Student data were collected using two different methods, through an online teaching platform and in the classroom. The findings were symmetrical in terms of precision and dimensionality. The third study completed the aforementioned ones testing the items on a representative sample from the general population in Spain. The participants were 630 citizens from 17 regions and responded to the EAI using an online platform. The results of the factor analysis led us to propose a measurement model, with 18 items and six first-order factors: environmental movement activism, conservation motivated by anthropocentric concern, confidence in science and technology, personal conservation behaviour, human dominance over nature, and support for population growth policies. External validity evidence was assessed by the correlation with the following variables: neuroticism, ecological behaviour, limits to economic growth, economic liberalism, sustainability, altruism, and social desirability. These estimations stayed away from demographic and personal aspects such as age, sex, political ideology, and region.

The Assessment of Psychosocial Work Conditions and Their Relationship to Well-Being: A Multi-Study Report

The aim of this multi-study report is to present a questionnaire that enables researchers and practitioners to assess and evaluate psychosocial risks related to well-being. In Study 1, we conducted a cross-sectional online-survey in 15 German companies from 2016 to 2017 to verify factor- and criterion-related validity. Data consisted of 1151 employee self-ratings. Exploratory and confirmatory factor analyses resulted in an eight-factor structure (CFI = 0.902, RMSEA = 0.058, and SRMR = 0.070). All scales held to excellent internal consistency values (α = 0.65–0.90) and were related significantly to well-being (r = 0.17–0.35, p < 0.001). A second, longitudinal study in 2018 showed satisfying convergent and discriminant validity (N = 293) to scales from KFZA and COPSOQ. Test-retest reliability (N = 73; α = 0.65–0.88, p < 0.05) was also good. The instrument provides incremental validity above existing instruments since it explains additional variance in well-being.

Assessing Self-Efficacy for Self-Regulation of Academic Writing

Abstract. Academic writing is a complex and demanding activity that plays an important role in self-regulated learning settings within higher education. Self-efficacy and self-regulation are crucial factors for success and failure in academic writing. Because of the lack of adequate instruments, assessment of these factors is still limited. This paper introduces a scale for the assessment of self-efficacy for self-regulation of academic writing (SSAW). We deductively developed the SSAW scale and then conducted three studies in order to test and validate the scale. The first study ( N = 121) resulted in a brief scale with good psychometric properties. The second study ( N = 660) showed the scale’s factorial validity. The third study ( N = 188) provided evidence for the convergent validity of the SSAW scale. In sum, these studies yield a reliable, valid, and economic scale. The results are discussed with regard to the usefulness of the SSAW scale for research and practice in higher education.

On the Validity of Forced Choice Scores Derived From the Thurstonian Item Response Theory Model

Forced choice (FC) measures may be a desirable alternative to single stimulus (SS) Likert items, which are easier to fake and can have associated response biases. However, classical methods of scoring FC measures lead to ipsative data, which have a number of psychometric problems. A Thurstonian item response theory (TIRT) model has been introduced as a way to overcome these issues, but few empirical validity studies have been conducted to ensure its effectiveness. This was the goal of the current three studies, which used FC measures of domains from popular personality frameworks including the Big Five and HEXACO, and both statement and adjective item stems. We computed TIRT and ipsative scores and compared their validity estimates. Convergent and discriminant validity of the scores were evaluated by correlating them with SS scores, and test-criterion validity evidence was evaluated by examining their relationships with meaningful outcomes. In all three studies, there was evidence for the convergent and test-criterion validity of the TIRT scores, though at times this was on par with the validity of the ipsative scores. The discriminant validity of the TIRT scores was problematic and was often worse than the ipsative scores.

Validity evidence of the Behavioral Activation for Depression Scale-Short Form among depressed smokers

A measure of Behavioral Activation (BA) is highly recommended when evaluating BA treatment effects for smokers with depression. Recently, a short version of the Behavioral Activation for Depression scale (BADS-SF) has been developed as a means of assessing changes in activation and avoidance patterns. To date there is no validated version of this questionnaire in Spanish. This study sought to adapt the BADS-SF to a Spanish population of depressed smokers. Method A sample of 169 smokers (72.2% female) with elevated depressive symptomatology completed the BADS-SF. Results A bi-factorial structure was obtained: Activation and Avoidance. Results indicated an acceptable internal consistency for both the Activation (ω = .85) and the Avoidance subscales (ω =.70). Overall, convergent validity was obtained with Activation and Avoidance subscales being related to other depression-related measures such as depressive symptomatology (Activation r = -.29; Avoidance r = .35), environmental reward (Activation r = .40; Avoidance r = -.41) and, nicotine dependence (Avoidance r = .23). This latter variable was the only one not showing a statistically significant association with the Activation factor (r = -.12). Conclusions The Spanish BADS-SF can be considered as a reliable and valid instrument when assessing behavioral activation among clinically depressed smokers.

A Systematic Review of Sexual Distress Measures

BACKGROUND

Sexual distress is an important component of sexual dysfunction and quality of life and many different measures have been developed for its assessment.

AIM

To conduct a literature review of measures for assessing sexual distress and to list, compare, and highlight their characteristics and psychometric properties.

METHODS

A systematic review was conducted using Scopus and PubMed databases to identify studies that developed and validated measures of sexual distress. The main characteristics and psychometric properties of each measure were extracted and examined.

OUTCOMES

Psychometrically validated measures of sexual distress and a summary of relative strengths and limitations.

RESULTS

We found 17 different measures for the assessment of sexual distress. 4 were standalone questionnaires and 13 were subscales included in questionnaires that assessed broader constructs. Although 5 measures were developed to assess sexual distress in the general population, most were developed and validated in very specific clinical groups. Most followed adequate steps in the development and validation process and have strong psychometric properties; however, several limitations were identified.

CLINICAL TRANSLATION

This literature review offers researchers and clinicians a list of sexual distress measures and relevant characteristics that can be used to select the best assessment tool for their objectives.

STRENGTHS AND LIMITATIONS

A thorough search procedure was used; however, there is still a chance that relevant articles might have been missed owing to our search methodology and inclusion criteria.

CONCLUSION

This is a novel and state-of-the-art review of assessment tools for sexual distress that includes valuable information measure selection in the study of sexual distress and sexual dysfunction. Santos-Iglesias P, Mohamed B, Walker LM. A Systematic Review of Sexual Distress Measures. J Sex Med 2018;15:625-644.

Cultural Adaptation and Psychometric Properties of the Shirom-Melamed Vigor Measure (SMVM) With Workers in Spain

Shirom's proposal about engagement focuses on vigor. Under this approach, vigor is considered an affect that mediates the relationship between resources, behaviors, and attitudes related to psychological functioning and health. It is important for occupational health professionals to have adequate measures of this construct. The Shirom-Melamed vigor measure (SMVM) was developed to capture this sense of energy comprising three components (physical strength, emotional energy, and cognitive liveliness). In the absence of a Spanish version of the SMVM, our aim is to perform a cultural adaptation and to further analyze its psychometric properties. In Study 1, we culturally adapt the SMVM in Spanish samples. It incorporates a careful development of a three-step procedure according to the International Test Commission and qualitative analyses to ensure a consensus version. Twenty-six individuals were involved. In Study 2, the responses of 203 workers from different organizations show the validity and reliability of the instrument. Confirmatory factor analyses yield a model with three interrelated dimensions showing good fit indices. Furthermore, concurrent validity is demonstrated. Finally, we discuss the usefulness of the SMVM for occupational health professionals.

Research design: the methodology for interdisciplinary research framework

Many of today’s global scientific challenges require the joint involvement of researchers from different disciplinary backgrounds (social sciences, environmental sciences, climatology, medicine, etc.). Such interdisciplinary research teams face many challenges resulting from differences in training and scientific culture. Interdisciplinary education programs are required to train truly interdisciplinary scientists with respect to the critical factor skills and competences. For that purpose this paper presents the Methodology for Interdisciplinary Research (MIR) framework. The MIR framework was developed to help cross disciplinary borders, especially those between the natural sciences and the social sciences. The framework has been specifically constructed to facilitate the design of interdisciplinary scientific research, and can be applied in an educational program, as a reference for monitoring the phases of interdisciplinary research, and as a tool to design such research in a process approach. It is suitable for research projects of different sizes and levels of complexity, and it allows for a range of methods’ combinations (case study, mixed methods, etc.). The different phases of designing interdisciplinary research in the MIR framework are described and illustrated by real-life applications in teaching and research. We further discuss the framework’s utility in research design in landscape architecture, mixed methods research, and provide an outlook to the framework’s potential in inclusive interdisciplinary research, and last but not least, research integrity.