1
|
Liang JZ, Ng DKW, Raveendran V, Teo MYK, Quah ELY, Chua KZY, Lua JK, Owyong JLJ, Vijayan AV, Abdul Hamid NAB, Yeoh TT, Ong EK, Phua GLG, Mason S, Fong W, Lim C, Woong N, Ong SYK, Krishna LKR. The impact of online education during the Covid-19 pandemic on the professional identity formation of medical students: A systematic scoping review. PLoS One 2024; 19:e0296367. [PMID: 38181035 PMCID: PMC10769105 DOI: 10.1371/journal.pone.0296367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 12/09/2023] [Indexed: 01/07/2024] Open
Abstract
Evolving individual, contextual, organizational, interactional and sociocultural factors have complicated efforts to shape the professional identity formation (PIF) of medical students or how they feel, act and think as professionals. However, an almost exclusive reliance on online learning during the COVID-19 pandemic offers a unique opportunity to study the elemental structures that shape PIF and the environmental factors nurturing it. We propose two independent Systematic Evidence-Based Approach guided systematic scoping reviews (SSR in SEBA)s to map accounts of online learning environment and netiquette that structure online programs. The data accrued was analysed using the clinically evidenced Krishna-Pisupati Model of Professional Identity Formation (KPM) to study the evolving concepts of professional identity. The results of each SSR in SEBA were evaluated separately with the themes and categories identified in the Split Approach combined to create richer and deeper 'themes/categories' using the Jigsaw Perspective. The 'themes/categories' from each review were combined using the Funnelling Process to create domains that guide the discussion. The 'themes/categories' identified from the 141 included full-text articles in the SSR in SEBA of online programs were the content and effects of online programs. The themes/categories identified from the 26 included articles in the SSR in SEBA of netiquette were guidelines, contributing factors, and implications. The Funnelling Process identified online programs (encapsulating the content, approach, structures and the support mechanisms); their effects; and PIF development that framed the domains guiding the discussion. This SSR in SEBA identifies the fundamental elements behind developing PIF including a structured program within a nurturing environment confined with netiquette-guided boundaries akin to a Community of Practice and the elemental aspect of a socialisation process within online programs. These findings ought to be applicable beyond online training and guide the design, support and assessment of efforts to nurture PIF.
Collapse
Affiliation(s)
- Jonathan Zhen Liang
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Donovan Kai Wei Ng
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Vijayprasanth Raveendran
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Mac Yu Kai Teo
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Elaine Li Ying Quah
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Keith Zi Yuan Chua
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Jun Kiat Lua
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | | | - Andrew Vimal Vijayan
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
| | | | - Ting Ting Yeoh
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Department of Pharmacy, National Cancer Centre Singapore, Singapore, Singapore
| | - Eng Koon Ong
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Assisi Hospice, Singapore, Singapore
| | - Gillian Li Gek Phua
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Lien Centre for Palliative Care, Duke-NUS Medical School, Singapore, Singapore
| | - Stephen Mason
- Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, University of Liverpool, Liverpool, United Kingdom
| | - Warren Fong
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Department of Rheumatology and Immunology, Singapore General Hospital, Singapore, Singapore
| | - Crystal Lim
- Medical Social Services, Singapore General Hospital, Singapore, Singapore
| | - Natalie Woong
- Department of Internal Medicine, Singapore General Hospital, Singapore, Singapore
| | - Simon Yew Kuang Ong
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Division of Medical Oncology, National Cancer Centre Singapore, Singapore, Singapore
| | - Lalit Kumar Radha Krishna
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, University of Liverpool, Liverpool, United Kingdom
- PalC, The Palliative Care Centre for Excellence in Research and Education, Singapore, Singapore
| |
Collapse
|
2
|
Riedel M, Kaefinger K, Stuehrenberg A, Ritter V, Amann N, Graf A, Recker F, Klein E, Kiechle M, Riedel F, Meyer B. ChatGPT's performance in German OB/GYN exams - paving the way for AI-enhanced medical education and clinical practice. Front Med (Lausanne) 2023; 10:1296615. [PMID: 38155661 PMCID: PMC10753765 DOI: 10.3389/fmed.2023.1296615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 11/27/2023] [Indexed: 12/30/2023] Open
Abstract
Background Chat Generative Pre-Trained Transformer (ChatGPT) is an artificial learning and large language model tool developed by OpenAI in 2022. It utilizes deep learning algorithms to process natural language and generate responses, which renders it suitable for conversational interfaces. ChatGPT's potential to transform medical education and clinical practice is currently being explored, but its capabilities and limitations in this domain remain incompletely investigated. The present study aimed to assess ChatGPT's performance in medical knowledge competency for problem assessment in obstetrics and gynecology (OB/GYN). Methods Two datasets were established for analysis: questions (1) from OB/GYN course exams at a German university hospital and (2) from the German medical state licensing exams. In order to assess ChatGPT's performance, questions were entered into the chat interface, and responses were documented. A quantitative analysis compared ChatGPT's accuracy with that of medical students for different levels of difficulty and types of questions. Additionally, a qualitative analysis assessed the quality of ChatGPT's responses regarding ease of understanding, conciseness, accuracy, completeness, and relevance. Non-obvious insights generated by ChatGPT were evaluated, and a density index of insights was established in order to quantify the tool's ability to provide students with relevant and concise medical knowledge. Results ChatGPT demonstrated consistent and comparable performance across both datasets. It provided correct responses at a rate comparable with that of medical students, thereby indicating its ability to handle a diverse spectrum of questions ranging from general knowledge to complex clinical case presentations. The tool's accuracy was partly affected by question difficulty in the medical state exam dataset. Our qualitative assessment revealed that ChatGPT provided mostly accurate, complete, and relevant answers. ChatGPT additionally provided many non-obvious insights, especially in correctly answered questions, which indicates its potential for enhancing autonomous medical learning. Conclusion ChatGPT has promise as a supplementary tool in medical education and clinical practice. Its ability to provide accurate and insightful responses showcases its adaptability to complex clinical scenarios. As AI technologies continue to evolve, ChatGPT and similar tools may contribute to more efficient and personalized learning experiences and assistance for health care providers.
Collapse
Affiliation(s)
- Maximilian Riedel
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Katharina Kaefinger
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Antonia Stuehrenberg
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Viktoria Ritter
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Niklas Amann
- Department of Gynecology and Obstetrics, Friedrich–Alexander-University Erlangen–Nuremberg (FAU), Erlangen, Germany
| | - Anna Graf
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Florian Recker
- Department of Gynecology and Obstetrics, Bonn University Hospital, Bonn, Germany
| | - Evelyn Klein
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Marion Kiechle
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| | - Fabian Riedel
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Bastian Meyer
- Department of Gynecology and Obstetrics, Klinikum Rechts der Isar, Technical University Munich (TU), Munich, Germany
| |
Collapse
|
3
|
Enoch LC, Abraham RM, Singaram VS. Factors That Enhance and Hinder the Retention and Transfer of Online Pre-Clinical Skills Training to Facilitate Blended Learning. ADVANCES IN MEDICAL EDUCATION AND PRACTICE 2023; 14:919-936. [PMID: 37645657 PMCID: PMC10461612 DOI: 10.2147/amep.s398376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 02/18/2023] [Indexed: 08/31/2023]
Abstract
Purpose During the SARS-CoV-2 pandemic, various online instructional strategies in clinical skills training were piloted. The sudden transition to the remote platform circumvented the rigorous planning associated with curriculum reform. This study aimed to explore students' and tutors' perceptions of factors that promoted or hindered successful learning transfer and to propose a blended conceptual model to guide affective, cognitive, and psychomotor clinical skills training in the pre-clinical phase of medical education. Methods A mixed-method quasi-experimental study assessed third-year students' transfer of clinical skills and knowledge following online learning in 2021. Students and their tutors completed online surveys that included open and closed-ended questions regarding factors influencing their experience of the adapted teaching methods. Descriptive statistical analysis was used for the quantitative data. Qualitative responses were thematically analyzed. Results One hundred fourteen students (48%) and seven tutors (100%) responded to the surveys. The questionnaires' internal consistency and construct validity were determined using Cronbach's α-Coefficient. There was an overall positive response (86%) to the acceptability of the online platform in clinical skills training. Using online simulations with targeted onsite practice was reported as effective in clinical skills training. Tutors perceived students as well-prepared for the skills laboratory. Five emergent themes, qualified by a linear model of asynchronous and synchronous online and onsite teaching with the evaluation of the instructional design and institutional support, informed the proposed blended learning guide for clinical skills training in the pre-clinical phase. Conclusion Blended clinical skills learning that included the flipped classroom concept was well-accepted. Virtual patients proved a convenient cognitive preparation tool for skills training and potentially optimized teaching delivery. The study found that the adapted teaching frameworks incorporating an online clinical skills component into a modified onsite curriculum augmented learners' ability to transfer knowledge to the clinical skills laboratory. An integrated five-step blended model is proposed for future interventions.
Collapse
Affiliation(s)
- L C Enoch
- School of Clinical Medicine, Clinical and Professional Practice, College of Health Sciences, University of KwaZulu-Natal, Durban, South Africa
| | - R M Abraham
- School of Clinical Medicine, Clinical and Professional Practice, College of Health Sciences, University of KwaZulu-Natal, Durban, South Africa
| | - V S Singaram
- School of Clinical Medicine, Clinical and Professional Practice, College of Health Sciences, University of KwaZulu-Natal, Durban, South Africa
| |
Collapse
|
4
|
Maeda Y, Hasegawa A, Miyake R, Dofutsu M, Higuchi Y, Osaku D, Suemitsu T, Onodera Y, Shozu M, Miura K, Yoshida Y, Komatsu H, Watari H. Association of online activities with obstetrics and gynecology specialty choice: a nationwide online survey. INTERNATIONAL JOURNAL OF MEDICAL EDUCATION 2022; 13:261-266. [PMID: 36183190 PMCID: PMC9905000 DOI: 10.5116/ijme.6320.36eb] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 09/13/2022] [Indexed: 06/16/2023]
Abstract
OBJECTIVES To investigate the association between online activities and the number of new obstetrics and gynecology senior residents. METHODS A nationwide web-based, self-administered anonymous survey was conducted to investigate recruitment and clerkship activities during the coronavirus disease 2019 pandemic. An online questionnaire was sent to 576 obstetrics and gynecology training institutions in Japan between December 21, 2020, and January 31, 2021. Overall, 334 institutions that gave valid responses were included (response rate: 58.0%). Multivariate logistic regression analysis examined the association between online activities, including recruitment and clerkship activities, and the number of new obstetrics and gynecology senior residents in 2021. The stratified analysis by implementing face-to-face activities was conducted to clarify the association. RESULTS The number of new senior residents increased in 187 facilities (56.0%) and decreased in 147 facilities (44.0%). The facilities that implemented face-to-face and online activities were 185 (55.4%) and 120 (35.9%), respectively. In multivariate logistic regression analysis, an increased number of new obstetrics and gynecology senior residents was significantly associated with face-to-face activities (adjusted odds ratio (AOR)=2.58, 95% confidence interval (CI): 1.11-5.97, p<.001) but not with online activities. In the stratified analysis, online activities were significantly associated with an increased number of new obstetrics and gynecology senior residents among the facilities without face-to-face activities (AOR=3.81, 95% CI: 1.40-10.32, p=.009) but not among those with face-to-face activities (AOR=0.87, 95% CI: 0.42-1.78). CONCLUSIONS Online activities were associated with an increased number of new obstetrics and gynecology senior residents among the facilities that did not conduct face-to-face activities.
Collapse
Affiliation(s)
- Yuto Maeda
- Department of Global Health Promotion, Tokyo Medical and Dental University, Tokyo, Japan
| | - Akihiro Hasegawa
- Department of Obstetrics and Gynecology, The Jikei University School of Medicine, Tokyo, Japan
| | - Ryuta Miyake
- Department of Obstetrics and Gynecology, Nara Medical University, Japan
| | - Mihoko Dofutsu
- Department of Obstetrics and Gynecology, Yokohama City University School of Medicine, Yokohama, Japan
| | - Yayoi Higuchi
- Department of Obstetrics and Gynecology, Kochi University, Kochi, Japan
| | - Daiken Osaku
- Department of Obstetrics and Gynecology, Tottori University, Tottori, Japan
| | - Tokumasa Suemitsu
- Department of Obstetrics and Gynecology, Kameda Medical Center, Chiba, Japan
| | - Yohei Onodera
- Department of Obstetrics and Gynecology, Akita University Graduate School of Medicine, Akita, Japan
| | - Makio Shozu
- Evolution and Reproductive Biology, Medical Mycology Research Center, Chiba University, Chiba, Japan
| | - Kiyonori Miura
- Department of Obstetrics and Gynecology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Yoshio Yoshida
- Department of Obstetrics and Gynecology, University of Fukui, Fukui, Japan
| | - Hiroaki Komatsu
- Department of Obstetrics and Gynecology, Tottori University, Tottori, Japan
| | - Hidemichi Watari
- Department of Obstetrics and Gynecology, Hokkaido University Graduate School of Medicine, Sapporo, Japan
| |
Collapse
|
5
|
Oertel M, Pepper NB, Schmitz M, Becker JC, Eich HT. Digital transfer in radiation oncology education for medical students-single-center data and systemic review of the literature. Strahlenther Onkol 2022; 198:765-772. [PMID: 35486128 PMCID: PMC9053120 DOI: 10.1007/s00066-022-01939-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 03/24/2022] [Indexed: 12/18/2022]
Abstract
PURPOSE Modern medical education demands innovative, competence-orientated concepts. The forced digital transfer of teaching due to the coronavirus pandemic also affected radiation oncology (RO). The following analysis investigates whether the attractivity of RO teaching at our faculty could be maintained during the pandemic and which possibilities exist to involve students (in active learning). The latter aspect is further elaborated on a broader scale by a systemic review of the literature on competence-orientated digital education. METHODS Evaluation results and participation rates of clinical lectures in radiation oncology (RO) were analyzed between the winter semester 2018/2019 and the summer semester 2021. A systemic review of the literature on digital education in RO for medical students was conducted. RESULTS Concerning evaluation results, a significant improvement for the 7th and 9th semesters was observed in comparison between the pre-pandemic and pandemic semesters (p = 0.046 and p = 0.05, respectively). Overall participation rates did not differ. However, the number of students attending > 75% of classes in the respective semester increased significantly between the pre-pandemic and pandemic period (median values: 38 vs. 79%, p = 0.046; 44 vs. 73%, p = 0.05; 45 vs. 64%, p = 0.05; 41 vs. 77%, p = 0.05; 41 vs. 71%, p = 0.05, for the 6th to 10th semester, respectively). CONCLUSION The analysis demonstrates the possibility of efficient digital transfer of a core curriculum in RO to the digital era, with a more continuous participation of students. This transfer may enable amelioration of teaching quality and the introduction of innovative and interactive concepts in accordance with the literature.
Collapse
Affiliation(s)
- Michael Oertel
- Department of Radiation Oncology, University Hospital Muenster, Albert-Schweitzer-Campus 1, building A1, 48149, Muenster, Germany.
| | - Niklas Benedikt Pepper
- Department of Radiation Oncology, University Hospital Muenster, Albert-Schweitzer-Campus 1, building A1, 48149, Muenster, Germany
| | - Martina Schmitz
- Institute of Anatomy and Vascular Biology, University of Muenster, Vesaliusweg 2-4, 48149, Muenster, Germany
| | - Jan Carl Becker
- Department of Medical Education (IfAS), University of Muenster, Albert-Schweitzer-Campus 1, building A6, 48149, Muenster, Germany
| | - Hans Theodor Eich
- Department of Radiation Oncology, University Hospital Muenster, Albert-Schweitzer-Campus 1, building A1, 48149, Muenster, Germany
| |
Collapse
|
6
|
Application of test-enhanced learning (TEL) in obstetrics and gynecology: a prospective study. Arch Gynecol Obstet 2022; 306:1563-1571. [PMID: 35831757 PMCID: PMC9281379 DOI: 10.1007/s00404-022-06656-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 06/01/2022] [Indexed: 11/02/2022]
Abstract
OBJECTIVE Clinical reasoning is an essential skill, the foundations of which should be acquired during medical school. Within the format of test-based learning, such examinations can also be used to support the long-term retention of procedural knowledge necessary for clinical reasoning. The aim was to investigate whether repeated exposure to clinical cases in obstetrics and gynecology (OBGYN) with built-in questions leads to higher learning outcome than pure reading cases and what influence the delay between the intervention and the final test has on the retention of the respective content. METHODS In this non-randomised crossover study, 5th-year medical students (duration of the study is 6 years) taking a 1-week clinical attachment in OBGYN participated in computer-based case seminars in winter term 2020/2021, in which different case histories on gynecological-obstetric diseases were presented. Case content was identical for all groups, but the presentation format (cases with key feature questions vs read-only cases) of individual case vignettes changed weekly. The also intervention was repeated after 2 weeks for each group. Knowledge was assessed in an entry and an exit exam consisting of 40 short-answer questions. RESULTS A total of 94 out of 118 eligible students participated in the study (response rate: 79.7%). Learning outcome was significantly higher for items presented in the key feature format compared to items presented as read-only cases (74.2 ± 8.6% vs. 71.0 ± 9.2%; p = 0.017). Furthermore, the analysis showed that the temporal distance of the intervention package from the final examination had no influence on retention. CONCLUSION This is the first study to demonstrate an effect of test-enhanced learning on clinical reasoning in the subject of OGBYN. In this cross-over study, repeated testing was more effective than repeated case-based learning alone. Curricular implementation of longitudinal key feature testing can thus improve learning outcomes for OBGYN.
Collapse
|
7
|
Sorg H, Ehlers JP, Sorg CGG. Digitalization in Medicine: Are German Medical Students Well Prepared for the Future? INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:8308. [PMID: 35886156 PMCID: PMC9317432 DOI: 10.3390/ijerph19148308] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/05/2022] [Revised: 07/05/2022] [Accepted: 07/06/2022] [Indexed: 11/18/2022]
Abstract
The German healthcare system is facing a major transformation towards digitalized medicine. The aim was to find out the attitude and the degree of preparation of upcoming medical professionals for digital medicine. By means of an online survey, medical students from 38 German faculties were asked about different topics concerning digitalization. Most students (70.0%) indicated that they had not had any university courses on digital topics. Thus, only 22.2% feel prepared for the technical reality of digitalized medicine. Most fear losing patient contact because of digitalized medicine and assume that the medical profession will not be endangered by digitalization. Security systems, data protection, infrastructure and inadequate training are cited as the top problems of digitalization in medicine. Medical students have major concerns about incorrect decisions and the consecutive medicolegal aspects of using digital support as part their treatment plans. Digitalization in medicine is progressing faster than it can currently be implemented in the practical work. The generations involved have different understandings of technology, and there is a lack of curricular training in medical schools. There must be a significant improvement in training in digital medical skills so that the current and future healthcare professionals are better prepared for digitalized medicine.
Collapse
Affiliation(s)
- Heiko Sorg
- Didactics and Education Research in the Health Sector, Faculty of Health, University of Witten/Herdecke, 58455 Witten, Germany;
- Department of Plastic and Reconstructive Surgery, Marien Hospital Witten, 58452 Witten, Germany
| | - Jan P. Ehlers
- Didactics and Education Research in the Health Sector, Faculty of Health, University of Witten/Herdecke, 58455 Witten, Germany;
| | - Christian G. G. Sorg
- Department of Management and Entrepreneurship, Faculty of Management, Economics and Society, University of Witten/Herdecke, 58455 Witten, Germany;
| |
Collapse
|