1
|
Silwanah AS, Suriah S, Jafar N, Areni IS, Yusuf RA. Content and features of Mobile health (mHealth) for mother and child nutrition in the first 1000 days of life (family based intervention): A systematic review. Nutr Health 2024:2601060241265550. [PMID: 39043216 DOI: 10.1177/02601060241265550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/25/2024]
Abstract
Background: Improving mother and child nutrition during the first 1000 days of life (DoL) is one of the major areas where mHealth has demonstrated great promise. A lot of mHealth is already used in society. However, no study examines the content and features of mobile health. Aim: This study aims to examine the difference in content and features of mHealth intervention for maternal and child nutrition throughout the first 1000 days of life. Thus, new apps can be enhanced. Methods: The online journal databases that offer free papers from Scopus-indexed journals published in 2017-2022 served as the primary sources for the literature included in this study. Several keywords were used in the literature search, which used the databases Google Scholar, Science Direct, and PubMed. A total of 8 articles were included in the literature review. Results: Existing mHealth provides content and features to support and improve the health status of pregnant women, breastfeeding mothers, and children aged 0-24 months. mHealth interventions have the potential to improve maternal and child nutrition health in the first 1000 days of life by providing education, communication, support, data collection and analysis, cultural appropriateness, accessibility, and capacity building for health workers. However, it is crucial to address challenges such as evidence-based design, privacy and security, sustainability, and data management, and to ensure cultural appropriateness and accessibility for all populations. Conclusions: The more complete the content, features, and uses of mHealth, the greater the users' acceptance.
Collapse
Affiliation(s)
- Andi Sani Silwanah
- Faculty of Public Health, Sekolah Tinggi Ilmu Kesehatan Makassar, Makassar, Indonesia
- Faculty of Public Health, Hasanuddin University, Makassar, Indonesia
| | - Suriah Suriah
- Faculty of Public Health, Hasanuddin University, Makassar, Indonesia
| | - Nurhaedar Jafar
- Faculty of Public Health, Hasanuddin University, Makassar, Indonesia
| | - Intan Sari Areni
- Faculty of Engineering, Hasanuddin University, Makassar, Indonesia
| | - Rezky Aulia Yusuf
- Faculty of Public Health, Universitas Muslim Indonesia, Makassar, Indonesia
| |
Collapse
|
2
|
Wunsch K, Fiedler J, Hubenschmid S, Reiterer H, Renner B, Woll A. An mHealth Intervention Promoting Physical Activity and Healthy Eating in a Family Setting (SMARTFAMILY): Randomized Controlled Trial. JMIR Mhealth Uhealth 2024; 12:e51201. [PMID: 38669071 PMCID: PMC11087865 DOI: 10.2196/51201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 10/27/2023] [Accepted: 02/27/2024] [Indexed: 04/28/2024] Open
Abstract
BACKGROUND Numerous smartphone apps are targeting physical activity (PA) and healthy eating (HE), but empirical evidence on their effectiveness for the initialization and maintenance of behavior change, especially in children and adolescents, is still limited. Social settings influence individual behavior; therefore, core settings such as the family need to be considered when designing mobile health (mHealth) apps. OBJECTIVE The purpose of this study was to evaluate the effectiveness of a theory- and evidence-based mHealth intervention (called SMARTFAMILY [SF]) targeting PA and HE in a collective family-based setting. METHODS A smartphone app based on behavior change theories and techniques was developed, implemented, and evaluated with a cluster randomized controlled trial in a collective family setting. Baseline (t0) and postintervention (t1) measurements included PA (self-reported and accelerometry) and HE measurements (self-reported fruit and vegetable intake) as primary outcomes. Secondary outcomes (self-reported) were intrinsic motivation, behavior-specific self-efficacy, and the family health climate. Between t0 and t1, families of the intervention group (IG) used the SF app individually and collaboratively for 3 consecutive weeks, whereas families in the control group (CG) received no treatment. Four weeks following t1, a follow-up assessment (t2) was completed by participants, consisting of all questionnaire items to assess the stability of the intervention effects. Multilevel analyses were implemented in R (R Foundation for Statistical Computing) to acknowledge the hierarchical structure of persons (level 1) clustered in families (level 2). RESULTS Overall, 48 families (CG: n=22, 46%, with 68 participants and IG: n=26, 54%, with 88 participants) were recruited for the study. Two families (CG: n=1, 2%, with 4 participants and IG: n=1, 2%, with 4 participants) chose to drop out of the study owing to personal reasons before t0. Overall, no evidence for meaningful and statistically significant increases in PA and HE levels of the intervention were observed in our physically active study participants (all P>.30). CONCLUSIONS Despite incorporating behavior change techniques rooted in family life and psychological theories, the SF intervention did not yield significant increases in PA and HE levels among the participants. The results of the study were mainly limited by the physically active participants and the large age range of children and adolescents. Enhancing intervention effectiveness may involve incorporating health literacy, just-in-time adaptive interventions, and more advanced features in future app development. Further research is needed to better understand intervention engagement and tailor mHealth interventions to individuals for enhanced effectiveness in primary prevention efforts. TRIAL REGISTRATION German Clinical Trials Register DRKS00010415; https://drks.de/search/en/trial/DRKS00010415. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/20534.
Collapse
Affiliation(s)
- Kathrin Wunsch
- Institute of Sports and Sports Science, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Janis Fiedler
- Institute of Sports and Sports Science, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Sebastian Hubenschmid
- Department of Computer and Information Science, University of Konstanz, Konstanz, Germany
| | - Harald Reiterer
- Department of Computer and Information Science, University of Konstanz, Konstanz, Germany
| | - Britta Renner
- Department of Psychology, University of Konstanz, Konstanz, Germany
| | - Alexander Woll
- Institute of Sports and Sports Science, Karlsruhe Institute of Technology, Karlsruhe, Germany
| |
Collapse
|
3
|
Pala D, Petrini G, Bosoni P, Larizza C, Quaglini S, Lanzola G. Smartphone applications for nutrition Support: A systematic review of the target outcomes and main functionalities. Int J Med Inform 2024; 184:105351. [PMID: 38295584 DOI: 10.1016/j.ijmedinf.2024.105351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 01/24/2024] [Accepted: 01/26/2024] [Indexed: 02/02/2024]
Abstract
INTRODUCTION A proper nutrition is essential for human life. Recently, special attention on this topic has been given in relation to three health statuses: obesity, malnutrition and specific diseases that can be related to food or treated with specific diets. Mobile technology is often used to assist users that wish to regulate their eating habits, and identifying which fields of application have been explored the most by the app developers and which main functionalities have been adopted can be useful in view of future app developments. METHODS We selected 322 articles mentioning nutrition support apps through a literature database search, all of which have undergone an initial screening. After the exclusion of papers that were already reviews, not presenting apps or not focused on nutrition, not relevant or not developed for human subjects, 100 papers were selected for subsequent analyses that aimed at identifying the main treated conditions, outcome measures and functionalities implemented in the Apps. RESULTS Of the selected studies, 33 focus on specific diseases, 24 on obesity, 2 on malnutrition and 41 on other targets (e.g., weight/diet control). Type 2 diabetes is the most targeted disease, followed by gestational diabetes, hypertension, colorectal cancer and CVDs which all were targeted by more than one app. Most Apps include self-monitoring and coaching functionalities, educational content and artificial intelligence (AI) tools are slightly less common, whereas counseling, gamification and questionnaires are the least implemented. Body weight and calories/nutrients were the most common general outcome measures, while glycated hemoglobin (HbA1c) was the most common clinical outcome. No statistically significant differences in the effectiveness of the different functionalities were found. CONCLUSION The use of mobile technology to improve nutrition has been widely explored in the last years, especially for weight control and specific diseases like diabetes; however, other food-related conditions such as Irritable Bowel Diseases appear to be less targeted by newly developed smartphone apps and their related studies. All different kinds of functionalities appear to be equally effective, but further specific studies are needed to confirm the results.
Collapse
Affiliation(s)
- Daniele Pala
- Department of Computer, Electrical and Biomedical Engineering, University of Pavia, Pavia, Italy; Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
| | - Giorgia Petrini
- Department of Computer, Electrical and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Pietro Bosoni
- Department of Computer, Electrical and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Cristiana Larizza
- Department of Computer, Electrical and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Silvana Quaglini
- Department of Computer, Electrical and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Giordano Lanzola
- Department of Computer, Electrical and Biomedical Engineering, University of Pavia, Pavia, Italy
| |
Collapse
|
4
|
Mohd Saad N, Mohamad M, Mat Ruzlin AN. Web-Based Intervention to Act for Weight Loss in Adults With Type 2 Diabetes With Obesity (Chance2Act): Protocol for a Nonrandomized Controlled Trial. JMIR Res Protoc 2024; 13:e48313. [PMID: 38294848 PMCID: PMC10867745 DOI: 10.2196/48313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 12/07/2023] [Accepted: 12/08/2023] [Indexed: 02/01/2024] Open
Abstract
BACKGROUND In adults with type 2 diabetes (T2D), weight loss can improve hemoglobin A1c, blood pressure, and triglycerides, and reduce the frequency of medications needed. Unfortunately, a large proportion of these individuals are not ready to initiate weight efforts, making existing obesity management strategies less effective. Many digital health interventions aim at weight loss, but there is still limited evidence on their effectiveness in changing weight loss behavior, especially in adults with T2D. OBJECTIVE This study aims to develop and validate "Chance2Act," a new web-based intervention, designed specifically to facilitate behavioral change in adults with T2D with obesity who are not ready to act toward weight loss. Then, the effectiveness of the newly developed intervention will be determined from a nonrandomized controlled trial. METHODS A web-based intervention will be developed based on the Transtheoretical Model targeting adults with T2D with obesity who are not ready to change for weight loss. Phase 1 will involve the development and validation of the web-based health intervention module. In phase 2, a nonrandomized controlled trial will be conducted in 2 government health clinics selected by the investigator. This is an unblinded study with a parallel assignment (ie, intervention vs control [usual care] with an allocation ratio of 1:1). A total of 124 study participants will be recruited, of which 62 participants will receive the Chance2Act intervention in addition to the usual care. The primary outcome is the changes in an individual's readiness from a stage of not being ready to change (precontemplation, contemplation, or preparation stage) to being ready for weight loss (action stage). The secondary outcomes include changes in self-efficacy, decisional balance, family support for weight loss, BMI, waist circumference, and body fat composition. RESULTS The phase 1 study will reveal the intervention's validity through the Content Validity Index and Face Validity Index, considering it valid if both indices exceed 0.83. The effectiveness of the intervention will be determined in phase 2, where the differences within and between groups will be analyzed in terms of the improvement of stages of change and all secondary outcomes as defined in the methodology. Data analysis for phase 2 will commence in 2024, with the anticipated publication of results in March 2024. CONCLUSIONS If proven effective, the result of the study may give valuable insights into the effective behavioral modification strategies for a web-based intervention targeting adults with T2D with obesity but not yet ready to change for weight loss. This intervention may be replicated or adopted in different settings, focusing on behavioral modification support that patients need. This study offers a deeper understanding of the application of behavior change techniques for a more holistic approach to obesity care in T2D. TRIAL REGISTRATION ClinicalTrials.gov NCT05736536; https://clinicaltrials.gov/study/NCT05736536. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/48313.
Collapse
Affiliation(s)
- Noraini Mohd Saad
- Faculty of Medicine, Universiti Teknologi MARA, Sungai Buloh, Selangor, Malaysia
| | - Mariam Mohamad
- Faculty of Medicine, Universiti Teknologi MARA, Sungai Buloh, Selangor, Malaysia
| | | |
Collapse
|
5
|
Mahmoodi Kahriz B, Snuggs S, Sah A, Clot S, Lamport D, Forrest J, Helme-Guizon A, Wilhelm MC, Caldara C, Anin CV, Vogt J. Unveiling Consumer Preferences and Intentions for Cocreated Features of a Combined Diet and Physical Activity App: Cross-Sectional Study in 4 European Countries. JMIR Hum Factors 2023; 10:e44993. [PMID: 38079197 PMCID: PMC10750232 DOI: 10.2196/44993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 06/27/2023] [Accepted: 08/24/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND Numerous mobile health apps are marketed globally, and these have specific features including physical activity tracking, motivational feedback, and recipe provision. It is important to understand which features individuals prefer and whether these preferences differ between consumer groups. OBJECTIVE In this study, we aimed to identify consumers' most preferred features and rewards for a mobile app that targets healthy eating and physical activity and to reduce the number of individual mobile health app features to a smaller number of key categories as perceived by consumers. In addition, we investigated the impact of differences in consumers' BMI and self-efficacy on their intention to use and willingness to pay for such an app. Finally, we identified the characteristics of different target groups of consumers and their responses toward app features via cluster analysis. METHODS A total of 212 participants from France, Italy, the United Kingdom, and Germany were recruited via the web to answer questions about app features, motivation, self-efficacy, demographics, and geographic factors. It is important to note that our study included an evenly distributed sample of people in the age range of 23 to 50 years (23-35 and 35-50 years). The app features in question were generated from a 14-day cocreation session by a group of consumers from the United Kingdom and the Republic of Ireland. RESULTS "Home work out suggestions," "exercise tips," and "progress charts" were the most preferred app features, whereas "gift vouchers" and "shopping discounts" were the most preferred rewards. "Connections with other communication apps" was the least preferred feature, and "charitable giving" was the least preferred reward. Importantly, consumers' positive attitude toward the "social support and connectedness and mindfulness" app feature predicted willingness to pay for such an app (β=.229; P=.004). Differences in consumers' health status, motivational factors, and basic demographics moderated these results and consumers' intention to use and willingness to pay for such an app. Notably, younger and more motivated consumers with more experience and knowledge about health apps indicated more positive attitudes and intentions to use and willingness to pay for this type of app. CONCLUSIONS This study indicated that consumers tend to prefer app features that are activity based and demonstrate progress. It also suggested a potential role for monetary rewards in promoting healthy lifestyle behaviors. Moreover, the results highlighted the role of consumers' health status, motivational factors, and socioeconomic status in predicting their app use. These results provide up-to-date, practical, and pragmatic information for the future design and operation of mobile health apps.
Collapse
Affiliation(s)
| | - Sarah Snuggs
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, United Kingdom
| | - Anumeha Sah
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, United Kingdom
| | - Sophie Clot
- Department of Economics, University of Reading, Reading, United Kingdom
| | - Daniel Lamport
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, United Kingdom
| | - Joseph Forrest
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, United Kingdom
| | | | | | - Cindy Caldara
- Grenoble Alpes University, Grenoble INP, CERAG, Grenoble, France
| | | | - Julia Vogt
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, United Kingdom
| |
Collapse
|
6
|
Blakeslee SB, Vieler K, Horak I, Stritter W, Seifert G. Planting Seeds for the Future: Scoping Review of Child Health Promotion Apps for Parents. JMIR Mhealth Uhealth 2023; 11:e39929. [PMID: 37471125 PMCID: PMC10401193 DOI: 10.2196/39929] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 11/12/2022] [Accepted: 05/02/2023] [Indexed: 07/21/2023] Open
Abstract
BACKGROUND Increasingly, parents use child health promotion apps to find health information. An overview of child health promotion apps for parents currently does not exist. The scope of child health topics addressed by parent apps is thus needed, including how they are evaluated. OBJECTIVE This scoping review aims to describe existing reported mobile health (mHealth) parent apps of middle- to high-income countries that promote child health. The focus centers on apps developed in the last 5 years, showing how the reported apps are evaluated, and listing reported outcomes found. METHODS A scoping review was conducted according to PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Scoping Reviews) guidelines to identify parent apps or web-based programs on child health promotion published between January 2016 and June 2021 in 5 databases: PubMed, ERIC, IEEE Xplore, Web of Science, and Google Scholar. Separate sources were sought through an expert network. Included studies were summarized and analyzed through a systematic and descriptive content analysis, including keywords, year of publication, country of origin, aims/purpose, study population/sample size, intervention type, methodology/method(s), broad topic(s), evaluation, and study outcomes. RESULTS In total, 39 studies met the inclusion criteria from 1040 database and 60 expert-identified studies. Keywords reflected the health topics and app foci. About 64% (25/39) of included studies were published after 2019 and most stemmed from the United States, Australian, and European-based research. Studies aimed to review or evaluate apps or conducted app-based study interventions. The number of participants ranged from 7 to 1200. Quantitative and qualitative methods were used. Interventions included 28 primary studies, 6 app feasibility studies, and 5 app or literature reviews. Eight separate topics were found: parental feeding and nutrition, physical activity, maternal-child health, parent-child health, healthy environment, dental health, mental health, and sleep. Study intervention evaluations cited behavior change theories in 26 studies and evaluations were carried out with a variety of topic-specific, adapted, self-developed, or validated questionnaires and evaluation tools. To evaluate apps, user input and qualitative evaluations were often combined with surveys and frequently rated with the Mobile App Rating Scale. Outcomes reported some positive effects, while several intervention studies saw no effect at all. Effectively evaluating changes in behavior through apps, recruiting target groups, and retaining app engagement were challenges cited. CONCLUSIONS New parents are a key target group for child health apps, but evaluating child health promotion apps remains a challenge. Whether tailored to parent needs or adapted to the specific topic, apps should be rooted in a transparent theoretical groundwork. Applicable lessons for parent apps from existing research are to tailor app content, include intuitive and adaptive features, and embed well-founded parameters for long-term effect evaluation on child health promotion.
Collapse
Affiliation(s)
- Sarah B Blakeslee
- Department of Pediatrics, Division of Oncology and Hematology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Kristin Vieler
- Department of Pediatrics, Division of Oncology and Hematology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Ingo Horak
- Digital Health Entrepreneur, Berlin, Germany
| | - Wiebke Stritter
- Department of Pediatrics, Division of Oncology and Hematology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Georg Seifert
- Department of Pediatrics, Division of Oncology and Hematology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
7
|
Ostovarfar J, Kaveh MH, Vardanjani HM, Ghahramani L, Karimi M, Asadollahi A, Zare R. Improving family health climate, effect of role modeling and maternal support in female students. BMC PRIMARY CARE 2023; 24:70. [PMID: 36907853 PMCID: PMC10008707 DOI: 10.1186/s12875-023-02015-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 02/22/2023] [Indexed: 03/14/2023]
Abstract
INTRODUCTION Girls can use their mother's emotional, informational and behavioral support to perform healthy behaviors due to their constant access to their mothers. This study aimed to evaluate the effect of role modeling and maternal support in the family to improve healthy behaviors and perceived Family Health Climate (FHC) in female students. METHODS In this educational quasi-experimental study, 261 female students (133 in the intervention group and 128 in the control group) and 223 mothers (109 intervention and 114 control) were selected using the cluster multi-stages sampling method and entered the study. Participants (intervention and control groups) completed the FHC scale at three stages (before intervention, immediately after the intervention, and 2 months after intervention). A training program that comprised 12 sessions for students and six sessions for their mothers using collaborative learning techniques and printed materials was conducted with the experimental group. Also after completing the questionnaire in the follow-up phase, pamphlets and educational videos were given to the control group. Data were analyzed using SPSS20 via a chi-square test, independent t-test, and Repeated Measures ANOVA at a significance level of 0.05. RESULTS Before the intervention, there was no significant difference between demographic variables and the score of the FHC scale in both groups (p < 0.05). Immediately and 2 months after the intervention, the experimental group (female students and their mothers) showed a significant increase in dimensions of FHC, including FHC-NU (Family Health Climate-Nutrition) and FHC-PA (Family Health Climate-Physical Activity), compared to the control group (p < 0.05). CONCLUSIONS Educating and informing mothers about the impact of their role modeling on their children, especially girls, can make them more aware of health-oriented behaviors towards their children. Such findings reinforced the importance of focusing on actions to encourage a healthy lifestyle (healthy diet and physical activity) in students with a focus on role modeling and parental support, especially mothers.
Collapse
Affiliation(s)
- Jeyran Ostovarfar
- grid.412571.40000 0000 8819 4698MPH Program, Medical School, Shiraz University of Medical Sciences, Setad Square, Shiraz, Fars Iran
| | - Mohammad Hossein Kaveh
- grid.412571.40000 0000 8819 4698Department of Health Promotion, School of Health, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Hossein Molavi Vardanjani
- grid.412571.40000 0000 8819 4698MPH Program, Medical School, Shiraz University of Medical Sciences, Setad Square, Shiraz, Fars Iran
| | - Leila Ghahramani
- grid.412571.40000 0000 8819 4698Department of Health Promotion, School of Health, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Masoud Karimi
- grid.412571.40000 0000 8819 4698Department of Health Promotion, School of Health, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Abdolrahim Asadollahi
- grid.412571.40000 0000 8819 4698Department of Health Promotion, School of Health, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Razie Zare
- grid.412504.60000 0004 0612 5699Department of Industrial & Organizational Psychology, Faculty Education & Psychology, Shahid Chamran University, Ahvaz, Iran
| |
Collapse
|
8
|
Schoeppe S, Waters K, Salmon J, Williams SL, Power D, Alley S, Rebar AL, Hayman M, Duncan MJ, Vandelanotte C. Experience and Satisfaction with a Family-Based Physical Activity Intervention Using Activity Trackers and Apps: A Qualitative Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:3327. [PMID: 36834022 PMCID: PMC9963519 DOI: 10.3390/ijerph20043327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 02/07/2023] [Accepted: 02/09/2023] [Indexed: 06/18/2023]
Abstract
Wearable activity trackers and smartphone apps have been shown to increase physical activity in children and adults. However, interventions using activity trackers and apps have rarely been tested in whole families. This study examined the experience and satisfaction with an activity tracker and app intervention (Step it Up Family) to increase physical activity in whole families. Telephone interviews were conducted with Queensland-based families (n = 19) who participated in the Step it Up Family intervention (N = 40, single-arm, pre/post feasibility study) in 2017/2018. Using commercial activity trackers combined with apps, the intervention included an introductory session, individual and family-level goal setting, self-monitoring, family step challenges, and weekly motivational text messages. Qualitative content analysis was conducted to identify themes, categories and sub-categories. In summary, parents reported that children were engaged with the activity tracker and app features to reach their daily step goals. Some technical difficulties were experienced with app navigation, syncing of activity tracker data, and tracker band discomfort. Although families liked that the weekly text messages reminded them to be active, they did not find them very motivating. Using text messages for physical activity motivation in families requires further testing. Overall, the intervention was well-received by families for increasing physical activity motivation.
Collapse
Affiliation(s)
- Stephanie Schoeppe
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Kim Waters
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Jo Salmon
- Institute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin University, Geelong 3125, Australia
| | - Susan L. Williams
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Deborah Power
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Stephanie Alley
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Amanda L. Rebar
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Melanie Hayman
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| | - Mitch J. Duncan
- Priority Research Centre for Physical Activity and Nutrition, School of Medicine and Public Health, Faculty of Health and Medicine, The University of Newcastle, Newcastle 2308, Australia
| | - Corneel Vandelanotte
- Physical Activity Research Group, Appleton Institute, School of Health, Medical and Applied Sciences, Central Queensland University, Rockhampton 4702, Australia
| |
Collapse
|
9
|
Kwasnicka D, Keller J, Perski O, Potthoff S, Ten Hoor GA, Ainsworth B, Crutzen R, Dohle S, van Dongen A, Heino M, Henrich JF, Knox L, König LM, Maltinsky W, McCallum C, Nalukwago J, Neter E, Nurmi J, Spitschan M, Van Beurden SB, Van der Laan LN, Wunsch K, Levink JJJ, Sanderman R. White Paper: Open Digital Health - accelerating transparent and scalable health promotion and treatment. Health Psychol Rev 2022; 16:475-491. [PMID: 35240931 DOI: 10.1080/17437199.2022.2046482] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
In this White Paper, we outline recommendations from the perspective of health psychology and behavioural science, addressing three research gaps: (1) What methods in the health psychology research toolkit can be best used for developing and evaluating digital health tools? (2) What are the most feasible strategies to reuse digital health tools across populations and settings? (3) What are the main advantages and challenges of sharing (openly publishing) data, code, intervention content and design features of digital health tools? We provide actionable suggestions for researchers joining the continuously growing Open Digital Health movement, poised to revolutionise health psychology research and practice in the coming years. This White Paper is positioned in the current context of the COVID-19 pandemic, exploring how digital health tools have rapidly gained popularity in 2020-2022, when world-wide health promotion and treatment efforts rapidly shifted from face-to-face to remote delivery. This statement is written by the Directors of the not-for-profit Open Digital Health initiative (n = 6), Experts attending the European Health Psychology Society Synergy Expert Meeting (n = 17), and the initiative consultant, following a two-day meeting (19-20th August 2021).
Collapse
Affiliation(s)
- Dominika Kwasnicka
- NHMRC CRE in Digital Technology to Transform Chronic Disease Outcomes, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia.,Faculty of Psychology, SWPS University of Social Sciences and Humanities, Wrocław, Poland
| | - Jan Keller
- Department of Education and Psychology; Freie Universität Berlin, Berlin, Germany
| | - Olga Perski
- Department of Behavioural Science and Health, University College London, London, UK
| | - Sebastian Potthoff
- Department of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle upon Tyne, UK
| | - Gill A Ten Hoor
- Department of Work & Social Psychology, Maastricht University, Maastricht, The Netherlands
| | - Ben Ainsworth
- Department of Psychology, University of Bath, Bath, UK
| | - Rik Crutzen
- Department of Health Promotion, Maastricht University/CAPHRI, Maastricht, the Netherlands
| | - Simone Dohle
- Department of Psychology, University of Cologne, Cologne, Germany and Institute of General Practice and Family Medicine, University Hospital Bonn, University of Bonn, Bonn, Germany
| | - Anne van Dongen
- Department of Psychology, Health, and Technology, University of Twente, Enschede, the Netherlands
| | - Matti Heino
- Faculty of Social Sciences, University of Helsinki, Helsinki, Finland
| | - Julia F Henrich
- Faculty of Social and Behavioural Sciences, Leiden University, Institute of Psychology, Unit of Health-, Medical- and Neuropsychology, Leiden, The Netherlands
| | - Liam Knox
- Sheffield Institute for Translational Neuroscience, The University of Sheffield, Sheffield, UK
| | - Laura M König
- Faculty of Life Sciences, University of Bayreuth, Bayreuth, Germany
| | - Wendy Maltinsky
- Faculty of Natural Sciences, Division of Psychology, University of Stirling, Stirling, UK
| | - Claire McCallum
- Centre for Digital Health and Care, Faculty of Engineering, University of Bristol, Bristol, UK
| | - Judith Nalukwago
- Center for Communication Programs, USAID-Social and Behavior Change Activity, Johns Hopkins University Bloomberg School of Public Health, Kampala, Uganda
| | - Efrat Neter
- Department of Behavioral Sciences, Ruppin Academic Center, Emeq Hefer, Israel
| | - Johanna Nurmi
- Faculty of Social Sciences, University of Helsinki, Helsinki, Finland.,University of Cambridge, Behavioural Science Group, Primary Care Unit, Institute of Public Health, Forvie Site, Cambridge, UK
| | - Manuel Spitschan
- TUM Department of Sport and Health Sciences (TUM SG), Technical University of Munich, Munich, Germany and Translational Sensory and Circadian Neuroscience, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | | | - L Nynke Van der Laan
- Department of Communication and Cognition, Tilburg University, Tilburg, The Netherlands
| | - Kathrin Wunsch
- Karlsruhe Institute of Technology, Institute of Sports and Sports Science, Karlsruhe, Germany
| | - Jasper J J Levink
- Levink Life Sciences BV & Stichting Feniks Ontwikkelingsbegeleiding, Utrecht, The Netherlands
| | - Robbert Sanderman
- Department of Psychology, Health, and Technology, University of Twente, Enschede, the Netherlands.,Department of Health Psychology, University Medical Center Groningen University of Groningen, Groningen, The Netherlands
| |
Collapse
|
10
|
Schoeppe S, Salmon J, Williams S, Power D, Waters K, Alley S, Rebar AL, Hayman M, Duncan MJ, Vandelanotte C. Feasibility of using activity trackers and apps to increase physical activity in whole families: The Step it Up Family intervention. Digit Health 2022; 8:20552076221129083. [PMID: 36225986 PMCID: PMC9548676 DOI: 10.1177/20552076221129083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 09/09/2022] [Indexed: 11/15/2022] Open
Abstract
Objective This study examined the feasibility of an activity tracker and app intervention to increase physical activity in whole families. Methods This was a single-arm feasibility study with pre-post-intervention measures. Between 2017 and 2018, 40 families (58 children aged 6-10 years, 39 mothers, 33 fathers) participated in the 6-week Step it Up Family programme in Queensland, Australia. It was delivered using Garmin activity trackers and apps, weekly motivational text messages and an introductory session. Online surveys and semi-structured interviews conducted with parents assessed intervention usage, acceptability, usability, perceived usefulness, use of physical activity self-management strategies and programme influence. Analyses included descriptive statistics, Wilcoxon signed-rank test and qualitative content analysis. Results Overall, 38 families completed the post-intervention survey (95% family retention; 90% children, 95% mothers, 88% fathers). Garmin activity tracker usage was high (i.e. nearly 24/7 during the 6 weeks intervention). Families also used the Garmin apps regularly (i.e. mostly 2-6 times per week). Further, 80% of mothers and 52% of fathers read the motivational mobile text messages. Usability and perceived usefulness of the Garmin activity trackers and apps were rated high. Both parents significantly increased their use of physical activity self-management strategies from pre to post-intervention. Parents expressed that the intervention had increased awareness of physical (in)activity in the family, encouraged to be active and promoted outdoor family activities. Conclusions Using activity trackers and apps to increase physical activity in the whole family was well received by children and parents which suggests that this intervention approach is feasible. However, further testing is needed amongst more diverse family populations. These early findings support the implementation of a randomised controlled trial to examine intervention efficacy.
Collapse
Affiliation(s)
- Stephanie Schoeppe
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia,Stephanie Schoeppe, School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Building 7, Bruce Highway, Rockhampton, QLD 4702, Australia.
| | - Jo Salmon
- School of Exercise and Nutrition Sciences, Institute for Physical Activity and Nutrition, Deakin University, Geelong, Australia
| | - Susan Williams
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| | - Deborah Power
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| | - Kim Waters
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| | - Stephanie Alley
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| | - Amanda L. Rebar
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| | - Melanie Hayman
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| | - Mitch J Duncan
- College of Health, Medicine, and Wellbeing, School of Medicine & Public Health, The University of Newcastle, Newcastle, Australia
| | - Corneel Vandelanotte
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Australia
| |
Collapse
|
11
|
Sleep quality, valence, energetic arousal, and calmness as predictors of device-based measured physical activity during a three-week mHealth intervention. GERMAN JOURNAL OF EXERCISE AND SPORT RESEARCH 2022. [PMCID: PMC9008661 DOI: 10.1007/s12662-022-00809-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Physical inactivity is known to be a risk factor for several noncommunicable diseases and has a high prevalence in today’s society. Therefore, it is crucial to understand the psychological factors associated with physical activity (PA). Recent developments in the field of ambulatory assessment and technological advances are promising to enhance our understanding of this relationship by analyzing longitudinal data within- and between-persons. These analyses can reveal important factors to design behavior change interventions to enhance PA. Therefore, this study used an ecological momentary assessment during the 3‑week intervention period in the SMARTFAMILY2.0 trial and aimed to investigate whether valence, calmness, energetic arousal, and sleep quality predict daily steps and moderate to vigorous PA. Overall, 49 adults (35–60 years) and 40 children (5–19 years) were included in this analysis and self-rated their mental state within our smartphone application while also wearing a hip-worn accelerometer for 21 consecutive days (996 days included) during the intervention period. Multilevel analyses were conducted to predict daily PA while considering covariables (e.g., child/adult and non-wear time) both within- and between-persons. The results indicated that higher than average ratings of a person’s valence and energetic arousal on one day predicted increased PA while higher than average calmness predicted decreased PA at the same day within this person. Sleep quality and between-person effects of the affective states showed no clear associations to PA. Overall, these results showed that within-person associations of valence, calmness, and energetic arousal should be considered when designing PA interventions for both children and adults. The influence of sleep quality, as well as between-person effects, should be further explored by future studies.
Collapse
|
12
|
Warsinsky S, Schmidt-Kraepelin M, Rank S, Thiebes S, Sunyaev A. Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game-Based Intervention Reporting Guidelines (GAMING). J Med Internet Res 2021; 23:e30390. [PMID: 34505840 PMCID: PMC8463952 DOI: 10.2196/30390] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 06/11/2021] [Accepted: 06/17/2021] [Indexed: 12/22/2022] Open
Abstract
BACKGROUND In health care, the use of game-based interventions to increase motivation, engagement, and overall sustainability of health behaviors is steadily becoming more common. The most prevalent types of game-based interventions in health care research are gamification and serious games. Various researchers have discussed substantial conceptual differences between these 2 concepts, supported by empirical studies showing differences in the effects on specific health behaviors. However, researchers also frequently report cases in which terms related to these 2 concepts are used ambiguously or even interchangeably. It remains unclear to what extent existing health care research explicitly distinguishes between gamification and serious games and whether it draws on existing conceptual considerations to do so. OBJECTIVE This study aims to address this lack of knowledge by capturing the current state of conceptualizations of gamification and serious games in health care research. Furthermore, we aim to provide tools for researchers to disambiguate the reporting of game-based interventions. METHODS We used a 2-step research approach. First, we conducted a systematic literature review of 206 studies, published in the Journal of Medical Internet Research and its sister journals, containing terms related to gamification, serious games, or both. We analyzed their conceptualizations of gamification and serious games, as well as the distinctions between the two concepts. Second, based on the literature review findings, we developed a set of guidelines for researchers reporting on game-based interventions and evaluated them with a group of 9 experts from the field. RESULTS Our results show that less than half of the concept mentions are accompanied by an explicit definition. To distinguish between the 2 concepts, we identified four common approaches: implicit distinction, synonymous use of terms, serious games as a type of gamified system, and distinction based on the full game dimension. Our Game-Based Intervention Reporting Guidelines (GAMING) consist of 25 items grouped into four topics: conceptual focus, contribution, mindfulness about related concepts, and individual concept definitions. CONCLUSIONS Conceptualizations of gamification and serious games in health care literature are strongly heterogeneous, leading to conceptual ambiguity. Following the GAMING can support authors in rigorous reporting on study results of game-based interventions.
Collapse
Affiliation(s)
- Simon Warsinsky
- Department of Economics and Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | | | - Sascha Rank
- Department of Economics and Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Scott Thiebes
- Department of Economics and Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Ali Sunyaev
- Department of Economics and Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
| |
Collapse
|
13
|
Fiedler J, Eckert T, Burchartz A, Woll A, Wunsch K. Comparison of Self-Reported and Device-Based Measured Physical Activity Using Measures of Stability, Reliability, and Validity in Adults and Children. SENSORS 2021; 21:s21082672. [PMID: 33920145 PMCID: PMC8069485 DOI: 10.3390/s21082672] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Revised: 04/02/2021] [Accepted: 04/07/2021] [Indexed: 12/05/2022]
Abstract
Quantification of physical activity (PA) depends on the type of measurement and analysis method making it difficult to compare adherence to PA guidelines. Therefore, test-retest reliability, validity, and stability for self-reported (i.e., questionnaire and diary) and device-based measured (i.e., accelerometry with 10/60 s epochs) PA was compared in 32 adults and 32 children from the SMARTFAMILY study to examine if differences in these measurement tools are systematic. PA was collected during two separate measurement weeks and the relationship for each quality criteria was analyzed using Spearman correlation. Results showed the highest PA values for questionnaires followed by 10-s and 60-s epochs measured by accelerometers. Levels of PA were lowest when measured by diary. Only accelerometry demonstrated reliable, valid, and stable results for the two measurement weeks, the questionnaire yielded mixed results and the diary showed only a few significant correlations. Overall, higher correlations for the quality criteria were found for moderate than for vigorous PA and the results differed between children and adults. Since the differences were not found to be systematic, the choice of measurement tools should be carefully considered by anyone working with PA outcomes, especially if vigorous PA is the parameter of interest.
Collapse
|
14
|
Brandes M, Muellmann S, Allweiss T, Bauer U, Bethmann A, Forberger S, Frense J, Gelius P, Pfeifer K, Okan O, Renner B, Schupp H, Wright M, Zeeb H. [Evidence-based primary prevention and health promotion: methods and procedures in 5 research consortia]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2021; 64:581-589. [PMID: 33835197 PMCID: PMC8033542 DOI: 10.1007/s00103-021-03322-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Accepted: 03/29/2021] [Indexed: 11/24/2022]
Abstract
Von 2014 bis 2022 erforschen die 5 deutschen Forschungsverbünde AEQUIPA, CAPITAL4HEALTH, HLCA, PartKommPlus und SMARTACT Themen der Primärprävention und Gesundheitsförderung mit dem Ziel, die Evidenzgrundlagen in diesen Bereichen weiterzuentwickeln. In diesem Beitrag wird die Arbeit der 5 Forschungsverbünde für Primärprävention und Gesundheitsförderung unter dem Aspekt der Evidenzbasierung aus der internen Perspektive vorgestellt, analysiert und diskutiert. Als orientierender Rahmen dient ein Modell der evidenzbasierten Public Health. Die 5 Forschungsverbünde nutzen für die Evidenzgenerierung vielfältige Zugangswege bzgl. der Beteiligung nichtakademischer, zivilgesellschaftlicher Akteur*innen und Nutzer*innen. Es finden sich vielfältige Studiendesigns, die von randomisiert kontrollierten Studien und systematischen Reviews zu diversen qualitativen Designs reichen. Die Nutzung von Modellen und Theorien unterstützt die Evidenzbasierung. Über die Evidenzentwicklung hinaus legen alle Verbünde einen Schwerpunkt auf die zumindest exemplarische Implementierung des neuen Wissens. Durch die Methodenvielfalt kann eine breit gefächerte Evidenzbasierung unter Berücksichtigung verbundspezifischer Aspekte realisiert werden. Grenzen für eine weitere systematische Stärkung der Evidenzbasierung liegen in strukturellen Rahmenbedingungen. Insbesondere die Einbindung von nichtakademischen, zivilgesellschaftlichen Akteur*innen und Nutzer*innen für die Arbeit mit schwer erreichbaren Zielgruppen kann oft nicht ausfinanziert bzw. zeitlich berücksichtigt werden. Die COVID-19-Pandemie verdeutlicht die Wichtigkeit eines flexiblen Methodenspektrums, in dem ein sinnvolles Zusammenspiel von digitalen und analogen Methoden anzustreben ist.
Collapse
Affiliation(s)
- Mirko Brandes
- Abteilung Prävention und Evaluation, Leibniz-Institut für Präventionsforschung und Epidemiologie - BIPS, Achterstr. 30, 28359, Bremen, Deutschland
| | - Saskia Muellmann
- Abteilung Prävention und Evaluation, Leibniz-Institut für Präventionsforschung und Epidemiologie - BIPS, Achterstr. 30, 28359, Bremen, Deutschland
| | - Theresa Allweiss
- Katholische Hochschule für Sozialwesen Berlin, Berlin, Deutschland
| | - Ulrich Bauer
- Fakultät für Erziehungswissenschaft, Zentrum für Prävention und Intervention im Kindes- und Jugendalter (ZPI), Interdisziplinäres Zentrum für Gesundheitskompetenzforschung (IZGK), Universität Bielefeld, Bielefeld, Deutschland
| | - Andreas Bethmann
- Katholische Hochschule für Sozialwesen Berlin, Berlin, Deutschland
| | - Sarah Forberger
- Abteilung Prävention und Evaluation, Leibniz-Institut für Präventionsforschung und Epidemiologie - BIPS, Achterstr. 30, 28359, Bremen, Deutschland
| | - Jennifer Frense
- Abteilung Prävention und Evaluation, Leibniz-Institut für Präventionsforschung und Epidemiologie - BIPS, Achterstr. 30, 28359, Bremen, Deutschland
| | - Peter Gelius
- Department für Sportwissenschaft und Sport, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Deutschland
| | - Klaus Pfeifer
- Department für Sportwissenschaft und Sport, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Deutschland
| | - Orkan Okan
- Fakultät für Erziehungswissenschaft, Zentrum für Prävention und Intervention im Kindes- und Jugendalter (ZPI), Interdisziplinäres Zentrum für Gesundheitskompetenzforschung (IZGK), Universität Bielefeld, Bielefeld, Deutschland
| | - Britta Renner
- Fachbereich Psychologie, Universität Konstanz, Konstanz, Deutschland
| | - Harald Schupp
- Fachbereich Psychologie, Universität Konstanz, Konstanz, Deutschland
| | - Michael Wright
- Katholische Hochschule für Sozialwesen Berlin, Berlin, Deutschland
| | - Hajo Zeeb
- Abteilung Prävention und Evaluation, Leibniz-Institut für Präventionsforschung und Epidemiologie - BIPS, Achterstr. 30, 28359, Bremen, Deutschland. .,Wissenschaftsschwerpunkt Gesundheitswissenschaften, Universität Bremen, Bremen, Deutschland.
| |
Collapse
|