4
|
Lagan S, Emerson MR, King D, Matwin S, Chan SR, Proctor S, Tartaglia J, Fortuna KL, Aquino P, Walker R, Dirst M, Benson N, Myrick KJ, Tatro N, Gratzer D, Torous J. Mental Health App Evaluation: Updating the American Psychiatric Association's Framework Through a Stakeholder-Engaged Workshop. Psychiatr Serv 2021; 72:1095-1098. [PMID: 33882716 DOI: 10.1176/appi.ps.202000663] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
The app evaluation framework of the American Psychiatric Association (APA) has emerged as an adaptable tool for those seeking to navigate the ever-growing space of mental health apps. The authors describe a meeting convened in December 2019 to refine the APA framework. The expert panel comprised 16 individuals across health care fields, with representation from psychiatry, psychology, social work, nursing, clinical informatics, peer support specialists, and individuals with lived mental health experience. This meeting resulted in an update to the APA framework with the addition of clearer question descriptions and the release of an eight-question screener that may be useful in clinical settings.
Collapse
Affiliation(s)
- Sarah Lagan
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Margaret R Emerson
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Darlene King
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Sonia Matwin
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Steven R Chan
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Stephon Proctor
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Julia Tartaglia
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Karen L Fortuna
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Patrick Aquino
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Robert Walker
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Michelle Dirst
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Nicole Benson
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Keris Jan Myrick
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - Nathan Tatro
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - David Gratzer
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| | - John Torous
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston (Lagan, Torous); College of Nursing, University of Nebraska Medical Center, Omaha (Emerson); Department of Psychiatry, Utah Southwestern Medical Center, Dallas (King); Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee (Matwin); U.S. Department of Veterans Affairs Palo Alto Health Care System, and Department of Psychiatry, Stanford Medical Center, Palo Alto, California (Chan); Behavioral Health Informatics, Children's Hospital of Philadelphia, Philadelphia (Proctor); Department of Psychiatry, Northwell Health, New York City (Tartaglia); Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire (Fortuna); Department of Psychiatry, Lahey Hospital and Medical Center, Boston (Aquino); Department of Mental Health, Office of Recovery and Empowerment, Boston (Walker); Department of Practice Management and Delivery Systems Policy (Dirst) and Department of Digital Health (Tatro), American Psychiatric Association, Washington, D.C.; Department of Psychiatry, McLean Hospital, Belmont, Massachusetts (Benson); Los Angeles County Department of Mental Health, Los Angeles (Myrick); Scarborough Hospital Toronto, and Department of Psychiatry, University of Toronto, Toronto (Gratzer). Dror Ben-Zeev, Ph.D., is editor of this column
| |
Collapse
|