A little bird told me your gender: Gender inferences in social media

Fair and equitable AI in biomedical research and healthcare: Social science perspectives

Artificial intelligence (AI) offers opportunities but also challenges for biomedical research and healthcare. This position paper shares the results of the international conference "Fair medicine and AI" (online 3-5 March 2021). Scholars from science and technology studies (STS), gender studies, and ethics of science and technology formulated opportunities, challenges, and research and development desiderata for AI in healthcare. AI systems and solutions, which are being rapidly developed and applied, may have undesirable and unintended consequences including the risk of perpetuating health inequalities for marginalized groups. Socially robust development and implications of AI in healthcare require urgent investigation. There is a particular dearth of studies in human-AI interaction and how this may best be configured to dependably deliver safe, effective and equitable healthcare. To address these challenges, we need to establish diverse and interdisciplinary teams equipped to develop and apply medical AI in a fair, accountable and transparent manner. We formulate the importance of including social science perspectives in the development of intersectionally beneficent and equitable AI for biomedical research and healthcare, in part by strengthening AI health evaluation.

Name-based demographic inference and the unequal distribution of misrecognition

Academics and companies increasingly draw on large datasets to understand the social world, and name-based demographic ascription tools are widespread for imputing information that is often missing from these large datasets. These approaches have drawn criticism on ethical, empirical and theoretical grounds. Using a survey of all authors listed on articles in sociology, economics and communication journals in Web of Science between 2015 and 2020, we compared self-identified demographics with name-based imputations of gender and race/ethnicity for 19,924 scholars across four gender ascription tools and four race/ethnicity ascription tools. We found substantial inequalities in how these tools misgender and misrecognize the race/ethnicity of authors, distributing erroneous ascriptions unevenly among other demographic traits. Because of the empirical and ethical consequences of these errors, scholars need to be cautious with the use of demographic imputation. We recommend five principles for the responsible use of name-based demographic inference.

Accounting for Diversity in Robot Design, Testbeds, and Safety Standardization

Science has started highlighting the importance of integrating diversity considerations in medicine and healthcare. However, there is little research into how these considerations apply, affect, and should be integrated into concrete healthcare innovations such as rehabilitation robotics. Robot policy ecosystems are also oblivious to the vast landscape of gender identity understanding, often ignoring these considerations and failing to guide developers in integrating them to ensure they meet user needs. While this ignorance may be for the traditional heteronormative configuration of the medical, technical, and legal world, the ending result is the failure of roboticists to consider them in robot development. However, missing diversity, equity, and inclusion considerations can result in robotic systems that can compromise user safety, be discriminatory, and not respect their fundamental rights. This paper explores the impact of overlooking gender and sex considerations in robot design on users. We focus on the safety standard for personal care robots ISO 13482:2014 and zoom in on lower-limb exoskeletons. Our findings signal that ISO 13482:2014 has significant gaps concerning intersectional aspects like sex, gender, age, or health conditions and, because of that, developers are creating robot systems that, despite adherence to the standard, can still cause harm to users. In short, our observations show that robotic exoskeletons operate intimately with users’ bodies, thus exemplifying how gender and medical conditions might introduce dissimilarities in human–robot interaction that, as long as they remain ignored in regulations, may compromise user safety. We conclude the article by putting forward particular recommendations to update ISO 13482:2014 to reflect better the broad diversity of users of personal care robots.

[Artificial intelligence and ethics in healthcare-balancing act or symbiosis?]

Artificial intelligence (AI) is becoming increasingly important in healthcare. This development triggers serious concerns that can be summarized by six major "worst-case scenarios". From AI spreading disinformation and propaganda, to a potential new arms race between major powers, to a possible rule of algorithms ("algocracy") based on biased gatekeeper intelligence, the real dangers of an uncontrolled development of AI are by no means to be underestimated, especially in the health sector. However, fear of AI could cause humanity to miss the opportunity to positively shape the development of our society together with an AI that is friendly to us.Use cases in healthcare play a primary role in this discussion, as both the risks and the opportunities of new AI-based systems become particularly clear here. For example, would older people with dementia (PWD) be allowed to entrust aspects of their autonomy to AI-based assistance systems so that they may continue to independently manage other aspects of their daily lives? In this paper, we argue that the classic balancing act between the dangers and opportunities of AI in healthcare can be at least partially overcome by taking a long-term ethical approach toward a symbiotic relationship between humans and AI. We exemplify this approach by showcasing our I‑CARE system, an AI-based recommendation system for tertiary prevention of dementia. This system has been in development since 2015 as the I‑CARE Project at the University of Bremen, where it is still being researched today.

“Broadcast your gender.” A comparison of four text-based classification methods of German YouTube channels

Social media platforms provide a large array of behavioral data relevant to social scientific research. However, key information such as sociodemographic characteristics of agents are often missing. This paper aims to compare four methods of classifying social attributes from text. Specifically, we are interested in estimating the gender of German social media creators. By using the example of a random sample of 200 YouTube channels, we compare several classification methods, namely (1) a survey among university staff, (2) a name dictionary method with the World Gender Name Dictionary as a reference list, (3) an algorithmic approach using the website gender-api.com, and (4) a Multinomial Naïve Bayes (MNB) machine learning technique. These different methods identify gender attributes based on YouTube channel names and descriptions in German but are adaptable to other languages. Our contribution will evaluate the share of identifiable channels, accuracy and meaningfulness of classification, as well as limits and benefits of each approach. We aim to address methodological challenges connected to classifying gender attributes for YouTube channels as well as related to reinforcing stereotypes and ethical implications.

Using Dynamic Pruned N-Gram Model for Identifying the Gender of the User

Organizations analyze customers’ personal data to understand and model their behavior. Identifying customers’ gender is a significant factor in analyzing markets that help plan the promotional campaigns, determine target customers and provide relevant offers. Several techniques were developed to analyze different types of data, including text, image, speech, and biometrics, to identify the gender of the user. The method of synthesis of the profile name differs from one customer to another. Using numerical substitutions of specific letters, known as Leet language, impedes the gender identification task. Moreover, using acronyms, misspellings, and adjacent names impose additional challenges. Towards this goal, this work uses the customers’ profile names associated with submitted reviews to recognize the customers’ gender. First, we create datasets of profile names extracted from the customers’ reviews. Secondly, we introduce a dynamic pruned n-gram model for identifying the gender of the user. It starts with data segmentation to handle adjacent parts, followed by data conversion and cleaning to fix the use of Leet language. Feature selection through a dynamic pruned n-gram model is the next step with the recurrent misspelling correction using fuzzy matching. We evaluate the proposed approach on the real data collected from active web resources. The obtained results demonstrate its validity and reliability.

Ethical Considerations from Child-Robot Interactions in Under-Resourced Communities

Recent advancements in socially assistive robotics (SAR) have shown a significant potential of using social robotics to achieve increasing cognitive and affective outcomes in education. However, the deployments of SAR technologies also bring ethical challenges in tandem, to the fore, especially in under-resourced contexts. While previous research has highlighted various ethical challenges that arise in SAR deployment in real-world settings, most of the research has been centered in resource-rich contexts, mainly in developed countries in the 'Global North,' and the work specifically in the educational setting is limited. This research aims to evaluate and reflect upon the potential ethical and pedagogical challenges of deploying a social robot in an under-resourced context. We base our findings on a 5-week in-the-wild user study conducted with 12 kindergarten students at an under-resourced community school in New Delhi, India. We used interaction analysis with the context of learning, education, and ethics to analyze the user study through video recordings. Our findings highlighted four primary ethical considerations that should be taken into account while deploying social robotics technologies in educational settings; (1) language and accent as barriers in pedagogy, (2) effect of malfunctioning, (un)intended harms, (3) trust and deception, and (4) ecological viability of innovation. Overall, our paper argues for assessing the ethical and pedagogical constraints and bridging the gap between non-existent literature from such a context to evaluate better the potential use of such technologies in under-resourced contexts.

Further Divided Gender Gaps in Research Productivity and Collaboration during the COVID-19 Pandemic: Evidence from Coronavirus-related Literature

Based on publication data on coronavirus-related fields, this study applies a difference in differences approach to explore the evolution of gender inequalities before and during the COVID-19 pandemic by comparing the differences in the numbers and shares of authorships, leadership in publications, gender composition of collaboration, and scientific impacts. We find that, during the pandemic: (1) females’ leadership in publications as the first author was negatively affected; (2) although both females and males published more papers relative to the pre-pandemic period, the gender gaps in the share of authorships have been strengthened due to the larger increase in males’ authorships; (3) the share of publications by mixed-gender collaboration declined; (4) papers by teams in which females play a key role were less cited in the pre-pandemic period, and this citation disadvantage was exacerbated during the pandemic; and (5) gender inequalities regarding authorships and collaboration were enhanced in the initial stage of COVID-19, widened with the increasing severity of COVID-19, and returned to the pre-pandemic level in September 2020. This study shows that females’ lower participation in teams as major contributors and less collaboration with their male colleagues also reflect their underrepresentation in science in the pandemic period. This investigation significantly deepens our understanding of how the pandemic influenced academia, based on which science policies and gender policy changes are proposed to mitigate the gender gaps.