Emotional experiences of service robots' anthropomorphic appearance: a multimodal measurement method

Anthropomorphic appearance is a key factor to affect users' attitudes and emotions. This research aimed to measure emotional experience caused by robots' anthropomorphic appearance with three levels - high, moderate, and low - using multimodal measurement. Fifty participants' physiological and eye-tracker data were recorded synchronously while they observed robot images that were displayed in random order. Afterward, the participants reported subjective emotional experiences and attitudes towards those robots. The results showed that the images of the moderately anthropomorphic service robots induced higher pleasure and arousal ratings, and yielded significantly larger pupil diameter and faster saccade velocity, than did the low or high robots. Moreover, participants' facial electromyography, skin conductance, and heart-rate responses were higher when observing moderately anthropomorphic service robots. An implication of the research is that service robots' appearance should be designed to be moderately anthropomorphic; too many human-like features or machine-like features may disturb users' positive emotions and attitudes.Practitioner Summary: This research aimed to measure emotional experience caused by three types of anthropomorphic service robots using a multimodal measurement experiment. The results showed that moderately anthropomorphic service robots evoked more positive emotion than high and low anthropomorphic robots. Too many human-like features or machine-like features may disturb users' positive emotions.

How the black hole illusion environment affects operational performance at different flight phases in aviation

The black hole illusion (BHI) is a subtype of spatial disorientation that can result in fatal consequences in aviation. Research on the BHI has generally focused on altitude deviation, and few studies have examined the effect across different flight phases. In a simulation-based experiment, 18 participants performed 12 simulated approach and landing tasks in normal and BHI environments. Flight performance was analyzed with 14 flight parameters and was compared across five points and three phases, which were referenced from a National Transportation Safety Board report and other previous studies. Results showed that multiple flight parameters were significantly impaired and that their influences varied from the initial approach to the final touchdown. In the BHI environment, participants tended to descend aggressively during the approach phase and flew a lower but similar glidepath during the last approach phase. They might have realized the abnormal situation induced by the BHI but usually were unable to recover from the dangerous maneuver in time. Additionally, the result of glide path error, one of the most commonly used variables in previous BHI research, was only significant during the last approach phase. Flight stability was also impaired in the BHI environment. This is the first study to systematically analyze the BHI effects on multiple flight parameters at different flight phases. The use of this experimental paradigm could facilitate future research to evaluate and prevent the BHI in a more comprehensive way.

Testing the saliency-based account of phasic alertness

As an essential component of the human attention system, the effect of phasic alertness refers to the change of performance with the presence of a preceding warning signal. Weinbach and Henik (Cognition, 133 (2), 414-419, 2014) argued that phasic alertness is an adaptive mechanism that diverts attention to salient events. This mechanism enhances selective attention when the critical event is more salient than others. When selective attention to less salient details is required, phasic alertness can lead to more interference from task-irrelevant information. The experiment on which this saliency-based account of phasic alertness is based has not been replicated. In two experiments, the present study attempted to replicate the alertness-related findings of Weinbach and Henik. Although we used a similar design, the results did not reveal evidence for an interaction between phasic alertness and response congruency in the global/local processing task. Our results do not support the saliency-based account of phasic alertness. We argue that more systematic investigation is needed for this phasic alertness account.

Vehicle crash simulations for safety: Introduction of connected and automated vehicles on the roadways

Traffic accidents are one main cause of human fatalities in modern society. With the fast development of connected and autonomous vehicles (CAVs), there comes both challenges and opportunities in improving traffic safety on the roads. While on-road tests are limited due to their high cost and hardware requirements, simulation has been widely used to study traffic safety. To make the simulation as realistic as possible, real-world crash data such as crash reports could be leveraged in the creation of the simulation. In addition, to enable such simulations to capture the complexity of traffic, especially when both CAVs and human-driven vehicles co-exist on the road, careful consideration needs to be given to the depiction of human behaviors and control algorithms of CAVs and their interactions. In this paper, the authors reviewed literature that is closely related to crash analysis based on crash reports and to simulation of mixed traffic when CAVs and human-driven vehicles co-exist, for studying traffic safety. Three main aspects are examined based on our literature review: data source, simulation methods, and human factors. It was found that there is an abundance of research in the respective areas, namely, crash report analysis, crash simulation studies (including vehicle simulation, traffic simulation, and driving simulation), and human factors. However, there is a lack of integration between them. Future research is recommended to integrate and leverage different state-of-the-art transportation-related technologies to contribute to road safety by developing an all-in-one-step crash analysis system.

Age is more than just a number: The relationship among age, non-chronological age factors, self-perceived driving abilities, and autonomous vehicle acceptance

Globally, adults aged 65 and older are a rapidly-growing population. Aging is associated with declines in perceptual, cognitive, and physical abilities, which often creates challenges in completing daily activities, such as driving. Autonomous vehicles (AVs) promise to provide older adults one way to maintain their mobility and independence. However, recent surveys of AV acceptance suggest that older adults have a lower AV acceptance compared to younger generations. One challenge is that most of these assessments have not accounted for the various non-chronological age factors that contribute to how older adults perceive their own driving skills and the utility of AVs. To fill this research gap, this study investigated the effects of non-chronological age factors and rated self-perceived driving abilities on AV acceptance across three age groups. An online survey was conducted using Amazon Mechanical Turk (MTurk), for which 438 valid responses were received. Respondents were categorized into a younger (18-40 years), middle-aged (41-64 years), and older (65-79 years) adult age group. Results showed that drivers of a younger age, with higher educational attainment, who rated themselves to have higher social support, and who have lower rated self-perceived driving abilities, report being more willing to accept AVs. Findings from this work can help to inform models of AV technology acceptance and guide in the development of marketing strategies to promote knowledge of AVs.

What I Say Means What I Do: Risk Concerns and Mobile Application-Selection Behaviors

OBJECTIVE

The goal of this study was to examine the relation between users' reported risk concerns and their choice behaviors in a mobile application (app) selection task.

BACKGROUND

Human users are typically regarded as the weakest link in cybersecurity and privacy protection; however, it is possible to leverage the users' predilections to increase security. There have been mixed results on the relation between users' self-reported privacy concerns and their behaviors.

METHOD

In three experiments, the timing of self-reported risk concerns was either a few weeks before the app-selection task (pre-screen), immediately before it (pre-task), or immediately after it (post-task). We also varied the availability and placement of clear definitions and quizzes to ensure users' understanding of the risk categories.

RESULTS

The post-task report significantly predicted the app-selection behaviors, consistent with prior findings. The pre-screen report was largely inconsistent with the reports implemented around the time of the task, indicating that participants' risk concerns may not be stable over time and across contexts. Moreover, the pre-task report strongly predicted the app-selection behaviors only when elaborated definitions and quizzes were placed before the pre-task question, indicating the importance of clear understanding of the risk categories.

CONCLUSION

Self-reported risk concerns may be unstable over time and across contexts. When explained with clear definitions, self-reported risk concerns obtained immediately before or after the app-selection task significantly predicted app-selection behaviors.

APPLICATION

We discuss implications for including personalized risk concerns during app selection that enable comparison of alternative mobile apps.

Family Relationships Under Work From Home: Exploring the Role of Adaptive Processes

Work-from-home (WFH) influences both work and life, and further impacts family relationships. The current study explored the impacts of WFH on family relationships during the COVID-19 pandemic and identified effective adaptive processes for maintaining family relationships under WFH. Using the Vulnerability-Stress-Adaptation (VSA) model, the study examined the roles of adaptive processes (spending time with family members and balancing work and life) and demographic differences (gender, age, marital status, and education level) in the relation between WFH and family relationships. Path analysis results based on an online survey (N = 150) suggested that, overall, WFH improved family relationships through proper adaptive processes. WFH had a positive relation to time spent with family members, and this relation was especially salient for workers with lower education levels. While there was no statistically significant overall relation between WFH and work-life balance, older workers tended to engage in increased work-life balance during WFH. Both adaptive processes were positively related to family relationship quality. The findings advance the understanding of family relationships and WFH and provide practical recommendations to enhance family relationships under WFH.

Tribute to E. J. Capaldi: Celebration of a Psychological Scientist

E. J. (John) Capaldi (1928–2020) made numerous contributions to experimental psychology in his long career at the University of Texas at Austin and Purdue University. He was a pioneer in the area of animal learning and cognition, known for his sequential theory of partial reinforcement extinction effects. His research in this area and in memory and counting phenomena was conducted for the most part with rats running in straight alley mazes under various sequences of trial outcomes (e.g., reward, nonreward, variations in reward size). John's other interests included the sequential theory applied to Pavlovian conditioning, evolutionary theory, and psychology of science. More generally, John was a scientist to the core who served as a role model to those who knew him. His career centered on the values of science and rigorous critical thinking based in empirical data, coupled with a curiosity and openness to different and new ideas in psychology.

Examination of a Response–Effect Compatibility Task With Continuous Mouse Movements: Free- Versus Forced-Choice Tasks and Sequential Modulations

According to ideomotor theory, we select actions by recalling and anticipating their sensory consequences, that is, their action effects. Compelling evidence for this theory comes from response–effect compatibility (REC) experiments, in which a response produces an effect with which it is either compatible or incompatible. For example, pressing a left/right response key is faster if it is predictably followed by an action effect on the same, compatible side compared with the other, incompatible side, even though the effect itself appears only after response time is measured. Recent studies investigated this effect with continuous responses (i.e., computer mouse movements) and reported an REC effect in a forced-choice but not in a free-choice task. From the keypressing literature, the opposite result pattern or no differences would have been expected. To clarify this issue, we report 3 experiments with mouse movement responses. Experiment 1 used a simpler scenario than in prior studies and found a similar result: The REC effect was evident in a forced- but not in a free-choice task. Also, sequential modulations of the REC effect were exploratorily analyzed and replicated with higher power in Experiment 2. However, Experiment 3 demonstrated that at least part of the REC effect with mouse movements can be attributed to stimulus–response compatibility (SRC), with a much smaller compatibility effect evident with a procedure for which SRC was reduced. We conclude that a sequentially modulated compatibility effect can be observed with mouse movements, but previous studies may have underestimated the contribution from SRC. The results are also discussed in terms of why the compatibility effect was observed in forced- but not free-choice tasks with mouse movement responses.

Practice and transfer with mappings of spoon tip and handle to keypress responses

When orientation of a horizontal spoon image varies to the left or right, instructions can map left and right keypresses to the tip or handle location. We conducted Experiment 1 to determine whether practice with an incompatible mapping of the salient tip transfers to a test session in which the relevant part and/or mapping are changed. Participants performed 80 practice trials with tip-incompatible mapping, followed by 80 test trials with tip-compatible, tip-incompatible, handle-compatible, or handle-incompatible mapping. Performance improved across 20-trial blocks in the practice session. In the test session, responses were 65 ms faster with tip-compatible than tip-incompatible mapping but 31 ms faster with handle-incompatible than handle-compatible mapping. This latter result, and verbal reports, indicate that some participants adopted a strategy of responding compatibly to the salient tip even though instructed to respond to the handle. Experiment 2 focused on whether participants with handle-incompatible mapping instructions would adopt the tip-compatible strategy spontaneously or after receiving a hint: 77% of participants reported adopting the tip-compatible strategy in Session 1, showing that prior experience responding to the tip is not necessary and 9% of participants did not report using that strategy in Session 1 but reported changing to it in Session 2 after receiving the hint. Their responses in Session 2 were slower than those who used the strategy throughout, but this difference was minimal in the last two trial blocks. Compatible mapping of the salient spoon tip to keypresses dominated performance over prior practice with incompatible tip mapping and instructions with incompatible handle mapping.

Effects of a neutral warning signal on spatial two-choice reactions

Posner et al. reported that, at short fixed foreperiods, a neutral warning tone reduced reaction times (RTs) in a visual two-choice task while increasing error rates for both spatially compatible and incompatible stimulus-response mappings. Consequently, they concluded that alertness induced by the warning does not affect the efficiency of information processing but the setting of a response criterion. We conducted two experiments to determine the conditions under which the trade-off occurs. In Experiment 1, participants performed the same two-choice task as in Posner et al.'s study without RT feedback. Results showed that the warning tone speeded responses with no evidence of speed/accuracy trade-off. In Experiment 2, RT feedback was provided after each response, and a speed/accuracy trade-off was found for the 50-ms foreperiod. However, better information-processing efficiency was evident for the 200-ms foreperiod. We conclude that the foreperiod effect of a 50-ms foreperiod is a result of response criterion adjustment and that providing trial-level RT feedback is critical for replicating this pattern. However, fixed foreperiods of 200 ms or longer benefit both speed and accuracy, implying a more controlled preparation component that improves response efficiency.

The Underlying neural mechanisms of interpersonal situations on collaborative ability: A hyperscanning study using functional near-infrared spectroscopy

The collaborative ability to coordinate an individual with others is critical to performance of joint actions. Prior studies found that different types of interpersonal situations have more or less impact on the collaborative ability of joint actions, but the results are controversial. To clarify the influence of interpersonal situations on collaborative ability, we adopted the joint Simon task, a choice-reaction task that two people perform together. Functional near-infrared spectroscopy (fNIRS) was used to study the neural mechanisms of interpersonal situations on collaborative ability and task performance under payoffs that fostered competition or cooperation. The fNIRS results showed that significant inter-brain neural synchronization (INS) occurred in the bilateral inferior parietal lobule (IPL) for both situations. Moreover, for the competition situation, the pairs also shown a significant INS in the right IPL. These results imply that the bilateral IPL is involved in cooperation and competition due to involvement of common concern and understanding of intention. The right IPL may be more crucial for competition because of the psychological resources involved in distinguishing self and others. Eventually, the INS in competition was better than in the other situations, correlating with higher performance of the joint task as well.

Sensor-based indicators of performance changes between sessions during robotic surgery training

Training of surgeons is essential for safe and effective use of robotic surgery, yet current assessment tools for learning progression are limited. The objective of this study was to measure changes in trainees' cognitive and behavioral states as they progressed in a robotic surgeon training curriculum at a medical institution. Seven surgical trainees in urology who had no formal robotic training experience participated in the simulation curriculum. They performed 12 robotic skills exercises with varying levels of difficulty repetitively in separate sessions. EEG (electroencephalogram) activity and eye movements were measured throughout to calculate three metrics: engagement index (indicator of task engagement), pupil diameter (indicator of mental workload) and gaze entropy (indicator of randomness in gaze pattern). Performance scores (completion of task goals) and mental workload ratings (NASA-Task Load Index) were collected after each exercise. Changes in performance scores between training sessions were calculated. Analysis of variance, repeated measures correlation, and machine learning classification were used to diagnose how cognitive and behavioral states associate with performance increases or decreases between sessions. The changes in performance were correlated with changes in engagement index (rrm=-.25,p<.001) and gaze entropy (rrm=-.37,p<.001). Changes in cognitive and behavioral states were able to predict training outcomes with 72.5% accuracy. Findings suggest that cognitive and behavioral metrics correlate with changes in performance between sessions. These measures can complement current feedback tools used by medical educators and learners for skills assessment in robotic surgery training.

A User-centered Decision-aiding Process for Selecting Power Analysis Tools

A priori power analyses have become increasingly popular in scientific communities, but the practice has not been widely discussed by HFE researchers. Given the complexity of conducting such analyses, software tools are essential. We review the emergence and current state of power analysis software tools, and use the concept of User-Centered Design as an analytical lens for examining the relationship between researchers' needs and power analysis tools' characteristics. Centering on users' wants and needs, we propose a decision-aiding process to assist researchers in identifying appropriate power analysis tools. This process consists of five user-centered considerations - two functional criteria (software input; software output) and three usability heuristics (learnability; ease of use; accessibility) - which are organized into a workflow. These criteria and heuristics are translated into questions that researchers should go through during the decision process. We illustrate use of the decision-aiding process with three example scenarios and lay out implications for researchers.

Visual salience of 3D and 2D spoons determines S-R mapping and flanker effects

This study tested the hypothesis that affordances for grasping with the corresponding hand are activated more strongly by three-dimensional (3D) real objects than by two-dimensional (2D) pictures of the objects. In Experiment 1, participants made left and right keypress responses to the handle or functional end (tip) of an eating utensil using compatible and incompatible mappings. In one session, stimuli were spoons mounted horizontally on a blackboard with the sides to which the handle and tip pointed varying randomly. In the other, stimuli were pictures of spoons displayed on a black computer screen. Three-dimensional and 2D sessions showed a similar benefit for compatible mapping when the tip was relevant and a small cost of compatible mapping when the handle was relevant. Experiment 2 used a flanker task in which participants responded compatibly to the location of the handle or the tip, and spoons located above and below the target spoon could have congruent or incongruent orientations. The difference between 3D and 2D displays was not obtained in the flanker effect for reaction time. There was little evidence that 3D objects activate grasping affordances that 2D images do not. Instead, we argue that visual salience of the tip is the critical factor determining these correspondence effects.

Emotion-induced attentional bias: does it modulate the spatial Simon effect?

Schlaghecken, F., Blagrove, E., Mantantzis, K., Maylor, E. A., & Watson, D. G. [(2017). Look on the bright side: Positivity bias modulates interference effects in the Simon task. Journal of Experimental Psychology: General, 146(6), 763-770] found larger spatial Simon effects for happy than sad faces. Unexpectedly, this enhancement was also observed for nonvalenced objects requiring the same response as happy faces. We examined whether the increase of the spatial Simon effect is location- or object-based. In Experiments 1 and 2, participants pressed a left/right key in response to a happy/sad face or a left-/right-pointing arrow. These stimuli appeared on the left/right side of fixation, with location being task-irrelevant. Consistent with Schlaghecken et al., the spatial Simon effect was numerically larger for happy than sad faces regardless of whether faces and arrows were presented in different blocks (Experiment 1) or intermixed within blocks (Experiment 2). However, the spatial Simon effect for arrows was not modulated by the faces' emotional valence. Similar findings were observed with pointing hands in Experiment 3. Our results imply that attentional bias is associated with specific objects (e.g. faces) not locations.

How psychologists help solve real-world problems in multidisciplinary research teams: Introduction to the special issue

Real-world problems are not confined to a single discipline. Multidisciplinary team research combines the methods and theories from different disciplines to achieve a common goal. It fosters collaboration among researchers with different expertise, which can lead to novel solutions and new discoveries that could not be achieved otherwise. This special issue of the American Psychologist consists of 10 articles that cover a range of research areas within the discipline of psychology. The authors of the articles describe the content of the research conducted by their teams and the ways in which the teams operate. In this introductory article, an overview of the topics covered in the special issue is provided. The overview shows that most areas of psychology are involved in the various multidisciplinary projects and emphasizes the fact that psychologists have many skills that put them in a good position for collaborating with specialists from other disciplines. This introduction to the special issue also highlights key points from the lessons learned covered in the articles and discusses tradeoffs of specific recommendations made by the authors. The conclusion reached is that there is much value in conducting multidisciplinary research and that the benefits of such research far outweigh the challenges that may be encountered along the way. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Emotional factors and physical properties of ballpoint pens that affect user satisfaction: Implications for pen and stylus design

Many studies of ballpoint pens have been conducted. However, those studies have not considered the emotional factors that can enhance user experience. Styluses resemble ballpoint pens in many ways, which are widely available in a variety of styles. Therefore, in the present study, we explored the physical and emotional attributes that improve user satisfaction with typical ballpoint pens, with the goal of also understanding what factors might be important for stylus design. First, 14 emotional factors associated with the pens were derived. Second, 16 different types of ball-point pens were measured for six physical properties. Then, an experiment was performed to assess user satisfaction and emotional factors for pens. The House of Quality (HOQ) was used to obtain the chief physical properties. Results showed that to increase user satisfaction it is necessary to make pens be comfortable, fine, refined, deep, and natural. Also, we found that for high user satisfaction pens need to be heavier and longer, have thick and antislip grips and thin nibs, and their center of gravity should be located close to the nib to increase user satisfaction.

Parallel Development of James J. Gibson’s Ecological and Paul M. Fitts’s Information Processing Approaches to Perception and Performance

James J. Gibson and Paul M. Fitts, two psychologists who had, and continue to have, a substantial influence on research in perception, action, and human performance, had remarkable, parallel careers with roots in the U.S. Army Air Forces Aviation Psychology program in World War II. Fitts is widely regarded as founder of the applied field of engineering psychology and the basic field of human performance, both based on a human information processing approach. Gibson founded ecological psychology, a school of thought that runs counter to the information processing approach and adopts a radical empiricist approach to perception and action in natural environments. Despite the origins of their disparate views in applied aviation psychology and each having had major impacts on the field of psychology, Gibson and Fitts seem to have had little contact with each other, and their research traditions have continued primarily along separate paths to this day. In this article, we review the arcs of Fitts’s and Gibson’s careers, emphasizing similarities and differences historically and theoretically. We end with a discussion of why their approaches differed widely, whether attempts to reconcile them can be meaningful, and the importance of experimental psychologists attending to applied research problems.

Word- and arrow-based Simon effects emerge for eccentrically presented location words and arrows

Two experiments examined whether the location-based Simon effect and word- or arrow-based Simon effects, and their interaction, emerge in the same task situations by presenting location words and (left and right, Experiment 1) or single-headed arrows (left and right pointing, Experiment 2) in the left-right visual field. These tasks include two attributes of task-irrelevant location information, physical location and either location word (Experiment 1) or arrow direction (Experiment 2), when they vary jointly for a single stimulus. Moreover, the location-based Simon effect in these tasks was compared to that obtained in a pure location-based Simon task. Results showed that (1) the location-, word- and arrow-based Simon effects occurred on both mean RT and delta plots; (2) the word- and arrow-based Simon effects interacted with the location-based Simon effect on mean RT; (3) the Simon effect in the pure location-based Simon task differed little from the location-based Simon effect in the two joint Simon tasks. These results indicate that different task-irrelevant spatial attributes can influence responses in the same task, and that one of them can influence the effect of the other on responses. This latter result offers evidence that the different attributes do not provide separate sources of activation.

Lillian Gilbreth and Amelia Earhart: How an Eye Toward Diversity Brought Two Pioneers Together

Amelia Earhart and Lillian Gilbreth are well-known for their accomplishments during the 20th century in aviation and industrial management, respectively. Both were outspoken advocates of women having professional careers during a time when that was uncommon. For these reasons, in 1935, Edward C. Elliott, then president of Purdue University, hired Earhart and Gilbreth. Earhart served as counselor on careers for women and consultant for aeronautics until her death in 1937 and Gilbreth as counselor and professor of management until 1948. Their contributions provide a beacon for the Human Factors and Ergonomics Society in its continual striving for diversity and equality for all members.

Stimulus-Response and Response-Effect Compatibility With Touchless Gestures and Moving Action Effects

OBJECTIVE

To determine whether response-effect (R-E) compatibility or stimulus-response (S-R) compatibility is more critical for touchless gesture responses.

BACKGROUND

Content on displays can be moved in the same direction (S-R incompatible but R-E compatible) or opposite direction (S-R compatible but R-E incompatible) as the touchless gesture that produces the movement. Previous studies suggested that it is easier to produce a button-press response when it is R-E compatible (and S-R incompatible). However, whether this R-E compatibility effect also occurs for touchless gesture responses is unknown.

METHOD

Experiments 1 and 2 employed an R-E compatibility manipulation in which participants made responses with an upward or downward touchless gesture that resulted in the display content moving in the same (compatible) or opposite (incompatible) direction. Experiment 3 employed an S-R compatibility manipulation in which the stimulus occurred at the upper or lower location on the screen.

RESULTS

Overall, only negligible influences of R-E compatibility on performing the touchless gestures were observed (in contrast to button-press responses), whereas S-R compatibility heavily affected the gestural responses.

CONCLUSION

The R-E compatibility obtained in many previous studies with various types of responses appears not to hold for touchless gestures as responses.

APPLICATION

The results suggest that in the design of touchless interfaces, unique factors may contribute to determining which mappings of gesture and display movements are preferred by users.