1
|
Yin T, Hoyet L, Christie M, Cani MP, Pettre J. With or Without You: Effect of Contextual and Responsive Crowds on VR-based Crowd Motion Capture. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2024; 30:2785-2795. [PMID: 38437106 DOI: 10.1109/tvcg.2024.3372038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2024]
Abstract
While data is vital to better understand and model interactions within human crowds, capturing real crowd motions is extremely challenging. Virtual Reality (VR) demonstrated its potential to help, by immersing users into either simulated virtual crowds based on autonomous agents, or within motion-capture-based crowds. In the latter case, users' own captured motion can be used to progressively extend the size of the crowd, a paradigm called Record-and-Replay (2R). However, both approaches demonstrated several limitations which impact the quality of the acquired crowd data. In this paper, we propose the new concept of contextual crowds to leverage both crowd simulation and the 2R paradigm towards more consistent crowd data. We evaluate two different strategies to implement it, namely a Replace-Record-Replay (3R) paradigm where users are initially immersed into a simulated crowd whose agents are successively replaced by the user's captured-data, and a Replace-Record-Replay-Responsive (4R) paradigm where the pre-recorded agents are additionally endowed with responsive capabilities. These two paradigms are evaluated through two real-world-based scenarios replicated in VR. Our results suggest that the behaviors observed in VR users with surrounding agents from the beginning of the recording process are made much more natural, enabling 3R or 4R paradigms to improve the consistency of captured crowd datasets.
Collapse
|
2
|
Wiles TM, Mangalam M, Sommerfeld JH, Kim SK, Brink KJ, Charles AE, Grunkemeyer A, Kalaitzi Manifrenti M, Mastorakis S, Stergiou N, Likens AD. NONAN GaitPrint: An IMU gait database of healthy young adults. Sci Data 2023; 10:867. [PMID: 38052819 PMCID: PMC10698035 DOI: 10.1038/s41597-023-02704-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Accepted: 10/31/2023] [Indexed: 12/07/2023] Open
Abstract
An ongoing thrust of research focused on human gait pertains to identifying individuals based on gait patterns. However, no existing gait database supports modeling efforts to assess gait patterns unique to individuals. Hence, we introduce the Nonlinear Analysis Core (NONAN) GaitPrint database containing whole body kinematics and foot placement during self-paced overground walking on a 200-meter looping indoor track. Noraxon Ultium MotionTM inertial measurement unit (IMU) sensors sampled the motion of 35 healthy young adults (19-35 years old; 18 men and 17 women; mean ± 1 s.d. age: 24.6 ± 2.7 years; height: 1.73 ± 0.78 m; body mass: 72.44 ± 15.04 kg) over 18 4-min trials across two days. Continuous variables include acceleration, velocity, position, and the acceleration, velocity, position, orientation, and rotational velocity of each corresponding body segment, and the angle of each respective joint. The discrete variables include an exhaustive set of gait parameters derived from the spatiotemporal dynamics of foot placement. We technically validate our data using continuous relative phase, Lyapunov exponent, and Hurst exponent-nonlinear metrics quantifying different aspects of healthy human gait.
Collapse
Affiliation(s)
- Tyler M Wiles
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Madhur Mangalam
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Joel H Sommerfeld
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Seung Kyeom Kim
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Kolby J Brink
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Anaelle Emeline Charles
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Alli Grunkemeyer
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Marilena Kalaitzi Manifrenti
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Spyridon Mastorakis
- College of Information Science and Technology, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Nick Stergiou
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA
- Department of Physical Education and Sport Science, Aristotle University, Thessaloniki, Greece
| | - Aaron D Likens
- Division of Biomechanics and Research Development, Department of Biomechanics, and Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, NE, 68182, USA.
| |
Collapse
|
3
|
Kovalenko S, Mamonov A, Kuznetsov V, Bulygin A, Shoshina I, Brak I, Kashevnik A. OperatorEYEVP: Operator Dataset for Fatigue Detection Based on Eye Movements, Heart Rate Data, and Video Information. SENSORS (BASEL, SWITZERLAND) 2023; 23:6197. [PMID: 37448047 DOI: 10.3390/s23136197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 06/30/2023] [Accepted: 07/03/2023] [Indexed: 07/15/2023]
Abstract
Detection of fatigue is extremely important in the development of different kinds of preventive systems (such as driver monitoring or operator monitoring for accident prevention). The presence of fatigue for this task should be determined with physiological and objective behavioral indicators. To develop an effective model of fatigue detection, it is important to record a dataset with people in a state of fatigue as well as in a normal state. We carried out data collection using an eye tracker, a video camera, a stage camera, and a heart rate monitor to record a different kind of signal to analyze them. In our proposed dataset, 10 participants took part in the experiment and recorded data 3 times a day for 8 days. They performed different types of activity (choice reaction time, reading, correction test Landolt rings, playing Tetris), imitating everyday tasks. Our dataset is useful for studying fatigue and finding indicators of its manifestation. We have analyzed datasets that have public access to find the best for this task. Each of them contains data of eye movements and other types of data. We evaluated each of them to determine their suitability for fatigue studies, but none of them fully fit the fatigue detection task. We evaluated the recorded dataset by calculating the correspondences between eye-tracking data and CRT (choice reaction time) that show the presence of fatigue.
Collapse
Affiliation(s)
- Svetlana Kovalenko
- Institute of Cognitive Neuroscience, HSE University, Moscow 101000, Russia
| | - Anton Mamonov
- Faculty of Physics and Mathematics and Natural Sciences, Peoples' Friendship University of Russia, Moscow 117198, Russia
| | - Vladislav Kuznetsov
- Federal Research Center "Computer Science and Control" of Russian Academy of Sciences (FRC CSC RAS), Moscow 119333, Russia
| | - Alexandr Bulygin
- St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia
| | - Irina Shoshina
- Institute for Cognitive Research, Saint Petersburg State University, St. Petersburg 199034, Russia
| | - Ivan Brak
- Faculty of Information Technologies, Novosibirsk State University, Novosibirsk 630090, Russia
| | - Alexey Kashevnik
- St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia
- Institute of Mathematics and Information Technologies, Petrozavodsk State University, Petrozavodsk 185910, Russia
| |
Collapse
|