Augmented Movelet Method for Activity Classification Using Smartphone Gyroscope and Accelerometer Data

Detection of Medication Taking Using a Wrist-Worn Commercially Available Wearable Device

PURPOSE

Medication nonadherence is a persistent and costly problem across health care. Measures of medication adherence are ineffective. Methods such as self-report, prescription claims data, or smart pill bottles have been used to monitor medication adherence, but these are subject to recall bias, lack real-time feedback, and are often expensive.

METHODS

We proposed a method for monitoring medication adherence using a commercially available wearable device. Passively collected motion data were analyzed on the basis of the Movelet algorithm, a dictionary learning framework that builds person-specific chapters of movements from short frames of elemental activities within the movements. We adapted and extended the Movelet method to construct a within-patient prediction model that identifies medication-taking behaviors.

RESULTS

Using 15 activity features recorded from wrist-worn wearable devices of 10 patients with breast cancer on endocrine therapy, we demonstrated that medication-taking behavior can be predicted in a controlled clinical environment with a median accuracy of 85%.

CONCLUSION

These results in a patient-specific population are exemplar of the potential to measure real-time medication adherence using a wrist-worn commercially available wearable device.

Technology and Mental Health: State of the Art for Assessment and Treatment

Technology is ubiquitous in society and is now being extensively used in mental health applications. Both assessment and treatment strategies are being developed and deployed at a rapid pace. The authors review the current domains of technology utilization, describe standards for quality evaluation, and forecast future developments. This review examines technology-based assessments of cognition, emotion, functional capacity and everyday functioning, virtual reality approaches to assessment and treatment, ecological momentary assessment, passive measurement strategies including geolocation, movement, and physiological parameters, and technology-based cognitive and functional skills training. There are many technology-based approaches that are evidence based and are supported through the results of systematic reviews and meta-analyses. Other strategies are less well supported by high-quality evidence at present, but there are evaluation standards that are well articulated at this time. There are some clear challenges in selection of applications for specific conditions, but in several areas, including cognitive training, randomized clinical trials are available to support these interventions. Some of these technology-based interventions have been approved by the U.S. Food and Drug administration, which has clear standards for which types of applications, and which claims about them, need to be reviewed by the agency and which are exempt.

Accuracy Improvement of Vehicle Recognition by Using Smart Device Sensors

This paper explores the utilization of smart device sensors for the purpose of vehicle recognition. Currently a ubiquitous aspect of people's lives, smart devices can conveniently record details about walking, biking, jogging, and stepping, including physiological data, via often built-in phone activity recognition processes. This paper examines research on intelligent transportation systems to uncover how smart device sensor data may be used for vehicle recognition research, and fit within its growing body of literature. Here, we use the accelerometer and gyroscope, which can be commonly found in a smart phone, to detect the class of a vehicle. We collected data from cars, buses, trains, and bikes using a smartphone, and we designed a 1D CNN model leveraging the residual connection for vehicle recognition. The model achieved more than 98% accuracy in prediction. Moreover, we also provide future research directions based on our study.

IoT-Inspired Reliable Irregularity-Detection Framework for Education 4.0 and Industry 4.0

Education 4.0 imitates Industry 4.0 in many aspects such as technology, customs, challenges, and benefits. The remarkable advancement in embryonic technologies, including IoT (Internet of Things), Fog Computing, Cloud Computing, and Augmented and Virtual Reality (AR/VR), polishes every dimension of Industry 4.0. The constructive impacts of Industry 4.0 are also replicated in Education 4.0. Real-time assessment, irregularity detection, and alert generation are some of the leading necessities of Education 4.0. Conspicuously, this study proposes a reliable assessment, irregularity detection, and alert generation framework for Education 4.0. The proposed framework correspondingly addresses the comparable issues of Industry 4.0. The proposed study (1) recommends the use of IoT, Fog, and Cloud Computing, i.e., IFC technological integration for the implementation of Education 4.0. Subsequently, (2) the Symbolic Aggregation Approximation (SAX), Kalman Filter, and Learning Bayesian Network (LBN) are deployed for data pre-processing and classification. Further, (3) the assessment, irregularity detection, and alert generation are accomplished over SoTL (the set of threshold limits) and the Multi-Layered Bi-Directional Long Short-Term Memory (M-Bi-LSTM)-based predictive model. To substantiate the proposed framework, experimental simulations are implemented. The experimental outcomes substantiate the better performance of the proposed framework, in contrast to the other contemporary technologies deployed for the enactment of Education 4.0.

Smartphone-Based Activity Recognition Using Multistream Movelets Combining Accelerometer and Gyroscope Data

Physical activity patterns can reveal information about one's health status. Built-in sensors in a smartphone, in comparison to a patient's self-report, can collect activity recognition data more objectively, unobtrusively, and continuously. A variety of data analysis approaches have been proposed in the literature. In this study, we applied the movelet method to classify the activities performed using smartphone accelerometer and gyroscope data, which measure a phone's acceleration and angular velocity, respectively. The movelet method constructs a personalized dictionary for each participant using training data and classifies activities in new data with the dictionary. Our results show that this method has the advantages of being interpretable and transparent. A unique aspect of our movelet application involves extracting unique information, optimally, from multiple sensors. In comparison to single-sensor applications, our approach jointly incorporates the accelerometer and gyroscope sensors with the movelet method. Our findings show that combining data from the two sensors can result in more accurate activity recognition than using each sensor alone. In particular, the joint-sensor method reduces errors of the gyroscope-only method in differentiating between standing and sitting. It also reduces errors in the accelerometer-only method when classifying vigorous activities.

Predicting Human Motion Signals Using Modern Deep Learning Techniques and Smartphone Sensors

The global adoption of smartphone technology affords many conveniences, and not surprisingly, healthcare applications using wearable sensors like smartphones have received much attention. Among the various potential applications and research related to healthcare, recent studies have been conducted on recognizing human activities and characterizing human motions, often with wearable sensors, and with sensor signals that generally operate in the form of time series. In most studies, these sensor signals are used after pre-processing, e.g., by converting them into an image format rather than directly using the sensor signals themselves. Several methods have been used for converting time series data to image formats, such as spectrograms, raw plots, and recurrence plots. In this paper, we deal with the health care task of predicting human motion signals obtained from sensors attached to persons. We convert the motion signals into image formats with the recurrence plot method, and use it as an input into a deep learning model. For predicting subsequent motion signals, we utilize a recently introduced deep learning model combining neural networks and the Fourier transform, the Fourier neural operator. The model can be viewed as a Fourier-transform-based extension of a convolution neural network, and in these experiments, we compare the results of the model to the convolution neural network (CNN) model. The results of the proposed method in this paper show better performance than the results of the CNN model and, furthermore, we confirm that it can be utilized for detecting potential accidental falls more quickly via predicted motion signals.

A systematic review of smartphone-based human activity recognition methods for health research

Smartphones are now nearly ubiquitous; their numerous built-in sensors enable continuous measurement of activities of daily living, making them especially well-suited for health research. Researchers have proposed various human activity recognition (HAR) systems aimed at translating measurements from smartphones into various types of physical activity. In this review, we summarized the existing approaches to smartphone-based HAR. For this purpose, we systematically searched Scopus, PubMed, and Web of Science for peer-reviewed articles published up to December 2020 on the use of smartphones for HAR. We extracted information on smartphone body location, sensors, and physical activity types studied and the data transformation techniques and classification schemes used for activity recognition. Consequently, we identified 108 articles and described the various approaches used for data acquisition, data preprocessing, feature extraction, and activity classification, identifying the most common practices, and their alternatives. We conclude that smartphones are well-suited for HAR research in the health sciences. For population-level impact, future studies should focus on improving the quality of collected data, address missing data, incorporate more diverse participants and activities, relax requirements about phone placement, provide more complete documentation on study participants, and share the source code of the implemented methods and algorithms.