Analyzing Associations Between Chronic Disease Prevalence and Neighborhood Quality Through Google Street View Images

Multi-Task Classification for Improved Health Outcome Prediction Based on Environmental Indicators

This paper aims to address the challenges associated with evaluating the impact of neighborhood environments on health outcomes. Google street view (GSV) images provide a valuable tool for assessing neighborhood environments on a large scale. By annotating the GSV images with labels indicating the presence or absence of specific neighborhood features, we can develop classifiers capable of automatically analyzing and evaluating the environment. However, the process of labeling GSV images to analyze and evaluate the environment is a time-consuming and labor-intensive task. To overcome these challenges, we propose using a multi-task classifier to enhance the training of classifiers with limited supervised GSV data. Our multi-task classifier utilizes readily available, inexpensive online images collected from Flickr as a related classification task. The hypothesis is that a classifier trained on multiple related tasks is less likely to overfit to small amounts of training data and generalizes better to unseen data. We leverage the power of multiple related tasks to improve the classifier's overall performance and generalization capability. Here we show that, with the proposed learning paradigm, predicted labels for GSV test images are more accurate. Across different environment indicators, the accuracy, F1 score and balanced accuracy increase up to 6 % in the multi-task learning framework compared to its single-task learning counterpart. The enhanced accuracy of the predicted labels obtained through the multi-task classifier contributes to a more reliable and precise regression analysis determining the correlation between predicted built environment indicators and health outcomes. The R2 values calculated for different health outcomes improve by up to 4 % using multi-task learning detected indicators.

Measuring and modelling perceptions of the built environment for epidemiological research using crowd-sourcing and image-based deep learning models

BACKGROUND

Perceptions of the built environment, such as nature quality, beauty, relaxation, and safety, may be key factors linking the built environment to human health. However, few studies have examined these types of perceptions due to the difficulty in quantifying them objectively in large populations.

OBJECTIVE

To measure and predict perceptions of the built environment from street-view images using crowd-sourced methods and deep learning models for application in epidemiologic studies.

METHODS

We used the Amazon Mechanical-Turk crowdsourcing platform where participants compared two street-view images and quantified perceptions of nature quality, beauty, relaxation, and safety. We optimized street-view image sampling methods to improve the quality and resulting perception data specific to participants enrolled in the Washington State Twin Registry (WSTR) health study. We used a transfer learning approach to train deep learning models by leveraging existing image perception data from the PlacePulse 2.0 dataset, which includes 1.1 million image comparisons, and refining based on new WSTR perception data. Resulting models were applied to WSTR addresses to estimate exposures and evaluate associations with traditional built environment measures.

RESULTS

We collected over 36,000 image comparisons and calculated perception measures for each image. Our final deep learning models explained 77.6% of nature quality, 68.1% of beauty, 72.0% of relaxation, and 64.7% of safety in pairwise image comparisons. Applying transfer learning with the new perception labels specific to the WSTR yielded an average improvement of 3.8% for model performance. Perception measures were weakly to moderately correlated with traditional built environment exposures for WSTR participant addresses; for example, nature quality and NDVI (r = 0.55), neighborhood area deprivation (r = -0.16), and walkability (r = -0.20), respectively.

SIGNIFICANCE

We were able to measure and model perceptions of the built environment optimized for a specific health study. Future applications will examine associations between these exposure measures and mental health in the WSTR.

IMPACT STATEMENT

Built environments influence health through complex pathways. Perceptions of nature quality, beauty, relaxation and safety may be particularly import for understanding these linkages, but few studies to-date have examined these perceptions objectively for large populations. For quantitative research, an exposure measure must be reproducible, accurate, and precise--here we work to develop such measures for perceptions of the urban environment. We created crowd-sourced and image-based deep learning methods that were able to measure and model these perceptions. Future applications will apply these models to examine associations with mental health in the Washington State Twin Registry.

Added-value of mosquito vector breeding sites from street view images in the risk mapping of dengue incidence in Thailand

Dengue is an emerging vector-borne viral disease across the world. The primary dengue mosquito vectors breed in containers with sufficient water and nutrition. Outdoor containers can be detected from geotagged images using state-of-the-art deep learning methods. In this study, we utilize such container information from street view images in developing a risk mapping model and determine the added value of including container information in predicting dengue risk. We developed seasonal-spatial models in which the target variable dengue incidence was explained using weather and container variable predictors. Linear mixed models with fixed and random effects are employed in our models to account for different characteristics of containers and weather variables. Using data from three provinces of Thailand between 2015 and 2018, the models are developed at the sub-district level resolution to facilitate the development of effective targeted intervention strategies. The performance of the models is evaluated with two baseline models: a classic linear model and a linear mixed model without container information. The performance evaluated with the correlation coefficients, R-squared, and AIC shows the proposed model with the container information outperforms both baseline models in all three provinces. Through sensitivity analysis, we investigate the containers that have a high impact on dengue risk. Our findings indicate that outdoor containers identified from street view images can be a useful data source in building effective dengue risk models and that the resulting models have potential in helping to target container elimination interventions.

Leveraging 31 Million Google Street View Images to Characterize Built Environments and Examine County Health Outcomes

OBJECTIVES

Built environments can affect health, but data in many geographic areas are limited. We used a big data source to create national indicators of neighborhood quality and assess their associations with health.

METHODS

We leveraged computer vision and Google Street View images accessed from December 15, 2017, through July 17, 2018, to detect features of the built environment (presence of a crosswalk, non-single-family home, single-lane roads, and visible utility wires) for 2916 US counties. We used multivariate linear regression models to determine associations between features of the built environment and county-level health outcomes (prevalence of adult obesity, prevalence of diabetes, physical inactivity, frequent physical and mental distress, poor or fair self-rated health, and premature death [in years of potential life lost]).

RESULTS

Compared with counties with the least number of crosswalks, counties with the most crosswalks were associated with decreases of 1.3%, 2.7%, and 1.3% of adult obesity, physical inactivity, and fair or poor self-rated health, respectively, and 477 fewer years of potential life lost before age 75 (per 100 000 population). The presence of non-single-family homes was associated with lower levels of all health outcomes except for premature death. The presence of single-lane roads was associated with an increase in physical inactivity, frequent physical distress, and fair or poor self-rated health. Visible utility wires were associated with increases in adult obesity, diabetes, physical and mental distress, and fair or poor self-rated health.

CONCLUSIONS

The use of computer vision and big data image sources makes possible national studies of the built environment's effects on health, producing data and results that may inform national and local decision-making.