Optimal Joint Detection and Estimation That Maximizes ROC-Type Curves

A Hybrid Approach for Approximating the Ideal Observer for Joint Signal Detection and Estimation Tasks by Use of Supervised Learning and Markov-Chain Monte Carlo Methods

The ideal observer (IO) sets an upper performance limit among all observers and has been advocated for assessing and optimizing imaging systems. For general joint detection and estimation (detection-estimation) tasks, estimation ROC (EROC) analysis has been established for evaluating the performance of observers. However, in general, it is difficult to accurately approximate the IO that maximizes the area under the EROC curve. In this study, a hybrid method that employs machine learning is proposed to accomplish this. Specifically, a hybrid approach is developed that combines a multi-task convolutional neural network and a Markov-Chain Monte Carlo (MCMC) method in order to approximate the IO for detection-estimation tasks. Unlike traditional MCMC methods, the hybrid method is not limited to use of specific utility functions. In addition, a purely supervised learning-based sub-ideal observer is proposed. Computer-simulation studies are conducted to validate the proposed method, which include signal-known-statistically/background-known-exactly and signal-known-statistically/background-known-statistically tasks. The EROC curves produced by the proposed method are compared to those produced by the MCMC approach or analytical computation when feasible. The proposed method provides a new approach for approximating the IO and may advance the application of EROC analysis for optimizing imaging systems.

Polycystic ovary syndrome: Identification of novel and hub biomarkers in the autophagy-associated mRNA-miRNA-lncRNA network

INTRODUCTION

Polycystic ovary syndrome (PCOS) is a common metabolic and endocrine disorder prevalent among women of reproductive age. Recent studies show that autophagy participated in the pathogenesis of PCOS, including anovulation, hyperandrogenism, and metabolic disturbances. This study was designed to screen autophagy-related genes (ATGs) that may play a pivotal role in PCOS, providing potential biomarkers and identifying new molecular subgroups for therapeutic intervention.

METHODS

Gene expression profiles of the PCOS and control samples were obtained from the publicly available Gene Expression Omnibus database. The gene lists of ATGs from databases were integrated. Then, the weighted gene co-expression network analysis was conducted to obtain functional modules and construct a multifactorial co-expression network. Gene Ontology and KEGG pathway enrichment analyses were performed for further exploration of ATG's function in the key modules. Differentially expressed ATGs were identified and validated in external datasets with the Limma R package. To provide guidance on PCOS phenotyping, the dysfunction module consists of a co-expression network mapped to PCOS patients. A PCOS-Autophagy-related co-expression network was established using Cytoscape, followed by identifying molecular subgroups using the Limma R package. ps. RNA-sequencing analysis was used to confirm the differential expression of hub ATGs, and the diagnostic value of hub ATGs was assessed by receiver operating characteristic curve analysis.

RESULTS

Three modules (Brown, Turquoise, and Green) in GSE8157, three modules (Blue, Red, and Green) in GSE43264, and four modules (Blue, Green, Black, and Yellow) in GSE106724 were identified to be PCOS-related by WGCNA analysis. 29 ATGs were found to be the hub genes that strongly correlated with PCOS. These hub ATGs were mainly enriched in autophagy-related functions and pathways such as autophagy, endocytosis, apoptosis, and mTOR signaling pathways. The mRNA-miRNA-lncRNA multifactorial network was successfully constructed. And three new molecular subgroups were identified via the K-means algorithm.

DISCUSSION

We provide a novel insight into the mechanisms behind autophagy in PCOS. BRCA1, LDLR, MAP1B, hsa-miR-92b-3p, hsa-miR-20b-5p, and NEAT1 might play a considerably important role in PCOS dysfunction. As a result, new potential biomarkers can be evaluated for use in PCOS diagnosis and treatment in the future.

Approximating the Ideal Observer for Joint Signal Detection and Localization Tasks by use of Supervised Learning Methods

Medical imaging systems are commonly assessed and optimized by use of objective measures of image quality (IQ). The Ideal Observer (IO) performance has been advocated to provide a figure-of-merit for use in assessing and optimizing imaging systems because the IO sets an upper performance limit among all observers. When joint signal detection and localization tasks are considered, the IO that employs a modified generalized likelihood ratio test maximizes observer performance as characterized by the localization receiver operating characteristic (LROC) curve. Computations of likelihood ratios are analytically intractable in the majority of cases. Therefore, sampling-based methods that employ Markov-Chain Monte Carlo (MCMC) techniques have been developed to approximate the likelihood ratios. However, the applications of MCMC methods have been limited to relatively simple object models. Supervised learning-based methods that employ convolutional neural networks have been recently developed to approximate the IO for binary signal detection tasks. In this paper, the ability of supervised learning-based methods to approximate the IO for joint signal detection and localization tasks is explored. Both background-known-exactly and background-known-statistically signal detection and localization tasks are considered. The considered object models include a lumpy object model and a clustered lumpy model, and the considered measurement noise models include Laplacian noise, Gaussian noise, and mixed Poisson-Gaussian noise. The LROC curves produced by the supervised learning-based method are compared to those produced by the MCMC approach or analytical computation when feasible. The potential utility of the proposed method for computing objective measures of IQ for optimizing imaging system performance is explored.

Risk analysis, ideal observers, and receiver operating characteristic curves for tasks that combine detection and estimation

Previously published work on joint estimation/detection tasks has focused on the area under the estimation receiver operating characteristic (EROC) curve as a figure of merit (FOM) for these tasks in imaging. Another FOM for these joint tasks is the Bayesian risk, where a cost is assigned to all detection outcomes and to the estimation errors, and then averaged over all sources of randomness in the object ensemble and the imaging system. Important elements of the cost function, which are not included in standard EROC analysis, are that the cost for a false positive depends on the estimate produced for the parameter vector, and the cost for a false negative depends on the true value of the parameter vector. The ideal observer in this setting, which minimizes the risk, is derived for two applications. In the first application, a parameter vector is estimated only in the case of a signal present classification. For the second application, parameter vectors are estimated for either classification, and these vectors may have different dimensions. In both applications, a risk-based estimation receiver operating characteristic curve is defined and an expression for the area under this curve is given. It is also shown that, for some observers, this area may be estimated from a two alternative forced choice test. Finally, if the classifier is optimized for a given estimator, then it is shown that the slope of the risk-based estimation receiver operating characteristic curve at each point is the negative of the ratio of the prior probabilities for the two classes.

Deep Learning Classification of 3.5 GHz Band Spectrograms with Applications to Spectrum Sensing

In the United States, the Federal Communications Commission has adopted rules permitting commercial wireless networks to share spectrum with federal incumbents in the 3.5 GHz Citizens Broadband Radio Service band. These rules require commercial systems to vacate the band when sensors detect radars operated by the U.S. military; a key example being the SPN-43 air traffic control radar. Such sensors require highly-accurate detection algorithms to meet their operating requirements. In this paper, using a library of over 14,000 3.5 GHz band spectrograms collected by a recent measurement campaign, we investigate the performance of thirteen methods for SPN-43 radar detection. Namely, we compare classical methods from signal detection theory and machine learning to several deep learning architectures. We demonstrate that machine learning algorithms appreciably outperform classical signal detection methods. Specifically, we find that a three-layer convolutional neural network offers a superior tradeoff between accuracy and computational complexity. Last, we apply this three-layer network to generate descriptive statistics for the full 3.5 GHz spectrogram library. Our findings highlight potential weaknesses of classical methods and strengths of modern machine learning algorithms for radar detection in the 3.5 GHz band.