Trends in clinical validation and usage of US Food and Drug Administration-cleared artificial intelligence algorithms for medical imaging

AIM

To examine the current landscape of US Food and Drug Administration (FDA)-approved artificial intelligence (AI) medical imaging devices and identify trends in clinical validation strategy.

MATERIALS AND METHODS

A retrospective study was conducted that analysed data extracted from the American College of Radiology (ACR) Data Science Institute AI Central database as of November 2021 to identify trends in FDA clearance of AI products related to medical imaging. Product and clinical validation information of each device was gathered from their respective public 510(k) summary or de novo request submission, depending on their type of authorisation.

RESULTS

Overall, the database included a total of 151 AI algorithms that were cleared by the FDA between 2008 and November 2021. Out of the 151 FDA summaries reviewed, 97 (64.2%) reported the use of clinical data to validate their device, with six (4%) revealing study participant demographics, and eight (5.3%) reporting the specifications of the machines used. A total of 51 (33.8%) AI devices characterised their clinical data as multicentre, three (2%) as single-centre, and the remaining 97 (64.2%) did not specify. The ground truth used for clinical validation was specified in 78 (51.6%) FDA summaries.

CONCLUSION

A wide breadth of AI algorithms has been developed for medical imaging. Most of the FDA summaries of the devices mention their use of clinical data and patient cases for device validation; however, few devices revealed the patient demographics or machine specifications used in their clinical studies, which may lead some consumers to question their external validation.

Prism Design for Spectral Flow Cytometry

Flow cytometers are instruments used for the rapid quantitative analysis of cell suspension. Traditional flow cytometry uses multi-channel filters to detect fluorescence, whereas full-spectrum fluorescence based on dispersion detection is a more effective and accurate method. The application of various dispersion schemes in flow cytometry spectroscopy has been studied. From the perspective of modern detectors and demand for the miniaturization of flow cytometry, prism dispersion exhibits higher and more uniform light energy utilization, meaning that it is a more suitable dispersion method for small flow cytometers, such as microfluidic flow cytometers. Prism dispersion designs include the size, number, and placement of prisms. By deducing the formula of the final position of light passing through the prism and combining it with the formula of transmittance, the design criteria of the top angle and the incident angle of the prism in pursuit of the optimum transmittance and dispersion index can be obtained. Considering the case of multiple prisms, under the premise of pursuing a smaller size, the optimal design criteria for dispersion system composed of multiple prisms can be obtained. The design of prism dispersion fluorescence detection was demonstrated with a microfluidic flow cytometer, and the effectiveness of the design results was verified by microsphere experiments and practical biological experiments. This design criterion developed in this study is generally applicable to spectral flow cytometers.

Study of the Semileptonic Decay Λ_{c}^{+}→Λe^{+}ν_{e}

The study of the Cabibbo-favored semileptonic decay Λ_{c}^{+}→Λe^{+}ν_{e} is reported using a 4.5  fb^{-1} data sample of e^{+}e^{-} annihilations collected at center-of-mass energies ranging from 4.600 GeV to 4.699 GeV with the BESIII detector at the BEPCII collider. The branching fraction of the decay is measured to be B(Λ_{c}^{+}→Λe^{+}ν_{e})=(3.56±0.11_{stat}±0.07_{syst})%, which is the most precise measurement to date. Furthermore, we perform an investigation of the internal dynamics in Λ_{c}^{+}→Λe^{+}ν_{e}. We provide the first direct comparisons of the differential decay rate and form factors with those predicted from lattice quantum chromodynamics (LQCD) calculations. Combining the measured branching fraction with a q^{2}-integrated rate predicted by LQCD, we determine |V_{cs}|=0.936±0.017_{B}±0.024_{LQCD}±0.007_{τ_{Λ_{c}}}.

Utility of trio-based prenatal exome sequencing incorporating splice-site and mitochondrial genome assessment in pregnancies with fetal ultrasound anomalies: prospective cohort study

OBJECTIVE

To evaluate the utility of trio-based prenatal exome sequencing (pES), incorporating splice-site and mitochondrial genome assessment, in the prenatal diagnosis of fetuses with ultrasound anomalies and normal copy-number variant sequencing (CNV-seq) results.

METHODS

This was a prospective study of 90 ongoing pregnancies with ultrasound anomalies that underwent trio-based pES after receiving normal CNV-seq results, from September 2020 to November 2021, in a single center in China. By using pES with a panel encompassing exome coding and splicing regions as well as mitochondrial genome for fetuses and parents, we identified the underlying genetic causes of fetal anomalies, incidental fetal findings and parental carrier status. Information on pregnancy outcome and the impact of pES findings on parental decision-making was collected.

RESULTS

Of the 90 pregnancies included, 28 (31.1%) received a diagnostic result that could explain the fetal ultrasound anomalies. The highest diagnostic yield was noted for brain abnormalities (3/6 (50.0%)), followed by hydrops (4/9 (44.4%)) and skeletal abnormalities (13/34 (38.2%)). Collectively, 34 variants of 20 genes were detected in the 28 diagnosed cases, with 55.9% (19/34) occurring de novo. Variants of uncertain significance (VUS) associated with fetal phenotypes were detected in six (6.7%) fetuses. Interestingly, fetal (n = 4) and parental (n = 3) incidental findings (IFs) were detected in seven (7.8%) cases. These included two fetuses carrying a de-novo likely pathogenic (LP) variant of the CIC and FBXO11 genes, respectively, associated with neurodevelopmental disorders, and one fetus with a LP variant in a mitochondrial gene. The remaining fetus presented with unilateral renal dysplasia and was incidentally found to carry a pathogenic PKD1 gene variant resulting in adult-onset polycystic kidney, which was later confirmed to be inherited from the mother. In addition, parental heterozygous variants associated with autosomal recessive diseases were detected in three families, including one with additional fetal diagnostic findings. Diagnostic results or fetal IFs contributed to parental decision-making about termination of the pregnancy in 26 families (26/72 (36.1%)), while negative pES results or identification of VUS encouraged 40 families (40/72 (55.6%)) to continue their pregnancy, which ended in a live birth in all cases.

CONCLUSION

Trio-based pES can provide additional genetic information for pregnancies with fetal ultrasound anomalies without a CNV-seq diagnosis. The incidental findings and parental carrier status reported by trio-based pES with splice-site and mitochondrial genome analysis extend its clinical application, but careful genetic counseling is warranted. © 2022 International Society of Ultrasound in Obstetrics and Gynecology.

Measurement of the Absolute Branching Fraction and Decay Asymmetry of Λ→nγ

The radiative hyperon decay Λ→nγ is studied using (10087±44)×10^{6}  J/ψ events collected with the BESIII detector operating at BEPCII. The absolute branching fraction of the decay Λ→nγ is determined to be (0.832±0.038_{stat}±0.054_{syst})×10^{-3}, which is a factor of 2.1 lower and 5.6 standard deviations different than the previous measurement. By analyzing the joint angular distribution of the decay products, the first determination of the decay asymmetry α_{γ} is reported with a value of -0.16±0.10_{stat}±0.05_{syst}.

Observation of an Isoscalar Resonance with Exotic J^{PC}=1^{-+} Quantum Numbers in J/ψ→γηη^{'}

Using a sample of (10.09±0.04)×10^{9}  J/ψ events collected with the BESIII detector operating at the BEPCII storage ring, a partial wave analysis of the decay J/ψ→γηη^{'} is performed. The first observation of an isoscalar state with exotic quantum numbers J^{PC}=1^{-+}, denoted as η_{1}(1855), is reported in the process J/ψ→γη_{1}(1855) with η_{1}(1855)→ηη^{'}. Its mass and width are measured to be (1855±9_{-1}^{+6})  MeV/c^{2} and (188±18_{-8}^{+3})  MeV, respectively, where the first uncertainties are statistical and the second are systematic, and its statistical significance is estimated to be larger than 19σ.

Observation of an a_{0}-like State with Mass of 1.817 GeV in the Study of D_{s}^{+}→K_{S}^{0}K^{+}π^{0} Decays

Using e^{+}e^{-} annihilation data corresponding to an integrated luminosity of 6.32  fb^{-1} collected at center-of-mass energies between 4.178 and 4.226 GeV with the BESIII detector, we perform the first amplitude analysis of the decay D_{s}^{+}→K_{S}^{0}K^{+}π^{0} and determine the relative branching fractions and phases for intermediate processes. We observe an a_{0}-like state with mass of 1.817 GeV in its decay to K_{S}^{0}K^{+} for the first time. In addition, we measure the ratio {B[D_{s}^{+}→K[over ¯]^{*}(892)^{0}K^{+}]/B[D_{s}^{+}→K[over ¯]^{0}K^{*}(892)^{+}]} to be 2.35_{-0.23stat}^{+0.42}±0.10_{syst}. Finally, we provide a precision measurement of the absolute branching fraction B(D_{s}^{+}→K_{S}^{0}K^{+}π^{0})=(1.46±0.06_{stat}±0.05_{syst})%.

Precise Measurements of Decay Parameters and CP Asymmetry with Entangled Λ-Λ[over ¯] Pairs

Based on 10 billion J/ψ events collected at the BESIII experiment, a search for CP violation in Λ decay is performed in the difference between CP-odd decay parameters α_{-} for Λ→pπ^{-} and α_{+} for Λ[over ¯]→p[over ¯]π^{+} by using the process e^{+}e^{-}→J/ψ→ΛΛ[over ¯]. With a five-dimensional fit to the full angular distributions of the daughter baryon, the most precise values for the decay parameters are determined to be α_{-}=0.7519±0.0036±0.0024 and α_{+}=-0.7559±0.0036±0.0030, respectively. The Λ and Λ[over ¯] averaged value of the decay parameter is extracted to be α_{avg}=0.7542±0.0010±0.0024 with unprecedented accuracy. The CP asymmetry A_{CP}=(α_{-}+α_{+})/(α_{-}-α_{+}) is determined to be -0.0025±0.0046±0.0012, which is one of the most precise measurements in the baryon sector. The reported results for the decay parameter will play an important role in the studies of the polarizations and CP violations for the strange, charmed and beauty baryons.

First Observation of the Direct Production of the χ_{c1} in e^{+}e^{-} Annihilation

We study the direct production of the J^{PC}=1^{++} charmonium state χ_{c1}(1P) in electron-positron annihilation by carrying out an energy scan around the mass of the χ_{c1}(1P). The data were collected with the BESIII detector at the BEPCII collider. An interference pattern between the signal process e^{+}e^{-}→χ_{c1}(1P)→γJ/ψ→γμ^{+}μ^{-} and the background processes e^{+}e^{-}→γ_{ISR}J/ψ→γ_{ISR}μ^{+}μ^{-} and e^{+}e^{-}→γ_{ISR}μ^{+}μ^{-} is observed by combining all the data samples. The χ_{c1}(1P) signal is observed with a significance of 5.1σ. This is the first observation of a C-even state directly produced in e^{+}e^{-} annihilation. The electronic width of the χ_{c1}(1P) resonance is determined to be Γ_{ee}=(0.12_{-0.08}^{+0.13})  eV, which is of the same order of magnitude as theoretical calculations.

Evidence for a Neutral Near-Threshold Structure in the K_{S}^{0} Recoil-Mass Spectra in e^{+}e^{-}→K_{S}^{0}D_{s}^{+}D^{*-} and e^{+}e^{-}→K_{S}^{0}D_{s}^{*+}D^{-}

We study the processes e^{+}e^{-}→K_{S}^{0}D_{s}^{+}D^{*-} and e^{+}e^{-}→K_{S}^{0}D_{s}^{*+}D^{-}, as well as their charge conjugated processes, at five center-of-mass energies between 4.628 and 4.699 GeV, using data samples corresponding to an integrated luminosity of 3.8  fb^{-1} collected by the BESIII detector at the BEPCII storage ring. Based on a partial reconstruction technique, we find evidence of a structure near the thresholds for D_{s}^{+}D^{*-} and D_{s}^{*+}D^{-} production in the K_{S}^{0} recoil-mass spectrum, which we refer to as the Z_{cs}(3985)^{0}. Fitting with a Breit-Wigner line shape, we find the mass of the structure to be (3992.2±1.7±1.6)  MeV/c^{2} and the width to be (7.7_{-3.8}^{+4.1}±4.3)  MeV, where the first uncertainties are statistical and the second are systematic. The significance of the Z_{cs}(3985)^{0} signal is found to be 4.6σ including both the statistical and systematic uncertainty. We report the Born cross section multiplied by the branching fraction at different energy points. The mass of the Z_{cs}(3985)^{0} is close to that of the Z_{cs}(3985)^{+}. Assuming SU(3) symmetry, the cross section of the neutral channel is consistent with that of the charged one. Hence, we conclude that the Z_{cs}(3985)^{0} is the isospin partner of the Z_{cs}(3985)^{+}.

Observation of Resonance Structures in e^{+}e^{-}→π^{+}π^{-}ψ_{2}(3823) and Mass Measurement of ψ_{2}(3823)

Using a data sample corresponding to an integrated luminosity of 11.3  fb^{-1} collected at center-of-mass energies from 4.23 to 4.70 GeV with the BESIII detector, we measure the product of the e^{+}e^{-}→π^{+}π^{-}ψ_{2}(3823) cross section and the branching fraction B[ψ_{2}(3823)→γχ_{c1}]. For the first time, resonance structure is observed in the cross section line shape of e^{+}e^{-}→π^{+}π^{-}ψ_{2}(3823) with significances exceeding 5σ. A fit to data with two coherent Breit-Wigner resonances modeling the sqrt[s]-dependent cross section yields M(R_{1})=4406.9±17.2±4.5  MeV/c^{2}, Γ(R_{1})=128.1±37.2±2.3  MeV, and M(R_{2})=4647.9±8.6±0.8  MeV/c^{2}, Γ(R_{2})=33.1±18.6±4.1  MeV. Though weakly disfavored by the data, a single resonance with M(R)=4417.5±26.2±3.5  MeV/c^{2}, Γ(R)=245±48±13  MeV is also possible to interpret data. This observation deepens our understanding of the nature of the vector charmoniumlike states. The mass of the ψ_{2}(3823) state is measured as (3823.12±0.43±0.13)  MeV/c^{2}, which is the most precise measurement to date.

Observation of a State X(2600) in the π^{+}π^{-}η' System in the Process J/ψ→γπ^{+}π^{-}η'

Based on (10087±44)×10^{6}  J/ψ events collected with the BESIII detector, the process J/ψ→γπ^{+}π^{-}η^{'} is studied using two largest decay channels of the η^{'} meson, η^{'}→γπ^{+}π^{-} and η^{'}→ηπ^{+}π^{-}, η→γγ. A new resonance, which we denote as the X(2600), is observed with a statistical significance larger than 20σ in the π^{+}π^{-}η^{'} invariant mass spectrum, and it has a connection to a structure around 1.5  GeV/c^{2} in the π^{+}π^{-} invariant mass spectrum. A simultaneous fit on the π^{+}π^{-}η^{'} and π^{+}π^{-} invariant mass spectra with the two η^{'} decay modes indicates that the mass and width of the X(2600) state are 2618.3±2.0_{-1.4}^{+16.3}  MeV/c^{2} and 195±5_{-17}^{+26}  MeV, where the first uncertainties are statistical, and the second systematic.

Observation of J/ψ Electromagnetic Dalitz Decays to X(1835), X(2120), and X(2370)

Using a sample of about 10^{10}  J/ψ events collected at a center-of-mass energy sqrt[s]=3.097  GeV with the BESIII detector, the electromagnetic Dalitz decays J/ψ→e^{+}e^{-}π^{+}π^{-}η^{'}, with η^{'}→γπ^{+}π^{-} and η^{'}→π^{+}π^{-}η, have been studied. The decay J/ψ→e^{+}e^{-}X(1835) is observed with a significance of 15σ, and also an e^{+}e^{-} invariant-mass dependent transition form factor of J/ψ→e^{+}e^{-}X(1835) is presented for the first time. The intermediate states X(2120) and X(2370) are also observed in the π^{+}π^{-}η^{'} invariant-mass spectrum with significances of 5.3σ and 7.3σ. The corresponding product branching fractions for J/ψ→e^{+}e^{-}X, X→π^{+}π^{-}η^{'} [X=X(1835), X(2120), and X(2370)] are reported.

Probing CP symmetry and weak phases with entangled double-strange baryons

Though immensely successful, the standard model of particle physics does not offer any explanation as to why our Universe contains so much more matter than antimatter. A key to a dynamically generated matter-antimatter asymmetry is the existence of processes that violate the combined charge conjugation and parity (CP) symmetry1. As such, precision tests of CP symmetry may be used to search for physics beyond the standard model. However, hadrons decay through an interplay of strong and weak processes, quantified in terms of relative phases between the amplitudes. Although previous experiments constructed CP observables that depend on both strong and weak phases, we present an approach where sequential two-body decays of entangled multi-strange baryon-antibaryon pairs provide a separation between these phases. Our method, exploiting spin entanglement between the double-strange Ξ- baryon and its antiparticle2 [Formula: see text], has enabled a direct determination of the weak-phase difference, (ξP - ξS) = (1.2 ± 3.4 ± 0.8) × 10-2 rad. Furthermore, three independent CP observables can be constructed from our measured parameters. The precision in the estimated parameters for a given data sample size is several orders of magnitude greater than achieved with previous methods3. Finally, we provide an independent measurement of the recently debated Λ decay parameter αΛ (refs. 4,5). The [Formula: see text] asymmetry is in agreement with and compatible in precision to the most precise previous measurement4.

Rapid switching and durable on-chip spark-cavitation-bubble cell sorter

Precise and high-speed sorting of individual target cells from heterogeneous populations plays an imperative role in cell research. Although the conventional fluorescence-activated cell sorter (FACS) is capable of rapid and accurate cell sorting, it occupies a large volume of the instrument and inherently brings in aerosol generation as well as cross-contamination among samples. The sorting completed in a fully enclosed and disposable microfluidic chip has the potential to eliminate the above concerns. However, current microfluidic cell sorters are hindered by the high complexities of the fabrication procedure and the off-chip setup. In this paper, a spark-cavitation-bubble-based fluorescence-activated cell sorter is developed to perform fast and accurate sorting in a microfluidic chip. It features a simple structure and an easy operation. This microfluidic sorter comprises a positive electrode of platinum and a negative electrode of tungsten, which are placed on the side of the main channel. By applying a high-voltage discharge on the pair of electrodes, a single spark cavitation bubble is created to deflect the target particle into the downstream collection channel. The sorter has a short switching time of 150 μs and a long lifespan of more than 100 million workable actions. In addition, a novel control strategy is proposed to dynamically adjust the discharge time to stabilize the size of the cavitation bubble for continuous sorting. The dynamic control of continuously triggering the sorter, the optimal delay time between fluorescence detection and cell sorting, and a theoretical model to predict the ideal sorting recovery and purity are studied to improve and evaluate the sorter performance. The experiments demonstrate that the sorting rate of target particles achieves 1200 eps, the total analysis throughput is up to 10,000 eps, the particles sorted at 4000 eps exhibit a purity greater than 80% and a recovery rate greater than 90%, and the sorting effect on the viability of HeLa cells is negligible.

Observation of the Singly Cabibbo Suppressed Decay Λ_{c}^{+}→nπ^{+}

The singly Cabibbo-suppressed decay Λ_{c}^{+}→nπ^{+} is observed for the first time with a statistical significance of 7.3σ by using 3.9  fb^{-1} of e^{+}e^{-} collision data collected at center-of-mass energies between 4.612 and 4.699 GeV with the BESIII detector at BEPCII. The branching fraction of Λ_{c}^{+}→nπ^{+} is measured to be (6.6±1.2_{stat}±0.4_{syst})×10^{-4}. By taking the upper limit of branching fractions of Λ_{c}^{+}→pπ^{0} from the Belle experiment, the ratio of branching fractions between Λ_{c}^{+}→nπ^{+} and Λ_{c}^{+}→pπ^{0} is calculated to be larger than 7.2 at the 90% confidence level, which disagrees with most predictions of the available phenomenological models. In addition, the branching fractions of the Cabibbo-favored decays Λ_{c}^{+}→Λπ^{+} and Λ_{c}^{+}→Σ^{0}π^{+} are measured to be (1.31±0.08_{stat}±0.05_{syst})×10^{-2} and (1.22±0.08_{stat}±0.07_{syst})×10^{-2}, respectively, which are consistent with previous results.

Measurement of the Cross Section for e^{+}e^{-}→Hadrons at Energies from 2.2324 to 3.6710 GeV

Based on electron-positron collision data collected with the BESIII detector operating at the Beijing Electron-Positron Collider II storage rings, the value of R≡σ(e^{+}e^{-}→hadrons)/σ(e^{+}e^{-}→μ^{+}μ^{-}) is measured at 14 center-of-mass energies from 2.2324 to 3.6710 GeV. The resulting uncertainties are less than 3.0% and are dominated by systematic uncertainties.

First Measurement of Polarizations in the Decay D^{0}→ωφ

Using a data sample corresponding to an integrated luminosity of 2.93  fb^{-1} collected at a center-of-mass energy sqrt[s]=3.773  GeV by the BESIII detector, the decay D^{0}→ωϕ is observed for the first time. The branching fraction is measured to be (6.48±0.96±0.40)×10^{-4} with a significance of 6.3σ, where the first and second uncertainties are statistical and systematic, respectively. An angular analysis reveals that the ϕ and ω mesons from the D^{0}→ωϕ decay are transversely polarized. The 95% confidence level upper limit on longitudinal polarization fraction is set to be less than 0.24, which is inconsistent with current theoretical expectations and challenges our understanding of the underlying dynamics in charm meson decays.