Perturbations of the T-cell receptor repertoire in response to SARS-CoV-2 in immunocompetent and immunocompromised individuals

BACKGROUND

Functional T-cell responses are essential for virus clearance and long-term protection after severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, whereas certain clinical factors, such as older age and immunocompromise, are associated with worse outcome.

OBJECTIVE

We sought to study the breadth and magnitude of T-cell responses in patients with coronavirus disease 2019 (COVID-19) and in individuals with inborn errors of immunity (IEIs) who had received COVID-19 mRNA vaccine.

METHODS

Using high-throughput sequencing and bioinformatics tools to characterize the T-cell receptor β repertoire signatures in 540 individuals after SARS-CoV-2 infection, 31 IEI recipients of COVID-19 mRNA vaccine, and healthy controls, we quantified HLA class I- and class II-restricted SARS-CoV-2-specific responses and also identified several HLA allele-clonotype motif associations in patients with COVID-19, including a subcohort of anti-type 1 interferon (IFN-1)-positive patients.

RESULTS

Our analysis revealed that elderly patients with COVID-19 with critical disease manifested lower SARS-CoV-2 T-cell clonotype diversity as well as T-cell responses with reduced magnitude, whereas the SARS-CoV-2-specific clonotypes targeted a broad range of HLA class I- and class II-restricted epitopes across the viral proteome. The presence of anti-IFN-I antibodies was associated with certain HLA alleles. Finally, COVID-19 mRNA immunization induced an increase in the breadth of SARS-CoV-2-specific clonotypes in patients with IEIs, including those who had failed to seroconvert.

CONCLUSIONS

Elderly individuals have impaired capacity to develop broad and sustained T-cell responses after SARS-CoV-2 infection. Genetic factors may play a role in the production of anti-IFN-1 antibodies. COVID-19 mRNA vaccines are effective in inducing T-cell responses in patients with IEIs.

T cell receptor sequencing identifies prior SARS-CoV-2 infection and correlates with neutralizing antibodies and disease severity

BACKGROUNDMeasuring the immune response to SARS-CoV-2 enables assessment of past infection and protective immunity. SARS-CoV-2 infection induces humoral and T cell responses, but these responses vary with disease severity and individual characteristics.METHODSA T cell receptor (TCR) immunosequencing assay was conducted using small-volume blood samples from 302 individuals recovered from COVID-19. Correlations between the magnitude of the T cell response and neutralizing antibody (nAb) titers or indicators of disease severity were evaluated. Sensitivity of T cell testing was assessed and compared with serologic testing.RESULTSSARS-CoV-2-specific T cell responses were significantly correlated with nAb titers and clinical indicators of disease severity, including hospitalization, fever, and difficulty breathing. Despite modest declines in depth and breadth of T cell responses during convalescence, high sensitivity was observed until at least 6 months after infection, with overall sensitivity ~5% greater than serology tests for identifying prior SARS-CoV-2 infection. Improved performance of T cell testing was most apparent in recovered, nonhospitalized individuals sampled > 150 days after initial illness, suggesting greater sensitivity than serology at later time points and in individuals with less severe disease. T cell testing identified SARS-CoV-2 infection in 68% (55 of 81) of samples with undetectable nAb titers (<1:40) and in 37% (13 of 35) of samples classified as negative by 3 antibody assays.CONCLUSIONThese results support TCR-based testing as a scalable, reliable measure of past SARS-CoV-2 infection with clinical value beyond serology.TRIAL REGISTRATIONSpecimens were accrued under trial NCT04338360 accessible at clinicaltrials.gov.FUNDINGThis work was funded by Adaptive Biotechnologies, Frederick National Laboratory for Cancer Research, NIAID, Fred Hutchinson Joel Meyers Endowment, Fast Grants, and American Society for Transplantation and Cell Therapy.

Longitudinal analysis of T cell receptor repertoires reveals shared patterns of antigen-specific response to SARS-CoV-2 infection

T cells play a prominent role in orchestrating the immune response to viral diseases, but their role in the clinical presentation and subsequent immunity to SARS-CoV-2 infection remains poorly understood. As part of a population-based survey of the municipality of Vo', Italy, conducted after the initial SARS-CoV-2 outbreak, we sampled the T cell receptor (TCR) repertoires of the population 2 months after the initial PCR survey and followed up positive cases 9 and 15 months later. At 2 months, we found that 97.0% (98 of 101) of cases had elevated levels of TCRs associated with SARS-CoV-2. T cell frequency (depth) was increased in individuals with more severe disease. Both depth and diversity (breadth) of the TCR repertoire were positively associated with neutralizing antibody titers, driven mostly by CD4+ T cells directed against spike protein. At the later time points, detection of these TCRs remained high, with 90.7% (78 of 96) and 86.2% (25 of 29) of individuals having detectable signal at 9 and 15 months, respectively. Forty-three individuals were vaccinated by month 15 and showed a significant increase in TCRs directed against spike protein. Taken together, these results demonstrate the central role of T cells in mounting an immune defense against SARS-CoV-2 that persists out to 15 months.

Clinical Validation of a Novel T-Cell Receptor Sequencing Assay for Identification of Recent or Prior Severe Acute Respiratory Syndrome Coronavirus 2 Infection

BACKGROUND

While diagnostic, therapeutic, and vaccine development in the coronavirus disease 2019 (COVID-19) pandemic has proceeded at unprecedented speed, critical gaps in our understanding of the immune response to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) remain unaddressed by current diagnostic strategies.

METHODS

A statistical classifier for identifying prior SARS-CoV-2 infection was trained using >4000 SARS-CoV-2-associated T-cell receptor (TCR) β sequences identified by comparing 784 cases and 2447 controls from 5 independent cohorts. The T-Detect COVID (Adaptive Biotechnologies) assay applies this classifier to TCR repertoires sequenced from blood samples to yield a binary assessment of past infection. Assay performance was assessed in 2 retrospective (n = 346; n = 69) and 1 prospective cohort (n = 87) to determine positive percent agreement (PPA) and negative percent agreement (NPA). PPA was compared with 2 commercial serology assays, and pathogen cross-reactivity was evaluated.

RESULTS

T-Detect COVID demonstrated high PPA in individuals with prior reverse transcription-polymerase chain reaction (RT-PCR)-confirmed SARS-CoV-2 infection (97.1% 15+ days from diagnosis; 94.5% 15+ days from symptom onset), high NPA (∼100%) in presumed or confirmed SARS-CoV-2 negative cases, equivalent or higher PPA than 2 commercial serology tests, and no evidence of pathogen cross-reactivity.

CONCLUSIONS

T-Detect COVID is a novel T-cell immunosequencing assay demonstrating high clinical performance for identification of recent or prior SARS-CoV-2 infection from blood samples, with implications for clinical management, risk stratification, surveillance, and understanding of protective immunity and long-term sequelae.

Immunopathological signatures in multisystem inflammatory syndrome in children and pediatric COVID-19

Pediatric Coronavirus Disease 2019 (pCOVID-19) is rarely severe; however, a minority of children infected with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) might develop multisystem inflammatory syndrome in children (MIS-C), with substantial morbidity. In this longitudinal multi-institutional study, we applied multi-omics (analysis of soluble biomarkers, proteomics, single-cell gene expression and immune repertoire analysis) to profile children with COVID-19 (n = 110) and MIS-C (n = 76), along with pediatric healthy controls (pHCs; n = 76). pCOVID-19 was characterized by robust type I interferon (IFN) responses, whereas prominent type II IFN-dependent and NF-κB-dependent signatures, matrisome activation and increased levels of circulating spike protein were detected in MIS-C, with no correlation with SARS-CoV-2 PCR status around the time of admission. Transient expansion of TRBV11-2 T cell clonotypes in MIS-C was associated with signatures of inflammation and T cell activation. The association of MIS-C with the combination of HLA A*02, B*35 and C*04 alleles suggests genetic susceptibility. MIS-C B cells showed higher mutation load than pCOVID-19 and pHC. These results identify distinct immunopathological signatures in pCOVID-19 and MIS-C that might help better define the pathophysiology of these disorders and guide therapy.

Multiple early factors anticipate post-acute COVID-19 sequelae

Post-acute sequelae of COVID-19 (PASC) represent an emerging global crisis. However, quantifiable risk factors for PASC and their biological associations are poorly resolved. We executed a deep multi-omic, longitudinal investigation of 309 COVID-19 patients from initial diagnosis to convalescence (2-3 months later), integrated with clinical data and patient-reported symptoms. We resolved four PASC-anticipating risk factors at the time of initial COVID-19 diagnosis: type 2 diabetes, SARS-CoV-2 RNAemia, Epstein-Barr virus viremia, and specific auto-antibodies. In patients with gastrointestinal PASC, SARS-CoV-2-specific and CMV-specific CD8+ T cells exhibited unique dynamics during recovery from COVID-19. Analysis of symptom-associated immunological signatures revealed coordinated immunity polarization into four endotypes, exhibiting divergent acute severity and PASC. We find that immunological associations between PASC factors diminish over time, leading to distinct convalescent immune states. Detectability of most PASC factors at COVID-19 diagnosis emphasizes the importance of early disease measurements for understanding emergent chronic conditions and suggests PASC treatment strategies.

144. Clinical Validation and Performance of a T-cell Immunosequencing Assay to Identify Past SARS-CoV-2 Infection

Background

Our understanding of the SARS-CoV-2 immune response has critical gaps that are inadequately addressed with available tools. We report the clinical performance of T-Detect COVID, the first T-cell assay to identify prior SARS-CoV-2 infection using T-cell receptor (TCR) sequencing and repertoire profiling from whole blood samples.

Methods

The T-Detect COVID assay combines high-throughput immunosequencing of the TCRß gene from blood samples with a statistical classifier demonstrating 99.8% specificity for identifying prior SARS-CoV-2 infection. The assay was employed in several retrospective and prospective cohorts to assess primary and secondary Positive Percent Agreement (PPA) with SARS-CoV-2 RT-PCR (N=205; N=77); primary and secondary Negative Percent Agreement (NPA; N=87; N=79); PPA compared to SARS-CoV-2 serology (N=55); and pathogen cross-reactivity (N=38). The real-world performance of the test was also evaluated in a retrospective review of test ordering (N=69) at a single primary care clinic in Park City, Utah.

Results

In validation studies, T-Detect COVID demonstrated high PPA (97.1% ≥15 days from diagnosis) in subjects with prior PCR-confirmed SARS-CoV-2 infection; high NPA (~100%) in SARS-CoV-2 negative cases; equivalent or higher PPA with RT-PCR compared to two commercial EUA antibody tests; and no evidence of pathogen cross-reactivity. Review of assay use in a single clinic showed 100% PPA with RT-PCR in individuals with past confirmed SARS-CoV-2 vs. 85.7% for antibody testing, 100% agreement with positive antibody results, and positive results in 2/4 convalescent subjects with seroreversion to a negative antibody. In addition, 12/69 (17.3%) individuals with absent or negative RT-PCR tested positive by T-Detect COVID, nearly all of whom had compatible symptoms and/or exposure. TCR positivity was observed up to 12+ months (median 118 days) from the date of positive RT-PCR.

Conclusion

A T-cell immunosequencing assay shows high clinical performance for identifying past SARS-CoV-2 infection from whole blood samples. This assay can provide additional insights on the SARS-CoV-2 immune response, with practical implications for clinical management, risk stratification, surveillance, assessing vaccine immunity, and understanding long-term sequelae.

Disclosures

Sudeb C. Dalai, MD, PhD, Adaptive Biotechnologies (Employee, Shareholder) Jennifer N. Dines, MD, Adaptive Biotechnologies (Employee, Shareholder) Thomas M. Snyder, PhD, Adaptive Biotechnologies (Employee, Shareholder) Rachel M. Gittelman, PhD, Adaptive Biotechnologies (Employee, Shareholder) Tera Eerkes, PhD, Adaptive Biotechnologies (Employee, Shareholder) Pashmi Vaney, PhD, Adaptive Biotechnologies (Employee, Shareholder) Sally Howard, PhD, Adaptive Biotechnologies (Employee, Shareholder) Kipp Akers, PhD, Adaptive Biotechnologies (Employee, Shareholder) Lynell Skewis, PhD, Adaptive Biotechnologies (Employee, Shareholder) Anthony Monteforte, PhD, Adaptive Biotechnologies (Employee, Shareholder) Pamela R. Witte, PhD, Adaptive Biotechnologies (Employee, Shareholder) Cristina Wolf, PhD, Adaptive Biotechnologies (Employee, Shareholder) Hans Nesse, PhD, Adaptive Biotechnologies (Employee, Shareholder) Jia Qadeer, PhD, Adaptive Biotechnologies (Employee, Shareholder) Sarah Duffy, PhD, Adaptive Biotechnologies (Employee, Shareholder) Emily Svejnoha, PhD, Adaptive Biotechnologies (Employee, Shareholder) Caroline Taromino, PhD, Adaptive Biotechnologies (Employee, Shareholder) Ian M. Kaplan, PhD, Adaptive Biotechnologies (Employee, Shareholder) John Alsobrook, MD, Adaptive Biotechnologies (Employee, Shareholder) Thomas Manley, MD, Adaptive Biotechnologies (Employee, Shareholder) Lance Baldo, MD, Adaptive Biotechnologies (Employee, Shareholder, Leadership Interest)

LB17. Immunosequencing of the T-Cell Receptor Repertoire Reveals Signatures Specific for Diagnosis and Characterization of Early Lyme Disease

Background

Changing climate and demographic trends have led to recent increases in the incidence of tick-borne illnesses. Early diagnosis of Lyme disease (LD) is critical for initiation of antibiotics to mitigate symptoms and prevent late manifestations. In patients not presenting with a typical erythema migrans rash, 2-tiered serologic testing is recommended to support a diagnosis of LD. However, 2-tiered testing is limited by ambiguity in interpretation and low sensitivity in early disease, highlighting an unmet clinical need for alternative diagnostic approaches. We identified a clinical signal for early LD based on evaluation of the T-cell response to B. burgdorferi infection.

Methods

We immunosequenced T-cell receptor (TCR) repertoires in blood samples from 3 independent cohorts of patients with laboratory-confirmed or clinically diagnosed early LD and endemic/non-endemic controls to identify 251 public, LD-associated TCRs. These TCRs were used to train a classifier that identified early LD with 99% specificity. Classifier sensitivity was evaluated in 211 LD cases and 2631 endemic controls and compared to that of standard 2-tiered testing (STTT). Biologic specificity was assessed by correlating TCR assay scores with clinical measures and by mapping the antigen specificity of Lyme-associated TCRs to B. burgdorferi antigens.

Figure 1. LD-associated TCRs distinguish cases (orange) from controls (blue) in training cohorts. (A) Logistic-growth curve used to define a scoring function. (B) Positive-call threshold (99th percentile in endemic controls).

Results

In early LD, TCR testing demonstrated a 1.9-fold increase in sensitivity compared to STTT (56% vs 30%), with a 3.1-fold increase ≤4 days from the onset of symptoms (44% vs 14%). TCR positivity predicted subsequent seroconversion in 37% of initially STTT-negative patients, suggesting the T-cell response is detectable before the humoral response. While positivity for both tests declined following treatment, greater declines in posttreatment sensitivity were observed for STTT compared to TCR testing. Higher TCR scores were associated with measures of disease severity, including abnormal liver function tests, disseminated rash, and number of symptoms. A subset of LD-associated TCRs mapped to B. burgdorferi antigens, demonstrating the high specificity of a TCR immunosequencing approach.

Figure 2. Validation of the TCR classifier in the JHU cohort and other holdout endemic controls. Distribution of model scores (A) and assay sensitivity (B). Model scores (C) and ROC (D) curves by serostatus.

Figure 3. Clinical correlates of TCR scoring. (A) Liver function test; (B) lymphocyte count, (C) rash presentation, (D) number of symptoms.

Conclusion

T-cell-based testing has potential clinical utility as a sensitive and specific diagnostic for early LD, particularly in the initial days of illness.

Disclosures

Sudeb C. Dalai, MD, PhD, Adaptive Biotechnologies (Employee, Shareholder) Julia Greissl, PhD, Microsoft (Employee, Shareholder) Mitch Pesesky, PhD, Adaptive Biotechnologies (Employee, Shareholder) Allison W. Rebman, MPH, Global Lyme Alliance (Research Grant or Support)Steven and Alexandra Cohen Foundation (Research Grant or Support) Mark J. Soloski, PhD, NIH grant P30 AR070254 (Grant/Research Support)Steven and Alexandra Cohen Foundation (Research Grant or Support) Elizabeth J. Horn, PhD, Adaptive Biotechnologies (Research Grant or Support)Bay Area Lyme Foundation (Research Grant or Support)Lyme Disease Biobank (Employee)Steven and Alexandra Cohen Foundation (Research Grant or Support) Jennifer N. Dines, MD, Adaptive Biotechnologies (Employee, Shareholder) Rachel M. Gittelman, PhD, Adaptive Biotechnologies (Employee, Shareholder) Thomas M. Snyder, PhD, Adaptive Biotechnologies (Employee, Shareholder) Ryan O. Emerson, PhD, Adaptive Biotechnologies (Other Financial or Material Support, Employment with Adaptive Biotechnologies during the time of this study) Edward Meeds, PhD, Microsoft (Employee, Shareholder) Thomas Manley, MD, Adaptive Biotechnologies (Other Financial or Material Support, Declares employment with Adaptive Biotechnologies during the time of this study) Ian M. Kaplan, PhD, Adaptive Biotechnologies (Employee, Shareholder) Lance Baldo, MD, Adaptive Biotechnologies (Employee, Shareholder, Leadership Interest) Jonathan M. Carlson, PhD, Microsoft (Employee, Shareholder) Harlan S. Robins, PhD, Adaptive Biotechnologies (Board Member, Employee, Shareholder) John Aucott, MD, Adaptive Biotechnologies (Advisor or Review Panel member)Bay Area Lyme Foundation (Other Financial or Material Support, Scientific Advisory Board member)Department of Health and Human Services (Other Financial or Material Support, Past Chair, 2018, HHS Tick-borne Disease Working Group, Office of HIV/AIDS and Infectious Disease Policy, Office of the Assistant Secretary of Health)Expert testimony (Other Financial or Material Support, Expert testimony)Global Lyme Alliance (Research Grant or Support)Pfizer (Consultant)Steven and Alexandra Cohen Foundation (Research Grant or Support)Tarsus Pharmaceuticals (Consultant)

126. Magnitude and Dynamics of the T-Cell Response to SARS-CoV-2 Infection and Vaccination

Background

T cells are central to the early identification and clearance of viral infections and support antibody generation by B cells, making them desirable for assessing the immune response to SARS-CoV-2 infection and vaccines. We combined 2 high-throughput immune profiling methods to create a quantitative picture of the SARS-CoV-2 T-cell response that is highly sensitive, durable, diagnostic, and discriminatory between natural infection and vaccination.

Methods

We deeply characterized 116 convalescent COVID-19 subjects by experimentally mapping CD8 and CD4 T-cell responses via antigen stimulation to 545 Human Leukocyte Antigen (HLA) class I and 284 class II viral peptides. We also performed T-cell receptor (TCR) repertoire sequencing on 1815 samples from 1521 PCR-confirmed SARS-CoV-2 cases and 3500 controls to identify shared public TCRs from SARS-CoV-2-associated CD8 and CD4 T cells. Combining these approaches with additional samples from vaccinated individuals, we characterized the response to natural infection as well as vaccination by separating responses to spike protein from other viral targets.

Results

We find that T-cell responses are often driven by a few immunodominant, HLA-restricted epitopes. As expected, the SARS-CoV-2 T-cell response peaks about 1-2 weeks after infection and is detectable at least several months after recovery. Applying these data, we trained a classifier to diagnose past SARS-CoV-2 infection based solely on TCR sequencing from blood samples and observed, at 99.8% specificity, high sensitivity soon after diagnosis (Day 3–7 = 85.1%; Day 8–14 = 94.8%) that persists after recovery (Day 29+/convalescent = 95.4%). Finally, by evaluating TCRs binding epitopes targeting all non-spike SARS-CoV-2 proteins, we were able to separate natural infection from vaccination with > 99% specificity.

Conclusion

TCR repertoire sequencing from whole blood reliably measures the adaptive immune response to SARS-CoV-2 soon after viral antigenic exposure (before antibodies are typically detectable) as well as at later time points, and distinguishes post-infection vs. vaccine immune responses with high specificity. This approach to characterizing the cellular immune response has applications in clinical diagnostics as well as vaccine development and monitoring.

Disclosures

Thomas M. Snyder, PhD, Adaptive Biotechnologies (Employee, Shareholder) Rachel M. Gittelman, PhD, Adaptive Biotechnologies (Employee, Shareholder) Mark Klinger, PhD, Adaptive Biotechnologies (Employee, Shareholder) Damon H. May, PhD, Adaptive Biotechnologies (Employee, Shareholder) Edward J. Osborne, PhD, Adaptive Biotechnologies (Employee, Shareholder) Ruth Taniguchi, PhD, Adaptive Biotechnologies (Employee, Shareholder) H. Jabran Zahid, PhD, Microsoft Research (Employee, Shareholder) Rebecca Elyanow, PhD, Adaptive Biotechnologies (Employee, Shareholder) Sudeb C. Dalai, MD, PhD, Adaptive Biotechnologies (Employee, Shareholder) Ian M. Kaplan, PhD, Adaptive Biotechnologies (Employee, Shareholder) Jennifer N. Dines, MD, Adaptive Biotechnologies (Employee, Shareholder) Matthew T. Noakes, PhD, Adaptive Biotechnologies (Employee, Shareholder) Ravi Pandya, PhD, Microsoft Research (Employee, Shareholder) Lance Baldo, MD, Adaptive Biotechnologies (Employee, Shareholder, Leadership Interest) James R. Heath, PhD, Merck (Research Grant or Support, Funding (from BARDA) for the ISB INCOV project, but had no role in planning the research or in writing the paper.) Joaquin Martinez-Lopez, MD, PhD, Adaptive Biotechnologies (Consultant) Jonathan M. Carlson, PhD, Microsoft Research (Employee, Shareholder) Harlan S. Robins, PhD, Adaptive Biotechnologies (Board Member, Employee, Shareholder)

Distinct populations of antigen-specific tissue-resident CD8+ T cells in human cervix mucosa

The ectocervix is part of the lower female reproductive tract (FRT), which is susceptible to sexually transmitted infections (STIs). Comprehensive knowledge of the phenotypes and T cell receptor (TCR) repertoire of tissue-resident memory T cells (TRMs) in the human FRT is lacking. We took single-cell RNA-Seq approaches to simultaneously define gene expression and TCR clonotypes of the human ectocervix. There were significantly more CD8+ than CD4+ T cells. Unsupervised clustering and trajectory analysis identified distinct populations of CD8+ T cells with IFNGhiGZMBloCD69hiCD103lo or IFNGloGZMBhiCD69medCD103hi phenotypes. Little overlap was seen between their TCR repertoires. Immunofluorescence staining showed that CD103+CD8+ TRMs were preferentially localized in the epithelium, whereas CD69+CD8+ TRMs were distributed evenly in the epithelium and stroma. Ex vivo assays indicated that up to 14% of cervical CD8+ TRM clonotypes were HSV-2 reactive in HSV-2-seropositive persons, reflecting physiologically relevant localization. Our studies identified subgroups of CD8+ TRMs in the human ectocervix that exhibited distinct expression of antiviral defense and tissue residency markers, anatomic locations, and TCR repertoires that target anatomically relevant viral antigens. Optimization of the location, number, and function of FRT TRMs is an important approach for improving host defenses to STIs.

T-cell receptor sequencing identifies prior SARS-CoV-2 infection and correlates with neutralizing antibody titers and disease severity

Measuring the adaptive immune response to SARS-CoV-2 can enable the assessment of past infection as well as protective immunity and the risk of reinfection. While neutralizing antibody (nAb) titers are one measure of protection, such assays are challenging to perform at a large scale and the longevity of the SARS-CoV-2 nAb response is not fully understood. Here, we apply a T-cell receptor (TCR) sequencing assay that can be performed on a small volume standard blood sample to assess the adaptive T-cell response to SARS-CoV-2 infection. Samples were collected from a cohort of 302 individuals recovered from COVID-19 up to 6 months after infection. Previously published findings in this cohort showed that two commercially available SARS-CoV-2 serologic assays correlate well with nAb testing. We demonstrate that the magnitude of the SARS-CoV-2-specific T-cell response strongly correlates with nAb titer, as well as clinical indicators of disease severity including hospitalization, fever, or difficulty breathing. While the depth and breadth of the T-cell response declines during convalescence, the T-cell signal remains well above background with high sensitivity up to at least 6 months following initial infection. Compared to serology tests detecting binding antibodies to SARS-CoV-2 spike and nucleoprotein, the overall sensitivity of the TCR-based assay across the entire cohort and all timepoints was approximately 5% greater for identifying prior SARS-CoV-2 infection. Notably, the improved performance of T-cell testing compared to serology was most apparent in recovered individuals who were not hospitalized and were sampled beyond 150 days of their initial illness, suggesting that antibody testing may have reduced sensitivity in individuals who experienced less severe COVID-19 illness and at later timepoints. Finally, T-cell testing was able to identify SARS-CoV-2 infection in 68% (55/81) of convalescent samples having nAb titers below the lower limit of detection, as well as 37% (13/35) of samples testing negative by all three antibody assays. These results demonstrate the utility of a TCR-based assay as a scalable, reliable measure of past SARS-CoV-2 infection across a spectrum of disease severity. Additionally, the TCR repertoire may be useful as a surrogate for protective immunity with additive clinical value beyond serologic or nAb testing methods.

Magnitude and Dynamics of the T-Cell Response to SARS-CoV-2 Infection at Both Individual and Population Levels

T cells are involved in the early identification and clearance of viral infections and also support the development of antibodies by B cells. This central role for T cells makes them a desirable target for assessing the immune response to SARS-CoV-2 infection. Here, we combined two high-throughput immune profiling methods to create a quantitative picture of the T-cell response to SARS-CoV-2. First, at the individual level, we deeply characterized 3 acutely infected and 58 recovered COVID-19 subjects by experimentally mapping their CD8 T-cell response through antigen stimulation to 545 Human Leukocyte Antigen (HLA) class I presented viral peptides (class II data in a forthcoming study). Then, at the population level, we performed T-cell repertoire sequencing on 1,815 samples (from 1,521 COVID-19 subjects) as well as 3,500 controls to identify shared "public" T-cell receptors (TCRs) associated with SARS-CoV-2 infection from both CD8 and CD4 T cells. Collectively, our data reveal that CD8 T-cell responses are often driven by a few immunodominant, HLA-restricted epitopes. As expected, the T-cell response to SARS-CoV-2 peaks about one to two weeks after infection and is detectable for at least several months after recovery. As an application of these data, we trained a classifier to diagnose SARS-CoV-2 infection based solely on TCR sequencing from blood samples, and observed, at 99.8% specificity, high early sensitivity soon after diagnosis (Day 3-7 = 85.1% [95% CI = 79.9-89.7]; Day 8-14 = 94.8% [90.7-98.4]) as well as lasting sensitivity after recovery (Day 29+/convalescent = 95.4% [92.1-98.3]). These results demonstrate an approach to reliably assess the adaptive immune response both soon after viral antigenic exposure (before antibodies are typically detectable) as well as at later time points. This blood-based molecular approach to characterizing the cellular immune response has applications in clinical diagnostics as well as in vaccine development and monitoring.

A large-scale database of T-cell receptor beta (TCRβ) sequences and binding associations from natural and synthetic exposure to SARS-CoV-2

We describe the establishment and current content of the ImmuneCODE™ database, which includes hundreds of millions of T-cell Receptor (TCR) sequences from over 1,400 subjects exposed to or infected with the SARS-CoV-2 virus, as well as over 135,000 high-confidence SARS-CoV-2-specific TCRs. This database is made freely available, and the data contained in it can be downloaded and analyzed online or offline to assist with the global efforts to understand the immune response to the SARS-CoV-2 virus and develop new interventions.

CANDI: an R package and Shiny app for annotating radiographs and evaluating computer-aided diagnosis

Motivation

Radiologists have used algorithms for Computer-Aided Diagnosis (CAD) for decades. These algorithms use machine learning with engineered features, and there have been mixed findings on whether they improve radiologists’ interpretations. Deep learning offers superior performance but requires more training data and has not been evaluated in joint algorithm-radiologist decision systems.

Results

We developed the Computer-Aided Note and Diagnosis Interface (CANDI) for collaboratively annotating radiographs and evaluating how algorithms alter human interpretation. The annotation app collects classification, segmentation, and image captioning training data, and the evaluation app randomizes the availability of CAD tools to facilitate clinical trials on radiologist enhancement.

Availability and implementation

Demonstrations and source code are hosted at (https://candi.nextgenhealthcare.org), and (https://github.com/mbadge/candi), respectively, under GPL-3 license.

Supplementary information

Supplementary material is available at Bioinformatics online.

Deep learning predicts hip fracture using confounding patient and healthcare variables

Hip fractures are a leading cause of death and disability among older adults. Hip fractures are also the most commonly missed diagnosis on pelvic radiographs, and delayed diagnosis leads to higher cost and worse outcomes. Computer-aided diagnosis (CAD) algorithms have shown promise for helping radiologists detect fractures, but the image features underpinning their predictions are notoriously difficult to understand. In this study, we trained deep-learning models on 17,587 radiographs to classify fracture, 5 patient traits, and 14 hospital process variables. All 20 variables could be individually predicted from a radiograph, with the best performances on scanner model (AUC = 1.00), scanner brand (AUC = 0.98), and whether the order was marked "priority" (AUC = 0.79). Fracture was predicted moderately well from the image (AUC = 0.78) and better when combining image features with patient data (AUC = 0.86, DeLong paired AUC comparison, p = 2e-9) or patient data plus hospital process features (AUC = 0.91, p = 1e-21). Fracture prediction on a test set that balanced fracture risk across patient variables was significantly lower than a random test set (AUC = 0.67, DeLong unpaired AUC comparison, p = 0.003); and on a test set with fracture risk balanced across patient and hospital process variables, the model performed randomly (AUC = 0.52, 95% CI 0.46-0.58), indicating that these variables were the main source of the model's fracture predictions. A single model that directly combines image features, patient, and hospital process data outperforms a Naive Bayes ensemble of an image-only model prediction, patient, and hospital process data. If CAD algorithms are inexplicably leveraging patient and process variables in their predictions, it is unclear how radiologists should interpret their predictions in the context of other known patient data. Further research is needed to illuminate deep-learning decision processes so that computers and clinicians can effectively cooperate.

A Public Database of Memory and Naive B-Cell Receptor Sequences

The vast diversity of B-cell receptors (BCR) and secreted antibodies enables the recognition of, and response to, a wide range of epitopes, but this diversity has also limited our understanding of humoral immunity. We present a public database of more than 37 million unique BCR sequences from three healthy adult donors that is many fold deeper than any existing resource, together with a set of online tools designed to facilitate the visualization and analysis of the annotated data. We estimate the clonal diversity of the naive and memory B-cell repertoires of healthy individuals, and provide a set of examples that illustrate the utility of the database, including several views of the basic properties of immunoglobulin heavy chain sequences, such as rearrangement length, subunit usage, and somatic hypermutation positions and dynamics.

Circulating cell-free DNA enables noninvasive diagnosis of heart transplant rejection

Monitoring allograft health is an important component of posttransplant therapy. Endomyocardial biopsy is the current gold standard for cardiac allograft monitoring but is an expensive and invasive procedure. Proof of principle of a universal, noninvasive diagnostic method based on high-throughput screening of circulating cell-free donor-derived DNA (cfdDNA) was recently demonstrated in a small retrospective cohort. We present the results of a prospective cohort study (65 patients, 565 samples) that tested the utility of cfdDNA in measuring acute rejection after heart transplantation. Circulating cell-free DNA was purified from plasma and sequenced (mean depth, 1.2 giga-base pairs) to quantify the fraction of cfdDNA. Through a comparison with endomyocardial biopsy results, we demonstrate that cfdDNA enables diagnosis of acute rejection after heart transplantation, with an area under the receiver operating characteristic curve of 0.83 and sensitivity and specificity that are comparable to the intrinsic performance of the biopsy itself. This noninvasive genome transplant dynamics approach is a powerful and informative method for routine monitoring of allograft health without incurring the risk, discomfort, and expense of an invasive biopsy.

Temporal response of the human virome to immunosuppression and antiviral therapy

There are few substantive methods to measure the health of the immune system, and the connection between immune strength and the viral component of the microbiome is poorly understood. Organ transplant recipients are treated with posttransplant therapies that combine immunosuppressive and antiviral drugs, offering a window into the effects of immune modulation on the virome. We used sequencing of cell-free DNA in plasma to investigate drug-virome interactions in a cohort of organ transplant recipients (656 samples, 96 patients) and find that antivirals and immunosuppressants strongly affect the structure of the virome in plasma. We observe marked virome compositional dynamics at the onset of the therapy and find that the total viral load increases with immunosuppression, whereas the bacterial component of the microbiome remains largely unaffected. The data provide insight into the relationship between the human virome, the state of the immune system, and the effects of pharmacological treatment and offer a potential application of the virome state to predict immunocompetence.

Feasibility of computerized adaptive testing for collection of patient-reported outcomes after inpatient rehabilitation

OBJECTIVE

To evaluate the feasibility of computer adaptive testing (CAT) using an Internet or telephone interface to collect patient-reported outcomes after inpatient rehabilitation and to examine patient characteristics associated with completion of the CAT-administered measure and mode of administration.

DESIGN

Prospective cohort study of patients contacted approximately 4 weeks after discharge from inpatient rehabilitation. Patients selected an Internet or telephone interface.

SETTING

Rehabilitation hospital.

PARTICIPANTS

Patients (N=674) with diagnoses of neurologic, orthopedic, or medically complex conditions.

INTERVENTIONS

None.

MAIN OUTCOME MEASURE

CAT version of the Community Participation Indicators (CAT-CPI).

RESULTS

From an eligible pool of 3221 patients, 674 (21%) agreed to complete the CAT-CPI. Patients who agreed to complete the CAT-CPI were younger and reported slightly higher satisfaction with overall care than those who did not participate. Among these patients, 231 (34%) actually completed the CAT-CPI; 141 (61%) selected telephone administration, and 90 (39%) selected Internet administration. Decreased odds of completing the CAT-CPI were associated with black and other race; stroke, brain injury, or orthopedic and other impairments; and being a Medicaid beneficiary, whereas increased odds of completing the CAT-CPI were associated with longer length of stay and higher discharge FIM cognition measure. Decreased odds of choosing Internet administration were associated with younger age, retirement status, and being a woman, whereas increased odds of choosing Internet administration were associated with higher discharge FIM motor measure.

CONCLUSIONS

CAT administration by Internet and telephone has limited feasibility for collecting postrehabilitation outcomes for most rehabilitation patients, but it is feasible for a subset of patients. Providing alternative ways of answering questions helps assure that a larger proportion of patients will respond.

Clonal evolution of preleukemic hematopoietic stem cells precedes human acute myeloid leukemia

Given that most bone marrow cells are short-lived, the accumulation of multiple leukemogenic mutations in a single clonal lineage has been difficult to explain. We propose that serial acquisition of mutations occurs in self-renewing hematopoietic stem cells (HSCs). We investigated this model through genomic analysis of HSCs from six patients with de novo acute myeloid leukemia (AML). Using exome sequencing, we identified mutations present in individual AML patients harboring the FLT3-ITD (internal tandem duplication) mutation. We then screened the residual HSCs and detected some of these mutations including mutations in the NPM1, TET2, and SMC1A genes. Finally, through single-cell analysis, we determined that a clonal progression of multiple mutations occurred in the HSCs of some AML patients. These preleukemic HSCs suggest the clonal evolution of AML genomes from founder mutations, revealing a potential mechanism contributing to relapse. Such preleukemic HSCs may constitute a cellular reservoir that should be targeted therapeutically for more durable remissions.

Abstract 3303: Clonal evolution of pre-leukemic hematopoietic stem cells precedes human acute myeloid leukemia

Acute myeloid leukemia (AML) is an aggressive malignancy of hematopoietic progenitors with poor clinical outcomes. Despite the power of next-generation DNA sequencing to describe AML genomes and to identify recurrent mutations, our fundamental understanding of the genomics of leukemogenesis is incomplete. Founder mutations in the majority of AML cases are unknown because pre-leukemic cells are clinically silent and are outcompeted by their malignant descendants. Our limited knowledge of founder mutations comes from infrequent cases of AML arising secondary to antecedent clonal bone marrow disorders or rare instances of inherited syndromes. Importantly, recent advances in AML stem cell biology now enable the prospective separation of residual non-leukemic hematopoietic stem cells (HSC) from AML cells. We previously showed that non-leukemic HSC contain clonal antecedents of AML in patients in long-term remission post-therapy, and have proposed a model in which serial acquisition of mutations occurs in self-renewing HSC. Here, we investigated this model and the nature of founder mutations through the genomic analysis of de novo AML and patient-matched residual non-leukemic HSC. Using exome sequencing, we identified mutations present in eight individual AML genomes (mean 10 mutations per patient) and screened for them in the residual HSC. We identified several mutations present in residual HSC that retained normal multilineage differentiation in vivo. These putative “early” mutations detected in residual HSC include NPM1c, mutations in TET2, and novel AML mutations in genes involving the cell cycle and mRNA biogenesis. Putative “late” mutations absent from residual HSC and only found in leukemic cells include FLT3 ITD and IDH1 R132H. Finally, through single cell analysis, we determined that as we hypothesized, a clonal progression of multiple mutations occurs in non-leukemic HSC. Quantitative genetic analyses of the HSC compartment enabled us to reconstruct the subclonal architecture of normal and pre-leukemic stem cells. Consistent with mouse models, pre-leukemic HSC with TET2 mutations outcompeted their normal counterparts. However, in most cases, normal HSC were 6-50 times more numerous than pre-leukemic HSC. In two cases where sequential populations of pre-leukemic HSC were identified, the less mutated pre-leukemic HSC population was 10-25 times more numerous than its more mutated descendent. This result contrasts with the classical model of a linear succession of dominant pre-leukemic subclones. These pre-leukemic HSC reveal the clonal evolution of AML genomes from founder mutations, suggest a potential mechanism contributing to relapse, and constitute a cellular reservoir that may need to be targeted for more durable remissions.

Citation Format: {Authors}. {Abstract title} [abstract]. In: Proceedings of the 103rd Annual Meeting of the American Association for Cancer Research; 2012 Mar 31-Apr 4; Chicago, IL. Philadelphia (PA): AACR; Cancer Res 2012;72(8 Suppl):Abstract nr 3303. doi:1538-7445.AM2012-3303

Enhanced functional potential of nucleic acid aptamer libraries patterned to increase secondary structure

The in vitro selection of nucleic acid libraries has driven the discovery of RNA and DNA receptors (aptamers) and catalysts with tailor-made functional properties. Functional nucleic acids emerging from selections have been observed to possess an unusually high degree of secondary structure. In this study, we experimentally examined the relationship between the degree of secondary structure in a nucleic acid library and its ability to yield aptamers that bind protein targets. We designed a patterned nucleic acid library (denoted R*Y*) to enhance the formation of stem-loop structures without imposing any specific sequence or secondary structural requirement. This patterned library was predicted computationally to contain a significantly higher average folding energy compared to a standard, unpatterned N(60) library of the same length. We performed three different iterated selections for protein binding using patterned and unpatterned libraries competing in the same solution. In all three cases, the patterned R*Y* library was enriched relative to the unpatterned library over the course of the 9- to 10-round selection. Characterization of individual aptamer clones emerging from the three selections revealed that the highest affinity aptamer assayed arose from the patterned library for two protein targets, while in the third case, the highest affinity aptamers from the patterned and random libraries exhibited comparable affinity. We identified the binding motif requirements for the most active aptamers generated against two of the targets. The two binding motifs are 3.4- and 27-fold more likely to occur in the R*Y* library than in the N(60) library. Collectively, our findings suggest that researchers performing selections for nucleic acid aptamers and catalysts should consider patterned libraries rather than commonly used N(m) libraries to increase both the likelihood of isolating functional molecules and the potential activities of the resulting molecules.

A microfluidic oligonucleotide synthesizer

De novo gene and genome synthesis enables the design of any sequence without the requirement of a pre-existing template as in traditional genetic engineering methods. The ability to mass produce synthetic genes holds great potential for biological research, but widespread availability of de novo DNA constructs is currently hampered by their high cost. In this work, we describe a microfluidic platform for parallel solid phase synthesis of oligonucleotides that can greatly reduce the cost of gene synthesis by reducing reagent consumption (by 100-fold) while maintaining a ∼100 pmol synthesis scale so there is no need for amplification before assembly. Sixteen oligonucleotides were synthesized in parallel on this platform and then successfully used in a ligation-mediated assembly method to generate DNA constructs ∼200 bp in length.

Translation of DNA into a library of 13,000 synthetic small-molecule macrocycles suitable for in vitro selection

DNA-templated organic synthesis enables the translation, selection, and amplification of DNA sequences encoding synthetic small-molecule libraries. Previously we described the DNA-templated multistep synthesis and model in vitro selection of a pilot library of 65 macrocycles. In this work, we report several key developments that enable the DNA-templated synthesis of much larger (>10,000-membered) small-molecule libraries. We developed and validated a capping-based approach to DNA-templated library synthesis that increases final product yields, simplifies the structure and preparation of reagents, and reduces the number of required manipulations. To expand the size and structural diversity of the macrocycle library, we augmented the number of building blocks in each DNA-templated step from 4 to 12, selected 8 different starting scaffolds which result in 4 macrocycle ring sizes and 2 building-block orientations, and confirmed the ability of the 36 building blocks and 8 scaffolds to generate DNA-templated macrocycle products. We computationally generated and experimentally validated an expanded set of codons sufficient to support 1728 combinations of step 1, step 2, and step 3 building blocks. Finally, we developed new high-resolution LC/MS analysis methods to assess the quality of large DNA-templated small-molecule libraries. Integrating these four developments, we executed the translation of 13,824 DNA templates into their corresponding small-molecule macrocycles. Analysis of the resulting libraries is consistent with excellent (>90%) representation of desired macrocycle products and a stringent test of sequence specificity suggests a high degree of sequence fidelity during translation. The quality and structural diversity of this expanded DNA-templated library provides a rich starting point for the discovery of functional synthetic small-molecule macrocycles.

Effects of template sequence and secondary structure on DNA-templated reactivity

DNA-templated organic synthesis enables the translation, selection, and amplification of DNA sequences encoding synthetic small-molecule libraries. As the size of DNA-templated libraries increases, the possibility of forming intramolecularly base-paired structures within templates that impede templated reactions increases as well. To achieve uniform reactivity across many template sequences and to computationally predict and remove any problematic sequences from DNA-templated libraries, we have systematically examined the effects of template sequence and secondary structure on DNA-templated reactivity. By testing a series of template sequences computationally designed to contain different degrees of internal secondary structure, we observed that high levels of predicted secondary structure involving the reagent binding site within a DNA template interfere with reagent hybridization and impair reactivity, as expected. Unexpectedly, we also discovered that templates containing virtually no predicted internal secondary structure also exhibit poor reaction efficiencies. Further studies revealed that a modest degree of internal secondary structure is required to maximize effective molarities between reactants, possibly by compacting intervening template nucleotides that separate the hybridized reactants. Therefore, ideal sequences for DNA-templated synthesis lie between two undesirable extremes of too much or too little internal secondary structure. The relationship between effective molarity and intervening nucleic acid secondary structure described in this work may also apply to nucleic acid sequences in living systems that separate interacting biological molecules.

DNA-templated functional group transformations enable sequence-programmed synthesis using small-molecule reagents

DNA-templated organic synthesis (DTS) has previously been used primarily to direct coupling reactions between two DNA-linked reactants. In some cases, reactants are difficult or impossible to tether to DNA oligonucleotides. The development of strategies that enable non-DNA linked small-molecule reagents to participate in sequence-programmed synthesis therefore would significantly expand the capabilities of DTS. We developed efficient DNA-templated functional group transformations of template-linked azides into corresponding amines, carboxylic acids, and thiols. The application of these reactions to a single-solution mixture of four template-linked organic azides enabled each azide to be transformed sequence specifically into a sulfonamide, carbamate, urea, or thiourea using small-molecule sulfonyl chloride, chloroformate, isocyanate, or isothiocyanate reagents not tethered to DNA. Only the four desired products were observed, without formation of any of the 12 possible undesired cross-products. Our results represent a new approach to small molecule diversification in a DNA-programmed manner.

Reaction discovery enabled by DNA-templated synthesis and in vitro selection

Current approaches to reaction discovery focus on one particular transformation. Typically, researchers choose substrates based on their predicted ability to serve as precursors for the target structure, then evaluate reaction conditions for their ability to effect product formation. This approach is ideal for addressing specific reactivity problems, but its focused nature might leave many areas of chemical reactivity unexplored. Here we report a reaction discovery approach that uses DNA-templated organic synthesis and in vitro selection to simultaneously evaluate many combinations of different substrates for bond-forming reactions in a single solution. Watson-Crick base pairing controls the effective molarities of substrates tethered to DNA strands; bond-forming substrate combinations are then revealed using in vitro selection for bond formation, PCR amplification and DNA microarray analysis. Using this approach, we discovered an efficient and mild carbon-carbon bond-forming reaction that generates an enone from an alkyne and alkene using an inorganic palladium catalyst. Although this approach is restricted to conditions and catalysts that are at least partially compatible with DNA, we expect that its versatility and efficiency will enable the discovery of additional reactions between a wide range of substrates.

Reversible association of telechelic molecules: an application of graph theory

We develop a method for calculating the exact free energy of tree clusters formed from associating telechelic molecules. The method uses the concept of rooted trees from the graph theory to enumerate all topologically distinct trees having a maximum degree of branching; it recursively separates the trees into different classes based on their connectivity, thus enabling the exact summation of the trees weighted by their respective Boltzmann factors. We apply our method to studying the pregel properties in pure telechelic solutions and in mixed telechelic and single-associating-end polymer solutions. We highlight the effect of energetic tendency for branching in the former and the effect of competitive association in the latter.

DNA-templated organic synthesis and selection of a library of macrocycles

The translation of nucleic acid libraries into corresponding synthetic compounds would enable selection and amplification principles to be applied to man-made molecules. We used multistep DNA-templated organic synthesis to translate libraries of DNA sequences, each containing three "codons," into libraries of sequence-programmed synthetic small-molecule macrocycles. The resulting DNA-macrocycle conjugates were subjected to in vitro selections for protein affinity. The identity of a single macrocycle possessing known target protein affinity was inferred through the sequence of the amplified DNA template surviving the selection. This work represents the translation, selection, and amplification of libraries of nucleic acids encoding synthetic small molecules rather than biological macromolecules.

Highly Sensitive in Vitro Selections for DNA-Linked Synthetic Small Molecules with Protein Binding Affinity and Specificity

We have developed in vitro selections for DNA-linked synthetic small molecules with protein binding affinity and specificity. These selections require only generally accessible equipment, offer high degrees of enrichment of active molecules from mixtures of predominantly inactive species, can be applied to a variety of unrelated proteins, and require approximately 108-fold less material than existing synthetic molecule screening methods. Iterating these selections multiplies the net enrichment of active molecules, enabling enormous overall enrichment factors exceeding 106 to be achieved. Further, the selections can be adapted to select for binding specificity in addition to binding affinity. The application of methods described in this work may play a key role in the discovery of desired molecules from DNA-templated synthetic libraries.

Successful treatment of familial idiopathic lipid storage myopathy with L-carnitine and modified lipid diet

We describe the clinical presentation, course, pathologic findings, and biochemical abnormalities found in three adult siblings with an idiopathic lipid storage myopathy. The major presenting symptoms were weakness and cramping, which were profound in one patient, moderate in the second patient, and mild in the third. All three individuals exhibited true myotonic discharges on EMG, normal or mildly depressed muscle free carnitine levels, and borderline delayed ketosis (40 hours) with fasting. Muscle biopsies from all three showed neutral lipid storage. Polymorphonuclear leukocytes and macrophages were vacuolated. No systemic abnormalities of glucose or fat metabolism were identified at rest, with fasting, or with exercise. The two more severely affected patients have responded to medium-chain triglyceride diet and oral carnitine with increased strength and muscle bulk and decreased histochemically observed neutral lipid stores in muscle. One patient has had a resolution of the electrical myotonia. Prednisone therapy in one patient resulted in a loss of cramping sensations but not improvement in strength. We suggest that some cases of idiopathic lipid storage myopathy may be safely and effectively treated with carnitine and medium-chain triglyceride diet.

Spinal subdural hematoma: case report and review of the literature

A case of lumbar spinal subdural hematoma in a patient who had been on anticoagulant therapy is reported. Thus far 19 cases of spinal subdural hematoma have been reported in the literature, the majority in patients with a bleeding diathesis and after a lumbar puncture. Our case is the third reported to be in association with anticoagulant therapy. The hematoma was lumbosacral, in contrast to the usual location in the dorsal-lumbar area. A possible mechanism for the production of spinal subdural hematoma after a lumbar puncture is discussed. An early decompressive laminectomy and evacuation of the hematoma is the recommended treatment to obtain the best possible recovery of neurological function. (Neurosurgery, 5: 614--616, 1979).