Dietary patterns, cost and compliance with low-protein diet of phenylketonuria and other inherited metabolic diseases

Parental and child's psychosocial and financial burden living with an inherited metabolic disease identified by newborn screening

Newborn screening (NBS) is one of the most effective measures of secondary prevention. While the benefit of NBS on the clinical long-term outcomes of children with inherited metabolic diseases (IMD) has been demonstrated, the potential burden of families living with an early diagnosed and treated child with an IMD has not been thoroughly investigated. The aim of this longitudinal questionnaire-based study on 369 families living with a child with an IMD was to investigate the psychosocial and financial burden following a true-positive NBS. The reported psychosocial burden differed between children and their parents, and was associated with the child's age, diagnosis, and treatment. At younger ages, parent-reported burden was higher for the parents than for the individual child, while it increased for children and decreased for parents as the child grew older. Furthermore, psychosocial burden increased if the child required a strict dietary treatment and was at risk of metabolic decompensation. Regardless of diagnosis and treatment, the developmental delay of their child independently increased the parental psychosocial burden. Financial burden was reported by 24% of all families, and was higher in low-income families and in families whose children required dietary treatment. In conclusion, a substantial psychosocial and financial burden was revealed for children and their families after true-positive NBS. Since this burden is likely to have a negative impact on the long-term individual health benefits of NBS, this study underlines the importance of regularly assessing the psychosocial and financial needs of these families.

Comparison of Cost Analysis in Patients with Tetrahydrobiopterin-Responsive and Non-Responsive Phenylketonuria in Turkey

Phenylketonuria is an inherited metabolic disorder that leads to neurobehavioral dysfunction. The main treatment is a low-phenylalanine diet and/or the cofactor tetrahydrobiopterin. Regular outpatient follow-up care and measurement of the phenylalanine levels in the blood are required. We aimed to analyze the economic burden of phenylketonuria on families and the state. The patients with phenylketonuria were divided into three groups according to their treatment: a low-phenylalanine diet group (n = 50), a tetrahydrobiopterin group (n = 44), and a group taking tetrahydrobiopterin together with the diet (n = 25). A comparative cost analysis was carried out. The annual economic burden to the state was calculated to average EUR 18,801 ± 15,345 and was lowest in the diet group, then in the tetrahydrobiopterin group, and highest in the tetrahydrobiopterin + diet group (p < 0.001). Out-of-pocket costs amounted to EUR 1531 ± 1173 per year, and indirect losses averaged EUR 2125 ± 1930 per year for all families. The economic loss was significantly lower in the families taking tetrahydrobiopterin than in the other groups (p = 0.001). The combined use of medical nutrition and BH4 treatments has been shown to increase the economic burden on the state. Reimbursing low-protein products and increasing the number of patients eligible for financial allowances may reduce the economic burden on families.

Production of low-protein cocoa powder with enzyme-assisted hydrolysis

Amino acid-related disorders are caused by a defect in the metabolic pathways of amino acid groups. These patients must follow a lifelong protein diet. The objective of this study was to produce a low-protein cocoa powder (LPP) with enzymatic hydrolysis and precipitation method. First, the solubility of cocoa powder was increased by heat and enzyme treatments (Amylase, Viscozyme, and Alcalase). Then, the protein level was decreased by isoelectric precipitation. According to the obtained results, the solubility of cocoa powder rose from 28.61% to 50.69%. Protein content decreased by almost 40% and significant reductions in the amino acid profile were also provided; the highest ones were detected in methionine (100%), lysine (73.65%), leucine (53.64%), alanine (46.17%), and isoleucine (44.73%) levels. LPP had high phenolic content (25.10 mg/g GAE) and the changes in the antioxidant activities were not significant (p > .05). Moreover, chocolate production with LPP and control powder was also carried out under laboratory conditions. Hardness (1732.52 g), moisture content (0.60%), and water activity (0.37) of chocolate samples produced with low-protein cocoa powder (LPC) were lower than those of the control sample. The Casson model well fitted to the rheological data (R 2 > .990) and chocolate samples showed elastic behavior. The removal of proteins from the cocoa was verified with Fourier transform infrared spectroscopy analyses. The melting temperatures of chocolates (31.84 and 31.54°C for control and LPC samples, respectively) did not change with the applied process. As a conclusion, it was revealed that the production of low-protein cocoa powder and chocolate is feasible for patients with amino acid disorders with this study.

Methods used to account for caregivers' sex and gender within studies examining the financial burden of caregivers of children and adolescents : Results from a scoping review

Background

Interest in the financial burden of informal caregivers has been growing. Unfortunately, it remains unclear which method(s) should be used when quantifying this burden.

Purpose

We conducted a scoping review aimed at identifying which methods have been used to conduct such work and quantified their performance. We were also interested in examining how sex and gender considerations were considered within selected studies.

Data Sources

Using a standardized approach, we identified studies published between 2012 and 2022 that aimed to document the financial burden of caregivers to child and adolescent patients. Our search strategy was applied to the MEDLINE, Embase, CINHAL, and Academic Search Premier databases.

Study Selection

Manuscript selection was performed by pairs of reviewers.

Data Extraction

Data extraction was performed by one reviewer with a second reviewer performing quality control. Results were reported using a narrative approach.

Data Synthesis

We identified 9801 unique citations, of which 200 were included in our review. Selected studies covered various disease area (eg, infection/parasitic diseases [n = 31, 16%]) and included quantitative (n = 180, 90%), qualitative (n = 4, 2%) and mixed study designs (n = 16, 8%). Most studies (n = 182, 91%) used questionnaires/surveys, either alone or in combination with other methods, to assess caregivers' financial burden. Less than half (n = 93, 47%) of studies reported on caregivers' sex and none reported on their gender.

Conclusion

We conducted an unrestricted review of published studies examining caregiver's financial burden which allowed us to identify general methodological trends observed in this literature. We believe this work may help improve future studies focusing on this important issue.

Food or medicine? A European regulatory perspective on nutritional therapy products to treat inborn errors of metabolism

Dietary or nutritional management strategies are the cornerstone of treatment for many inborn errors of metabolism (IEMs). Though a vital part of standard of care, the products prescribed for this are often not formally registered as medication. Instead, they are regulated as food or as food supplements, impacting the level of oversight as well as reimbursed policies. This scoping literature review explores the European regulatory framework relevant to these products and its implications for current clinical practice. Searches of electronic databases (PubMed, InfoCuria) were carried out, supplemented by articles identified by experts, from reference lists, relevant guidelines and case-law by the European Court of Justice. In the European Union (EU), nutritional therapy products are regulated as food supplements, food for special medical purposes (FSMPs) or medication. The requirements and level of oversight increase for each of these categories. Relying on lesser-regulated food products to treat IEMs raises concerns regarding product quality, safety, reimbursement and patient access. In order to ascertain whether a nutritional therapy product functions as medication and thus could be classified as such, we developed a flowchart to assess treatment characteristics (benefit, pharmacological attributes, and safety) with a case-based approach. Evaluating nutritional therapy products might reveal a justifiable need for a pharmaceutical product. A flowchart can facilitate systematically distinguishing products that function medication-like in the management of IEMs. Subsequently, finding and implementing appropriate solutions for these products might help improve the quality, safety and accessibility including reimbursement of treatment for IEMs.

Expert Consensus on the Long-Term Effectiveness of Medical Nutrition Therapy and Its Impact on the Outcomes of Adults with Phenylketonuria

Many adults with phenylketonuria (PKU) rely on medical nutrition therapy (MNT; low phenylalanine (Phe) diet with protein substitutes/medical foods) to maintain blood Phe concentrations within recommended ranges and prevent PKU-associated comorbidities. Despite disease detection through newborn screening and introduction of MNT as early as birth, adherence to MNT often deteriorates from childhood onwards, complicating the assessment of its effectiveness in the long term. Via a modified Delphi process, consensus (≥70% agreement) was sought on 19 statements among an international, multidisciplinary 13-member expert panel. After three iterative voting rounds, the panel achieved consensus on 17 statements related to the limitations of the long-term effectiveness of MNT (7), the burden of long-term reliance on MNT (4), and its potential long-term detrimental health effects (6). According to the expert panel, the effectiveness of MNT is limited in the long term, is associated with a high treatment burden, and demonstrates that adults with PKU are often unable to achieve metabolic control through dietary management alone, creating an unmet need in the adult PKU population.

Professional activity, gender and disease-related emotions: The impact on parents' experiences in caring for children with phenylketonuria

Introduction

Clinical management of rare diseases often fails to acknowledge the challenges faced by caregivers. Whilst management of phenylketonuria (PKU) may not be considered as dire as other conditions, most studies primarily concentrate on clinical issues, dietary adherence, or the quality of life of the PKU patients, leaving caregivers in the background. The aim of the study was to evaluate the psychosocial effects of PKU on family caregivers.

Methods

Between October 30th, 2022 and February 28th, 2023, we collected data from caregivers of children with PKU using an anonymous, self-administered, computer-assisted online questionnaire. The survey was distributed among to patients during their regular visits to five Polish PKU treatment centers.

Results

A total of 159 Polish caregivers of children with PKU completed the survey. This research shows that while women caregivers were more likely to be unemployed due to their responsibilities for childcare (50.3% compared to 0% for men), and men caregivers were more likely to be employed full-time (93.8% compared to 40.6% for women), the former reported higher emotional engagement in caregiving (88.1% vs 56.3% respectively). Significantly, unemployed mothers reported higher levels of loneliness, helplessness, and emotional control problems, and lacked psychological/emotional support more often than employed mothers. This research also shows a statistically significant positive correlation between mothers' education level and financial situation (p < 0.05) and education level and professional activity (p < 0.01). Additionally, a significant positive correlation was found between perceived financial situation and feeling of happiness (p < 0.001), and between financial situation and professional activity (p < 0.001). Finally, a significant positive correlation was observed between feeling of happiness and professional activity (p < 0.05).

Conclusions

According to our findings, there is a link between subjective happiness, financial situation, and professional activity among female caregivers. The relationship between these factors goes beyond just the income earned from work. The results of our study imply that there could even be a therapeutic advantage for working mothers. It is crucial to recognize the emotional difficulties that employed mothers may experience while taking care of a child with PKU, and to provide them with the necessary assistance and resources to meet their needs. Additionally, our results may provide a foundation for redefining the support system for caregivers in Poland.

Phenylalanine hydroxylase deficiency treatment and management: A systematic evidence review of the American College of Medical Genetics and Genomics (ACMG)

PURPOSE

Elevated serum phenylalanine (Phe) levels due to biallelic pathogenic variants in phenylalanine hydroxylase (PAH) may cause neurodevelopmental disorders or birth defects from maternal phenylketonuria. New Phe reduction treatments have been approved in the last decade, but uncertainty on the optimal lifespan goal Phe levels for patients with PAH deficiency remains.

METHODS

We searched Medline and Embase for evidence of treatment concerning PAH deficiency up to September 28, 2021. Risk of bias was evaluated based on study design. Random-effects meta-analyses were performed to compare IQ, gestational outcomes, and offspring outcomes based on Phe ≤ 360 μmol/L vs > 360 μmol/L and reported as odds ratio and 95% CI. Remaining results were narratively synthesized.

RESULTS

A total of 350 studies were included. Risk of bias was moderate. Lower Phe was consistently associated with better outcomes. Achieving Phe ≤ 360 μmol/L before conception substantially lowered the risk of negative effect to offspring in pregnant individuals (odds ratio = 0.07, 95% CI = 0.04-0.14; P < .0001). Adverse events due to pharmacologic treatment were common, but medication reduced Phe levels, enabling dietary liberalization.

CONCLUSIONS

Reduction of Phe levels to ≤360 μmol/L through diet or medication represents effective interventions to treat PAH deficiency.

Complications of the Low Phenylalanine Diet for Patients with Phenylketonuria and the Benefits of Increased Natural Protein

Phenylketonuria (PKU) is an inherited disorder in which phenylalanine (Phe) is not correctly metabolized leading to an abnormally high plasma Phe concentration that causes profound neurologic damage if left untreated. The mainstay of treatment for PKU has centered around limiting natural protein in the diet while supplementing with medical foods in order to prevent neurologic injury while promoting growth. This review discusses several deleterious effects of the low Phe diet along with benefits that have been reported for patients with increased natural protein intake while maintaining plasma Phe levels within treatment guidelines.

Exploring the Barriers and Motivators to Dietary Adherence among Caregivers of Children with Disorders of Amino Acid Metabolism (AAMDs): A Qualitative Study

Dietary intervention is generally accepted as the mainstay of treatment for patients with disorders of amino acid metabolism (AAMDs). However, dietary adherence to a low-protein diet is always reported as a common challenge among these patients. This study explored the perception of barriers and motivators to dietary adherence among caregivers of AAMD patients in Malaysia. Twenty caregivers of children with AAMDs receiving ongoing treatment at the genetic clinic participated in an online focus group discussion from November to December 2021. Findings showed a total of five interrelated main themes identified from focus group discussion (FGD) exploring parents’ experiences related to the management of their child’s daily diet. The barriers to dietary adherence were burden of dietary treatment, diet and dietary behavior, parenting challenges, limited knowledge related to dietary treatment, and challenges in healthcare system delivery. Key factors facilitating good dietary adherence include good knowledge of dietary treatment, parental coping strategies, social coping, and dietary behavior. In conclusion, despite the existence of several barriers to the implementation of dietary treatment, caregivers managed to use a wide range of coping strategies to overcome some, if not all, of the challenges. The important next step is to develop, in conjunction with multidisciplinary healthcare professionals, feasible implementation strategies that could address these barriers and at the same time improve the quality of life of caregivers.

Families' healthcare experiences for children with inherited metabolic diseases: protocol for a mixed methods cohort study

INTRODUCTION

Children with inherited metabolic diseases (IMDs) often have complex and intensive healthcare needs and their families face challenges in receiving high-quality, family centred health services. Improvement in care requires complex interventions involving multiple components and stakeholders, customised to specific care contexts. This study aims to comprehensively understand the healthcare experiences of children with IMDs and their families across Canada.

METHODS AND ANALYSIS

A two-stage explanatory sequential mixed methods design will be used. Stage 1: quantitative data on healthcare networks and encounter experiences will be collected from 100 parent/guardians through a care map, 2 baseline questionnaires and 17 weekly diaries over 5-7 months. Care networks will be analysed using social network analysis. Relationships between demographic or clinical variables and ratings of healthcare experiences across a range of family centred care dimensions will be analysed using generalised linear regression. Other quantitative data related to family experiences and healthcare experiences will be summarised descriptively. Ongoing analysis of quantitative data and purposive, maximum variation sampling will inform sample selection for stage 2: a subset of stage 1 participants will participate in one-on-one videoconference interviews to elaborate on the quantitative data regarding care networks and healthcare experiences. Interview data will be analysed thematically. Qualitative and quantitative data will be merged during analysis to arrive at an enhanced understanding of care experiences. Quantitative and qualitative data will be combined and presented narratively using a weaving approach (jointly on a theme-by-theme basis) and visually in a side-by-side joint display.

ETHICS AND DISSEMINATION

The study protocol and procedures were approved by the Children's Hospital of Eastern Ontario's Research Ethics Board, the University of Ottawa Research Ethics Board and the research ethics boards of each participating study centre. Findings will be published in peer-reviewed journals and presented at scientific conferences.

Is diagnosing patients with Organic Acidurias and Aminoacidopathies enough? Conundrums of a low middle-income country

Objective:

This study was done to determine the factors responsible for non-treatment of inherited metabolic disorders (IMDs) requiring food for special medical purposes (FSMPs) in Pakistan.

Methods:

A descriptive cross-sectional study was conducted by Departments of Pediatrics & Child Health and Pathology & Laboratory Medicine, Aga Khan University. Patients diagnosed with IMDs from January 2013 to December 2016 requiring FSMPs were surveyed after a year of initial diagnosis to collect the details of treatment advised, mortality status, and reasons of non-treatment, including not prescribed by physician, non-acceptance by family, non-availability or non-affordability.

Results:

Over four years period, 311 patients were identified with IMDs; Median age of patients was 1.0 yrs (0.0.2-3.65) with 54% (n=168) being male. Of the total 38.2% (n=119) required FSMPs, 9% (n=28) patients were excluded due to unavailability of diagnostics information. Parents of 58 patients requiring FSMPs out of 119 participated in survey. The leading causes of non-treatment were, FSMPs not prescribed by physicians (n= 30, 51.7%) followed by non-affordability (n=23, 39.6%), families’ unacceptance in (n=9, 18%) patients, non-availability of FSMPs (n=2, 3.4%) and early death of patient (n=1, 1.7%).

Conclusion:

The main factors responsible for non-treatment of FSMPs requiring IMDs were non-prescription by physician and non-affordability.

Special Low Protein Foods Prescribed in England for PKU Patients: An Analysis of Prescribing Patterns and Cost

Patients with phenylketonuria (PKU) are reliant on special low protein foods (SLPFs) as part of their dietary treatment. In England, several issues regarding the accessibility of SLPFs through the national prescribing system have been highlighted. Therefore, prescribing patterns and expenditure on all SLPFs available on prescription in England (n = 142) were examined. Their costs in comparison to regular protein-containing (n = 182) and ‘free-from’ products (n = 135) were also analysed. Similar foods were grouped into subgroups (n = 40). The number of units and costs of SLPFs prescribed in total and per subgroup from January to December 2020 were calculated using National Health Service (NHS) Business Service Authority (NHSBSA) ePACT2 (electronic Prescribing Analysis and Cost Tool) for England. Monthly patient SLPF units prescribed were calculated using patient numbers with PKU and non-PKU inherited metabolic disorders (IMD) consuming SLPFs. This was compared to the National Society for PKU (NSPKU) prescribing guidance. Ninety-eight percent of SLPF subgroups (n = 39/40) were more expensive than regular and ‘free-from’ food subgroups. However, costs to prescribe SLPFs are significantly less than theoretical calculations. From January to December 2020, 208,932 units of SLPFs were prescribed (excluding milk replacers), costing the NHS £2,151,973 (including milk replacers). This equates to £962 per patient annually, and prescribed amounts are well below the upper limits suggested by the NSPKU, indicating under prescribing of SLPFs. It is recommended that a simpler and improved system should be implemented. Ideally, specialist metabolic dietitians should have responsibility for prescribing SLPFs. This would ensure that patients with PKU have the necessary access to their essential dietary treatment, which, in turn, should help promote dietary adherence and improve metabolic control.

A review of treatment modalities in gyrate atrophy of the choroid and retina (GACR)

Gyrate atrophy of the choroid and retina (GACR) is a rare inborn error of amino acid metabolism caused by bi-allelic variations in OAT. GACR is characterised by vision decline in early life eventually leading to complete blindness, and high plasma ornithine levels. There is no curative treatment for GACR, although several therapeutic modalities aim to slow progression of the disease by targeting different steps within the ornithine pathway. No international treatment protocol is available. We systematically collected all international literature on therapeutic interventions in GACR to provide an overview of published treatment effects.

METHODS

Following the PRISMA guidelines, we conducted a systematic review of the English literature until December 22nd 2020. PubMed and Embase databases were searched for studies related to therapeutic interventions in patients with GACR.

RESULTS

A total of 33 studies (n = 107 patients) met the inclusion criteria. Most studies were designed as case reports (n = 27) or case series (n = 4). No randomised controlled trials or large cohort studies were found. Treatments applied were protein-restricted diets, pyridoxine supplementation, creatine or creatine precursor supplementation, l-lysine supplementation, and proline supplementation. Protein-restricted diets lowered ornithine levels ranging from 16.0-91.2%. Pyridoxine responsiveness was reported in 30% of included mutations. Lysine supplementation decreased ornithine levels with 21-34%. Quality assessment showed low to moderate quality of the articles.

CONCLUSIONS

Based primarily on case reports ornithine levels can be reduced by using a protein restricted diet, pyridoxine supplementation (variation-dependent) and/or lysine supplementation. The lack of pre-defined clinical outcome measures and structural follow-up in all included studies impeded conclusions on clinical effectiveness. Future research should be aimed at 1) Unravelling the OAT biochemical pathway to identify other possible pathologic metabolites besides ornithine, 2) Pre-defining GACR specific clinical outcome measures, and 3) Establishing an international historical cohort.

The Impact of the First 2020 COVID-19 Lockdown on the Metabolic Control of Patients with Phenylketonuria

The present study assessed patients' metabolic control of phenylketonuria (PKU) during the first 2020 COVID-19 lockdown in Poland. Blood (phenylalanine) Phe results of the tests of 535 patients, performed in 2019 and in the first months of 2020, were analysed. The six-week lockdown period was compared to the preceding six-week period as well as to the two corresponding periods of 2019 (three non-lockdown periods). More patients failed to perform Phe tests in the lockdown period (32.7%) than in non-lockdown periods (15.6%, 15.1%, 17.2%; p < 0.001 for all). The median Phe levels for those patients who performed testing in all the four periods did not differ between periods. However, these patients tended to perform only one test during the lockdown (ORs: 1.43 to 1.60; 95% CI: from 1.01-2.04 to 1.11-2.30, p-value 0.02 to 0.005). Patients who did not take blood during the lockdown (46.7%) performed significantly fewer blood tests in the remaining periods (median <IQR>: 1 <0-1> vs. 2 <1-4>; p < 0.001). In conclusion, direct assessment of patients' compliance based upon Phe levels during the pandemic lockdown was not possible. Pre-pandemic non-compliant patients frequently failed to perform the test during the lockdown, whereas the previously compliant ones were more likely to perform only one test. This strongly suggests that metabolic control might have worsened.

Health economic burden of patients with phenylketonuria (PKU) - A retrospective study of German health insurance claims data

This retrospective matched-cohort analysis compared health-economic burdens of adults (≥18 years; n = 377) with phenylketonuria (PKU) and age/gender-matched non-PKU controls (n = 3770) in Germany. Healthcare costs and resource-utilization were analyzed for the year 2015. Differences between groups were tested using 95% CI of mean differences (MD). PKU patients had significantly higher mean costs in total (MD €3307, 95% CI €1736–€4879), for pharmaceuticals (MD €1912, 95% CI €1195–€2629) [including dietary amino-acid supplements (MD €1268, 95% CI €864–€1672)], and outpatient costs (MD €395, 95% CI €115–€675). Inpatient costs (MD €904, 95% CI -€293 to €2100) and costs for aids and remedies (MD €97, 95% CI -€10 to €203) were also higher in PKU patients. PKU patients had more outpatient visits and stayed longer in hospital. Adult PKU patients incur higher total healthcare costs than non-PKU controls, especially regarding pharmaceuticals and outpatient costs, and more frequent resource-utilization, resulting in higher health-economic burden for the statutory healthcare system.

One Year of Newborn Screening for SMA - Results of a German Pilot Project

OBJECTIVE

Spinal muscular atrophy (SMA) is the most common neurodegenerative disease in childhood. The study was conducted to assess the impact of early detection of SMA by newborn screening (NBS) on the clinical course of the disease.

METHODS

Screening was performed in two federal states of Germany, Bavaria and North Rhine Westphalia, between January 2018 and February 2019. The incidence in the screening population was calculated as number of detected patients with a homozygous deletion in the SMN1-gene per number of screened patients. To get an idea about the incidence of newly diagnosed SMA in the year prior to screening a survey covering all neuropediatric centers in the state of Bavaria was conducted, identifying all SMA-cases in 2017 and 2018. Following positive NBS and confirmatory diagnostic test, treatment was advised according to the recommendations of the "American SMA NBS Multidisciplinary Working Group". Immediate treatment with Nusinersen was recommended in children with 2 and 3 SMN2 copies and a conservative strict follow-up strategy in children with ≥4 copies. All children underwent regular standardized neuropediatric examination, CHOP INTEND and HINE-2 testing as well as electrophysiological exams every 2-3 months.

RESULTS

165,525 children were screened. 22 cases of SMA were identified, meaning an incidence rate of 1:7524. SMN2 copy number analysis showed 2 SMN2 copies in 45% of patients, 3 SMN2 copies in 19 % and 4 SMN2 copies in 36%. These findings are confirmed in the most recent statistical data-cut from 31st August 2019 (incidence 1:7089, 2 SMN2 copies in 44%, 3 in 15% and 4 in 38%). Comparison with up-to-date German data on SMA incidence and the Bavarian survey give evidence that NBS did not lead to a relevant increase in incidence. 10 patients with 2 or 3 SMN2 copies were treated with Nusinersen, starting between 15- 39 days after birth, in 7/10 patients before onset of symptoms. Presymptomatically treated patients (age at last examination: 1- 12 months, median 8 months) showed no muscle weakness by the age of one month to one year. One child with 4 SMN2 copies became symptomatic at the age of 8 months.

CONCLUSIONS

Newborn screening, resulting in presymptomatic treatment, improves outcome in children with genetically proven SMA. Newborn screening for SMA should be introduced in all countries where therapy is available. An immediate therapy in cases with 4 SMN2 copies should be considered.