Ongoing Laboratory Performance Study on Chemical Analysis of Hydrophobic and Hydrophilic Compounds in Three Aquatic Passive Samplers

The quality of chemical analysis is an important aspect of passive sampling-based environmental assessments. The present study reports on a proficiency testing program for the chemical analysis of hydrophobic organic compounds in silicone and low-density polyethylene (LDPE) passive samplers and hydrophilic compounds in polar organic chemical integrative samplers. The median between-laboratory coefficients of variation (CVs) of hydrophobic compound concentrations in the polymer phase were 33% (silicone) and 38% (LDPE), similar to the CVs obtained in four earlier rounds of this program. The median CV over all rounds was 32%. Much higher variabilities were observed for hydrophilic compound concentrations in the sorbent: 50% for the untransformed data and a factor of 1.6 after log transformation. Limiting the data to the best performing laboratories did not result in less variability. Data quality for hydrophilic compounds was only weakly related to the use of structurally identical internal standards and was unrelated to the choice of extraction solvent and extraction time. Standard deviations of the aqueous concentration estimates for hydrophobic compound sampling by the best performing laboratories were 0.21 log units for silicone and 0.27 log units for LDPE (factors of 1.6 to 1.9). The implications are that proficiency testing programs may give more realistic estimates of uncertainties in chemical analysis than within-laboratory quality control programs and that these high uncertainties should be taken into account in environmental assessments.

Determination of urea in pet feed: assessing the suitability of different analytical techniques using proficiency test data

The determination of urea in pet feed at contaminant levels using the spectrophotometric method described in Commission Regulation (EC) No 152/2009 has been reported by several EU laboratories to lack the required selectivity. Whilst urea is not authorised as an additive in pet feed, the control of urea in pet feed is of economic importance, because the addition of urea may unlawfully increase the apparent protein content. To investigate the capabilities of different analytical techniques, a proficiency test was organised where the participants (EU official control laboratories, laboratories from the academia and private laboratories) were free to use their method of choice for analysing three dog feed test materials, two samples of which were spiked with urea. Twenty-one laboratories submitted results using the following techniques: spectrophotometry (Implementing Regulation (EC) No 152/2009), LC-MS/MS, HPLC-UV, enzymatic-colorimetry, gravimetry and an 'in-house photometric' method. Only two laboratories that used LC-MS/MS were able to quantify urea accurately in the test material containing a mass fraction of 18.9 mg kg-1 whereas satisfactory results at the level of 258.9 mg kg-1 were obtained by one participant that used an 'in-house photometric method' and one that used the enzymatic method, in addition to the five participants using LC-MS/MS. The technique that provided the highest success rate across the three test materials was LC-MS/MS, whereas spectrophotometry, the enzymatic-based and HPLC-UV methods led to overestimated results in addition to a dispersion of results not suitable for compliance analysis. To address the determination of urea in pet feed at low levels, a better performing method than the one described in the legislation is required.

Interlaboratory Comparison of Extractable Organofluorine Measurements in Groundwater and Eel (Anguilla rostrata): Recommendations for Methods Standardization

Research on per- and polyfluoroalkyl substances (PFAS) frequently incorporates organofluorine measurements, particularly because they could support a class-based approach to regulation. However, standardized methods for organofluorine analysis in a broad suite of matrices are currently unavailable, including a method for extractable organofluorine (EOF) measured using combustion ion chromatography (CIC). Here, we report the results of an international interlaboratory comparison. Seven laboratories representing academia, government, and the private sector measured paired EOF and PFAS concentrations in groundwater and eel (Anguilla rostrata) from a site contaminated by aqueous film-forming foam. Among all laboratories, targeted PFAS could not explain all EOF in groundwater but accounted for most EOF in eel. EOF results from all laboratories for at least one replicate extract fell within one standard deviation of the interlaboratory mean for groundwater and five out of seven laboratories for eel. PFAS spike mixture recoveries for EOF measurements in groundwater and eel were close to the criterion (±30%) for standardized targeted PFAS methods. Instrumental operation of the CIC such as replicate sample injections was a major source of measurement uncertainty. Blank contamination and incomplete inorganic fluorine removal may introduce additional uncertainties. To elucidate the presence of unknown organofluorine using paired EOF and PFAS measurements, we recommend that analysts carefully consider confounding methodological uncertainties such as differences in precision between measurements, data processing steps such as blank subtraction and replicate analyses, and the relative recoveries of PFAS and other fluorine compounds.

Validation and interlaboratory comparison of anticoagulant rodenticide analysis in animal livers using ultra-performance liquid chromatography-mass spectrometry

Anticoagulant rodenticides (ARs) are used to control rodent populations. Poisoning of non-target species can occur by accidental consumption of commercial formulations used for rodent control. A robust method for determining ARs in animal tissues is important for animal postmortem diagnostic and forensic purposes. We evaluated an ultra-performance liquid chromatography coupled with mass spectrometry (UPLC-MS) method to quantify 8 ARs (brodifacoum, bromadiolone, chlorophacinone, coumachlor, dicoumarol, difethialone, diphacinone, warfarin) in a wide range of animal (bovine, canine, chicken, equine, porcine) liver samples, including incurred samples. We further evaluated UPLC-MS in 2 interlaboratory comparison (ILC) studies; one an ILC exercise (ICE), the other a proficiency test (PT). The limits of detection of UPLC-MS were 0.3-3.1 ng/g, and the limits of quantification were 0.8-9.4 ng/g. The recoveries obtained using UPLC-MS were 90-115%, and relative SDs were 1.2-13% for each of the 8 ARs for the 50, 500, and 2,000 ng/g spiked liver samples. The overall accuracy from the laboratories participating in the 2 ILC studies (4 and 11 laboratories for ICE and PT studies, respectively) were 86-118%, with relative repeatability SDs of 3.7-11%, relative reproducibility SDs of 7.8-31.2%, and Horwitz ratio values of 0.5-1.5. Via the ILC studies, we verified the accuracy of UPLC-MS for AR analysis in liver matrices and demonstrated that ILC can be utilized to evaluate performance characteristics of analytical methods.

Toxic or not toxic? The specifications of the standard ISO 10993-5 are not explicit enough to yield comparable results in the cytotoxicity assessment of an identical medical device

Background

Medical device manufacturers are obliged to prove the biocompatibility of their products when they come into contact with the human body. The requirements for the biological evaluation of medical devices are specified by the international standard series ISO 10993. Part five of this series describes the performance of in vitro cytotoxicity tests. This test evaluates the effects of medical device use on cell health. The existence of the specific standard suggests that the tests will produce reliable and comparable results. However, the ISO 10993-5 offers wide latitude in the test specifications. In the past, we noticed inconsistencies of the results from different laboratories.

Objective

To determine if the specifications of the standard ISO 10993-5 are explicit to ensure the comparability of test results and, if not, identify potential influencing factors.

Methods

An interlaboratory comparison was conducted for the in vitro cytotoxicity test according to ISO 10993-5. Fifty-two international laboratories evaluated the cytotoxicity for two unknown samples. One was polyethylene (PE) tubing, which is expected to be non-cytotoxic and the other was polyvinyl chloride (PVC) tubing, for which a cytotoxic potential was presumed. All laboratories were asked to perform an elution test with predefined extraction specifications. The other test parameters were freely chosen by the laboratories according to the guidelines set by the standard.

Results

To our surprise only 58 percent of the participating laboratories identified the cytotoxic potential of both materials as expected. Particularly for PVC a considerable variation of the results between the laboratories was observed [mean = 43 ± 30 (SD), min = 0, max = 100]. We showed that ten percent serum supplementation to the extraction medium, as well as longer incubation of the cells with the extract, greatly increased the test sensitivity for PVC.

Conclusion

The results clearly show that the specifications set by the ISO 10993-5 are not explicit enough to obtain comparable results for an identical medical device. To set requirements that ensure reliable cytotoxicity assessments, further research will be necessary to identify the best test conditions for specific materials and/or devices and the standard needs to be revised accordingly.

Formulae Differences Commence a Database for Interlaboratory Studies of Natural Organic Matter

Direct comparison of high-resolution mass spectrometry (HRMS) data acquired with different instrumentation or parameters remains problematic as the derived lists of molecular species via HRMS, even for the same sample, appear distinct. This inconsistency is caused by inherent inaccuracies associated with instrumental limitations and sample conditions. Hence, experimental data may not reflect a corresponding sample. We propose a method that classifies HRMS data based on the differences in the number of elements between each pair of molecular formulae within the formulae list to preserve the essence of the given sample. The novel metric, formulae difference chains expected length (FDCEL), allowed for comparing and classifying samples measured by different instruments. We also demonstrate a web application and a prototype for a uniform database for HRMS data serving as a benchmark for future biogeochemical and environmental applications. FDCEL metric was successfully employed for both spectrum quality control and examination of samples of various nature.

Thickness measurements of graphene oxide flakes using atomic force microscopy: results of an international interlaboratory comparison

Flake thickness is one of the defining properties of graphene-related 2D materials (GR2Ms), and therefore requires reliable, accurate, and reproducible measurements with well-understood uncertainties. This is needed regardless of the production method or manufacturer because it is important for all GR2M products to be globally comparable. An international interlaboratory comparison on thickness measurements of graphene oxide flakes using atomic force microscopy has been completed in technical working area 41 of versailles project on advanced materials and standards. Twelve laboratories participated in the comparison project, led by NIM, China, to improve the equivalence of thickness measurement for two-dimensional flakes. The measurement methods, uncertainty evaluation and a comparison of the results and analysis are reported in this manuscript. The data and results of this project will be directly used to support the development of an ISO standard.

[Interlaboratory comparison for determination of lead in drinking water]

OBJECTIVE

To analyze and evaluate the testing capability of lead in drinking water in the laboratories of the provincial and municipal centers for disease control and prevention across the country by implementing the interlaboratory comparison project.

METHODS

The preparation method of the secondary standard materials were used as the reference for the sample preparation in the interlaboratory comparison project. The homogeneity and stability of the samples and short-term stability for simulated transportation were tested by single factor analysis of variance(ANOVA) and mean consistency test(t test). On top of using the kernel density estimation to test the distribution of laboratory test result, we adopted a robust statistical method to analyze the laboratory test result and used Z-score to evaluate the testing ability of each participating laboratory.

RESULTS

A total of 448 laboratories throughout the country participated in the proficiency testing program.341 laboratories(76.1%) of participating laboratories, obtained satisfactory result. Results provided by 28 laboratories(6.3%) of total participating laboratories, were found suspicious in their capacities. Finally, there were 79 laboratories(17.6%) of total participating laboratories, with result found to be outliers.

CONCLUSION

The statistical result of the interlaboratory comparison project show that the testing capability of lead in drinking water has been ranked as satisfactory in the laboratories of the provincial and municipal centers for disease control and prevention across the country, and the testing capability of a small number of laboratories requires further improvement.

[Interlaboratory comparison for determination of arsenic in drinking water]

OBJECTIVE

To analyze and evaluate the testing capability of arsenic in drinking water in the laboratories of the provincial and municipal centers for disease control and prevention across the country by implementing the interlaboratory comparison project.

METHODS

The preparation method of the secondary standard materials were used as the reference for the sample preparation in the interlaboratory comparison project. The homogeneity and stability of the samples and short-term stability for simulated transportation were tested by single factor analysis of variance(ANOVA) and linear regression and mean consistency test(t test). On top of using the kernel density estimation to test the distribution of laboratory test result, we adopted precision statistical method to analyze the laboratory test result and used Z-score to evaluate the testing ability of each participating laboratory.

RESULTS

A total of 411 laboratories throughout the country participated in the proficiency testing program.389 laboratories(94.6%) of participating laboratories, obtained satisfactory result. Results provided by 2 laboratories(0.5%) of total participating laboratories, were found suspicious in their capacities. Finally, there were 20 laboratories(4.9%) of total participating laboratories, with result found to be outliers.

CONCLUSION

The testing capability of arsenic in drinking water has been ranked as satisfactory in the laboratories of the provincial and municipal centers for disease control and prevention across the country, and the testing capability of a small number of laboratories requires further improvement.

[Interlaboratory comparison for determination of cadmium in drinking water]

OBJECTIVE

To analyze and evaluate the testing capability of cadmium in drinking water in the laboratories of the provincial and municipal centers for disease control and prevention across the country by implementing the interlaboratory comparison project.

METHODS

The preparation method of the secondary standard materials were used as the reference for the sample preparation in the interlaboratory comparison project. The homogeneity and stability of the samples and short-term stability for simulated transportation were tested by single factor analysis of variance(ANOVA) and linear regression and mean consistency test(t test). On top of using the kernel density estimation to test the distribution of laboratory test result, we adopted precision statistical method to analyze the laboratory test result and used Z-score to evaluate the testing ability of each participating laboratory.

RESULTS

A total of 409 laboratories throughout the country participated in the proficiency testing program.383 laboratories(93.6%) of participating laboratories, obtained satisfactory result. Results provided by 4 laboratories(1.0%) of total participating laboratories, were found suspicious in their capacities. Finally, there were 22 laboratories(5.4%) of total participating laboratories, with result found to be outliers.

CONCLUSION

The statistical result of the interlaboratory comparison project show that the testing capability of cadmium in drinking water has been ranked as satisfactory in the laboratories of the provincial and municipal centers for disease control and prevention across the country, and the testing capability of a small number of laboratories requires further improvement.

Second round of an interlaboratory comparison of SARS-CoV2 molecular detection assays used by 45 veterinary diagnostic laboratories in the United States

The COVID-19 pandemic presents a continued public health challenge. Veterinary diagnostic laboratories in the United States use RT-rtPCR for animal testing, and many laboratories are certified for testing human samples; hence, ensuring that laboratories have sensitive and specific SARS-CoV2 testing methods is a critical component of the pandemic response. In 2020, the FDA Veterinary Laboratory Investigation and Response Network (Vet-LIRN) led an interlaboratory comparison (ILC1) to help laboratories evaluate their existing RT-rtPCR methods for detecting SARS-CoV2. All participating laboratories were able to detect the viral RNA spiked in buffer and PrimeStore molecular transport medium (MTM). With ILC2, Vet-LIRN extended ILC1 by evaluating analytical sensitivity and specificity of the methods used by participating laboratories to detect 3 SARS-CoV2 variants (B.1; B.1.1.7 [Alpha]; B.1.351 [Beta]) at various copy levels. We analyzed 57 sets of results from 45 laboratories qualitatively and quantitatively according to the principles of ISO 16140-2:2016. More than 95% of analysts detected the SARS-CoV2 RNA in MTM at ≥500 copies for all 3 variants. In addition, for nucleocapsid markers N1 and N2, 81% and 92% of the analysts detected ≤20 copies in the assays, respectively. The analytical specificity of the evaluated methods was >99%. Participating laboratories were able to assess their current method performance, identify possible limitations, and recognize method strengths as part of a continuous learning environment to support the critical need for the reliable diagnosis of COVID-19 in potentially infected animals and humans.

Low-Level Radon Activity Concentration-A MetroRADON International Intercomparison

An international comparison of continuous monitors measuring radon activity concentration was performed to validate the traceability of the European radon calibration facilities. It was carried out by comparing the secondary standards used by these previous facilities, ranging from 100 Bq·m^-3 to 300 Bq·m^-3. Secondary standards were individually compared to a secondary reference device previously calibrated in a reference radon atmosphere traceable to a primary standard. The intercomparison was organized by the National Institute for Nuclear, Chemical, and Biological Protection (SUJCHBO) in the period from October 2019 to April 2020 within the European Metrology Program for Innovation and Research (EMPIR), JRP-Contract 16ENV10 MetroRADON. Eight European laboratories participated in this study. The results of the experiment are presented and discussed.

Intercomparison of Radon Flux Monitors at Low and at High Radium Content Areas under Field Conditions

Interlaboratory exercises are a good tool to compare the response of different systems to the same quantity and to identify possible inconsistencies between them. One of the main goals of the EMPIR 19ENV01 traceRadon project is to harmonize radon flux measurements based on different systems and methodologies. In the framework of the traceRadon Project, two radon flux intercomparison campaigns were carried out in October 2021 at high and at low radon source areas. Four institutions participated in the field intercomparison exercises with their own systems. Every system was based on a specific radon monitor (diffusion or pump mode) and an accumulation chamber (with manual or automatic opening). Radon fluxes were calculated by each participant using both exponential and linear fittings of the radon activity concentration measured over time within the accumulation chambers. The results of this study show mainly: (i) the exponential approach is not advisable due to the variability of the radon flux and the leakage of the systems during long-time measurements; (ii) the linear approach should be applied to minimize the measurement period in agreement with the time response and sensitivity of the monitors; (iii) radon flux measured at high radon source areas (radium content of about 800 Bq kg^-1) risks being underestimated because of the influence of advective effects; (iv) radon flux measured at low radon source areas (radium content of about 30 Bq kg^-1) may present large uncertainties if sensitive radon monitors with pump mode are not used.

How Structured Metadata Acquisition Contributes to the Reproducibility of Nanosafety Studies: Evaluation by a Round-Robin Test

It has been widely recognized that nanosafety studies are limited in reproducibility, caused by missing or inadequate information and data gaps. Reliable and comprehensive studies should be performed supported by standards or guidelines, which need to be harmonized and usable for the multidisciplinary field of nanosafety research. The previously described minimal information table (MIT), based on existing standards or guidelines, represents one approach towards harmonization. Here, we demonstrate the applicability and advantages of the MIT by a round-robin test. Its modular structure enables describing individual studies comprehensively by a combination of various relevant aspects. Three laboratories conducted a WST-1 cell viability assay using A549 cells to analyze the effects of the reference nanomaterials NM101 and NM110 according to predefined (S)OPs. The MIT contains relevant and defined descriptive information and quality criteria and thus supported the implementation of the round-robin test from planning, investigation to analysis and data interpretation. As a result, we could identify sources of variability and justify deviating results attributed to differences in specific procedures. Consequently, the use of the MIT contributes to the acquisition of reliable and comprehensive datasets and therefore improves the significance and reusability of nanosafety studies.

Interlaboratory Validation of Toxicity Testing Using the Duckweed Lemna minor Root-Regrowth Test

Simple Summary

Duckweed (Lemna minor) is commonly used as a phytotoxicity test organism, adopted by the main international standardization organizations (ISO, OECD, USEPA, ASTM). For duckweed tests, measurements of fronds or biomass are usually preferred with a standard exposure period of at least 7 days. The proposed root- regrowth test differs from other internationally standardized methods in several important aspects: (a) the test can be performed within 72 h; (b) the test vessel was a 24-well cell plate; (c) the required volume of test water samples was 3 mL; (d) roots were excised before exposure and newly developed roots then measured. The validation of the new test method by interlaboratory comparison tests confirmed that the Lemna root bioassay is valid and reliable. The root growth test is therefore a valuable tool for rapid toxicity screening of wastewater effluents and hazardous pollutants in natural waters because it is simple to perform, quick to conduct, cost-effective to operate, and can have operational benefits for testing time, since management decisions need to be made promptly in the event of unpredictable pollution events.

Abstract

The common duckweed (Lemna minor), a freshwater monocot that floats on the surfaces of slow-moving streams and ponds, is commonly used in toxicity testing. The novel Lemna root- regrowth test is a toxicity test performed in replicate test vessels (24-well plates), each containing 3 mL test solution and a 2–3 frond colony. Prior to exposure, roots are excised from the plant, and newly developed roots are measured after 3 days of regrowth. Compared to the three internationally standardized methods, this bioassay is faster (72 h), simpler, more convenient (requiring only a 3-mL) and cheaper. The sensitivity of root regrowth to 3,5-dichlorophenol was statistically the same as using the conventional ISO test method. The results of interlaboratory comparison tests conducted by 10 international institutes showed 21.3% repeatability and 27.2% reproducibility for CuSO₄ and 21.28% repeatability and 18.6% reproducibility for wastewater. These validity criteria are well within the generally accepted levels of <30% to 40%, confirming that this test method is acceptable as a standardized biological test and can be used as a regulatory tool. The Lemna root regrowth test complements the lengthier conventional protocols and is suitable for rapid screening of wastewater and priority substances spikes in natural waters.

The Metrological Traceability, Performance and Precision of European Radon Calibration Facilities

An interlaboratory comparison for European radon calibration facilities was conducted to evaluate the establishment of a harmonized quality level for the activity concentration of radon in air and to demonstrate the performance of the facilities when calibrating measurement instruments for radon. Fifteen calibration facilities from 13 different European countries participated. They represented different levels in the metrological hierarchy: national metrology institutes and designated institutes, national authorities for radiation protection and participants from universities. The interlaboratory comparison was conducted by the German Federal Office for Radiation Protection (BfS) and took place from 2018 to 2020. Participants were requested to measure radon in atmospheres of their own facilities according to their own procedures and requirements for metrological traceability. A measurement device with suitable properties was used to determine the comparison values. The results of the comparison showed that the radon activity concentrations that were determined by European calibration facilities complying with metrological traceability requirements were consistent with each other and had common mean values. The deviations from these values were normally distributed. The range of variation of the common mean value was a measure of the degree of agreement between the participants. For exposures above 1000 Bq/m³, the variation was about 4% for a level of confidence of approximately 95% (k=2). For lower exposure levels, the variation increased to about 6%.

Volatile organic compounds from building products-Results from six round robin tests with emission test chambers conducted between 2008 and 2018

Emission testing of volatile organic compounds (VOC) from materials and products is commonly based on emission test chamber measurements. To ensure the comparability of results from different testing laboratories, their measurement performance must be verified. For this purpose, Bundesanstalt für Materialforschung und -prüfung (BAM) organizes an international proficiency test (round robin test, RRT) every two years using well-characterized test materials (one sealant, one furniture board, and four times a lacquer) with defined VOC emissions. The materials fulfilled the requirements of homogeneity, reproducibility, and stability. Altogether, 36 VOCs were included of which 33 gave test chamber air concentrations between 13 and 83 µg/m³ . This is the typical concentration range to be expected and to be quantified when performing chamber tests. Three compounds had higher concentrations between 326 and 1105 µg/m³ . In this paper, the relative standard deviations (RSD) of BAM round robin tests since 2008 are compared and the improvement of the comparability of the emission chamber testing is shown by the decrease of the mean RSD down to 28% in 2018. In contrast, the first large European interlaboratory comparison in 1999 showed a mean RSD of 51%.

Interlaboratory Comparison Study on Ribodepleted Total RNA High-Throughput Sequencing for Plant Virus Diagnostics and Bioinformatic Competence

High-throughput sequencing (HTS) technologies and bioinformatic analyses are of growing interest to be used as a routine diagnostic tool in the field of plant viruses. The reliability of HTS workflows from sample preparation to data analysis and results interpretation for plant virus detection and identification must be evaluated (verified and validated) to approve this tool for diagnostics. Many different extraction methods, library preparation protocols, and sequence and bioinformatic pipelines are available for virus sequence detection. To assess the performance of plant virology diagnostic laboratories in using the HTS of ribosomal RNA depleted total RNA (ribodepleted totRNA) as a diagnostic tool, we carried out an interlaboratory comparison study in which eight participants were required to use the same samples, (RNA) extraction kit, ribosomal RNA depletion kit, and commercial sequencing provider, but also their own bioinformatics pipeline, for analysis. The accuracy of virus detection ranged from 65% to 100%. The false-positive detection rate was very low and was related to the misinterpretation of results as well as to possible cross-contaminations in the lab or sequencing provider. The bioinformatic pipeline used by each laboratory influenced the correct detection of the viruses of this study. The main difficulty was the detection of a novel virus as its sequence was not available in a publicly accessible database at the time. The raw data were reanalysed using Virtool to assess its ability for virus detection. All virus sequences were detected using Virtool in the different pools. This study revealed that the ribodepletion target enrichment for sample preparation is a reliable approach for the detection of plant viruses with different genomes. A significant level of virology expertise is needed to correctly interpret the results. It is also important to improve and complete the reference data.

Benchmarking the ACEnano Toolbox for Characterisation of Nanoparticle Size and Concentration by Interlaboratory Comparisons

ACEnano is an EU-funded project which aims at developing, optimising and validating methods for the detection and characterisation of nanomaterials (NMs) in increasingly complex matrices to improve confidence in the results and support their use in regulation. Within this project, several interlaboratory comparisons (ILCs) for the determination of particle size and concentration have been organised to benchmark existing analytical methods. In this paper the results of a number of these ILCs for the characterisation of NMs are presented and discussed. The results of the analyses of pristine well-defined particles such as 60 nm Au NMs in a simple aqueous suspension showed that laboratories are well capable of determining the sizes of these particles. The analysis of particles in complex matrices or formulations such as consumer products resulted in larger variations in particle sizes within technologies and clear differences in capability between techniques. Sunscreen lotion sample analysis by laboratories using spICP-MS and TEM/SEM identified and confirmed the TiO₂ particles as being nanoscale and compliant with the EU definition of an NM for regulatory purposes. In a toothpaste sample orthogonal results by PTA, spICP-MS and TEM/SEM agreed and stated the TiO₂ particles as not fitting the EU definition of an NM. In general, from the results of these ILCs we conclude that laboratories are well capable of determining particle sizes of NM, even in fairly complex formulations.

veterinary diagnostic laboratories

The continued search for intermediate hosts and potential reservoirs for SARS-CoV2 makes it clear that animal surveillance is critical in outbreak response and prevention. Real-time RT-PCR assays for SARS-CoV2 detection can easily be adapted to different host species. U.S. veterinary diagnostic laboratories have used the CDC assays or other national reference laboratory methods to test animal samples. However, these methods have only been evaluated using internal validation protocols. To help the laboratories evaluate their SARS-CoV2 test methods, an interlaboratory comparison (ILC) was performed in collaboration with multiple organizations. Forty-four sets of 19 blind-coded RNA samples in Tris-EDTA (TE) buffer or PrimeStore transport medium were shipped to 42 laboratories. Results were analyzed according to the principles of the International Organization for Standardization (ISO) 16140-2:2016 standard. Qualitative assessment of PrimeStore samples revealed that, in approximately two-thirds of the laboratories, the limit of detection with a probability of 0.95 (LOD95) for detecting the RNA was ≤20 copies per PCR reaction, close to the theoretical LOD of 3 copies per reaction. This level of sensitivity is not expected in clinical samples because of additional factors, such as sample collection, transport, and extraction of RNA from the clinical matrix. Quantitative assessment of Ct values indicated that reproducibility standard deviations for testing the RNA with assays reported as N1 were slightly lower than those for N2, and they were higher for the RNA in PrimeStore medium than those in TE buffer. Analyst experience and the use of either a singleplex or multiplex PCR also affected the quantitative ILC test results.

Multilocus Variable-Number Tandem-Repeat Analysis of Enterohemorrhagic Escherichia coli Serogroups O157, O26, and O111 Based on a De Novo Look-Up Table Constructed by Regression Analysis

Multilocus variable-number tandem-repeat analysis (MLVA) is a widely accepted molecular typing tool for enterohemorrhagic Escherichia coli (EHEC). However, ensuring the accuracy of MLVA data among multiple laboratories remains difficult. We developed a method of constructing adjusted look-up tables, which are necessary for MLVA profiling, at each laboratory using a regression analysis based on electrophoresis data from 24 in-house reference strains. On performing MLVA against 51 EHEC O157 isolates, the repeat numbers of 46 isolates were determined accurately using the look-up table with a 99% prediction interval, an outcome superior to that when using a 95% prediction interval. For the remaining five isolates, although the electrophoresis size fell outside the look-up table, we were able to predict the repeat number accurately by extrapolation or the nearest values of the look-up table. Our approach provides more accurate results than a nonadjusted conventional look-up table for calibrating MLVA profiles.

The first IAEA inter-laboratory comparison exercise in Latin America and the Caribbean for stable isotope analyses of water samples

The use of stable isotopes (δ ²H and δ ¹⁸O) is widespread in water resources studies. In the Latin America and the Caribbean (LAC) region, the application of isotope techniques has increased in the past decade, but there remains room to gain self-reliance in environmental isotope studies, necessitating easy and fast access to good-quality isotope data. To that end, in 2018 the IAEA carried out the first regional interlaboratory comparison exercise, testing the analytical performance of 25 laboratories using isotope-ratio mass spectrometry and laser absorption spectroscopy. The three test samples covered a commonly observed range of 0 to -16 ‰ δ ¹⁸O and 0 to -115 ‰ δ ²H. z- and ζ-scores were used to benchmark laboratories' performance against a strict criterion. We found that 81% of the laboratories had satisfactory performance ( | z | ¯ ≤ 2) for δ ²H but only 54% achieved similar scores for δ ¹⁸O. Only a minor fraction of results (12% for δ ²H and 15% for δ ¹⁸O) were unsatisfactory. The larger number of questionable results for δ ¹⁸O confirmed the challenges in laser absorption spectroscopy for this isotope. Besides instrumental performance, the sample throughput, laboratory reference materials, and data post-processing were contributing factors to inaccurate or imprecise performance.

Travelling Wave Ion Mobility-Derived Collision Cross Section for Mycotoxins: Investigating Interlaboratory and Interplatform Reproducibility

Parent and modified mycotoxin analysis remains a challenge because of their chemical diversity, the presence of isomeric forms, and the lack of analytical standards. The creation and application of a collision cross section (CCS) database for mycotoxins may bring new opportunities to overcome these analytical challenges. However, it is still an open question whether common CCS databases can be used independently from the instrument type and ion mobility mass spectrometry (IM-MS) technologies, which utilize different methodologies for determining the gas-phase mobility. Here, we demonstrated the reproducibility of CCS measurements for mycotoxins in an interlaboratory study (average RSD 0.14% ± 0.079) and across different traveling wave IM-MS (TWIMS) systems commercially available (ΔCCS% < 2). The separation in the drift time dimension of critical pairs of isomers for modified mycotoxins was also achieved. In addition, the comparison of measured and predicted CCS values, including regulated and emerging mycotoxins, was addressed.

Harmonized procedures lead to comparable quantification of total oxylipins across laboratories

Oxylipins are potent lipid mediators involved in a variety of physiological processes. Their profiling has the potential to provide a wealth of information regarding human health and disease and is a promising technology for translation into clinical applications. However, results generated by independent groups are rarely comparable, which increases the need for the implementation of internationally agreed upon protocols. We performed an interlaboratory comparison for the MS-based quantitative analysis of total oxylipins. Five independent laboratories assessed the technical variability and comparability of 133 oxylipins using a harmonized and standardized protocol, common biological materials (i.e., seven quality control plasmas), standard calibration series, and analytical methods. The quantitative analysis was based on a standard calibration series with isotopically labeled internal standards. Using the standardized protocol, the technical variance was within ±15% for 73% of oxylipins; however, most epoxy fatty acids were identified as critical analytes due to high variabilities in concentrations. The comparability of concentrations determined by the laboratories was examined using consensus value estimates and unsupervised/supervised multivariate analysis (i.e., principal component analysis and partial least squares discriminant analysis). Interlaboratory variability was limited and did not interfere with our ability to distinguish the different plasmas. Moreover, all laboratories were able to identify similar differences between plasmas. In summary, we show that by using a standardized protocol for sample preparation, low technical variability can be achieved. Harmonization of all oxylipin extraction and analysis steps led to reliable, reproducible, and comparable oxylipin concentrations in independent laboratories, allowing the generation of biologically meaningful oxylipin patterns.

Intercomparison of Indoor Radon Measurements Under Field Conditions In the Framework of MetroRADON European Project

Interlaboratory comparisons are a basic part of the regular quality controls of laboratories to warranty the adequate performance of test and measurements. The exercise presented in this article is the comparison of indoor radon gas measurements under field conditions performed with passive detectors and active monitors carried out in the Laboratory of Natural Radiation (LNR). The aim is to provide a direct comparison between different methodologies and to identify physical reasons for possible inconsistencies, particularly related to sampling and measurement techniques. The variation of radon concentration during the comparison showed a big range of values, with levels from approximately 0.5 to 30 kBq/m³. The reference values for the two exposure periods have been derived from a weighted average of participants’ results applying an iterative algorithm. The indexes used to analyze the participants’ results were the relative percentage difference D(%), the Zeta score (ζ), and the z-score (z). Over 80% of the results for radon in air exposure are within the interval defined by the reference value and 20% and 10% for the first and the second exposure, respectively. Most deviations were detected with the overestimating of the exposure using passive detectors due to the related degassing time of detector holder materials.

Interlaboratory comparison of heavy metal testing in animal diagnostic specimens and feed using inductively coupled plasma-mass spectrometry

We compared inductively coupled plasma-mass spectrometry (ICP-MS) test results for the analysis of heavy metals (As, Ba, Cd, Hg, Pb, and Se) in pet foods and routine veterinary diagnostic specimens using intralaboratory and interlaboratory comparisons. Four laboratories, 1 principal laboratory and 3 collaborating laboratories, conducted instrument comparison (limit of detection [LOD], limit of quantification [LOQ], and linear dynamic range [LDR] on 24 data sets), in-house method comparison (accuracy and precision on 120 data sets), and interlaboratory comparison (reproducibility on 528 data sets using Horwitz equation analysis). Matrices tested included 2 types of pet food jerky treats (chicken and sweet potato), bovine blood, and bovine liver and kidney. The instrument comparison study confirmed that ICP-MS provided the sensitivity necessary for the analysis of all heavy metals tested at concentrations below the level of concern for routine diagnostic testing. The "in-house" method comparison samples, spiked at low (0.04 µg/g), medium (0.4 µg/g), and high (8.0 µg/g; note: the high validation level spike for mercury was 2 µg/g) concentration levels, indicated that ICP-MS can meet U.S. FDA acceptance criteria for both accuracy (90-105% recovery) and precision (< 6% coefficient of variation). The interlaboratory comparison studies showed that ICP-MS is a reproducible method for the analysis of heavy metals (HorRat value of 0.5-2.0) except for mercury in one laboratory, which used a different sample preparation method (open block rather than microwave digestion). Overall, our study showed that ICP-MS is a reproducible method for the analysis of heavy metals in spite of minor differences in methodology.

Multilaboratory Comparison of Pneumococcal Multiplex Immunoassays Used in Immunosurveillance of Streptococcus pneumoniae across Europe

Serology of Streptococcus pneumoniae is challenging due to existence of multiple clinically relevant serotypes and the introduction of multivalent vaccines in national immunization programs. Multiplex immunoassays (MIAs) are applied as high-throughput cost-effective methods for serosurveillance, and yet laboratories use their own protocols. The aims of this study were to assess the agreement of results generated by MIAs in different laboratories within the EU Pneumo Multiplex Assay Consortium, to analyze factors contributing to differences in outcome, and to create a harmonized protocol. The study demonstrated good agreement of results of MIAs performed by laboratories using controlled assays for determination of levels of vaccine-induced pneumococcal antibodies. The EU Pneumo Multiplex Assay Consortium is open to everyone working in public health services, and it aims to facilitate efforts by participants to run and maintain a cost-effective, reproducible, high-quality MIA platform.

Surveillance studies are required to estimate the impact of pneumococcal vaccination in both children and the elderly across Europe. The World Health Organization (WHO) recommends use of enzyme immunoassays (EIAs) as standard methods for immune surveillance of pneumococcal antibodies. However, as levels of antibodies to multiple serotypes are monitored in thousands of samples, a need for a less laborious and more flexible method has evolved. Fluorescent-bead-based multiplex immunoassays (MIAs) are suitable for this purpose. An increasing number of public health and diagnostic laboratories use MIAs, although the method is not standardized and no international quality assessment scheme exists. The EU Pneumo Multiplex Assay Consortium was initiated in 2013 to advance harmonization of MIAs and to create an international quality assessment scheme. In a multilaboratory comparison organized by the consortium, agreement among nine laboratories that used their own optimized MIA was assessed on a panel of 15 reference sera for 13 pneumococcal serotypes with the new WHO standard 007sp. Agreement was assessed in terms of assay accuracy, reproducibility, repeatability, precision, and bias. The results indicate that the evaluated MIAs are robust and reproducible for measurement of vaccine-induced antibody responses. However, some serotype-specific variability in the results was observed in comparisons of polysaccharides from different sources and of different conjugation methods, especially for serotype 4. On the basis of the results, the consortium has contributed to the harmonization of MIA protocols to improve reliability of immune surveillance of Streptococcus pneumoniae.

IMPORTANCE Serology of Streptococcus pneumoniae is challenging due to existence of multiple clinically relevant serotypes and the introduction of multivalent vaccines in national immunization programs. Multiplex immunoassays (MIAs) are applied as high-throughput cost-effective methods for serosurveillance, and yet laboratories use their own protocols. The aims of this study were to assess the agreement of results generated by MIAs in different laboratories within the EU Pneumo Multiplex Assay Consortium, to analyze factors contributing to differences in outcome, and to create a harmonized protocol. The study demonstrated good agreement of results of MIAs performed by laboratories using controlled assays for determination of levels of vaccine-induced pneumococcal antibodies. The EU Pneumo Multiplex Assay Consortium is open to everyone working in public health services, and it aims to facilitate efforts by participants to run and maintain a cost-effective, reproducible, high-quality MIA platform.

Hydrogen-Deuterium Exchange Mass Spectrometry (HDX-MS) Centroid Data Measured between 3.6 °C and 25.4 °C for the Fab Fragment of NISTmAb

The spreadsheet file reported herein provides centroid data, descriptive of deuterium uptake, for the FabFragment of NISTmAb (PDB: 5K8A) reference material, as measured by the bottom-up hydrogen-deuterium exchange mass spectrometry (HDX-MS) method. The protein sample was incubated in deuterium-rich solutions under uniform pH and salt concentrations between 3.6 oC and 25.4 oC for seven intervals ranging over (0 to 14,400) s plus a ∞pseudo s control. The deuterium content of peptic peptide fragments were measured by mass spectrometry. These data were reported by fifteen laboratories, which conducted the measurements using orbitrap and Q-TOF mass spectrometers. The cohort reported ≈ 78,900 centroids for 430 proteolytic peptide sequences of the heavy and light chains of NISTmAb, providing nearly 100 % coverage. In addition, some groups reported ≈ 10,900 centroid measurements for 77 peptide sequences of the Fc fragment. The instrumentation and physical and chemical conditions under which these data were acquired are documented.

interlab: A Python Module for Analyzing Interlaboratory Comparison Data

interlab was developed as a software tool to perform consensus analysis on spectral data from interlaboratory studies. It is designed to estimate the spread in the spectral data and to identify possible outliers among both spectral populations and facilities in the study. Use of this code allows researchers to identify laboratories producing data closest to the consensus values, thereby ensuring that untargeted studies are using the most precise data available to them. The software was originally developed for analyzing NMR data but can be applied to any array data, including Raman or FTIR spectroscopy and GC-MS or LC-MS.

A scoring metric for multivariate data for reproducibility analysis using chemometric methods

Process quality control and reproducibility in emerging measurement fields such as metabolomics is normally assured by interlaboratory comparison testing. As a part of this testing process, spectral features from a spectroscopic method such as nuclear magnetic resonance (NMR) spectroscopy are attributed to particular analytes within a mixture, and it is the metabolite concentrations that are returned for comparison between laboratories. However, data quality may also be assessed directly by using binned spectral data before the time-consuming identification and quantification. Use of the binned spectra has some advantages, including preserving information about trace constituents and enabling identification of process difficulties. In this paper, we demonstrate the use of binned NMR spectra to conduct a detailed interlaboratory comparison and composition analysis. Spectra of synthetic and biologically-obtained metabolite mixtures, taken from a previous interlaboratory study, are compared with cluster analysis using a variety of distance and entropy metrics. The individual measurements are then evaluated based on where they fall within their clusters, and a laboratory-level scoring metric is developed, which provides an assessment of each laboratory's individual performance.

A Bayesian approach to an interlaboratory comparison

Interlaboratory comparisons are an important check of the quality of a measurement technique. In this paper we examine the accelerator mass spectrometry (AMS) measurement of 41Ca, an unstable isotope of calcium that has emerged as a valuable tracer for a variety of studies. We use a Bayesian framework to explore the quality and consistency of the AMS measurements made by Lawrence Livermore National Laboratory (LLNL) and the Purdue Rare Isotope Measurement Laboratory (PRIME Lab). This framework should be generalizable to other interlaboratory comparisons. The laboratories measured 47 samples, with each lab measuring an aliquot of each sample. The Bayesian approach allowed us to derive a probability distribution for four parameters reflecting the quality of the data, and to then address the following questions: (1) are the results from the two labs consistent? (2) are the uncertainties quoted by the two labs reasonable? We find that any consistent offset between the two labs is negligible, and that the uncertainties may be slightly underestimated.

Interlaboratory comparison of a general method to screen foods for pesticides using QuEChERs extraction with high performance liquid chromatography and high resolution mass spectrometry

An interlaboratory comparison of a multipesticide residue analytical method is reported. The goal of the comparison was to evaluate the potential for liquid chromatography/high resolution mass spectrometry along with a specific automated screening procedure to allow the determination of the presence or absence of a set of targeted compounds without additional manual review. The method utilized an off the shelf QuEChERs based extraction followed by analysis with an orbitrap mass spectrometer with the data evaluated by ToxID. The method was tested at three laboratories, with three produce matrices (spinach, carrots, and oranges), and three levels of spiked pesticides with all analyses in triplicate. A series of 247 compounds were tested, and it was found that the three laboratories produced consistent data; however, manual review was still necessary. The data was shown to have no false negatives for 211 compounds in the three produce matrixes at 200 ppb. Of these 211 compounds, 189 had no false negatives at 50 ppb, and 129 had no false negatives at 10 ppb. The HRMS method was shown to be robust with similar data being achieved by all three laboratories and detectable concentrations only slightly above the range shown for triple quadrupole MS/MS.

Ultra-trace analysis of 41Ca in urine by accelerator mass spectrometry: an inter-laboratory comparison

A ⁴¹Ca interlaboratory comparison between Lawrence Livermore National Laboratory (LLNL) and the Purdue Rare Isotope Laboratory (PRIME Lab) has been completed. Analysis of the ratios assayed by accelerator mass spectrometry (AMS) shows that there is no statistically significant difference in the ratios. Further, Bayesian analysis shows that the uncertainties reported by both facilities are correct with the possibility of a slight under-estimation by one laboratory. Finally, the chemistry procedures used by the two facilities to produce CaF₂ for the cesium sputter ion source are robust and don't yield any significant differences in the final result.

Interlaboratory comparison of backscatter coefficient estimates for tissue-mimicking phantoms

Ultrasonic backscatter is useful for characterizing tissues and several groups have reported methods for estimating backscattering properties. Previous interlaboratory comparisons have been made to test the ability to accurately estimate the backscatter coefficient (BSC) by different laboratories around the world. Results of these comparisons showed variability in BSC estimates but were acquired only for a relatively narrow frequency range, and, most importantly, lacked reference to any independent predictions from scattering theory. The goal of this study was to compare Faran-scattering-theory predictions with cooperatively-measured backscatter coefficients for low-attenuating and tissue-like attenuating phantoms containing glass sphere scatterers of different sizes for which BSCs can independently be predicted. Ultrasonic backscatter measurementswere made for frequencies from 1 to 12 MHz. Backscatter coefficients were estimated using two different planar-reflector techniques at two laboratories for two groups of phantoms. Excellent agreement was observed between BSC estimates from both laboratories. In addition, good agreement with the predictions of Faran's theory was obtained, with average fractional (bias) errors ranging from 8-14%. This interlaboratory comparison demonstrates the ability to accurately estimate parameters derived from the BSC, including an effective scatterer size and the acoustic concentration, both of which may prove useful for diagnostic applications of ultrasound tissue characterization.

Interlaboratory Comparison of Magnetic Thin Film Measurements

A potential low magnetic moment standard reference material (SRM) was studied in an interlaboratory comparison. The mean and the standard deviation of the saturation moment m s, the remanent moment m r, and the intrinsic coercivity H c of nine samples were extracted from hysteresis-loop measurements. Samples were measured by thirteen laboratories using inductive-field loopers, vibrating-sample magnetometers, alternating-gradient force magnetometers, and superconducting quantum-interference-device magnetometers. NiFe films on Si substrates had saturation moment measurements reproduced within 5 % variation among the laboratories. The results show that a good candidate for an SRM must have a highly square hysteresis loop (m r/m s > 90 %), H c ≈ 400 A·m(-1) (5 Oe), and m s ≈ 2 × 10(-7) A·m(2) (2 × 10(-4) emu).

Hysteresis in Transport Critical-Current Measurements of Oxide Superconductors

We have investigated magnetic hysteresis in transport critical-current (I c) measurements of Ag-matrix (Bi,Pb)2Sr2Ca2Cu3O10- x (Bi-2223) and AgMg-matrix Bi2Sr2CaCu2O8+ x (Bi-2212) tapes. The effect of magnetic hysteresis on the measured critical current of high temperature superconductors is a very important consideration for every measurement procedure that involves more than one sweep of magnetic field, changes in field angle, or changes in temperature at a given field. The existence of this hysteresis is well known; however, the implications for a measurement standard or interlaboratory comparisons are often ignored and the measurements are often made in the most expedient way. A key finding is that I c at a given angle, determined by sweeping the angles in a given magnetic field, can be 17 % different from the I c determined after the angle was fixed in zero field and the magnet then ramped to the given field. Which value is correct is addressed in the context that the proper sequence of measurement conditions reflects the application conditions. The hysteresis in angle-sweep and temperature-sweep data is related to the hysteresis observed when the field is swept up and down at constant angle and temperature. The necessity of heating a specimen to near its transition temperature to reset it to an initial state between measurements at different angles and temperatures is discussed.

Interlaboratory Comparison on High-Temperature Superconductor Critical-Current Measurements

An extensive interlaboratory comparison was conducted on high temperature superconductor (HTS) critical-current measurements. This study was part of an international cooperative effort through the Versailles Project on Advanced Materials and Standards (VAMAS). The study involved six U.S. laboratories that are recognized leaders in the field of HTS. This paper includes the complete results from this comparison of critical-current measurements on Ag-sheathed Bi₂Sr₂Ca₂Cu₃O_10-x (2223) tapes. The effects of sample characteristics, specimen mounting, measurement technique, and specimen damage were studied. The future development of a standard HTS measurement method is also discussed. Most of the evolution of this emerging technology has occurred in improvement of the performance of the conductors. The successful completion of this interlaboratory comparison is an important milestone in the evolution of HTS technology and marks a level of maturity that the technology has reached.

The Limitations of Models and Measurements as Revealed Through Chemometric Intercomparison

Interlaboratory Comparisons using common (reference) materials of known composition are an established means for assessing overall measurement precision and accuracy. Intercomparisons based on common data sets are equally important and informative, when one is dealing with complex chemical patterns or spectra requiring significant numerical modeling and manipulation for component identification and quantification. Two case studies of "Chemometric Intercomparison" using Simulation Test Data (STD) are presented, the one comprising STD vectors as applied to nuclear spectrometry, and the other, STD data matrices as applied to aerosol source apportionment. Generic information gained from these two exercises includes: a) the requisites for a successful STD intercomparison (including the nature and preparation of the simulation test patterns); b) surprising degrees of bias and imprecision associated with the data evaluation process, per se; c) the need for increased attention to implicit assumptions and adequate statements of uncertainty; and d) the importance of STD beyond the Intercomparison-i.e., their value as a chemometric research tool. Open research questions developed from the STD exercises are highlighted, especially the opportunity to explore "Scientific Intuition" which is essential for the solution of the underdetermined, multicollinear inverse problems that characterize modern Analytical Chemistry.