Consensus procedures and their role in pediatric rheumatology

Factors for Consideration by Pediatric Rheumatologists When Scoring the Physician Global Assessment of Disease Activity in Juvenile Idiopathic Arthritis: First Step Toward an Internal Consensus

OBJECTIVE

The physician global assessment of disease activity (PhGA) is a tool used nearly ubiquitously by pediatric rheumatologists for the assessment of patient disease activity status. However, this tool lacks standardization in its scoring. This survey aimed to identify score influencing factors, along with inclusion or exclusion of extra-articular manifestations and imaging, when scoring the PhGA in juvenile idiopathic arthritis (JIA).

METHODS

Electronic surveys were sent to Paediatric Rheumatology International Trials Organisation and Pediatric Rheumatology Care and Outcomes Improvement Network members who completed a previous survey on scoring of the PhGA. Respondents were asked to rank their top seven factors for inclusion in the PhGA for nonsystemic JIA (nsJIA) and systemic JIA (sJIA), along with ranking extra-articular manifestations and imaging for inclusion. Frequency and percentage of rank and Likert responses were analyzed, and geographic regions as well as level of experience were compared using the chi-square test and Fisher's test.

RESULTS

A total of 276 respondents from 54 countries and six continents participated. For nsJIA, factors selected by >50% included number of swollen joints, active uveitis, duration of morning stiffness, and number of tender joints. For sJIA, factors selected by >50% were presence and duration of fever, laboratory tests, number of swollen joints, serositis, rash, hepatomegaly, lung disease, and lymphadenopathy. Agreement on the inclusion of extra-articular factors, such as uveitis, macrophage activation syndrome, and sJIA-associated lung disease, had >70% moderate or strong agreement for inclusion, whereas psoriasis had only 50.5% agreement for inclusion and imaging had 64.7% agreement for inclusion. Variations in rank between different geographic regions or level of experience were minor.

CONCLUSION

This survey identifies factors that pediatric rheumatology providers find important for PhGA scoring of disease activity, documents varying agreement on inclusion of extra-articular manifestations of disease, and lays the framework for further consensus work.

Validation of the PEDiatric Behçet's Disease classification criteria: an evidence-based approach

OBJECTIVES

to validate the PEDiatric Behçet's Disease classification criteria (PEDBD) with an evidence-based approach.

METHODS

210 pediatric patients (70 Behçet's disease (BD), 40 Periodic Fever, Aphthous stomatitis, Pharyngitis, Adenitis, 35 familial Mediterranean fever, 26 hyper-IgD syndrome, 22 TNF-Receptor associated Periodic fever Syndrome, 17 undefined recurrent fevers) were randomly selected from the Eurofever Registry. A set of 11 experienced clinicians/researchers blinded to the original diagnosis evaluated the patients. Using the table consensus as gold standard (agreement ≥ 80%), the PEDBD, ISG and ICBD criteria were applied to BD patients and to confounding diseases with other autoinflammatory conditions in order to define their sensitivity, specificity and accuracy.

RESULTS

At the end of the third round, a consensus was reached in 139/210 patients (66.2%). The patients with a consensus ≥80% were classified as confirmed-BD (n = 24), and those with an agreement of 60-79% as probable-BD (n = 10). When comparing these patients with the confounding diseases group, an older age at disease onset, the presence of oral and genital ulcers, skin papulo-pustular lesions, a positive pathergy test and posterior uveitis were BD distinctive elements. The ISG, ICBD and PEDBD criteria were applied to confirmed-BD and to the confounding disease group, showing a sensitivity of 0.50, 0.79 and 0.58, a specificity of 1.00, 0.97, 0.99, and an accuracy of 0.91, 0.94 and 0.92, respectively.

CONCLUSIONS

the PEDBD criteria were very specific, while the ICBD resulted to be more sensitive. The complexity of childhood BD suggests larger prospective international cohorts to further evaluate the performance of the criteria.

Adherence to best practice consensus guidelines for familial Mediterranean fever: a modified Delphi study among paediatric rheumatologists in Turkey

Background

Although not validated fully, recommendations are present for diagnosis, screening and treatment modalities of patients with familial Mediterranean fever (FMF).

Objective

To review the current practices of clinicians regarding FMF and reveal their adherence to consensus guidelines.

Methods

Fifteen key points selected regarding the diagnosis and management of FMF were assessed by 14 paediatric rheumatologists with a three-round modified Delphi panel.

Results

Consensus was reached on the following aspects: genetic analysis should be ordered to all patients when clinical findings support FMF, but its result is not decisive alone. In the absence of clinical features, colchicine should be commenced when two pathogenic alleles and family history of amyloidosis are present. Serum amyloid A testing at each visit is recommended in patients resistant to colchicine, with subclinical inflammation and family history of amyloidosis. Consensus was reached on both the definition of colchicine resistance and starting biologic in resistant cases. Cost, efficiency, ease of use, treatment adherence, accessibility and emergence of adverse events are the factors affecting the choice of biologic agents. In patients without any attack and evidence of subclinical inflammation within the last 6 months following initiation of biologics, treatment dose intervals can be prolonged.

Conclusion

A consensus was achieved regarding the routine diagnosis and screening and treatment of FMF patients. The definition of colchicine resistance was made and a protocol was created for prolongation of treatment intervals of biologic agents. We anticipate that the results of the study reveal real-life data on the approach to patients in clinical practice.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00296-020-04776-1.

Development and Acceptability of a Patient Decision Aid for Pain Management in Juvenile Idiopathic Arthritis: The JIA Option Map

BACKGROUND

Youths with juvenile idiopathic arthritis (JIA) often experience pain, which reduces their quality of life. A diversity of pain management options exists for these patients, but few discussions happen in clinical settings. Our team is developing a web-based patient decision aid (PDA) to help youths with JIA, parents, and their health care providers (HCPs) make informed and preference-based decisions about pain management options.

OBJECTIVE

The objective of this study was to develop a paper-based prototype of the web-based PDA and to assess its acceptability.

METHODS

We developed a paper-based prototype of the PDA, called the JIA Option Map, using an iterative process following the International Patient Decision Aid Standards and based on the Ottawa Decision Support Framework. We held three consensus meetings and a follow-up online survey followed by discussions among team members to agree on the format and content of the PDA. We then evaluated acceptability through interviews with 12 youth with JIA (aged 8-18 years), 12 parents, and 11 HCPs. Participants from rheumatology clinics in Canada and the USA reviewed the PDA and assessed its usefulness, content, and format. Interviews were audiotaped, transcribed verbatim, and analyzed using simple descriptive content analysis.

RESULTS

The PDA contains an assessment of pain and current treatments, a values-clarification exercise, a list of 33 treatment options with evidence-based information, and a goal-setting exercise. All participants agreed that it would be a useful tool for making decisions about pain management. Participants appreciated the incorporation of scientific evidence and visuals to demonstrate the benefits of treatment options but suggested describing the source of the evidence more thoroughly. Participants suggested adding complementary medicine and nutrition to the available treatment options and removing options that are primarily used to reduce inflammation. Most participants preferred an interactive web-based version of the PDA that would show a few options consistent with their preferences, followed by a discussion with HCPs.

CONCLUSION

The PDA was deemed acceptable to all participants, with a few modifications. This feedback was used to improve the PDA by simplifying and clarifying the information and adjusting the number of treatment options presented. Work is underway to develop an interactive web-based version with an algorithm to present options tailored to each user.

Classification criteria for autoinflammatory recurrent fevers

Background

Different diagnostic and classification criteria are available for hereditary recurrent fevers (HRF)—familial Mediterranean fever (FMF), tumour necrosis factor receptor-associated periodic fever syndrome (TRAPS), mevalonate kinase deficiency (MKD) and cryopyrin-associated periodic syndromes (CAPS)—and for the non-hereditary, periodic fever, aphthosis, pharyngitis and adenitis (PFAPA). We aimed to develop and validate new evidence-based classification criteria for HRF/PFAPA.

Methods

Step 1: selection of clinical, laboratory and genetic candidate variables; step 2: classification of 360 random patients from the Eurofever Registry by a panel of 25 clinicians and 8 geneticists blinded to patients’ diagnosis (consensus ≥80%); step 3: statistical analysis for the selection of the best candidate classification criteria; step 4: nominal group technique consensus conference with 33 panellists for the discussion and selection of the final classification criteria; step 5: cross-sectional validation of the novel criteria.

Results

The panellists achieved consensus to classify 281 of 360 (78%) patients (32 CAPS, 36 FMF, 56 MKD, 37 PFAPA, 39 TRAPS, 81 undefined recurrent fever). Consensus was reached for two sets of criteria for each HRF, one including genetic and clinical variables, the other with clinical variables only, plus new criteria for PFAPA. The four HRF criteria demonstrated sensitivity of 0.94–1 and specificity of 0.95–1; for PFAPA, criteria sensitivity and specificity were 0.97 and 0.93, respectively. Validation of these criteria in an independent data set of 1018 patients shows a high accuracy (from 0.81 to 0.98).

Conclusion

Eurofever proposes a novel set of validated classification criteria for HRF and PFAPA with high sensitivity and specificity.

Toward New Classification Criteria for Juvenile Idiopathic Arthritis: First Steps, Pediatric Rheumatology International Trials Organization International Consensus

OBJECTIVE

To revise the current juvenile idiopathic arthritis (JIA) International League of Associations for Rheumatology (ILAR) classification criteria with an evidence-based approach, using clinical and routine laboratory measures available worldwide, to identify homogeneous clinical groups and to distinguish those forms of chronic arthritis typically seen only in children from the childhood counterpart of adult diseases.

METHODS

The overall project consists of 4 steps. This work represents Step 1, a Delphi Web-based consensus and Step 2, an international nominal group technique (NGT) consensus conference for the new provisional Pediatric Rheumatology International Trials Organization JIA classification criteria. A future large data collection of at least 1000 new-onset JIA patients (Step 3) followed by analysis and NGT consensus (Step 4) will provide data for the evidence-based validation of the JIA classification criteria.

RESULTS

In Step 1, three Delphi rounds of interactions were implemented to revise the 7 ILAR JIA categories. In Step 2, forty-seven questions with electronic voting were implemented to derive the new proposed criteria. Four disorders were proposed: (a) systemic JIA; (b) rheumatoid factor-positive JIA; (c) enthesitis/spondylitis-related JIA; and (d) early-onset antinuclear antibody-positive JIA. The other forms were gathered under the term "others." These will be analyzed during the prospective data collection using a list of descriptors to see whether the clustering of some of them could identify homogeneous entities.

CONCLUSION

An international consensus was reached to identify different proposed homogeneous chronic disorders that fall under the historical term JIA. These preliminary criteria will be formally validated with a dedicated project.

Towards a new set of classification criteria for PFAPA syndrome

BACKGROUND

Diagnosis of Periodic Fever, Aphthous stomatitis, Pharyngitis and Cervical Adenitis (PFAPA) syndrome is currently based on the modified Marshall's criteria, but no validated evidence based classification criteria for PFAPA has been established so far.

METHODS

A multistep process, based on the Delphi and Nominal Group Technique was conducted. After 2 rounds of e-mail Delphi survey involving 21 experts in autoinflammation we obtained a list of variables that were discussed in an International Consensus Conference. Variables reaching the 80% of consensus between participants were included in the new classification criteria. In the second phase the new classification criteria and the modified Marshall's criteria were applied on a cohort of 80 pediatric PFAPA patients to compare their performance.

RESULTS

The Delphi Survey was sent to 22 participants, 21 accepted to participate. Thirty variables were obtained from the survey and have been discussed at the Consensus Conference. Through the Nominal Group Technique we obtained a new set of classification criteria. These criteria were more restrictive in respect to the modified Marshall's criteria when applied on our cohort of patients.

CONCLUSION

Our work led us to identify a new set of classification criteria for PFAPA syndrome, but they resulted to be too restrictive to be applied in daily clinical practice for the diagnosis of PFAPA.

Consensus proposal for taxonomy and definition of the autoinflammatory diseases (AIDs): a Delphi study

Autoinflammatory diseases (AIDs) are a relatively new family of disorders, defined about 19 years ago. Some of them are hereditary and some are not. The names given to these diseases do not follow any systematic guidelines, and sometimes the same disorder carries several names. The aim of this study is to refine the definition of AIDs and to provide some conventions for their naming. We focused mainly on monogenetic AIDs. Delphi technique, which enables consensus among a group of experts through internet and mail communication and questionnaires, was employed. After achieving 100% consensus among six members of a steering committee, the questionnaire containing AID definitions and the agreed-upon conventions were sent to 26 physicians and researchers working in the field of AIDs in order to gain broader support for the committee's proposals. The committee proposed the following definition for AIDs: "Autoinflammatory diseases are clinical disorders caused by defect(s) or dysregulation of the innate immune system, characterized by recurrent or continuous inflammation (elevated acute phase reactants-APR) and the lack of a primary pathogenic role for the adaptive immune system (autoreactive T-cells or autoantibody production)." Several rules were defined for guiding the naming of these diseases among which are: abandoning eponyms and preferring the name of the gene over its encoded protein. The new definition for AIDs allows inclusion of clinical disorders mainly associated with defects in the innate immune system. The new conventions propose names with clinical meaning and in some cases even clues for treatment.

Imaging of temporomandibular joint abnormalities in juvenile idiopathic arthritis with a focus on developing a magnetic resonance imaging protocol

Inflammation and damage in the temporomandibular joint (TMJ) often develop without clinical symptoms but can lead to severe facial growth abnormalities and impaired health-related quality of life, making early diagnosis of TMJ changes crucial to identify. Inflammatory and osteochondral changes detectable through magnetic resonance imaging (MRI) occur in TMJs of approximately 40% of children with juvenile idiopathic arthritis (JIA), and no other imaging modality or physical method of examination can reliably detect these changes. Therefore contrast-enhanced MRI is the diagnostic standard for diagnosis and interval monitoring of JIA. However the specific usage of MRI for TMJ arthritis is not standardized at present. There is a recognized need for a consensus effort toward standardization of an imaging protocol with required and optional sequences to improve detection of pathological changes and shorten study time. Such a consensus imaging protocol is important for providing maximum information with minimally necessary sequences in a way that allows inter-site comparison of results of clinical trials and improved clinical management. In this paper we describe the challenges of TMJ imaging and present expert-panel consensus suggestions for a standardized TMJ MRI protocol.

An international delphi survey for the definition of the variables for the development of new classification criteria for periodic fever aphtous stomatitis pharingitis cervical adenitis (PFAPA)

BACKGROUND

Diagnosis of Periodic fever, aphthous stomatitis, pharyngitis and cervical adenitis (PFAPA) is currently based on a set of criteria proposed in 1999 modified from Marshall's criteria. Nevertheless no validated evidence based set of classification criteria for PFAPA has been established so far. The aim of this study was to identify candidate classification criteria PFAPA syndrome using international consensus formation through a Delphi questionnaire survey.

METHODS

A first open-ended questionnaire was sent to adult and pediatric clinicians/researchers, asking to identify the variables thought most likely to be helpful and relevant for the diagnosis of PFAPA. In a second survey, respondents were asked to select, from the list of variables coming from the first survey, the 10 features that they felt were most important, and to rank them in descending order from most important to least important.

RESULTS

The response rate to the first and second Delphi was respectively 109/124 (88%) and 141/162 (87%). The number of participants that completed the first and second Delphi was 69/124 (56%) and 110/162 (68%). From the first Delphi we obtained a list of 92 variables, of which 62 were selected in the second Delphi. Variables reaching the top five position of the rank were regular periodicity, aphthous stomatitis, response to corticosteroids, cervical adenitis, and well-being between flares.

CONCLUSION

Our process led to identification of features that were felt to be the most important as candidate classification criteria for PFAPA by a large sample of international rheumatologists. The performance of these items will be tested further in the next phase of the study, through analysis of real patient data.

Toward Establishing a Standardized Magnetic Resonance Imaging Scoring System for Temporomandibular Joints in Juvenile Idiopathic Arthritis

OBJECTIVE

The temporomandibular joints (TMJs) are frequently affected in children with juvenile idiopathic arthritis (JIA). Early detection is challenging, as major variation is present in scoring TMJ pathology on magnetic resonance imaging (MRI). Consensus-driven development and validation of an MRI scoring system for TMJs has important clinical utility in timely improvement of diagnosis and serving as an outcome measure. We report on a multi-institutional collaboration toward developing a TMJ MRI scoring system for JIA.

METHODS

Seven readers independently assessed MRI scans from 21 patients (42 TMJs, from patients ages 6-16 years) using 3 existing MRI scoring systems from American, German, and Swiss institutions. Reliability scores, scoring system definitions, and items were discussed among 10 JIA experts through 2 rounds of Delphi surveys, nominal group voting, and subsequent consensus meetings to create a novel TMJ MRI scoring system.

RESULTS

Average-measure absolute agreement intraclass correlation coefficients (avICCs) for the total scores of all 3 scoring systems were highly reliable at 0.96 each. Osteochondral items showed higher reliability than inflammatory items. An additive system was deemed preferable for assessing minor joint changes over time. Eight items were considered sufficiently reliable and/or important for integration into the consensus scoring system: bone marrow edema and enhancement (avICC 0.57-0.61, smallest detectable difference [SDD] ± 45-63% prior to redefining), condylar flattening (avICC 0.95-0.96, SDD ± 23-28%), effusions (avICC 0.85-0.88, SDD ± 25-26%), erosions (avICC 0.94, SDD ± 20%), synovial enhancement and thickening (previously combined, avICC 0.90-0.91, SDD ± 33%), and disk abnormalities (avICC 0.90, SDD ± 19%).

CONCLUSION

A novel TMJ MRI scoring system was developed by consensus. Further iterative refinements and reliability testing are warranted in upcoming studies.

EULAR/ACR classification criteria for adult and juvenile idiopathic inflammatory myopathies and their major subgroups: a methodology report

OBJECTIVE

To describe the methodology used to develop new classification criteria for adult and juvenile idiopathic inflammatory myopathies (IIMs) and their major subgroups.

METHODS

An international, multidisciplinary group of myositis experts produced a set of 93 potentially relevant variables to be tested for inclusion in the criteria. Rheumatology, dermatology, neurology and paediatric clinics worldwide collected data on 976 IIM cases (74% adults, 26% children) and 624 non-IIM comparator cases with mimicking conditions (82% adults, 18% children). The participating clinicians classified each case as IIM or non-IIM. Generally, the classification of any given patient was based on few variables, leaving remaining variables unmeasured. We investigated the strength of the association between all variables and between these and the disease status as determined by the physician. We considered three approaches: (1) a probability-score approach, (2) a sum-of-items approach criteria and (3) a classification-tree approach.

RESULTS

The approaches yielded several candidate models that were scrutinised with respect to statistical performance and clinical relevance. The probability-score approach showed superior statistical performance and clinical practicability and was therefore preferred over the others. We developed a classification tree for subclassification of patients with IIM. A calculator for electronic devices, such as computers and smartphones, facilitates the use of the European League Against Rheumatism/American College of Rheumatology (EULAR/ACR) classification criteria.

CONCLUSIONS

The new EULAR/ACR classification criteria provide a patient's probability of having IIM for use in clinical and research settings. The probability is based on a score obtained by summing the weights associated with a set of criteria items.

2016 ACR-EULAR adult dermatomyositis and polymyositis and juvenile dermatomyositis response criteria-methodological aspects

Objective

The objective was to describe the methodology used to develop new response criteria for adult DM/PM and JDM.

Methods

Patient profiles from prospective natural history data and clinical trials were rated by myositis specialists to develop consensus gold-standard ratings of minimal, moderate and major improvement. Experts completed a survey regarding clinically meaningful improvement in the core set measures (CSM) and a conjoint-analysis survey (using 1000Minds software) to derive relative weights of CSM and candidate definitions. Six types of candidate definitions for response criteria were derived using survey results, logistic regression, conjoint analysis, application of conjoint-analysis weights to CSM and published definitions. Sensitivity, specificity and area under the curve were defined for candidate criteria using consensus patient profile data, and selected definitions were validated using clinical trial data.

Results

Myositis specialists defined the degree of clinically meaningful improvement in CSM for minimal, moderate and major improvement. The conjoint-analysis survey established the relative weights of CSM, with muscle strength and Physician Global Activity as most important. Many candidate definitions showed excellent sensitivity, specificity and area under the curve in the consensus profiles. Trial validation showed that a number of candidate criteria differentiated between treatment groups. Top candidate criteria definitions were presented at the consensus conference.

Conclusion

Consensus methodology, with definitions tested on patient profiles and validated using clinical trials, led to 18 definitions for adult PM/DM and 14 for JDM as excellent candidates for consideration in the final consensus on new response criteria for myositis.

2017 European League Against Rheumatism/American College of Rheumatology classification criteria for adult and juvenile idiopathic inflammatory myopathies and their major subgroups

OBJECTIVE

To develop and validate new classification criteria for adult and juvenile idiopathic inflammatory myopathies (IIM) and their major subgroups.

METHODS

Candidate variables were assembled from published criteria and expert opinion using consensus methodology. Data were collected from 47 rheumatology, dermatology, neurology and paediatric clinics worldwide. Several statistical methods were used to derive the classification criteria.

RESULTS

Based on data from 976 IIM patients (74% adults; 26% children) and 624 non-IIM patients with mimicking conditions (82% adults; 18% children), new criteria were derived. Each item is assigned a weighted score. The total score corresponds to a probability of having IIM. Subclassification is performed using a classification tree. A probability cut-off of 55%, corresponding to a score of 5.5 (6.7 with muscle biopsy) 'probable IIM', had best sensitivity/specificity (87%/82% without biopsies, 93%/88% with biopsies) and is recommended as a minimum to classify a patient as having IIM. A probability of ≥90%, corresponding to a score of ≥7.5 (≥8.7 with muscle biopsy), corresponds to 'definite IIM'. A probability of <50%, corresponding to a score of <5.3 (<6.5 with muscle biopsy), rules out IIM, leaving a probability of ≥50 to <55% as 'possible IIM'.

CONCLUSIONS

The European League Against Rheumatism/American College of Rheumatology (EULAR/ACR) classification criteria for IIM have been endorsed by international rheumatology, dermatology, neurology and paediatric groups. They employ easily accessible and operationally defined elements, and have been partially validated. They allow classification of 'definite', 'probable' and 'possible' IIM, in addition to the major subgroups of IIM, including juvenile IIM. They generally perform better than existing criteria.

2017 European League Against Rheumatism/American College of Rheumatology Classification Criteria for Adult and Juvenile Idiopathic Inflammatory Myopathies and Their Major Subgroups

OBJECTIVE

To develop and validate new classification criteria for adult and juvenile idiopathic inflammatory myopathies (IIM) and their major subgroups.

METHODS

Candidate variables were assembled from published criteria and expert opinion using consensus methodology. Data were collected from 47 rheumatology, dermatology, neurology, and pediatric clinics worldwide. Several statistical methods were utilized to derive the classification criteria.

RESULTS

Based on data from 976 IIM patients (74% adults; 26% children) and 624 non-IIM patients with mimicking conditions (82% adults; 18% children), new criteria were derived. Each item is assigned a weighted score. The total score corresponds to a probability of having IIM. Subclassification is performed using a classification tree. A probability cutoff of 55%, corresponding to a score of 5.5 (6.7 with muscle biopsy) "probable IIM," had best sensitivity/specificity (87%/82% without biopsies, 93%/88% with biopsies) and is recommended as a minimum to classify a patient as having IIM. A probability of ≥90%, corresponding to a score of ≥7.5 (≥8.7 with muscle biopsy), corresponds to "definite IIM." A probability of <50%, corresponding to a score of <5.3 (<6.5 with muscle biopsy), rules out IIM, leaving a probability of ≥50-<55% as "possible IIM."

CONCLUSION

The European League Against Rheumatism/American College of Rheumatology (EULAR/ACR) classification criteria for IIM have been endorsed by international rheumatology, dermatology, neurology, and pediatric groups. They employ easily accessible and operationally defined elements, and have been partially validated. They allow classification of "definite," "probable," and "possible" IIM, in addition to the major subgroups of IIM, including juvenile IIM. They generally perform better than existing criteria.

2016 American College of Rheumatology/European League Against Rheumatism Criteria for Minimal, Moderate, and Major Clinical Response in Juvenile Dermatomyositis: An International Myositis Assessment and Clinical Studies Group/Paediatric Rheumatology International Trials Organisation Collaborative Initiative

OBJECTIVE

To develop response criteria for juvenile dermatomyositis (DM).

METHODS

We analyzed the performance of 312 definitions that used core set measures from either the International Myositis Assessment and Clinical Studies Group (IMACS) or the Paediatric Rheumatology International Trials Organisation (PRINTO) and were derived from natural history data and a conjoint analysis survey. They were further validated using data from the PRINTO trial of prednisone alone compared to prednisone with methotrexate or cyclosporine and the Rituximab in Myositis (RIM) trial. At a consensus conference, experts considered 14 top candidate criteria based on their performance characteristics and clinical face validity, using nominal group technique.

RESULTS

Consensus was reached for a conjoint analysis-based continuous model with a total improvement score of 0-100, using absolute percent change in core set measures of minimal (≥30), moderate (≥45), and major (≥70) improvement. The same criteria were chosen for adult DM/polymyositis, with differing thresholds for improvement. The sensitivity and specificity were 89% and 91-98% for minimal improvement, 92-94% and 94-99% for moderate improvement, and 91-98% and 85-86% for major improvement, respectively, in juvenile DM patient cohorts using the IMACS and PRINTO core set measures. These criteria were validated in the PRINTO trial for differentiating between treatment arms for minimal and moderate improvement (P = 0.009-0.057) and in the RIM trial for significantly differentiating the physician's rating for improvement (P < 0.006).

CONCLUSION

The response criteria for juvenile DM consisted of a conjoint analysis-based model using a continuous improvement score based on absolute percent change in core set measures, with thresholds for minimal, moderate, and major improvement.

2016 American College of Rheumatology/European League Against Rheumatism Criteria for Minimal, Moderate, and Major Clinical Response in Juvenile Dermatomyositis: An International Myositis Assessment and Clinical Studies Group/Paediatric Rheumatology International Trials Organisation Collaborative Initiative

To develop response criteria for juvenile dermatomyositis (DM). We analysed the performance of 312 definitions that used core set measures from either the International Myositis Assessment and Clinical Studies Group (IMACS) or the Paediatric Rheumatology International Trials Organisation (PRINTO) and were derived from natural history data and a conjoint analysis survey. They were further validated using data from the PRINTO trial of prednisone alone compared to prednisone with methotrexate or cyclosporine and the Rituximab in Myositis (RIM) trial. At a consensus conference, experts considered 14 top candidate criteria based on their performance characteristics and clinical face validity, using nominal group technique. Consensus was reached for a conjoint analysis-based continuous model with a total improvement score of 0-100, using absolute per cent change in core set measures of minimal (≥30), moderate (≥45), and major (≥70) improvement. The same criteria were chosen for adult DM/polymyositis, with differing thresholds for improvement. The sensitivity and specificity were 89% and 91-98% for minimal improvement, 92-94% and 94-99% for moderate improvement, and 91-98% and 85-86% for major improvement, respectively, in juvenile DM patient cohorts using the IMACS and PRINTO core set measures. These criteria were validated in the PRINTO trial for differentiating between treatment arms for minimal and moderate improvement (p=0.009-0.057) and in the RIM trial for significantly differentiating the physician's rating for improvement (p<0.006). The response criteria for juvenile DM consisted of a conjoint analysis-based model using a continuous improvement score based on absolute per cent change in core set measures, with thresholds for minimal, moderate, and major improvement.

2016 American College of Rheumatology/European League Against Rheumatism criteria for minimal, moderate, and major clinical response in adult dermatomyositis and polymyositis: An International Myositis Assessment and Clinical Studies Group/Paediatric Rheumatology International Trials Organisation Collaborative Initiative

To develop response criteria for adult dermatomyositis (DM) and polymyositis (PM). Expert surveys, logistic regression, and conjoint analysis were used to develop 287 definitions using core set measures. Myositis experts rated greater improvement among multiple pairwise scenarios in conjoint analysis surveys, where different levels of improvement in 2 core set measures were presented. The PAPRIKA (Potentially All Pairwise Rankings of All Possible Alternatives) method determined the relative weights of core set measures and conjoint analysis definitions. The performance characteristics of the definitions were evaluated on patient profiles using expert consensus (gold standard) and were validated using data from a clinical trial. The nominal group technique was used to reach consensus. Consensus was reached for a conjoint analysis-based continuous model using absolute per cent change in core set measures (physician, patient, and extramuscular global activity, muscle strength, Health Assessment Questionnaire, and muscle enzyme levels). A total improvement score (range 0-100), determined by summing scores for each core set measure, was based on improvement in and relative weight of each core set measure. Thresholds for minimal, moderate, and major improvement were ≥20, ≥40, and ≥60 points in the total improvement score. The same criteria were chosen for juvenile DM, with different improvement thresholds. Sensitivity and specificity in DM/PM patient cohorts were 85% and 92%, 90% and 96%, and 92% and 98% for minimal, moderate, and major improvement, respectively. Definitions were validated in the clinical trial analysis for differentiating the physician rating of improvement (p<0.001). The response criteria for adult DM/PM consisted of the conjoint analysis model based on absolute per cent change in 6 core set measures, with thresholds for minimal, moderate, and major improvement.

2016 American College of Rheumatology/European League Against Rheumatism Criteria for Minimal, Moderate, and Major Clinical Response in Adult Dermatomyositis and Polymyositis: An International Myositis Assessment and Clinical Studies Group/Paediatric Rheumatology International Trials Organisation Collaborative Initiative

OBJECTIVE

To develop response criteria for adult dermatomyositis (DM) and polymyositis (PM).

METHODS

Expert surveys, logistic regression, and conjoint analysis were used to develop 287 definitions using core set measures. Myositis experts rated greater improvement among multiple pairwise scenarios in conjoint analysis surveys, where different levels of improvement in 2 core set measures were presented. The PAPRIKA (Potentially All Pairwise Rankings of All Possible Alternatives) method determined the relative weights of core set measures and conjoint analysis definitions. The performance characteristics of the definitions were evaluated on patient profiles using expert consensus (gold standard) and were validated using data from a clinical trial. The nominal group technique was used to reach consensus.

RESULTS

Consensus was reached for a conjoint analysis-based continuous model using absolute percent change in core set measures (physician, patient, and extramuscular global activity, muscle strength, Health Assessment Questionnaire, and muscle enzyme levels). A total improvement score (range 0-100), determined by summing scores for each core set measure, was based on improvement in and relative weight of each core set measure. Thresholds for minimal, moderate, and major improvement were ≥20, ≥40, and ≥60 points in the total improvement score. The same criteria were chosen for juvenile DM, with different improvement thresholds. Sensitivity and specificity in DM/PM patient cohorts were 85% and 92%, 90% and 96%, and 92% and 98% for minimal, moderate, and major improvement, respectively. Definitions were validated in the clinical trial analysis for differentiating the physician rating of improvement (P < 0.001).

CONCLUSION

The response criteria for adult DM/PM consisted of the conjoint analysis model based on absolute percent change in 6 core set measures, with thresholds for minimal, moderate, and major improvement.

Childhood Arthritis and Rheumatology Research Alliance consensus clinical treatment plans for juvenile dermatomyositis with skin predominant disease

BACKGROUND

Juvenile dermatomyositis (JDM) is the most common form of the idiopathic inflammatory myopathies in children. A subset of children have the rash of JDM without significant weakness, and the optimal treatments for these children are unknown. The goal of this study was to describe the development of consensus clinical treatment plans (CTPs) for children with JDM who have active skin rashes, without significant muscle involvement, referred to as skin predominant JDM in this manuscript.

METHODS

The Children's Arthritis and Rheumatology Research Alliance (CARRA) is a North American consortium of pediatric rheumatology health care providers. CARRA members collaborated to determine consensus on typical treatments for JDM patients with skin findings without significant weakness, to develop CTPs for this subgroup of patients. We used a combination of Delphi surveys and nominal group consensus meetings to develop these CTPs.

RESULTS

Consensus was reached on patient characteristics and outcome assessment, and CTPs were developed and finalized for patients with skin predominant JDM. Treatment option A included hydroxychloroquine alone, Treatment option B included hydroxychloroquine and methotrexate, and Treatment option C included hydroxychloroquine, methotrexate and corticosteroids.

CONCLUSIONS

Three CTPs were developed for use in children with skin predominant JDM, which reflect typical treatment approaches. These are not considered to be specific recommendations or standard of care. Using the CARRA network and prospective data collection, we will be able to apply statistical methods in the future to allow comparisons of JDM patients following these consensus treatment plans.

Development of the autoinflammatory disease damage index (ADDI)

Objectives

Autoinflammatory diseases cause systemic inflammation that can result in damage to multiple organs. A validated instrument is essential to quantify damage in individual patients and to compare disease outcomes in clinical studies. Currently, there is no such tool. Our objective was to develop a common autoinflammatory disease damage index (ADDI) for familial Mediterranean fever, cryopyrin-associated periodic syndromes, tumour necrosis factor receptor-associated periodic fever syndrome and mevalonate kinase deficiency.

Methods

We developed the ADDI by consensus building. The top 40 enrollers of patients in the Eurofever Registry and 9 experts from the Americas participated in multiple rounds of online surveys to select items and definitions. Further, 22 (parents of) patients rated damage items and suggested new items. A consensus meeting was held to refine the items and definitions, which were then formally weighted in a scoring system derived using decision-making software, known as 1000minds.

Results

More than 80% of the experts and patients completed the online surveys. The preliminary ADDI contains 18 items, categorised in the following eight organ systems: reproductive, renal/amyloidosis, developmental, serosal, neurological, ears, ocular and musculoskeletal damage. The categories renal/amyloidosis and neurological damage were assigned the highest number of points, serosal damage the lowest number of points. The involvement of (parents of) patients resulted in the inclusion of, for example, chronic musculoskeletal pain.

Conclusions

An instrument to measure damage caused by autoinflammatory diseases is developed based on consensus building. Patients fulfilled a significant role in this process.

Development and Preliminary Face and Content Validation of the "Which Health Approaches and Treatments Are You Using?" (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

Objective

Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology.

Methods

A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items.

Results

Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity.

Conclusions

Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic diseases.

Development and initial validation of international severity scoring system for familial Mediterranean fever (ISSF)

OBJECTIVE

To develop widely accepted international severity score for children and adult patients with familial Mediterranean fever (FMF) that can be easily applied, in research and clinical practice.

METHODS

Candidate severity criteria were suggested by several FMF expert physicians. After three rounds of Delphi survey, the candidate criteria, defined by the survey, were discussed by experts in a consensus meeting. Each expert brought data of clinical manifestations, laboratory findings and physician's global assessments (PGAs) of minimum 20 patients from their centres. We used the PGAs for disease severity as a gold standard. Logistic regression analysis was used to evaluate the predicting value of each item, and receiver operating characteristic curve analysis was performed to demonstrate the success of the criteria set.

RESULTS

A total of 281 patients consist of 162 children and 119 adults with FMF were enrolled and available for validity analysis: Nine domains were included in the final core set of variables for the evaluation of disease severity in FMF. The International Severity Score for FMF (ISSF) may reach a maximum of 10 if all items are maximally scored. The threshold values to determine: severe disease ≥6, intermediate disease 3-5, mild disease ≤2. Area under the curve was calculated as 0.825 for this set in the whole group.

CONCLUSIONS

The initial validity of ISSF both in children and adult with FMF was demonstrated. We anticipate that it will provide a robust tool to objectively define disease severity for clinical trials, future research as well as for therapeutic decisions in managing patients with FMF.

Health outcomes of pediatric rheumatic diseases

Measurement of health outcomes in pediatric rheumatic diseases is a critical component of clinical practice and research studies. Measures should include the biological, physical, and psychosocial dimensions of health. Health outcome measures are developed systematically, often using consensus methods. Prior to implementation into practice, health outcome measures must undergo evaluation of measurement properties such as reliability, validity, and responsiveness. There are several health outcome measures available for juvenile idiopathic arthritis, juvenile systemic lupus erythematosus, and juvenile dermatomyositis, many of which are composite measures of disease activity. In addition, tools exist for measuring physical functioning and health-related quality of life. There is increasing focus on the incorporation of patient-reported or parent-reported outcomes when measuring the health state of patients with pediatric rheumatic diseases. Further work is required to determine the optimal health outcome measures and approach for eliciting the patient's perception of their health state in pediatric rheumatology.

A smartphone-based pain management app for adolescents with cancer: establishing system requirements and a pain care algorithm based on literature review, interviews, and consensus

BACKGROUND

Pain that occurs both within and outside of the hospital setting is a common and distressing problem for adolescents with cancer. The use of smartphone technology may facilitate rapid, in-the-moment pain support for this population. To ensure the best possible pain management advice is given, evidence-based and expert-vetted care algorithms and system design features, which are designed using user-centered methods, are required.

OBJECTIVE

To develop the decision algorithm and system requirements that will inform the pain management advice provided by a real-time smartphone-based pain management app for adolescents with cancer.

METHODS

A systematic approach to algorithm development and system design was utilized. Initially, a comprehensive literature review was undertaken to understand the current body of knowledge pertaining to pediatric cancer pain management. A user-centered approach to development was used as the results of the review were disseminated to 15 international experts (clinicians, scientists, and a consumer) in pediatric pain, pediatric oncology and mHealth design, who participated in a 2-day consensus conference. This conference used nominal group technique to develop consensus on important pain inputs, pain management advice, and system design requirements. Using data generated at the conference, a prototype algorithm was developed. Iterative qualitative testing was conducted with adolescents with cancer, as well as pediatric oncology and pain health care providers to vet and refine the developed algorithm and system requirements for the real-time smartphone app.

RESULTS

The systematic literature review established the current state of research related to nonpharmacological pediatric cancer pain management. The 2-day consensus conference established which clinically important pain inputs by adolescents would require action (pain management advice) from the app, the appropriate advice the app should provide to adolescents in pain, and the functional requirements of the app. These results were used to build a detailed prototype algorithm capable of providing adolescents with pain management support based on their individual pain. Analysis of qualitative interviews with 9 multidisciplinary health care professionals and 10 adolescents resulted in 4 themes that helped to adapt the algorithm and requirements to the needs of adolescents. Specifically, themes were overall endorsement of the system, the need for a clinical expert, the need to individualize the system, and changes to the algorithm to improve potential clinical effectiveness.

CONCLUSIONS

This study used a phased and user-centered approach to develop a pain management algorithm for adolescents with cancer and the system requirements of an associated app. The smartphone software is currently being created and subsequent work will focus on the usability, feasibility, and effectiveness testing of the app for adolescents with cancer pain.

Validation of the auto-inflammatory diseases activity index (AIDAI) for hereditary recurrent fever syndromes

Objectives

To validate the Auto-Inflammatory Diseases Activity Index (AIDAI) in the four major hereditary recurrent fever syndromes (HRFs): familial Mediterranean fever (FMF), mevalonate kinase deficiency (MKD), tumour necrosis factor receptor-associated periodic syndrome (TRAPS) and cryopyrin-associated periodic syndromes (CAPS).

Methods

In 2010, an international collaboration established the content of a disease activity tool for HRFs. Patients completed a 1-month prospective diary with 12 yes/no items before a clinical appointment during which their physician assessed their disease activity by a questionnaire. Eight international experts in auto-inflammatory diseases evaluated the patient's disease activity by a blinded web evaluation and a nominal group technique consensus conference, with their consensus judgement considered the gold standard. Sensitivity/specificity/accuracy measures and the ability of the score to discriminate active from inactive patients via the best cut-off score were calculated by a receiver operating characteristic analysis.

Results

Consensus was achieved for 98/106 (92%) cases (39 FMF, 35 CAPS, 14 TRAPS and 10 MKD), with 26 patients declared as having inactive disease and 72 as having active disease. The median total AIDAI score was 14 (range=0–175). An AIDAI cut-off score ≥9 discriminated active from inactive patients, with sensitivity/specificity/accuracy of 89%/92%/90%, respectively, and an area under the curve of 98% (95% CI 96% to 100%).

Conclusions

The AIDAI score is a valid and simple tool for assessing disease activity in FMF/MKD/TRAPS/CAPS. This tool is easy to use in clinical practice and has the potential to be used as the standard efficacy measure in future clinical trials.

Disease activity measures in paediatric rheumatic diseases

Disease activity refers to potentially reversible aspects of a disease. Measurement of disease activity in paediatric rheumatic diseases is a critical component of patient care and clinical research. Disease activity measures are developed systematically, often involving consensus methods. To be useful, a disease activity measure must be feasible, valid, and interpretable. There are several challenges in quantifying disease activity in paediatric rheumatology; namely, the conditions are multidimensional, the level of activity must be valuated in the context of treatment being received, there is no gold standard for disease activity, and it is often difficult to incorporate the patient's perspective of their disease activity. To date, core sets of response variables are defined for juvenile idiopathic arthritis, juvenile systemic lupus erythematosus, and juvenile dermatomyositis, as well as definitions for improvement in response to therapy. Several specific absolute disease activity measures also exist for each condition. Further work is required to determine the optimal disease activity measures in paediatric rheumatology.

The Standardization of Uveitis Nomenclature (SUN) Project. Development of a clinical evidence base utilizing informatics tools and techniques

BACKGROUND

Given the recent increased focus on evidence-based medicine, it is critical that diseases and syndromes have accurate and complete descriptions, including standardized and widely accepted terminologies. Standardizing these descriptions and terminologies is necessary to develop tools such as computerized data entry forms and classification criteria. This need is especially true for diseases that are relatively uncommon, such as uveitis.

OBJECTIVES

To develop a standardized and internationally accepted terminology for the field of uveitis.

METHODS

The Standardization of Uveitis Nomenclature (SUN) Working Group (WG) is an international group of 79 uveitis experts from 18 countries and 62 clinical centers. Initial terminology was developed utilizing a "modified" green field approach, which was enhanced through web-based surveys and teleconferences via a "modified" Delphi technique. Terms were mapped provisionally into ontologic dimensions for each syndrome. The Working Group then met and utilized nominal group techniques as a formalized method of finalizing the mappings.

RESULTS

Mapping of terms into dimensions to describe 28 major uveitic diseases was confirmed using nominal group techniques (achieving super-majority consensus) for each of the diseases at a meeting of the entire WG.

CONCLUSIONS

The SUN WG utilized an informatics-based approach to develop a standardized and internationally accepted terminology for the uveitides.

Developing a standardized approach to the assessment of pain in children and youth presenting to pediatric rheumatology providers: a Delphi survey and consensus conference process followed by feasibility testing

BACKGROUND

Pain in children with rheumatic conditions such as arthritis is common. However, there is currently no standardized method for the assessment of this pain in children presenting to pediatric rheumatologists. A more consistent and comprehensive approach is needed to effectively assess, treat and monitor pain outcomes in the pediatric rheumatology population. The objectives of this study were to: (a) develop consensus regarding a standardized pain assessment tool for use in pediatric rheumatology practice and (b) test the feasibility of three mediums (paper, laptop, and handheld-based applications) for administration.

METHODS

In Phase 1, a 2-stage Delphi technique (pediatric rheumatologists and allied professionals) and consensus meeting (pediatric pain and rheumatology experts) were used to develop the self- and proxy-report pain measures. In Phase 2, 24 children aged 4-7 years (and their parents), and 77 youth, aged 8-18 years, with pain, were recruited during routine rheumatology clinic appointments and completed the pain measure using each medium (order randomly assigned). The participant's rheumatologist received a summary report prior to clinical assessment. Satisfaction surveys were completed by all participants. Descriptive statistics were used to describe the participant characteristics using means and standard deviations (for continuous variables) and frequencies and proportions (for categorical variables)

RESULTS

Completing the measure using the handheld device took significantly longer for youth (M = 5.90 minutes) and parents (M = 7.00 minutes) compared to paper (M = 3.08 and 2.28 minutes respectively p = 0.001) and computer (M = 3.40 and 4.00 minutes respectively; p < 0.001). There was no difference in the number of missed responses between mediums for children or parents. For youth, the number of missed responses varied across mediums (p = 0.047) with the greatest number of missed responses occurring with the handheld device. Most children preferred the computer (65%, p = 0.008) and youth reported no preference between mediums (p = 0.307). Most physicians (60%) would recommend the computer summary over the paper questionnaire to a colleague.

CONCLUSIONS

It is clinically feasible to implement a newly developed consensus-driven pain measure in pediatric rheumatology clinics using electronic or paper administration. Computer-based administration was most efficient for most users, but the medium employed in practice may depend on child age and economic and administrative factors.

Methods of formal consensus in classification/diagnostic criteria and guideline development

Guidelines or diagnostic criteria in clinical practice assist physicians in their clinical decision-making and improve health outcomes for patients. Diagnostic and classification criteria should be based on evidence from rigorously conducted controlled studies. Formal group consensus methods have been developed to organize subjective judgments and to synthesize them with the available evidence. This review discusses 4 types of formal consensus methods used in the health field and their applications in rheumatology: the Delphi method, Nominal Group Technique, RAND/UCLA Appropriateness Method, and National Institutes of Health consensus development conference.

An International Consensus Survey of Diagnostic Criteria for Macrophage Activation Syndrome in Systemic Juvenile Idiopathic Arthritis

Objective.

To identify candidate diagnostic criteria for macrophage activation syndrome (MAS) complicating systemic juvenile idiopathic arthritis (sJIA) using international consensus formation through a Delphi questionnaire survey.

Methods.

A questionnaire listing 28 clinical, laboratory, and histopathologic features of MAS elicited by literature review was sent to 505 pediatric rheumatologists worldwide. Respondents were asked to select the 10 features that they felt were most important and useful in the diagnosis of MAS, and to order the 10 selected features by assigning the number 10 to the most important, and ending with 1 as the least important.

Results.

The response rate was 46% (232 physicians from 47 countries). The items selected by more than 50% of respondents were, in order of frequency, falling platelet count, hyperferritinemia, evidence of macrophage hemophagocytosis in the bone marrow, increased liver enzymes, falling leukocyte count, persistent continuous fever ≥ 38°C, falling erythrocyte sedimentation rate, hypofibrinogenemia, and hypertriglyceridemia.

Conclusion.

Our process led to identification of features that were felt to be most important as candidate diagnostic criteria for MAS by a large sample of international pediatric rheumatologists.

A preliminary score for the assessment of disease activity in hereditary recurrent fevers: results from the AIDAI (Auto-Inflammatory Diseases Activity Index) Consensus Conference

BACKGROUND

The systemic autoinflammatory disorders (SAID) share many clinical manifestations, albeit with variable patterns, intensity and frequency. A common definition of disease activity would be rational and useful in the management of these lifelong diseases. Moreover, standardised disease activity scores are required for the assessment of new therapies in constant development. The aim of this study was to develop preliminary activity scores for familial Mediterranean fever, mevalonate kinase deficiency, tumour necrosis factor receptor-1-associated periodic syndrome and cryopyrin-associated periodic syndromes (CAPS).

METHODS

The study was conducted using two well-recognised consensus formation methods: the Delphi technique and the nominal group technique. The results from a two-step survey and data from parent/patient interviews were used as preliminary data to develop the agenda for a consensus conference to build a provisional scoring system.

RESULTS

24 of 65 experts in SAID from 20 countries answered the web questionnaire and 16 attended the consensus conference. There was consensus agreement to develop separate activity scores for each disease but with a common format based on patient diaries. Fever and disease-specific clinical variables were scored according to their severity. A final score was generated by summing the score of all the variables divided by the number of days over which the diary was completed. Scores varied from 0 to 16 (0-13 in CAPS). These scores were developed for the purpose of clinical studies but could be used in clinical practice.

CONCLUSION

Using widely recognised consensus formation techniques, preliminary scores were obtained to measure disease activity in four main SAID. Further prospective validation study of this instrument will follow.

A guide to organizing a multicenter clinical trial

Multicenter clinical trials are important research tools. Planning a multicenter clinical trial is a long and arduous task that requires substantial preparation time. In this guide, the authors discuss the steps used to plan a multicenter clinical trial. A preplanning phase, which involves formulating and refining a research question and conducting pilot studies, is detailed, and the planning phase, which involves the acquisition of funding to support the coordination and preparation of a multicenter clinical trial, culminating in the submission of an R01 grant, is described. An essential asset to planning a multicenter clinical trial is the fluidity with which all collaborators work together toward a common vision. The philosophy among collaborators should be consensus and commitment and is emphasized by the development of a consensus assisted study protocol. Most important are the recruitment of centers and co-investigators who are dedicated, collaborative, and selfless in the team effort to achieve goals that cannot be reached by a single-center effort.

The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositis

OBJECTIVE

To develop a provisional definition for the evaluation of response to therapy in juvenile dermatomyositis (DM) based on the Paediatric Rheumatology International Trials Organisation juvenile DM core set of variables.

METHODS

Thirty-seven experienced pediatric rheumatologists from 27 countries achieved consensus on 128 difficult patient profiles as clinically improved or not improved using a stepwise approach (patient's rating, statistical analysis, definition selection). Using the physicians' consensus ratings as the "gold standard measure," chi-square, sensitivity, specificity, false-positive and-negative rates, area under the receiver operating characteristic curve, and kappa agreement for candidate definitions of improvement were calculated. Definitions with kappa values >0.8 were multiplied by the face validity score to select the top definitions.

RESULTS

The top definition of improvement was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 1 of the remaining worsening by more than 30%, which cannot be muscle strength. The second-highest scoring definition was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 2 of the remaining worsening by more than 25%, which cannot be muscle strength (definition P1 selected by the International Myositis Assessment and Clinical Studies group). The third is similar to the second with the maximum amount of worsening set to 30%. This indicates convergent validity of the process.

CONCLUSION

We propose a provisional data-driven definition of improvement that reflects well the consensus rating of experienced clinicians, which incorporates clinically meaningful change in core set variables in a composite end point for the evaluation of global response to therapy in juvenile DM.

External quality assurance as a revalidation method for pathologists in pediatric histopathology: Comparison of four international programs

AIM

External quality assurance (EQA) is an extremely valuable resource for clinical pathologists to maintain high standards, improve diagnostic skills, and possibly revalidate medical license. The aim of this study was to participate in and compare four international slide survey programs (UK, IAP-Germany, USA-Canada, Australasia) in pediatric histopathology for clinical pathologists with the aim to use it as a revalidation method.

METHODS

The following parameters were evaluated: number of circulations per year, number of slides, membership requirement, proof of significant pediatric pathology work, open to overseas participants, laboratory accreditation, issue of continuing professional development certificates and credits, slides discussion meeting, use of digital images, substandard performance letter, and anonymity of responses.

RESULTS

The UK scheme, which has sampling procedure over several time frames (2 circulations/year, 30 slides), partial confidentiality, and multiple sources of data and assessors, can be used as a model for revalidation. The US-Canadian and Australasian schemes only partially fulfill the revalidation requirements. The IAP scheme appears to be essentially an educational program and may be unsuitable for revalidation.

CONCLUSION

The purposes and programs of EQA schemes vary worldwide. In order for it to be used for revalidation, it is advisable that EQA schemes are immediately unified.