26
|
Ruggieri AP, Elkin P, Chute CG. Representation by standard terminologies of health status concepts contained in two health status assessment instruments used in rheumatic disease management. Proc AMIA Symp 2000:734-8. [PMID: 11079981 PMCID: PMC2243938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023] Open
Abstract
Health and functional status data have been shown to have clinical utility in predicting outcome. Various metadata registries in the form of patient self-administered health assessment questionnaires have been incorporated into routine clinical care and clinical research of patients with rheumatic disease. Examples of such health assessment instruments are the Clinical Health Assessment Questionnaire (CLINHAQ) and the Modified Health Assessment Questionnaire (MHAQ). These instruments contain concepts that are an integral part of the health and functional status domain. Using an automated indexing tool we examined the clinical content coverage by SNOMED RT and the Unified Medical Language System (UMLS) Metathesaurus for health and functional status concepts identified in the MHAQ and CLINHAQ. Significant differences existed between the overall representational ability of SNOMED and UMLS for concepts identified in the MHAQ (49%, vs. 77% respectively, p < .005) and for concepts identified in the CLINHAQ (30% vs. 64% respectively p < .005). Representational capability by SNOMED-RT and UMLS for concepts in a given health assessment instrument was carried across four semantic classes of "attitudes", "symptoms", "activities", and "social attributes". The conceptual content coverage of health status assessment concepts contained in the MHAQ and CLINHAQ by SNOMED-RT and UMLS was incomplete but better for UMLS with its panoply of vocabulary sources. This observed overall improved representation by UMLS appeared to be due to better representation of concepts in "activities" and "social attributes" semantic classes. Representation of health or functional status concepts in a computerized medical record should be founded on a universally agreed concept model of that domain. Established functional and health status metadata registries can serve as important sources for concepts and candidate classes within that domain.
Collapse
|
27
|
Solbrig HR, Elkin PL, Ogren PV, Chute CG. A formal approach to integrating synonyms with a reference terminology. Proc AMIA Symp 2000:814-8. [PMID: 11079997 PMCID: PMC2244034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023] Open
Abstract
Medical terminologies continue to grow in scope, completeness and detail. The emerging generation of terminology systems define concepts in terms of their position within a categorical structure. It is still necessary, however, to access and represent the concepts using everyday spoken and written language, which introduces both lexical and semantic ambiguity. This ambiguity can have a negative impact on both selectivity and recall when it comes to associating free-form textual phrases with their coded equivalent. Lexical ambiguity issues can often be addressed algorithmically, but semantic ambiguity presents a more difficult problem. A common solution to the semantic problem is to associate many different representational permutations with a given target concept. This approach has several drawbacks. An alternate solution is to build separate synonym tables that can serve as permuted indices into the terms representing the underlying concepts. A potential shortcoming of this approach, however, is a further reduction in the lookup selectivity. One possible source of loss of selectivity could be "meaning drift"--the gradual change in meaning that can be introduced when following a chain of nearly synonymous words. We posited that organizing synonyms into separate "meaning clusters" might reduce this loss in precision, but the results of this study did not bear that out.
Collapse
|
28
|
Harris MR, Graves JR, Solbrig HR, Elkin PL, Chute CG. Embedded structures and representation of nursing knowledge. J Am Med Inform Assoc 2000; 7:539-49. [PMID: 11062227 PMCID: PMC129662 DOI: 10.1136/jamia.2000.0070539] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
Nursing Vocabulary Summit participants were challenged to consider whether reference terminology and information models might be a way to move toward better capture of data in electronic medical records. A requirement of such reference models is fidelity to representations of domain knowledge. This article discusses embedded structures in three different approaches to organizing domain knowledge: scientific reasoning, expertise, and standardized nursing languages. The concept of pressure ulcer is presented as an example of the various ways lexical elements used in relation to a specific concept are organized across systems. Different approaches to structuring information-the clinical information system, minimum data sets, and standardized messaging formats-are similarly discussed. Recommendations include identification of the polyhierarchies and categorical structures required within a reference terminology, systematic evaluations of the extent to which structured information accurately and completely represents domain knowledge, and modifications or extensions to existing multidisciplinary efforts.
Collapse
|
29
|
Harris MR, Graves JR, Herrick LM, Elkin PL, Chute CG. The content coverage and organizational structure of terminologies: the example of postoperative pain. Proc AMIA Symp 2000:335-9. [PMID: 11079900 PMCID: PMC2243894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023] Open
Abstract
Concepts such as symptoms present specific representational challenges in the EMR. This is because concepts without clear boundaries and external referents such as physical objects can only be examined against other terminology-based concept representation systems. The truth and falsity of such concept representation is therefore relative to the terminology-based systems. Using the concept of acute postoperative pain as an example, we examined three terminology based approaches to representing the concept. Widely varying coverage across existing clinical terminologies was evident, although the common clinical approach to reporting attributes of symptoms provided a useful organizational structure and should be examined in relation to developing terminology and information models.
Collapse
|
30
|
Elkin PL, Tuttle M, Keck K, Campbell K, Atkin G, Chute CG. The role of compositionality in standardized problem list generation. Stud Health Technol Inform 1999; 52 Pt 1:660-4. [PMID: 10384537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/13/2023]
Abstract
Compositionality is the ability of a Vocabulary System to record non-atomic strings. In this manuscript we define the types of composition, which can occur. We will then propose methods for both server based and client-based composition. We will differentiate the terms Pre-Coordination, Post-Coordination, and User-Directed Coordination. A simple grammar for the recording of terms with concept level identification will be presented, with examples from the Unified Medical Language System's (UMLS) Metathesaurus. We present an implementation of a Window's NT based client application and a remote Internet Based Vocabulary Server, which makes use of this method of compositionality. Finally we will suggest a research agenda which we believe is necessary to move forward toward a more complete understanding of compositionality. This work has the promise of paving the way toward a robust and complete Problem List Entry Tool.
Collapse
|
31
|
Wagner JL, Alberts SR, Sloan JA, Cha S, Killian J, O'Connell MJ, Van Grevenhof P, Lindman J, Chute CG. Incremental costs of enrolling cancer patients in clinical trials: a population-based study. J Natl Cancer Inst 1999; 91:847-53. [PMID: 10340904 DOI: 10.1093/jnci/91.10.847] [Citation(s) in RCA: 70] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Payment for care provided as part of clinical research has become less predictable as a result of managed care. Because little is known at present about how entry into cancer trials affects the cost of care for cancer patients, we conducted a matched case-control comparison of the incremental medical costs attributable to participation in cancer treatment trials. METHODS Case patients were residents of Olmsted County, MN, who entered phase II or phase III cancer treatment trials at the Mayo Clinic from 1988 through 1994. Control patients were patients who did not enter trials but who were eligible on the basis of tumor registry matching and medical record review. Sixty-one matched pairs were followed for up to 5 years after the date of trial entry for case patients or from an equivalent date for control patients. Hospital, physician, and ancillary service costs were estimated from a population-based cost database developed at the Mayo Clinic. RESULTS Trial enrollees incurred modestly (no more than 10%) higher costs over various follow-up periods. The mean cumulative 5-year cost in 1995 inflation-adjusted U.S. dollars among trial enrollees after adjustment for censoring was $46424 compared with $44 133 for control patients. After 1 year, trial enrollee costs were $24645 compared with $23 964 for control patients. CONCLUSIONS This study suggests that cancer chemotherapy trials may not imply budget-breaking costs. Cancer itself is a high-cost illness. Clinical protocols may add relatively little to that cost.
Collapse
|
32
|
Chute CG. ISO TC 215: what the health world needs now. M.D. COMPUTING : COMPUTERS IN MEDICAL PRACTICE 1999; 16:21-2. [PMID: 10439594] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/13/2023]
|
33
|
Chute CG. Standards move to center stage. M.D. COMPUTING : COMPUTERS IN MEDICAL PRACTICE 1999; 16:29-32. [PMID: 10202420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
34
|
Elkin PL, Bailey KR, Ogren PV, Bauer BA, Chute CG. A randomized double-blind controlled trial of automated term dissection. Proc AMIA Symp 1999:62-6. [PMID: 10566321 PMCID: PMC2232669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/14/2023] Open
Abstract
OBJECTIVE To compare the accuracy of an automated mechanism for term dissection to represent the semantic dependencies within a compositional expression, with the accuracy of a practicing Internist to perform this same task. We also compare the results of four evaluators to determine the inter-observer variability and the variance between term sets, with respect to the accuracy of the mappings and the consistency of the failure analysis. METHODS 500 terms, which required a compositional expression to effect an exact match, were randomly distributed into two sets of 250 terms (Set A and Set B). Set A was dissected using the Automated Term Dissection (ATD) Algorithm. A physician specializing in Internal Medicine dissected set B. He had no prior knowledge of the dissection algorithm or how it functioned. In this manuscript, the authors use Human Term Dissection (HTD) to refer to this method. Set A was randomized to two sets of 125 terms (Set A1 and Set A2). Set B was randomized to two sets of 125 terms (Set B1 and Set B2). A new set of 250 terms Set C was created from Set A1 and Set B2. A second new set of 250 terms Set D was created from Set A2 and Set B1. Two expert Indexers reviewed Set C and another two expert Indexers reviewed Set D. They were blinded to which terms were dissected by the clinician and which terms were dissected by the automated term dissection algorithm. The person providing the files for review to the Indexers was also unaware of which terms were dissected by ATD vs. the HTD method. The Indexers recorded whether or not the dissection was the best possible representation of the input concept. If not, a failure analysis was conducted. They recorded whether or not the dissection was in error and if so was a modifier not subsumed or was a Kernel concept subsumed when it should not have been. If a concept was missing, the Indexers recorded whether it was a Kernel concept, a modifier, a qualifier or a negative qualifier. RESULTS The ATD method was judged to be accurate and readable in 265 out of the 424 terms with adequate content (62.7%). The HTD method was judged to be accurate in 272 out of 414 terms with adequate content (65.7%). There was no statistically significant difference between the rates of acceptability of the ATD and HTD methods (p = 0.33). There was a non-significant trend toward greater acceptability of the ATD method in the subgroup of terms with three or more compositional elements. ATD was acceptable in 53.6% of the terms where the HTD was only acceptable in 43.6% (p = 0.11). The failure analysis showed that both methods misrepresented kernel concepts and modifiers much more commonly than qualifiers (p < 0.001). CONCLUSIONS There is no statistically significant difference in the accuracy and readability of terms dissected using the automated term dissection method when compared with human term dissection, as judged by four expert medical indexers. There is a non-significant trend toward improved performance of the ATD method in the subset of more complex terms. The authors submit that this may be due to a tendency for users to be less compulsive when the time to complete the task is long. Automated term dissection is a useful and perhaps preferable method for representing readable and accurate compound terminological expressions.
Collapse
|
35
|
McDonald FS, Chute CG, Ogren PV, Wahner-Roedler D, Elkin PL. A large-scale evaluation of terminology integration characteristics. Proc AMIA Symp 1999:864-7. [PMID: 10566483 PMCID: PMC2232475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/14/2023] Open
Abstract
OBJECTIVE To describe terminology integration characteristics of local specialty specific and general vocabularies in order to facilitate the appropriate inclusion and mapping of these terms into a large-scale terminology. METHODS We compared the sensitivity, specificity, positive predictive value, and positive likelihood ratios for Automated Term Composition to correctly map 9050 local specialty specific (dermatology) terms and 4994 local general terms to UMLS using Metaphrase. Results were systematically combined among exact matches, semantic type filtered matches, and non-filtered matches. For the general set, an analysis of semantic type filtering was performed. RESULTS Dermatology exact matches defined a sensitivity of 51% (57% for general terms) and a specificity of 86% (92% general terms). Including semantic type filtered matches increased sensitivity (75% dermatology; 88% general); as did inclusion of non-filtered matches (98% and 99%). These inclusions correspondingly decreased specificity (filtered: 82% and 74%; non-filtered: 52% and 32%). Positive predictive values for exact matches (93.0% dermatology, 97.6% general) were improved by small but significant (p < 0.001) margins by including filtered matches (95.1% dermatology, 98.4% general) but decreased with non-filtered matches (89.2% dermatology, 87.8% general). Adding additional semantic types to the filtering algorithm failed to improve the positive predictive value or the positive likelihood ratio of term mapping, in spite of a 2.3% improvement in sensitivity. CONCLUSIONS Automated methods for mapping local "colloquial" terminologies to large-scale controlled health vocabulary systems are practical (ppv 95% dermatology, 98% general). Semantic type filtering improves specificity without sacrificing sensitivity and yields high positive predictive values in every set analyzed.
Collapse
|
36
|
Chute CG, Elkin PL, Sherertz DD, Tuttle MS. Desiderata for a clinical terminology server. Proc AMIA Symp 1999:42-6. [PMID: 10566317 PMCID: PMC2232621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/14/2023] Open
Abstract
Clinical terminology servers are distinguished from more broadly based terminology servers intended for nomenclature development or mediation across classifications. Focusing upon the consistent and comparable entry of clinical observations, findings, and events, key desiderata are enumerated and expanded. These include 1) word normalization, 2) word completion, 3) target terminology specification, 4) spelling correction, 5) lexical matching, 6) term completion, 7) semantic locality, 8) term composition and 9) decomposition. Comparisons of this functionality to previously published models and specifications are made. Experience with a clinical terminology server, Metaphrase, is described.
Collapse
|
37
|
McKnight LK, Elkin PL, Ogren PV, Chute CG. Barriers to the clinical implementation of compositionality. Proc AMIA Symp 1999:320-4. [PMID: 10566373 PMCID: PMC2232608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/14/2023] Open
Abstract
BACKGROUND Compositional mechanisms for the entry of clinically relevant controlled vocabularies have been suggested as a possible solution to providing adequate descriptive precision while keeping term vocabulary redundancy under control. As of yet, there are no widely accepted term navigators that allow physicians to enter problem lists utilizing controlled vocabularies with compositionality. METHODS We report on the results of a usability trial of 5 physicians using our most recent attempt at developing the Mayo Problem List Manager. We tested the implementation of an automated term composition, and hierarchical term dissection. RESULTS Participants found acceptable terms 96% of the time and found automated term composition helpful in 85% of the case scenarios. There was significant confusion about the terminology used to describe compositional elements (kernel concepts, modifiers, and qualifiers) however participants used the functions appropriately. Speed of entry was universally stated as the limiting factor. CONCLUSIONS The variety of methods that our participants used to enter terms highlights the need for multiple ways to accomplish the task of data entry. Successful implementation of user directed compositionality could be accomplished with further improvement of the user interface and the underlying terminology.
Collapse
|
38
|
Dunne D, Chute CG. Detailed content and terminological properties of DSM-IV. Proc AMIA Symp 1999:57-61. [PMID: 10566320 PMCID: PMC2232634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/14/2023] Open
Abstract
DSM-IV, the Diagnostic and Statistical Manual of Mental Disorders, is the internationally accepted standard for nomenclature and diagnosis in psychiatric practice. The objective of this project is to parse the rubric criteria of the DSM to extract the clinically detailed signs, symptoms, findings, and conditions that are present. These are a "latent terminology" implicit within the DSM, which is highly granular and clinically specific. This manuscript describes the content of these terms that heretofore existed sub rosa, though we recognize that during the authorship of the DSM such terms were constructed deliberately and systematically. Relevant characteristics of the classification system are briefly reviewed. Summary results of parsing the defining criteria for the 400 ICD-9 Codes enumerated in DSM-IV are presented.
Collapse
|
39
|
Tuttle MS, Olson NE, Keck KD, Cole WG, Erlbaum MS, Sherertz DD, Chute CG, Elkin PL, Atkin GE, Kaihoi BH, Safran C, Rind D, Law V. Metaphrase: an aid to the clinical conceptualization and formalization of patient problems in healthcare enterprises. Methods Inf Med 1998; 37:373-83. [PMID: 9865035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
Patient descriptors, or "problems," such as "brain metastases of melanoma" are an effective way for caregivers to describe patients. But most problems, e.g., "cubital tunnel syndrome" or "ulnar nerve compression," found in problem lists in an Electronic Medical Record (EMR) are not comparable computationally--in general, a computer cannot determine whether they describe the same or a related problem, or whether the user would have preferred "ulnar nerve compression syndrome." Metaphrase is a scalable, middleware component designed to be accessed from problem-manager applications in EMR systems. In response to caregivers' informal descriptors it suggests potentially equivalent, authoritative, and more formally comparable descriptors. Metaphrase contains a clinical subset of the 1997 UMLS Metathesaurus and some 10,000 "problems" from the Mayo Clinic and Harvard Beth Israel Hospital. Word and term completion, spelling correction, and semantic navigation, all combine to ease the burden of problem conceptualization, entry and formalization.
Collapse
|
40
|
Campbell KE, Cohn SP, Chute CG, Shortliffe EH, Rennels G. Scalable methodologies for distributed development of logic-based convergent medical terminology. Methods Inf Med 1998; 37:426-39. [PMID: 9865041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
As the size and complexity of medical terminologies increase, terminology modelers are increasingly hampered by lack of tools and methods to manage the development process. This paper presents our use and ongoing evaluation of a description-logic classifier to support cognitive scalability of the underlying terminology and our enhancements to that classifier to support concurrent development utilizing semantics-based concurrency control methods. Our enhancements, collectively referred to as the Gálapagos, consist of several applications that take locally-developed terminology enhancements from multiple sites, identify conflicting design decisions, support the modelers' reconciliation of the conflicting designs, and efficiently disseminate updates tailored for locally enhanced terminologies. We have tested our ideas through concurrent evolutionary enhancement of SNOMED International at three Kaiser Permanente regions and the Mayo Clinic. We have found that the underlying environment has met our design objectives, and supports semantic-based concurrency control, and identification and resolution of conflicting design decisions.
Collapse
|
41
|
Xia Z, Jacobsen SJ, Bergstralh EJ, Chute CG, Katusic SK, Lieber MM. Secular changes in radical prostatectomy utilization rates in Olmsted County, Minnesota 1980 to 1995. J Urol 1998; 159:904-8. [PMID: 9474179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
PURPOSE We estimated the changes in utilization of radical prostatectomy for treatment of prostate cancer and describe the clinical characteristics of men undergoing radical prostatectomy in a population based setting. MATERIALS AND METHODS The Rochester Epidemiology Project was used to identify all Olmsted County residents who underwent radical prostatectomy from 1980 to 1995. The community medical records of these men were reviewed to determine the clinical and pathological stage and grade at biopsy and following surgery. RESULTS From 1980 to 1995, 311 radical prostatectomies were performed on Olmsted County men. From 1980 to 1987 prostatectomy rates ranged from 6.3 to 31.0/100,000 men but rates increased dramatically to 53.6/100,000 in 1988 and 106.2/100,000 in 1992. The rate after 1992 decreased to 53.0/100,000 and then increased slightly to 80.4/100,000. There was a shift to younger age in more recent times (mean patient age 65.4 years in 1980 to 1986 and 62.4 in 1993 to 1995, p = 0.02), a nonsignificant (p = 0.10) trend toward lower pathological stage in recent years (42% stage pT2 in 1980 to 1986 versus 55% in 1993 to 1995) and a significant decrease in the proportion of cases of disease up staged following surgery (53% in 1980 to 1986 versus 37% in 1993 to 1995, p = 0.03). There was no significant trend in pathological grade with time (63% Mayo grade I or II in 1980 to 1986 versus 52% in 1993 to 1995, p = 0.30). CONCLUSIONS These findings demonstrate an increase in radical prostatectomy rates that coincided with increases in prostate cancer incidence. There was a decrease in population prostatectomy rates in 1993 which was followed by modest increases to levels lower than the peak in 1992. However, the clinical characteristics of patients during this period did not change dramatically, suggesting that in a population based setting the selection factors for patients undergoing surgical treatment may not have changed.
Collapse
|
42
|
Chute CG, Elkin PL, Fenton SH, Atkin GE. A clinical terminology in the post modern era: pragmatic problem list development. Proc AMIA Symp 1998:795-9. [PMID: 9929328 PMCID: PMC2232227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023] Open
Abstract
A brief review of the rich heritage of classifications and terminologies is the background for a description of the Mayo Clinic's clinical terminology development. Vender specific system constraints prompted the scope and style of an interim problem list vocabulary. We describe the sources and review process which led to a working terminology for use in a Computer-based Patient Record (CPR). Because terminology development is often subjective and metrics against which to measure the quality of individual human judgements are few, we decided to compare the selection of preferred terms made by general internists with those made by sub-specialists. A significant difference between a sub-specialist's assignment of preferred terms and a general internist's (948 vs. 2271, P < 0.001) was observed. Sub-specialists were less than half as likely as a generalist to designate a term as a preferred form. These results emphasize the need for sub-specialty editing when assigning preferred terms to concepts.
Collapse
|
43
|
Chute CG. The Copernican era of healthcare terminology: a re-centering of health information systems. Proc AMIA Symp 1998:68-73. [PMID: 9929184 PMCID: PMC2232272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023] Open
Abstract
Health terminology and classifications have been an unseen backwater in healthcare practice and information systems development. Today however, the recognized need for comparable patient data is driving a new discovery about its strategic importance. Consistent patient descriptions and concept-centered data representations are crucial for efficient discovery of optimal treatments, best outcomes, and efficient practice patterns. The fabled linkage of knowledge sources at the time and place of care requires the conceptual intermediary of common terminology. A brief history overviewing the evolution of health classifications will provide the foundation for considering present and evolving health terminology developments. Their roles in health information systems will be characterized. Discussion will focus on the likely influences of the HIPAA legislation nationally and the new ISO Healthcare Informatics Technical Committee internationally, on terminology adaptation and incorporation.
Collapse
|
44
|
Elkin PL, Bailey KR, Chute CG. A randomized controlled trial of automated term composition. Proc AMIA Symp 1998:765-9. [PMID: 9929322 PMCID: PMC2232145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023] Open
Abstract
OBJECTIVE To compare the ability of an Automated Term Composition (ATC) algorithm with non-compositional mappings to provide coverage (exact mappings to a controlled vocabulary) for a randomly selected set of free text entries which were entered as headings to the Impression section of the clinical notes system at the Mayo Foundation. We also compare the results of four evaluators to determine the inter-observer variability and the variance between term sets, with respect to the accuracy of the mappings and the reliability of the failure analysis. METHODS From a corpus of approximately 1,000,000 unique terms entered into the Impression/Report/Plan section of the clinical notes system in the calendar year 1997, we randomly selected 1,000 terms. We then further randomized these 1,000 terms into two groups of 500 (Sets A and B). We constructed two copies of the same term matching interface, one without ATC (alpha) and one with ATC (beta). We took four expert Indexers and assigned them to one of the following tasks. The first reviewer (R1) compared set A using the alpha program and then set B using the beta program (R1(Aalpha + Bbeta)). The second compared set A using the alpha program and then set B using the alpha program (R2(A + B) alpha). The third compared set B using the beta program and then set A using the beta program (R3(B + A) beta). The fourth compared set A using the beta program and then set B using the alpha program (R4(Abeta + Balpha)). RESULTS The program with Automated Term Composition mapped 540 out of the 1,000 Concepts correctly (54.0%). The same program without ATC mapped only 276 out of the 1,000 Concepts correctly (27.6%). Therefore the program with ATC was significantly more effective at matching concepts in our problem lists than the same search engine without ATC (p < 0.0001; McNemar Method). These figures result from the comparison of the alpha program with the beta program by reviewers one and four. Failure analysis showed that with the alpha version 425 out of the 724 mismatches were because a base concept was missing from the retrieval set (58.7%) and 299 mismatches were from missing qualifiers or modifiers or both (41.3%). In the beta version of the program (with ATC) 340 out of the 460 mismatches were secondary to there being a missing base concept in the retrieval set (73.9%) and only 120 mismatches due to missing modifiers and or qualifiers (26.1%). CONCLUSIONS Automated term composition provided significantly better coverage of a randomly chosen set of patient problems, diagnosed at the Mayo Clinic during the 1997 calendar year, when compared with the same information retrieval system without ATC. We believe that these results speak further to the excellent content coverage provided by the UMLS metathesaurus. These authors believe that increased structure, normalization of UMLS content and semantics, and better tools to make use of the currently available content such as automated term composition, are what is needed to leverage the production of commercially viable tools that provide access to controlled vocabularies for medicine.
Collapse
|
45
|
Chute CG, Cohn SP, Campbell JR. A framework for comprehensive health terminology systems in the United States: development guidelines, criteria for selection, and public policy implications. ANSI Healthcare Informatics Standards Board Vocabulary Working Group and the Computer-Based Patient Records Institute Working Group on Codes and Structures. J Am Med Inform Assoc 1998; 5:503-10. [PMID: 9824798 PMCID: PMC61331 DOI: 10.1136/jamia.1998.0050503] [Citation(s) in RCA: 95] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
Health care in the United States has become an information-intensive industry, yet electronic health records represent patient data inconsistently for lack of clinical data standards. Classifications that have achieved common acceptance, such as the ICD-9-CM or ICD, aggregate heterogeneous patients into broad categories, which preclude their practical use in decision support, development of refined guidelines, or detailed comparison of patient outcomes or benchmarks. This document proposes a framework for the integration and maturation of clinical terminologies that would have practical applications in patient care, process management, outcome analysis, and decision support. Arising from the two working groups within the standards community--the ANSI (American National Standards Institute) Healthcare Informatics Standards Board Working Group and the Computer-based Patient Records Institute Working Group on Codes and Structures--it outlines policies regarding 1) functional characteristics of practical terminologies, 2) terminology models that can broaden their applications and contribute to their sustainability, 3) maintenance attributes that will enable terminologies to keep pace with rapidly changing health care knowledge and process, and 4) administrative issues that would facilitate their accessibility, adoption, and application to improve the quality and efficiency of American health care.
Collapse
|
46
|
Cohn SP, Chute CG. Clinical terminologies and computer-based patient records. JOURNAL OF AHIMA 1997; 68:41-3. [PMID: 10184701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
47
|
Elkin PL, Mohr DN, Tuttle MS, Cole WG, Atkin GE, Keck K, Fisk TB, Kaihoi BH, Lee KE, Higgins MC, Suermondt HJ, Olson N, Claus PL, Carpenter PC, Chute CG. Standardized problem list generation, utilizing the Mayo canonical vocabulary embedded within the Unified Medical Language System. PROCEEDINGS : A CONFERENCE OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION. AMIA FALL SYMPOSIUM 1997:500-4. [PMID: 9357676 PMCID: PMC2233586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
UNLABELLED VOCABULARY: The Mayo problem list vocabulary is a clinically derived lexicon created from the entries made to the Mayo Clinic's Master Sheet Index and the problem list entries made to the Impression/ Report/Plan section of the Clinical Notes System over the last three years. The vocabulary was reduced by eliminating repetition including lexical variants, spelling errors, and qualifiers (Administrative or Operational terms). Qualifiers are re-coordinated with other terms, at run-time, which greatly increased the number of input strings which our system is capable of recognizing. IMPLEMENTATION The Problem Manager is implemented using standard windows tools in a Windows NT environment. The interface is designed using Object Pascal. HTTP calls are passed over the World Wide Web to a UNIX based vocabulary server. The server returns a document, which is read into Object Pascal structures, parsed, filtered and displayed. STUDY This paper reports the results of a recent Usability Trial focused on assessing the viability of this mechanism for standardized problem entry. Eight clinicians engaged in eleven scenarios and responded as to their satisfaction with the systems performance. These responses were observed, videotaped and tabulated. Clinicians in this study were able to find acceptable diagnoses in 91.1% of the scenarios. The response time was acceptable in 92.5% of the scenarios. The presentation of related terms was stated to be useful in at least one scenario by seven of the eight participants. All clinicians wanted to make use of shortcuts which would minimize the amount of typing necessary to encode the concept they were searching for (e.g. Abbreviations, Word Completion). CONCLUSIONS Clinicians are willing to choose a canonical term from a suggested list (as opposed to their own wording). Clinicians want an "intelligent" system, which would suggest terms within a category (e.g. Types of "Migraine"). They are able to make functional use of our system, in its current state of development. Finally, all clinicians appreciate the value of encoding their problems in a standardized vocabulary, toward improved research, education and practice.
Collapse
|
48
|
Campbell JR, Carpenter P, Sneiderman C, Cohn S, Chute CG, Warren J. Phase II evaluation of clinical coding schemes: completeness, taxonomy, mapping, definitions, and clarity. CPRI Work Group on Codes and Structures. J Am Med Inform Assoc 1997; 4:238-51. [PMID: 9147343 PMCID: PMC61239 DOI: 10.1136/jamia.1997.0040238] [Citation(s) in RCA: 90] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
OBJECTIVE To compare three potential sources of controlled clinical terminology (READ codes version 3.1, SNOMED International, and Unified Medical Language System (UMLS) version 1.6) relative to attributes of completeness, clinical taxonomy, administrative mapping, term definitions and clarity (duplicate coding rate). METHODS The authors assembled 1929 source concept records from a variety of clinical information taken from four medical centers across the United States. The source data included medical as well as ample nursing terminology. The source records were coded in each scheme by an investigator and checked by the coding scheme owner. The codings were then scored by an independent panel of clinicians for acceptability. Codes were checked for definitions provided with the scheme. Codes for a random sample of source records were analyzed by an investigator for "parent" and "child" codes within the scheme. Parent and child pairs were scored by an independent panel of medical informatics specialists for clinical acceptability. Administrative and billing code mapping from the published scheme were reviewed for all coded records and analyzed by independent reviewers for accuracy. The investigator for each scheme exhaustively searched a sample of coded records for duplications. RESULTS SNOMED was judged to be significantly more complete in coding the source material than the other schemes (SNOMED* 70%; READ 57%; UMLS 50%; *p < .00001). SNOMED also had a richer clinical taxonomy judged by the number of acceptable first-degree relatives per coded concept (SNOMED* 4.56, UMLS 3.17; READ 2.14, *p < .005). Only the UMLS provided any definitions; these were found for 49% of records which had a coding assignment. READ and UMLS had better administrative mappings (composite score: READ* 40.6%; UMLS* 36.1%; SNOMED 20.7%, *p < .00001), and SNOMED had substantially more duplications of coding assignments (duplication rate: READ 0%; UMLS 4.2%; SNOMED* 13.9%, *p < .004) associated with a loss of clarity. CONCLUSION No major terminology source can lay claim to being the ideal resource for a computer-based patient record. However, based upon this analysis of releases for April 1995, SNOMED International is considerably more complete, has a compositional nature and a richer taxonomy. Is suffers from less clarity, resulting from a lack of syntax and evolutionary changes in its coding scheme. READ has greater clarity and better mapping to administrative schemes (ICD-10 and OPCS-4), is rapidly changing and is less complete. UMLS is a rich lexical resource, with mappings to many source vocabularies. It provides definitions for many of its terms. However, due to the varying granularities and purposes of its source schemes, it has limitations for representation of clinical concepts within a computer-based patient record.
Collapse
|
49
|
Chute CG, Elkin PL. A clinically derived terminology: qualification to reduction. PROCEEDINGS : A CONFERENCE OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION. AMIA FALL SYMPOSIUM 1997:570-4. [PMID: 9357690 PMCID: PMC2233541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Mayo Foundation is developing synonym rich entry points for the recording of patient problems by clinicians, which will map to the KP-Mayo Convergent Medical Terminology. We describe the empirical sources for these terminology components, and how the number and complexity of the terms could be substantially reduced by the introduction of a Qualifier axis. The expressive power of these entry points is dramatically enhanced by this axis. This work is being integrated into terminology navigation modules being jointly developed with Lexical Technology, which leverages UMLS content. It will from the basis for structured problem entry into Mayo's Computer-based Electronic Record.
Collapse
|
50
|
Claus PL, Carpenter PC, Chute CG, Mohr DN, Gibbons PS. Clinical care management and workflow by episodes. PROCEEDINGS : A CONFERENCE OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION. AMIA FALL SYMPOSIUM 1997:91-5. [PMID: 9357595 PMCID: PMC2233562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
This paper describes the implementation of clinically defined episodes of care and the introduction of an episode-based summary list of patient problems across Mayo Clinic Rochester in 1996 and 1997. Although Mayo's traditional paper-based system has always relied on a type of 'episode of care' (called the "registration") for patient and history management, a new, more clinically relevant definition of episode of care was put into practice in November 1996. This was done to improve care management and operational processes and to provide a basic construct for the electronic medical record. Also since November 1996, a computer-generated summary list of patient problems, the "Master Sheet Summary Report," organized by episode, has been placed in all patient histories. In the third quarter of 1997, the ability to view the episode-based problem summary online was made available to the 3000+ EMR-capable workstations deployed across the Mayo Rochester campus. In addition, the clinically oriented problem summarization process produces an improved basic "package" of clinical information expected to lead to improved analytic decision support, outcomes analysis and epidemiological research.
Collapse
|