Feeds:
Posts
Comments

Posts Tagged ‘Valvular heart disease’


 

Application of Natural Language Processing (NLP) on ~1MM cases of semi-structured echocardiogram reports: Identification of aortic stenosis (AS) cases – Accuracy comparison to administrative diagnosis codes (IDC 9/10 codes)

Reporter: Aviva Lev-Ari, PhD, RN

Large-Scale Identification of Aortic Stenosis and its Severity Using Natural Language Processing on Electronic Health Records

Background Systematic case identification is critical to improving population health, but widely used diagnosis code-based approaches for conditions like valvular heart disease are inaccurate and lack specificity. Objective To develop and validate natural language processing (NLP) algorithms to identify aortic stenosis (AS) cases and associated parameters from semi-structured echocardiogram reports and compare its accuracy to administrative diagnosis codes. Methods Using 1,003 physician-adjudicated echocardiogram reports from Kaiser Permanente Northern California, a large, integrated healthcare system (>4.5 million members), NLP algorithms were developed and validated to achieve positive and negative predictive values >95% for identifying AS and associated echocardiographic parameters. Final NLP algorithms were applied to all adult echocardiography reports performed between 2008-2018, and compared to ICD-9/10 diagnosis code-based definitions for AS found from 14 days before to six months after the procedure date. Results A total of 927,884 eligible echocardiograms were identified during the study period among 519,967 patients. Application of the final NLP algorithm classified 104,090 (11.2%) echocardiograms with any AS (mean age 75.2 years, 52% women), with only 67,297 (64.6%) having a diagnosis code for AS between 14 days before and up to six months after the associated echocardiogram. Among those without associated diagnosis codes, 19% of patients had hemodynamically significant AS (i.e., greater than mild disease). Conclusion A validated NLP algorithm applied to a systemwide echocardiography database was substantially more accurate than diagnosis codes for identifying AS. Leveraging machine learning-based approaches on unstructured EHR data can facilitate more effective individual and population management than using administrative data alone.

Large-scale identification of aortic stenosis and its severity using natural language processing on electronic health records

Author links open overlay panel

Matthew D.SolomonMD, PhD∗†GraceTabadaMPH∗AmandaAllen∗Sue HeeSungMPH∗Alan S.GoMD∗‡§‖

Division of Research, Kaiser Permanente Northern California, Oakland, California

Department of Cardiology, Kaiser Oakland Medical Center, Oakland, California

Department of Health Systems Science, Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, California

§

Departments of Epidemiology, Biostatistics and Medicine, University of California, San Francisco, San Francisco, California

Department of Medicine, Stanford University, Stanford, California

Available online 18 March 2021.

https://www.sciencedirect.com/science/article/pii/S2666693621000256

Background

Systematic case identification is critical to improving population health, but widely used diagnosis code–based approaches for conditions like valvular heart disease are inaccurate and lack specificity.

Objective

To develop and validate natural language processing (NLP) algorithms to identify aortic stenosis (AS) cases and associated parameters from semi-structured echocardiogram reports and compare their accuracy to administrative diagnosis codes.

Methods

Using 1003 physician-adjudicated echocardiogram reports from Kaiser Permanente Northern California, a large, integrated healthcare system (>4.5 million members), NLP algorithms were developed and validated to achieve positive and negative predictive values > 95% for identifying AS and associated echocardiographic parameters. Final NLP algorithms were applied to all adult echocardiography reports performed between 2008 and 2018 and compared to ICD-9/10 diagnosis code–based definitions for AS found from 14 days before to 6 months after the procedure date.

Results

A total of 927,884 eligible echocardiograms were identified during the study period among 519,967 patients. Application of the final NLP algorithm classified 104,090 (11.2%) echocardiograms with any AS (mean age 75.2 years, 52% women), with only 67,297 (64.6%) having a diagnosis code for AS between 14 days before and up to 6 months after the associated echocardiogram. Among those without associated diagnosis codes, 19% of patients had hemodynamically significant AS (ie, greater than mild disease).

Conclusion

A validated NLP algorithm applied to a systemwide echocardiography database was substantially more accurate than diagnosis codes for identifying AS. Leveraging machine learning–based approaches on unstructured electronic health record data can facilitate more effective individual and population management than using administrative data alone.

Keywords

Aortic stenosis Echocardiography Machine learning Population health Quality and outcomes Valvular heart disease

SOURCE

https://www.sciencedirect.com/science/article/pii/S2666693621000256

Read Full Post »