The authors have declared that no competing interests exist.
Patients with inflammatory bowel disease (IBD) frequently visit the emergency department (ED). The use of cputed tomography (CT) scans in this population has drastically increased in recent years and may confer an increased risk of malignancy. Records were obtained for IBD patients aged 18 or older who visited our institutional ED with a gastrointestinal chief complaint and who had a CT scan ordered by an ED physician. A predictive model for identifying a clinically actionable finding (CAF) on CT scan was created using logistic regression carried out on a predetermined set of variables. Data were available on 156 Crohn’s disease (CD) patients contributing 350 visits and 63 ulcerative colitis (UC) patients contributing 114 total visits. CAF was identified at 108/350 (30.9%) of visits in CD patients and 33/114 (29.0%) of visits in UC patients. History of CAF (OR 11.6, CI 4.54-29.6) and a platelet count above 400,000/mL (OR 3.42, CI 1.56-7.50) were the strongest predictors of CAF. History of psychiatric illness (OR 0.67, CI 0.35-1.29) and diarrhea (OR .043, CI 0.23-0.83) were associated with a lower likelihood of CAF. A prediction model was created that was able to detect 94.4% of CAF cases while correctly predicting CAF non-cases 35% of the time. This model holds promise as a tool to reduce imaging in this population.
Inflammatory bowel disease (IBD) affects an estimated 1.5 million Americans.(1) Young age at onset and a relapsing-remitting disease course may lead to frequent and ongoing healthcare system interactions, a substantial proportion of which are in the emergency department (ED). IBD patients made an estimated 76,000 visits to the ED in 2005, an increase of 165% from the previous decade.(2) Abdominopelvic computed tomography (APCT) use in the ED increased in Crohn’s disease (CD) patients from 47% in 2001 to 78% of all ED visits in 2009.(3)
APCTs commonly reveal findings (abscess, perforation, obstruction, et cetera) in this population that change clinical management. Previous studies have shown that 16.8-48% of CD and 12.8% of ulcerative colitis (UC) patients receiving an APCT in the ED had a finding that changed clinical management.(3-9) However, APCTs are associated with a cost and may be associated with an increased risk for malignancy. It is estimated that one APCT confers an increased risk of malignancy of about 6/10,000, which when applied on a population level is estimated to account for 1.5-2% of all cancers in the United States.(10) Additionally, several studies have identified a subgroup of patients with IBD that are high utilizers of imaging studies; these patients may be at a higher risk for harm from the associated radiation than the general IBD population.(11-14) Risk factors associated with increased radiation exposure included young age at diagnosis, prior surgery, and more severe disease.(13) Furthermore, a study examining outpatient use of CT scans by patients with Crohn’s disease identified chronic pain, any psychiatric diagnoses, and frequent missed outpatient appointments as risk factors for high utilization of CT scans.(14)
While prior studies have associated psychosocial variables with a higher utilization of healthcare, no studies have examined whether these variables affect the likelihood of identifying a clinically actionable finding (CAF) on APCT scan in IBD patients presenting to the ED. The aim of this retrospective cohort study was to identify demographic and clinical characteristics that may predict whether a patient with IBD presenting to the ED with a gastrointestinal chief complaint has a CAF on an APCT scan. Furthermore we constructed a model for patients with Crohn’s disease to assist clinical decision-making surrounding the choice to obtain an APCT in this potentially vulnerable population.
Prior to initiation of research approval was obtained from the Oregon Health & Science University institutional review board. The Oregon Clinical and Translational Research Institute (OCTRI) cohort discovery tool was used to identify patients at OHSU with a diagnosis of CD or UC by Institutional Classification of Diseases-9th Revision (ICD-9) code 555.x or 556.x (confirmed by review of the medical chart using clinical, endoscopic, histologic, and radiologic findings) with visits to the OHSU emergency department between January 1, 2008 and August 1, 2014 with an APCT ordered during that encounter.
Electronic medical records were manually reviewed (ML, KJ, JL) to determine whether the patients met inclusion criteria and to abstract data. Inclusion criteria were patient age greater than or equal to 18, an established diagnosis of CD or UC at presentation to the ED, a gastrointestinal chief complaint, and an APCT scan ordered by an ED physician (
The OCTRI cohort discovery tool was also used to identify 50 CD patients with ICD-9 code 555.x or 556.x who visited the OHSU emergency department between January 1, 2008 and April 1, 2014 who did not have an APCT ordered during that encounter. These patients met identical inclusion criteria to the expmental group but did not have an APCT ordered by an ED physician and were used as controls. Within this control group a surrogate marker of CAF was used since there were no imaging findings available at their ED visit by which a CAF could be identified. Encounters were examined for CAF diagnosed clinically or via imaging (not ordered by an ED physician) within the associated clinical encounter, or within the 4 subsequent weeks if the patient was discharged from the ED.
APCTs with and without intravenous and oral contrast administration were included. Summarized APCT scan results were reviewed to assess for the primary outcome: a CAF. A CAF was defined as one or more of the following identified on imaging: obstruction, abscess, perforation, acute cholecystitis, cholangitis, appendicitis, diverticulitis, ischemia, vascular emergency, pyelonephritis, renal obstruction, pancreatitis, new neoplasm, complicated urolithiasis, new fistula requiring intervention, or gynecologic emergency. Obstruction was defined by the presence of a transition point on imaging.
Demographic and clinical characteristics measured at the initial ED encounter were examined in CD and UC patients and were compared between patients who did and did not have a CAF identified on APCT in each group in a univariate analysis (
|
|
|
|
|
Neutrophils | 76 (65,85) | 80 (70,88) | 72 (64,83) | 0.007 |
Lactate | 1.1 (0.7,3.0) | 3.1 (1.35,3.65) | 0.75 (0.6,1.1) | 0.002 |
Diarrhea | 36.5% (57) | 22.4% (15) | 47.2% (42) | 0.001 |
Gastrointestinal bleed | 27.6% (43) | 19.4% (13) | 33.7% (30) | 0.048 |
Constipation | 11.5% (18) | 17.9% (12) | 6.7% (6) | 0.031 |
History of obstruction | 48.7% (76) | 73.1% (49) | 30.3% (27) | <0.001 |
History of abscess | 32.7% (51) | 53.7% (36) | 16.9% (15) | <0.001 |
History of CD-related surgery | 67.9% (106) | 79.1% (53) | 59.6% (53) | 0.01 |
Disease phenotype | ||||
Inflammatory | 36.5% (57) | 22.4% (15) | 47.2% (42) | 0.002 |
Stricturing | 32.7% (51) | 34.3% (23) | 31.5% (28) | |
Perforating/Fistulizing | 30.8% (48) | 43.3% (29) | 21.3% (19) | |
Admission | 76.3% (119) | 91.0% (61) | 65.2% (58) | <0.001 |
|
|
|
|
|
---|---|---|---|---|
Mean outpatient encounters/month | 0.19 (0.02,0.42) | 0.30 (0.14,0.52) | 0.12 (0.01,0.38) | 0.05 |
APCT in last 30 days | 7.9% (5) | 26.3% (5) | 0.0% (0) | 0.002* |
APCT in last 6 months | 14.3% (9) | 31.6% (6) | 6.8% (3) | 0.017* |
Diarrhea | 44.4% (28) | 21.1% (4) | 54.5% (24) | 0.014 |
Gastrointestinal bleed | 42.9% (27) | 15.8% (3) | 54.5% (24) | 0.004 |
Constipation | 7.9% (5) | 21.1% (4) | 2.3% (1) | 0.026* |
To identify characteristics that may predict whether CD patients presenting to the ED may have a CAF at a given ED visit a random-effects logistic regression model was built using the available patient-level and visit-level information. A set of easily obtainable, objectively measurable candidate predictors was chosen to include in the model construction based on literature review and
A small number of variables that were missing 80% or more of the values were excluded from consideration in the final model. Multiple imputation was employed to fill in missing covariate values so that visits with incomplete information could be included in analyses. Specifically a sequential imputation using chained equations employing predictive mean matching over the output from a
As a sensitivity analysis each of the variables included in the model was removed one at a time and the performance of each of these models was evaluated and compared (
Of the 328 patients identified using the OCTRI cohort discovery tool, 219 met inclusion criteria. 156 patients had a diagnosis of CD and accounted for a total of 350 ED visits. 96 (61.5%) CD patients underwent 1 APCT, 43 (27.6%) underwent 2 to 4 APCTs, and 17 (10.9%) underwent 5 or more APCTs. The mean age (±SD) of CD patients at presentation to the ED was 37.9 (±13.3), and 188 (53.7%) of encounters were made by women. One or more CAF was identified on APCT in 108/350 (30.9%) of all CD patient encounters.
63 patients with UC were identified with a total of 114 ED visits. In the UC group 40 patients (63.5%) underwent 1 APCT, 20 (31.7%) underwent 2 to 4 APCTs, and 3 (4.8%) underwent 5 or more APCTs. The mean age (±SD) of UC patients at presentation to the ED was 45.1 (±15.9), and 64 (56.1%) of encounters were made by women. One or more CAF was identified in 33/114 (28.9%) of all UC patient encounters. Supplementary
Univariate analysis was performed comparing the baseline characteristics of initial patient ED encounters where CAF was identified to those where no CAF was identified. In the CD cohort the group with CAF identified at the first visit had a greater chance of a previous history of obstruction or abscess, prior CD-related surgery, perforating/fistulizing disease, and admission. The CAF group more often presented with constipation, elevated neutrophil count, and elevated lactate, but constipation was uncommon in each group and lab values were missing for many patients. (
Predictors for the model were selected by identifying the variables that had the highest impact on prediction of CAF in CD patients. Variables included in the final model were age, history of psychiatric diagnosis, history of CAF, diarrhea, and platelet count > 400,000/mL. (
|
|
|
---|---|---|
Psychiatric diagnosis | 0.67 | 0.35, 1.29 |
History of clinically actionable finding | 11.6 | 4.54, 29.6 |
Diarrhea | 0.43 | 0.23, 0.83 |
Platelet count ≥ 400,000 | 3.42 | 1.56, 7.50 |
Estimates are age-adjusted for both linear and quadratic age effects.
In an effort to simplify the model to allow it to be more easily applied in clinical practice, it was converted from an odds scale (multiplicative) to a log-odds scale (additive). The log-odds scale was further simplified by re-centering at zero and rounding to the nearest integer. (
|
---|
Start at 0 and add or subtract the indicated amount if the specified condition is met:Prior history of CAF?+6Platelet count >400,000+3 (If unobserved, assume a high count)Active diarrhea?-2Prior history of psychiatric diagnosis?-1 (If unknown, assume no history)Age correctionAge 18-45? 0Age 46-55?+1Age 56-65?+2Age 66-75?+5Age 76 or older?+9If the total risk score is:Negative or 0 DO NOT SCANPositive SCAN |
Scores on this scale can be converted to estimated probabilities using the formula
An exploratory analysis was carried out comparing the 17/156 (10.9%) of CD patients who underwent 5 or more APCT scans (a radiation dose that is commonly considered hazardous) during the study period to those who did not.(12, 18) The high-utilizers were much less likely to have a CAF identified at any given visit with 27/145 (18.6%) of APCT scans revealing a CAF in the high-utilizer group compared to 81/205 (39.5%) of APCTs with a CAF identified in those patients who underwent 4 or fewer APCT scans. However, visits by the high utilizers seemed to cluster temporally, with 43% of all visits made by high utilizers occurring at the same age (in years) as the previous visit, compared to only 13% of visits by non-high utilizers. Hence, the lower rate of CAF incidence may be at least partially explained by autocorrelation between visits. Additionally there was little indication that high utilizers and non-high utilizers differed in indicators of acute illness such as vital signs or laboratory values at visits.
This study confirms previously published high rates of CAF identified on APCT in patients with CD presenting to the ED with a gastrointestinal chief complaint with one or more CAF identified on APCT in 30.9% of patient encounters.(3-8) Variables most predictive of CAF in CD patients were increasing age, history of psychiatric diagnosis, history of CAF, diarrhea and a platelet count of more than 400,000.
Interestingly our study found a higher rate of CAF in visits by UC patients (28.9%) than a previous study that reported a rate of 12.8%.(7) Examining the rates of individual types of CAF between our two studies the increased rate of CAFs in our study is almost entirely due to a higher incidence of obstruction (10.5% vs 1.9%) and abscess (8.8% vs 2.0%). While inclusion criteria were similar in the two studies, diagnosis of UC was established via established diagnosis of UC at presentation to the ED in both studies, and any given individual had a diagnosis of UC of varying certainty. While UC is not commonly associated with obstruction as a complication previously undiagnosed CD may present this way. Unfortunately we do not have data regarding prior abdominal surgeries such as colectomy in this population, which may also predispose to obstruction. The higher rates of immunomodulatory use, which predispose to infections such as abscess, may help explain the higher incidence of abscesses identified in our patient population compared to the previously reported study.
Prior studies have identified variables associated with increased radiation exposure and high utilization of health care in IBD patients, but none has examined a potential association of psychosocial variables with the probability of identifying a CAF.(11-14) Our study sought to identify whether psychosocial variables may lead to a consistent under reporting or over reporting of symptoms and impact the likelihood that a truly CAF would be identified on imaging. While there were no remarkable differences in these characteristics on univariate analysis between the CD patients who had CAF identified at the first visit and those who did not, a history of psychiatric diagnosis was found to be protective against having a CAF identified on APCT in our predictive model.
We identified a sub-group of 17/156 (10.9%) of CD and 3/63 (4.8%) of UC patients that underwent 5 or more APCT scans ordered by an ED physician, a level of radiation exposure considered potentially harmful on an individual scale.(12, 18) CD patients in our study who underwent 5 or more APCTs were less likely to have a CAF identified on any given scan: 18.6% compared to 39.5% in the patients who underwent 4 or fewer APCTs. Although a higher degree of correlation among visits in the former group may partially explain the contrast, this group may also represent a particularly vulnerable population who present to the ED and are scanned more frequently but are less likely to benefit from each scan.
We also assessed the total number of APCT scans obtained at our institution in any context for these patients and found that 56/156 (35.9%) of CD and 15/63 (23.8%) of UC patients underwent 5 or more APCT scans obtained in any clinical context within the approximately 6-year timeframe of our study. These rates of exposure to radiation from CT scans are higher than those previously reported in the literature with a recent meta-analysis examining ionizing radiation dose across all clinical contexts showed a harmful level of radiation in 11.1% and 2% of Crohn's disease and ulcerative colitis patients respectively.(18) Additionally our data do not account for APCT scans obtained at institutions other than our own and do not account for other forms of ionizing radiation and so could underestimate the true rates of radiation exposure in these patients.
The retrospective and single-center nature of our study imposes inherent limitations. Patients did not experience a standardized workup. Certain variables that may have been of use in a predictive model, such as erythrocyte sedimentation rate, C-reactive protein, lactate, and abdominal plain films, were not obtained in the majority of ED visits. We constructed our model to emphasize sensitivity over specificity as missing a CAF could have severe consequences for a patient and any model that misses a significant amount of CAFs would not be of real world utility. This resulted in a reduction of the number of patients that may be saved an APCT scan based on the predictive model, limiting its utility as a cost- and radiation-reduction tool.
The choice to examine outcomes of APCT scans introduces bias into our study as well as the criteria which ED physicians employ to decide to obtain an APCT scan are uncertain and may vary across patients and practitioners. Finally, the multiplicity of potential CAFs that can be identified on an APCT introduces difficulty in creating a unifying model that may predict any of these complications, a potential explanation for the low specificity of the model.
Our model has proven to be robust. Multiple imputation was used for encounters missing variables but the performance characteristics of the model held up even when using only encounters with complete data sets. Additionally, the model was internally validated by removing patients one at a time, and held up when applied to a control group who did not have an APCT obtained at their ED visit; this suggests that we did not overfit to this one dataset. Sensitivity analysis, performed by removing variables from the predictive model and assessing the impact on performance, revealed that the model was robust to specification error as long as history of CAF (the most influential predictor) was maintained in the model. Finally, to our knowledge we are the first to attempt to associate psychosocial variables with the likelihood of identifying a CAF on imaging.
Additional studies are needed to identify what factors predispose some patients to repeated CAFs. Additionally, further characterization of the subgroup of patients that are high utilizers of CT scans may provide information helpful in identifying and caring for this potentially more vulnerable population. We plan to carry out a prospective validation of this model in our institutional ED.
In summary, the yield of APCT for identifying a CAF was 30.9% in CD patients and 28.9% in UC patients. Our model performed well when used to identify patients with a low likelihood of having a CAF identified on APCT scan, a finding that may aid ED physicians by identifying those patients least likely to benefit from APCT. While our model was internally validated and performed well when applied to a control group, it requires external validation on a larger set of patients.
Departmental funding from the Division of Gastroenterology and Hepatology at Oregon Health & Science University was obtained for assistance with statistical analysis.