Impact of a Novel Multiparameter Decision Support System on Intraoperative Processes of Care and Postoperative Outcomes

Sachin Kheterpal; Amy Shanks; Kevin K. Tremper

doi:10.1097/ALN.0000000000002023

Free

Perioperative Medicine | February 2018

Impact of a Novel Multiparameter Decision Support System on Intraoperative Processes of Care and Postoperative Outcomes

Sachin Kheterpal, M.D., M.B.A.; Amy Shanks, Ph.D.; Kevin K. Tremper, Ph.D., M.D.

Author Notes

From the Department of Anesthesiology, University of Michigan Medical School, Ann Arbor, Michigan.
This article has been selected for the Anesthesiology CME Program. Learning objectives and disclosure and ordering information can be found in the CME section at the front of this issue.
This article has been selected for the Anesthesiology CME Program. Learning objectives and disclosure and ordering information can be found in the CME section at the front of this issue.×
This article is featured in “This Month in Anesthesiology,” page 1A.
This article is featured in “This Month in Anesthesiology,” page 1A.×
Corresponding articles on pages 241 and 247.
Corresponding articles on pages 241 and 247.×
Supplemental Digital Content is available for this article. Direct URL citations appear in the printed text and are available in both the HTML and PDF versions of this article. Links to the digital files are provided in the HTML text of this article on the Journal's Web site (www.anesthesiology.org).
Supplemental Digital Content is available for this article. Direct URL citations appear in the printed text and are available in both the HTML and PDF versions of this article. Links to the digital files are provided in the HTML text of this article on the Journal's Web site (www.anesthesiology.org).×
This article has an audio podcast.
This article has an audio podcast.×
Submitted for publication October 29, 2016. Accepted July 25, 2017.
Submitted for publication October 29, 2016. Accepted July 25, 2017.×
Address correspondence to Dr. Kheterpal: UH 1H2417 SPC 0048, 1500 East Medical Center Drive, Ann Arbor, Michigan 48109. sachinkh@med.umich.edu. This article may be accessed for personal use at no charge through the Journal Web site, www.anesthesiology.org.

Article Information

Anesthesiology 2 2018, Vol.128, 272-282. doi:10.1097/ALN.0000000000002023

Abstract

Background: The authors hypothesized that a multiparameter intraoperative decision support system with real-time visualizations may improve processes of care and outcomes.

Methods: Electronic health record data were retrospectively compared over a 6-yr period across three groups: experimental cases, in which the decision support system was used for 75% or more of the case at sole discretion of the providers; parallel controls (system used 74% or less); and historical controls before system implementation. Inclusion criteria were adults under general anesthesia, advanced medical disease, case duration of 60 min or longer, and length of stay of two days or more. The process measures were avoidance of intraoperative hypotension, ventilator tidal volume greater than 10 ml/kg, and crystalloid administration (ml · kg^–1 · h^–1). The secondary outcome measures were myocardial injury, acute kidney injury, mortality, length of hospital stay, and encounter charges.

Results: A total of 26,769 patients were evaluated: 7,954 experimental cases, 10,933 parallel controls, and 7,882 historical controls. Comparing experimental cases to parallel controls with propensity score adjustment, the data demonstrated the following medians, interquartile ranges, and effect sizes: hypotension 1 (0 to 5) versus 1 (0 to 5) min, P < 0.001, beta = –0.19; crystalloid administration 5.88 ml · kg^–1 · h^–1 (4.18 to 8.18) versus 6.17 (4.32 to 8.79), P < 0.001, beta = –0.03; tidal volume greater than 10 ml/kg 28% versus 37%, P < 0.001, adjusted odds ratio 0.65 (0.53 to 0.80); encounter charges $65,770 ($41,237 to $123,869) versus $69,373 ($42,101 to $132,817), P < 0.001, beta = –0.003. The secondary clinical outcome measures were not significantly affected.

Conclusions: The use of an intraoperative decision support system was associated with improved process measures, but not postoperative clinical outcomes.

Visual Abstract: An online visual overview is available for this article at http://links.lww.com/ALN/B632.

What We Know about This Topic

The extent to which intraoperative decision support systems guide care and improve outcomes remains unclear.
The authors compared a novel decision support system to a historical control group and to a matched (nonrandomized) contemporaneous control group.

What This Article Tells Us That Is New

Most improvements were time-dependent. Decision support was associated with improved process-of-care measures compared to contemporaneous control patients, but not with improved clinical outcomes.
Decision support systems should be formally evaluated because the extent to which they will enhance patient care is not obvious.

WIDE variation in surgical outcomes persist across hospitals and countries despite decades of research and quality improvement efforts.^1,2 Strategies such as team training and checklists, first demonstrated to decrease adverse events in aerospace and aviation, have now been incorporated into health care.^3,4 In addition, the electronic health record (EHR), novel diagnostic technology, and minimally invasive surgical options should theoretically improve patient outcomes. However, the advent of new data streams has created a new challenge: “alarm fatigue,” which may result in harm due to the failure to recognize actionable patient deterioration.⁵

Concurrently, observational studies of large databases and prospective trials have found associations between intraoperative physiologic management and postoperative outcomes.^6–8 Specifically, reduced episodes of intraoperative hypotension, improved ventilation management, tighter glucose control, and more restrictive fluid management have all been associated with improved postoperative outcomes.^6–17 Management of these interventions in the hyperacute intraoperative setting requires a single anesthesiology provider to integrate second-to-second changes in more than 40 distinct physiologic parameters in the context of specific patient comorbidities and the dynamic surgical insult itself. However, there are mixed data regarding the value of alert systems in demonstrating a measurable change in clinical decision-making or patient outcomes.^4,14,18,19 Unsuccessful trials have relied on basic alphanumeric paging and EHR-based screen pop-ups, and have been limited to blood pressure or brain function monitoring data.^4,18 There are promising results for improved management of hyperglycemia.^14,19

It has been suggested that anesthesia adopt tactics established in the aviation industry, such as multifunction displays and decision support systems, which integrate across the disparate data sources, devices, and contexts to highlight and recommend specific interventions.^4,19–21 An intraoperative multiparameter decision support system with novel real-time visualizations for anesthesia care has received US Food and Drug Administration (FDA) clearance.²² With real-time data extracted from physiologic monitors, EHRs, and peer-reviewed literature transformed into a readily understandable schematic view of organ systems, the system integrates multiple streams of data and knowledge into a single user interface (fig. 1).²² We sought to determine whether implementation of an integrated decision support display was associated with: (1) improved adherence to care processes; and (2) reduced postoperative complications and mortality.

Fig. 1.

The primary patient-specific visualization used in the multiparameter decision support system evaluated in this study, AlertWatch. The aortic arch is red (signifying the mean arterial pressure is below the hypotension threshold of 55 mmHg; there is a scrolling red text alert signifying current hypotension as well as the cumulative duration of hypotension thus far during the case). If the patient’s mean arterial pressure is greater than 60 mmHg, the aortic arch would be green, with no text alerts. If the mean arterial pressure is between 55 and 60 mmHg, the aortic arch would be colored yellow, with a text alert giving the current mean arterial pressure, indicating that the hypotension threshold of 55 mmHg is approaching. The decision support system display receives information from physiologic monitors, anesthesia information management system, and laboratory systems, and displays it in easily identifiable icons of human organs. It is color-coded to signify normal (green), slightly abnormal (yellow), and abnormal (red) ranges. Organs highlighted in orange have comorbidities. The left side of the display provides patient case data and the calculated input and output balance, as well as the presence of infectious disease, the preoperative pain score, and the presence of infusions. Text alerts are presented on the right side of the display in the following hierarchy: black text is informational, red text is for important alerts, and scrolling red alerts are those that need immediate attention. There are more than 47 alerts originating from the 250 pieces of information continuously being extracted from the medical records. The central portion of the display is composed of icons of organ systems: brain, lungs, heart, liver, and kidneys. The level within the heart signifies the fluid status with respect to input and output balance: green (±20% of the estimated blood volume), yellow (high or low, representing ±20 to 40% of the estimated blood volume), and red (very low or very high level, representing greater than 40% positive or negative fluid balance). If there is an invasive arterial catheter or central venous catheter, the level of fluid level and color within the heart is guided by the normal ranges of systolic pressure variation or central venous pressure. Note: in this patient, the fluid level in the heart is in the normal range with a systolic pressure variation of 6 mmHg.

Full Size | Slide (.ppt)

Materials and Methods

Institutional Review Board approval was obtained for this retrospective analysis (University of Michigan, Ann Arbor, Michigan); patient consent was waived because no direct patient identifiers were collected or used during the conduct of this study. The study protocol was reviewed, approved, and registered by the Department of Anesthesiology’s Anesthesia Clinical Research Committee before data extraction or analysis. The patient inclusion, exclusion, primary outcome, and proposed statistical analysis plan were prespecified and included in this protocol. The study is reported in consultation with the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) recommendations.²³

Intervention

AlertWatch OR (AlertWatch; Ann Arbor, Michigan), a FDA-cleared, multifunction decision support system, is composed of real-time data extracted from physiologic monitors and EHR data displayed in a readily identifiable schematic view of organ systems (fig. 1). The system extracts, analyzes, and presents more than 250 pieces of information, providing a “live” organ system view with a beating heart, expanding aortic arch, and ventilating lungs.^18,22 The display is color coded to indicate normal range (green), borderline abnormal range (yellow), and abnormal range (red) for the data related to each organ system or lab value. Organs or systems with underlying comorbidities are outlined in orange (fig. 1). The display also has 48 digital text alerts and two audible alerts (both related to blood pressure). The text alerts, which appear in the upper right alert section of the display, come in three hierarchies: black text for general information, red text for important information, and scrolling red text for information that should be addressed immediately (fig. 1). There are multiple calculations conducted in the background for clinical purposes.^18,22 The system provides an audible alert when the mean arterial pressure drops below 55 mmHg (a triple beep with a decreasing tone), the aortic arch turns red, and a red text scrolling alert is displayed in the upper right alert section of the display, noting the actual mean pressure (fig. 1). The aortic arch turns yellow as a warning when the mean arterial pressure decreases to 60 mmHg or less. Similar alerts are included for intraoperative tidal volume in ml/kg ideal body weight and fluid balance (incorporating fasting duration, insensible losses, fluid administration blood loss; fig. 2).

Fig. 2.

This figure shows the window that opens when the input and output balance is tapped. This window shows the itemized input and output fluid balance using standard rules. In this case, the patient has received 2,500 ml of crystalloid, has had 400 ml of estimated blood loss, has a urine output of 500 ml, and insensible loss of 1,953 ml, resulting in an overall fluid balance of –1,153 ml. Lower in the window the nil per os time is noted, which can be changed. There is also an option to add additional fluid loss through the third-space surgical losses.

Full Size | Slide (.ppt)

Patient Population and Study Groups

The analysis was divided into two periods; a historical control period defined as the 22-month period before the initiation of the decision support system (July 1, 2010 to April 30, 2012) and a parallel control period for when the decision support system was available (July 1, 2012 to June 30, 2016). The two months between May 1, 2012 and June 30, 2012 were an implementation transition period while supplemental screens were installed on the anesthesia workstations to display the decision support system. Patients aged 18 yr or older with advanced comorbid medical disease (defined as American Society of Anesthesiologists Physical Status III or IV documentation) undergoing non–liver transplant surgical procedures requiring general anesthesia with a duration greater than 1 hr and postoperative hospital length of stay of two days or more were included. Because cardiac, thoracic, and vascular procedures are performed at a distinct facility, these patients were not included. Patients with a preoperative mean arterial pressure less than 55 mmHg were excluded. A few intrathoracic procedures performed as part of multispecialty surgery were performed at the study location and included in the analytic dataset.

The treatment group was defined as the decision support system being viewed for 75% or more of the duration of the case. The use of this Web-based display was at the sole discretion of the anesthesia providers. In the primary intention-to-treat analysis, a case in which the decision support system was used less than 75% of case duration was considered a parallel control. Historical controls were cases before implementation of the system. These groups were retrospectively assigned during the analysis phase of the study.

The coprimary outcomes were three process measures: hypotension (the number of minutes the patient experienced a mean arterial pressure below 55 mmHg),⁷ inappropriate ventilation (intraoperative mechanical ventilation with a median tidal volume greater than 10 ml/kg ideal body weight for patients with an ideal body weight of 50 kg or less), and fluid resuscitation rate (crystalloid infused in ml · kg^–1 · h^–1 in patients who had an estimated blood loss of less than 500 ml and did not receive a blood transfusion). We chose to compare fluid resuscitation in patients with less than 500 ml blood loss because of the high degree of variability in accuracy of estimated blood loss, especially in cases with large blood loss.^24,25 The inappropriate ventilation patient population was chosen because previous literature showed that female patients, or those with short stature, remain at risk for excessively large intraoperative tidal volumes, and our default ventilator tidal volume setting (500 ml) is appropriate for patients greater than 50 kg.²⁶

The secondary clinical outcome measures were myocardial injury after noncardiac surgery (defined as a postoperative troponin greater than or equal to 0.3 µg/l [upper limit of normal = 0.3 µg/l]) or postoperative acute kidney injury (AKI), defined as Kidney Disease: Improving Global Outcomes criteria stage 1 or 2, within 7 days after surgery.²⁷ Patients with preoperative creatinine greater than 3 mg/dl, or patients missing creatinine, were excluded from the AKI analysis. In addition, hospital length of stay in days, hospital charges, and 30-day all-cause in-hospital mortality were compared. Hospital charges were not specified in the original protocol as the data were not available at the time of proposal review; they were included as a secondary outcome.

Statistical Analysis

Three distinct analyses were performed: a combined analysis of AlertWatch versus historical control and parallel controls together; AlertWatch versus parallel controls; and AlertWatch versus historical controls. Covariates considered for risk and selection bias adjustment are delineated in table 1. For analysis of hypotension, inappropriate ventilation, fluid resuscitation, myocardial injury, and AKI, we used male sex, age in decades of life (reference age group: 18 to 30 yr), World Health Organization body mass index categories (reference group: normal body mass index), log-transformed surgical duration in minutes, inexperienced provider (defined as clinical anesthesia first-year resident), and in-room provider type (certified registered nurse anesthetist vs. resident), surgical urgency (emergency vs. nonemergency), and individual clinical comorbidities as covariates. Each clinical comorbidity was identified by extracting clinical and administrative diagnoses from our EHR and enterprise research data warehouse. They were grouped into specific comorbidities (e.g., diabetes with complications vs. diabetes without complications) using previously published and validated Elixhauser comorbidity definitions for use with International Classification of Diseases, Ninth and Tenth Revision.²⁸ Surgical duration was log-transformed due to nonnormal distribution. In addition, we incorporated procedure-specific risk using a categorical variable of the anesthesiology base Current Procedural Terminology (CPT) code. Each anesthesia base CPT code (275 distinct codes) was collapsed into one of 18 distinct groups, which reflect similar procedural invasiveness and body area. For example, a colostomy takedown with re-anastomosis versus pancreatectomy would each be represented in a different categorical risk group in our analysis (Supplemental Digital Content 1, http://links.lww.com/ALN/B588, a table listing all CPT categories used). For 30-day mortality and length of stay, the clinical comorbidities and CPT category covariates were replaced by the Risk Stratification Index,²⁹ which has been validated for comparison across patients and hospitals for these outcomes. The Risk Stratification Index incorporates procedure- and patient-specific risk using discharge procedure and diagnoses codes, and is derived from a national dataset of more than 35 million patients.²⁹

Table 1.

Descriptive Characteristics of Studied Patient Population, Providers, and Follow-up Laboratory Testing

Full Size | Slide (.ppt)

For the parallel control analysis, we used a two-stage modeling process. First, the aforementioned covariates were used to derive a propensity score that predicted the use of AlertWatch. We assumed that the decision to use AlertWatch was not distributed randomly across cases, and some underlying variation in patient or procedural risk was likely present. This propensity score reflects the probability that a patient would be provided care using AlertWatch and improves the ability to address provider selection bias in choosing to use AlertWatch for more or less complex patients and procedures. Next, this propensity score was used as a covariate in a multivariable model combined with AlertWatch use to model the dependent outcome variables. Use of a propensity score via covariate adjustment helps to address underlying selection bias when evaluating the impact of nonrandomly assigned treatments, such as the use of AlertWatch.³⁰

For the historical control and overall combined analyses, a propensity score is not applicable because all historical control patients have zero probability of AlertWatch use; the decision support tool was not available for use before its implementation. In lieu of a propensity score, the covariates described above and delineated in table 1 were used individually in multivariable modeling. Across all analyses, a generalized linear model using Poisson distribution was employed for continuous outcomes and a logistic regression model was used for dichotomous outcomes. C-statistics and Akaike information criterion were used to evaluate the discriminating capacity of logistic and linear models, respectively. Bonferroni correction for multiple testing of three coprimary outcomes was performed to establish the statistical significance threshold: P = 0.05 / 3 = 0.0167.

In a post hoc sensitivity analysis, calendar year was included as a covariate in the parallel control analysis to assess the possible impact of “learning” over time, as AlertWatch-based clinical guidelines impacted the care of patients even if AlertWatch was not being used.¹⁸ In addition, post hoc sensitivity analyses of three distinct provider subgroups was performed: certified registered nurse anesthetists, residents, and clinical anesthesia first-year residents only. Finally, a post hoc sensitivity analysis was performed to evaluate whether the definition of “AlertWatch usage” as 75% or greater of case duration was affected by variant thresholds (greater than or equal to 60%, 70%, 80%, or 90%) or “AlertWatch parallel control” as 0% of case duration usage.

Results

A total of 26,769 patients were included in the final dataset: 7,954 AlertWatch cases, 10,933 parallel controls, and 7,882 historical controls (fig. 3). Overall, the studied populations demonstrated a high comorbidity burden (table 1) and relatively high rates of postoperative troponin (12% or greater for all groups) and creatinine measurement (94% or greater for all groups), consistent with their high risk (table 2).

Table 2.

Comparison of Process and Outcome Measures in Historical Controls, Parallel Controls, and AlertWatch Use Patients, with Combined Multivariable Analysis across All Three Groups

Full Size | Slide (.ppt)

Fig. 3.

Flow diagram delineating process by which initial patient population was refined to analytical data set. ASA = American Society of Anesthesiologists Physical Status; LOS = length of stay.

Full Size | Slide (.ppt)

Robust multivariable adjustment demonstrated that in both the overall combined analysis (across all three groups) and parallel control analysis (using propensity score covariate adjustment), all three coprimary outcome process measures demonstrated statistically significant improvement (tables 2 and 3). C-statistics for the combined analysis multivariable logistic regressions varied from 0.70 (stage 1 AKI) to 0.85 (mortality), indicating satisfactory model discriminating capacity, and consistent with previously published literature such as the Risk Stratification Index.²⁹ Hypotension demonstrated a statistically significantly lower risk-adjusted duration for AlertWatch cases than parallel and historical control (beta coefficient –0.29; P < 0.001; 95% CI, –0.30 to –0.27; table 2), although the median duration was clinically similar across all groups (1 to 2 min). AlertWatch patients demonstrated a statistically and clinically significant lower percentage of cases where the median tidal volume was greater than 10 ml/kg ideal body weight (28% AlertWatch vs. 37% parallel control and 57% historical control [adjusted odds ratio 0.39; P < 0.001; 95% CI, 0.32 to 0.47]) and lower median crystalloid ml · kg^–1 · h^–1 weight (5.88 ml · kg^–1 · h^–1 AlertWatch vs. 6.17 parallel control and 7.40 historical control [beta coefficient –0.09; P < 0.001; 95% CI, –0.10 to –0.07]; table 2).

Table 3.

Multivariable Model Results for Comparison of AlertWatch Cases to Parallel Controls and Historical Controls

Full Size | Slide (.ppt)

In the overall combined analysis (table 2), AlertWatch use was found to be an independent predictor and protective against postoperative myocardial injury (adjusted odds ratio 0.68; P < 0.001; 95% CI, 0.55 to 0.84) and associated with shorter hospital length of stay (beta coefficient –0.05; P < 0.001; 95% CI, –0.06 to –0.04), but did not demonstrate statistically significant improvement in stage 1 or 2 AKI or mortality (table 2). When compared to historical controls (table 3), AlertWatch use was found to be an independent predictor and protective against the secondary outcomes of postoperative myocardial injury (adjusted odds ratio 0.54; 95% CI, 0.42 to 0.69), stage 1 AKI (adjusted odds ratio 0.86; 95% CI, 0.78 to 0.94), stage 2 AKI (adjusted odds ratio 0.77; 95% CI, 0.63 to 0.95), mortality (adjusted odds ratio 0.77; 95% CI, 0.61 to 0.98), and hospital length of stay (beta –0.12; 95% CI, –0.13 to –0.11; table 3). However, when compared to parallel controls using propensity score covariate adjustment, AlertWatch no longer demonstrated a significant impact on postoperative myocardial injury, AKI, mortality, or hospital length of stay (table 3). The median encounter charges for parallel controls was $69,373 (25th to 75th percentile, $42,101 to $132,817), while the median encounter charges for AlertWatch cases was $65,770 ($41,237 to $123,869), a statistically significant decrease (beta coefficient –0.003; P < 0.001; 95% CI, –0.003 to –0.003).

A post hoc sensitivity analysis incorporating calendar year of procedure into the propensity score adjusted parallel controls analysis demonstrated an attenuation of all process and outcome measure effects, with only minutes of hypotension retaining significance. Additional post hoc sensitivity analyses comparing AlertWatch cases to parallel controls (propensity score adjusted), evaluating each in-room provider type as a subgroup analysis, demonstrated results similar to the primary analysis. For certified registered nurse anesthetists or residents overall, process-of-care measures were reliably improved compared to historical and parallel controls with statistical significance and similar effect sizes. However, for clinical anesthesia first-year residents only, only hypotension met the Bonferroni-corrected statistical significance threshold of P < 0.0167 (Supplemental Digital Content 2 [http://links.lww.com/ALN/B589], 3 [http://links.lww.com/ALN/B590], and 4 [http://links.lww.com/ALN/B591], tables listing analysis specific to these provider subgroups). A post hoc sensitivity analysis evaluating different AlertWatch usage definitions—greater than or equal to 60%, 70%, 80%, or 90% of case duration—demonstrated the same process and outcome measure differences to be statistically significantly associated with AlertWatch usage as the primary analysis definition (greater than or equal to 75% of case duration). A final post hoc sensitivity analysis defining “parallel control” as cases with AlertWatch used for 0% of the cases demonstrated that use of AlertWatch was associated with not only improvements in hypotension, lower fluid administration, improved tidal volume management, and lower encounter charges, but also shorter median length of stay (Supplemental Digital Content 5, http://links.lww.com/ALN/B592, a table describing the results of this sensitivity analysis).

Discussion

Our implementation of a novel decision support system, including real-time visualizations, was associated with a risk-adjusted improvement in process-of-care measures among high-risk patients undergoing major inpatient surgery. We did not observe an effect on postoperative clinical outcomes or length of hospital stay, although a slight decrease in encounter charges was noted. The impact upon studied processes of care (hypotension, inappropriate ventilation, fluid resuscitation) is resilient across multiple analyses: comparison to combined historical and parallel controls and propensity score adjusted parallel controls. Previous efforts at modeling healthcare improvement efforts in the mold of other high-risk, data-driven industries, such as aviation, have typically disappointed. The current analysis provides encouraging data regarding the potential for intraoperative anesthesiology decision support tools integrating EHR and real-time physiologic data in the hyperacute operating room environment.

The aviation industry has been a leader in applying technology to improve quality and safety.³¹ Starting in the 1970s, a new method of integrating the increasingly complex flight data into a display was developed, referred to as the “glass cockpit.”³² The purpose of this display was to present information to the pilot in a more usable format, enabling rapid interpretation while flying the aircraft, especially during acute situations. The adoption of the “glass cockpit” was associated with a significant improvement in safety. The intraoperative anesthesiologist’s “cockpit” and development of safety monitoring technology has paralleled that of the aviation industry; starting with advanced monitoring standards, emergency protocols, team training, high-fidelity simulators, and checklists.^3,33,34

The analyses of the data do not demonstrate a reliable association between use of the decision support tool and postoperative outcomes, although a small decrease in encounter charges was noted in the primary analysis, as well as both encounter charges and length of stay in a sensitivity analysis. Encounter charges in the parallel control analysis (propensity score adjusted) do demonstrate a statistically significant decrease in costs associated with AlertWatch use ($65,770 [25th to 75th percentile, $41,237 to $123,869] AlertWatch use vs. $69,373 [$42,101 to $132,817] parallel controls; P < 0.001; beta coefficient –0.003). However, no other clinical or resource utilization outcomes studied were found to be statistically different between AlertWatch and parallel controls. The overall combined analysis and historical control analysis did note differences in some postoperative outcomes (tables 2 and 3), but the validity of this observation is questionable given the inherent limitations of before-and-after analyses and the absence of significance in the parallel control analysis. The impact of underlying practice change over time was also highlighted by the fact that the effect size of any process-of-care improvement was attenuated when compared to parallel controls, rather than to historical controls (table 3).

It is also unclear why improvements in process-of-care measures did not yield measurable improvements in the studied postoperative outcomes of AKI, myocardial injury, or mortality. Although intraoperative hypotension, inappropriate lung ventilation, and excessive fluid administration are all associated with postoperative complications, the multitude of care processes (preoperative, intraoperative, and postoperative) not impacted by an intraoperative decision support system may have overwhelmed any possible beneficial value to impacting these three processes of care. It is also possible that postoperative outcomes that were not evaluated in this study, such as pulmonary complications or surgical site infections, were impacted, but not observed as part of this analysis. Previous literature has demonstrated the value of decision support systems to improve not only glycemic management processes of care, but also rates of surgical site infections.^14,19

Other efforts have failed to demonstrate the value of automated alerts to prevent hypotension.^4,18 Panjasawatwong et al. investigated the use of a visual and paging alert for hypotension in a prospective randomized trial.⁴ This study of more than 3,000 patients had disappointing results; the alert did not statistically significantly improve the management of blood pressure or reduce hospital length of stay.⁴ McCormick et al. recently evaluated an alert for low blood pressure and low bispectral index. Although they were able to observe a small decrease in duration of so-called “double-low,” this effect waned during the conduct of the study and they did not observe a difference in the primary outcome, 90-day mortality.¹⁸ Unlike the system implemented by these institutions, the decision support system evaluated in the current study includes alerts designed to provide warning before crossing critical thresholds. For example, the display provides a primary visual alert when blood pressure drops into the “yellow range” (mean arterial pressure less than 60 mmHg) by having the aortic arch turn yellow, thereby giving the clinician a warning that they are approaching a critical blood pressure range of 55 mmHg. This may have caused providers to treat hypotension more aggressively. Although the absolute, unadjusted minutes of mean arterial pressure less than 55 mmHg were clinically similar across groups, multivariable risk-adjusted analysis showed a statistically significant impact (table 2). The clinical significance of this finding, and any associated impact at other blood pressure levels, warrants further study.

A protective lung ventilation bundle that includes the use of intraoperative tidal volumes less than 10 ml/kg ideal body weight has been demonstrated to decrease postoperative pulmonary complications in both operative and critical care literature, although some controversy remains.^11,35,36 The decision support system determines if the tidal volume is greater than 10 ml/kg ideal body weight. If so, a text alert recommends a change to a specific tidal volume range that corresponds to 6 to 8 ml/kg, ideal body weight.¹¹ The control groups had a greater percent of cases that had tidal volume out of the recommended range, especially in the historical controls. Any tactic that may contribute to a decreased incidence of postoperative pulmonary complications would have a significant impact on costs and length of stay.³⁷

Restrictive fluid administration during the intraoperative period is a nearly universal element of modern enhanced recovery after surgery protocols.¹³ Although controversy exists regarding the value of “goal-directed” fluid therapy and the definition of “restrictive” versus “liberal” thresholds, epidemiologic, meta-analysis, and randomized controlled trial data continue to demonstrate that our historical fluid administration practices were likely excessive and that lower fluid balance may be associated with improved postoperative bowel function, wound healing, and pulmonary function across surgical specialties.^15–17,38 It is interesting to note that the AlertWatch group demonstrated not only less crystalloid in ml · kg^–1 · h^–1 in both the historical and control comparison, but also lower variability of fluid resuscitation. We feel this implies tighter crystalloid control by targeting the amount of crystalloid based on the constant presentation of the input and output calculation and/or the invasive objective measures of systolic pressure variation and central venous pressure (table 2; figs. 1 and 2).

There are several significant limitations to this study. First, it is an observational study; therefore, by definition, it cannot prove cause and effect, only associations. Second, the two control groups in this study, a historical control and a parallel control, each have limitations. The historical control cannot control for the improvement of care over time, while the parallel control group has the limitation of selection bias. It is possible that individual practitioners’ experience levels may have affected the results; we mitigated this bias by including experience level in the risk adjustment. In addition, due to within-provider cluster size limitations, we were unable to employ a multilevel fixed and random effects model to control for individual provider effects. Importantly, our results and conclusions are limited to a specific subset of patients: those with advanced medical disease undergoing major surgical procedures requiring general anesthesia and inpatient care. Next, we were unable to collect reliable pulmonary complication data given the nuances of a pneumonia, atelectasis, or pulmonary edema diagnosis. In addition, although the AlertWatch exposure group was defined as the use of the decision support application for 75% of case duration, it is entirely possible that the clinician was ignoring the application alerts, or had it covered by another clinical application, rendering the visual alerts hidden; this would bias toward the null hypothesis of no impact on process of care or postoperative outcome measures. Another limitation of this observational study is that the data for troponin and creatinine are only available for patients from whom those values were collected. It is possible that there were many patients who had organ injury that were missed. We feel this limitation would cause the data to underestimate the true incidence of organ injury rate in both the treatment and control groups in a similar fashion, and therefore would not affect the conclusions of the study. Next, the post hoc sensitivity analysis incorporating the year of procedure demonstrates that provider learning and underlying practice improvement may eventually supersede the incremental impact of decision support system use.

Overall, the results of this study demonstrate that a decision support system employed during anesthesia care is reliably associated with an improvement in multiple process measures. Given the increasing availability of patient care data, promulgation of practice guidelines, and the need to implement those guidelines acutely at the bedside in patients with dynamic clinical status, the current trend of more devices with auditory, static high/low threshold alarms may not be the only answer.

Research Support

All funding was from the Department of Anesthesiology, University of Michigan Medical School, Ann Arbor, Michigan.

Competing Interests

Dr. Tremper is the founder of, and has an equity interest in, AlertWatch (Ann Arbor, Michigan), the company that developed the decision support system being evaluated.

References

Ghaferi, AA, Birkmeyer, JD, Dimick, JB . Complications, failure to rescue, and mortality with major inpatient surgery in medicare patients. Ann Surg 2009; 250:1029–34 [Article] [PubMed]

Pearse, RM, Moreno, RP, Bauer, P, Pelosi, P, Metnitz, P, Spies, C, Vallet, B, Vincent, JL, Hoeft, A, Rhodes, A ; European Surgical Outcomes Study (EuSOS) group for the Trial Groups of the European Society of Intensive Care Medicine and the European Society of Anaesthesiology: Mortality after surgery in Europe: A 7 day cohort study. Lancet 2012; 380:1059–65 [Article] [PubMed]

Neily, J, Mills, PD, Young-Xu, Y, Carney, BT, West, P, Berger, DH, Mazzia, LM, Paull, DE, Bagian, JP . Association between implementation of a medical team training program and surgical mortality. JAMA 2010; 304:1693–700 [Article] [PubMed]

Panjasawatwong, K, Sessler, DI, Stapelfeldt, WH, Mayers, DB, Mascha, EJ, Yang, D, Kurz, A . A randomized trial of a supplemental alarm for critically low systolic blood pressure. Anesth Analg 2015; 121:1500–7 [Article] [PubMed]

Bonafide, CP, Lin, R, Zander, M, Graham, CS, Paine, CW, Rock, W, Rich, A, Roberts, KE, Fortino, M, Nadkarni, VM, Localio, AR, Keren, R . Association between exposure to nonactionable physiologic monitor alarms and response time in a children’s hospital. J Hosp Med 2015; 10:345–51 [Article] [PubMed]

Kheterpal, S, O’Reilly, M, Englesbe, MJ, Rosenberg, AL, Shanks, AM, Zhang, L, Rothman, ED, Campbell, DA, Tremper, KK . Preoperative and intraoperative predictors of cardiac adverse events after general, vascular, and urological surgery. Anesthesiology 2009; 110:58–66 [Article] [PubMed]

Walsh, M, Devereaux, PJ, Garg, AX, Kurz, A, Turan, A, Rodseth, RN, Cywinski, J, Thabane, L, Sessler, DI . Relationship between intraoperative mean arterial pressure and clinical outcomes after noncardiac surgery: Toward an empirical definition of hypotension. Anesthesiology 2013; 119:507–15 [Article] [PubMed]

Monk, TG, Bronsert, MR, Henderson, WG, Mangione, MP, Sum-Ping, ST, Bentt, DR, Nguyen, JD, Richman, JS, Meguid, RA, Hammermeister, KE . Association between intraoperative hypotension and hypertension and 30-day postoperative mortality in noncardiac surgery. Anesthesiology 2015; 123:307–19 [Article] [PubMed]

Sun, LY, Wijeysundera, DN, Tait, GA, Beattie, WS . Association of intraoperative hypotension with acute kidney injury after elective noncardiac surgery. Anesthesiology 2015; 123:515–23 [Article] [PubMed]

van Waes, JA, van Klei, WA, Wijeysundera, DN, van Wolfswinkel, L, Lindsay, TF, Beattie, WS . Association between intraoperative hypotension and myocardial injury after vascular surgery. Anesthesiology 2016; 124:35–44 [Article] [PubMed]

Futier, E, Constantin, JM, Paugam-Burtz, C, Pascal, J, Eurin, M, Neuschwander, A, Marret, E, Beaussier, M, Gutton, C, Lefrant, JY, Allaouchiche, B, Verzilli, D, Leone, M, De Jong, A, Bazin, JE, Pereira, B, Jaber, S ; IMPROVE Study Group: A trial of intraoperative low-tidal-volume ventilation in abdominal surgery. N Engl J Med 2013; 369:428–37 [Article] [PubMed]

Kotagal, M, Symons, RG, Hirsch, IB, Umpierrez, GE, Dellinger, EP, Farrokhi, ET, Flum, DR ; SCOAP-CERTAIN Collaborative: Perioperative hyperglycemia and risk of adverse events among patients with and without diabetes. Ann Surg 2015; 261:97–103 [Article] [PubMed]

Chappell, D, Jacob, M, Hofmann-Kiefer, K, Conzen, P, Rehm, M . A rational approach to perioperative fluid management. Anesthesiology 2008; 109:723–40 [Article] [PubMed]

Ehrenfeld, JM, Wanderer, JP, Terekhov, M, Rothman, BS, Sandberg, WS . A perioperative systems design to improve intraoperative glucose monitoring is associated with a reduction in surgical site infections in a diabetic patient population. Anesthesiology 2017; 126:431–40 [Article] [PubMed]

Regenbogen, SE, Shah, NJ, Collins, SD, Hendren, S, Englesbe, MJ, Campbell, DAJr . Population-based assessment of intraoperative fluid administration practices across three surgical specialties. Ann Surg 2017; 265:930–40 [Article] [PubMed]

Myles, PS, Andrews, S, Nicholson, J, Lobo, DN, Mythen, M . Contemporary approaches to perioperative IV fluid therapy. World J Surg 2017; 41:2457–63

Rahbari, NN, Zimmermann, JB, Schmidt, T, Koch, M, Weigand, MA, Weitz, J . Meta-analysis of standard, restrictive and supplemental fluid administration in colorectal surgery. Br J Surg 2009; 96:331–41 [Article] [PubMed]

McCormick, PJ, Levin, MA, Lin, HM, Sessler, DI, Reich, DL . Effectiveness of an electronic alert for hypotension and low bispectral index on 90-day postoperative mortality: A prospective, randomized trial. Anesthesiology 2016; 125:1113–20 [Article] [PubMed]

Sathishkumar, S, Lai, M, Picton, P, Kheterpal, S, Morris, M, Shanks, A, Ramachandran, SK . Behavioral modification of intraoperative hyperglycemia management with a novel real-time audiovisual monitor. Anesthesiology 2015; 123:29–37 [Article] [PubMed]

Kruger, GH, Tremper, KK . Advanced integrated real-time clinical displays. Anesthesiol Clin 2011; 29:487–504 [PubMed]

Tremper, KK . Anesthesiology: from patient safety to population outcomes: The 49^th annual Rovenstine lecture. Anesthesiology 2011; 114:755–70 [Article] [PubMed]

AlertWatch: OR, FDA 510(k) Clearance. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf15/k153335.pdf. Accessed October 20, 2016

von Elm, E, Altman, DG, Egger, M, Pocock, SJ, Gøtzsche, PC, Vandenbroucke, JP ; STROBE Initiative: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. Lancet 2007; 370:1453–7 [Article] [PubMed]

McCullough, TC, Roth, JV, Ginsberg, PC, Harkaway, RC . Estimated blood loss underestimates calculated blood loss during radical retropubic prostatectomy. Urol Int 2004; 72:13–6 [Article] [PubMed]

Ram, GG, Suresh, P, Vijayaraghavan, PV . Surgeons often underestimate the amount of blood loss in replacement surgeries. Chin J Traumatol 2014; 17:225–8 [PubMed]

Bender, SP, Paganelli, WC, Gerety, LP, Tharp, WG, Shanks, AM, Housey, M, Blank, RS, Colquhoun, DA, Fernandez-Bustamante, A, Jameson, LC, Kheterpal, S . Intraoperative lung-protective ventilation trends and practice patterns: A report from the Multicenter Perioperative Outcomes Group. Anesth Analg 2015; 121:1231–9 [Article] [PubMed]

Kellum, JA, Lameire, N ; KDIGO AKI Guideline Work Group: Diagnosis, evaluation, and management of acute kidney injury: A KDIGO summary (Part 1). Crit Care 2013; 17:204 [Article] [PubMed]

Quan, H, Sundararajan, V, Halfon, P, Fong, A, Burnand, B, Luthi, JC, Saunders, LD, Beck, CA, Feasby, TE, Ghali, WA . Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care 2005; 43:1130–9 [Article] [PubMed]

Sessler, DI, Sigl, JC, Manberg, PJ, Kelley, SD, Schubert, A, Chamoun, NG . Broadly applicable risk stratification system for predicting duration of hospitalization and mortality. Anesthesiology 2010; 113:1026–37 [Article] [PubMed]

Austin, PC . An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behav Res 2011; 46:399–424 [Article] [PubMed]

Boeing: Statistical summary of commercial jet airplane accidents. Worldwide Operations: 1959–2016. Available at: http://www.boeing.com/resources/boeingdotcom/company/about_bca/pdf/statsum.pdf. Accessed October 20, 2016

NASA: Glass Cockpit. Available at: https://www.nasa.gov/centers/langley/news/factsheets/Glasscockpit.html. Accessed October 20, 2016

American Society of Anesthesiologists Standards for Basic Anesthetic Monitoring. (Committee of Origin: Standard and Practice Parameters.) Approved by the ASA House of Delegates on October 21, 1986. Available at: http://www.asahq.org/quality-and-practice-management/practice-guidance-resource-documents/standards-for-basic-anesthetic-monitoring. Accessed October 20, 2016

Haynes, AB, Weiser, TG, Berry, WR, Lipsitz, SR, Breizat, AH, Dellinger, EP, Herbosa, T, Joseph, S, Kibatala, PL, Lapitan, MC, Merry, AF, Moorthy, K, Reznick, RK, Taylor, B, Gawande, AA ; Safe Surgery Saves Lives Study Group: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med 2009; 360:491–9 [Article] [PubMed]

Güldner, A, Kiss, T, Serpa Neto, A, Hemmes, SN, Canet, J, Spieth, PM, Rocco, PR, Schultz, MJ, Pelosi, P, Gama de Abreu, M . Intraoperative protective mechanical ventilation for prevention of postoperative pulmonary complications: A comprehensive review of the role of tidal volume, positive end-expiratory pressure, and lung recruitment maneuvers. Anesthesiology 2015; 123:692–713 [Article] [PubMed]

Hedenstierna, G, Edmark, L . Protective ventilation during anesthesia: Is it meaningful? Anesthesiology 2016; 125:1079–82 [Article] [PubMed]

Dimick, JB, Chen, SL, Taheri, PA, Henderson, WG, Khuri, SF, Campbell, DAJr . Hospital costs associated with surgical complications: A report from the private-sector National Surgical Quality Improvement Program. J Am Coll Surg 2004; 199:531–7 [Article] [PubMed]

Wuethrich, PY, Burkhard, FC, Thalmann, GN, Stueber, F, Studer, UE . Restrictive deferred hydration combined with preemptive norepinephrine infusion during radical cystectomy reduces postoperative complications and hospitalization time: A randomized clinical trial. Anesthesiology 2014; 120:365–77 [Article] [PubMed]

Fig. 1.

Full Size | Slide (.ppt)

Fig. 2.

Full Size | Slide (.ppt)

Fig. 3.

Flow diagram delineating process by which initial patient population was refined to analytical data set. ASA = American Society of Anesthesiologists Physical Status; LOS = length of stay.

Full Size | Slide (.ppt)

Table 1.

Descriptive Characteristics of Studied Patient Population, Providers, and Follow-up Laboratory Testing

Full Size | Slide (.ppt)

Table 2.

Comparison of Process and Outcome Measures in Historical Controls, Parallel Controls, and AlertWatch Use Patients, with Combined Multivariable Analysis across All Three Groups

Full Size | Slide (.ppt)

Table 3.

Multivariable Model Results for Comparison of AlertWatch Cases to Parallel Controls and Historical Controls

Full Size | Slide (.ppt)

Log in to access full content

Impact of a Novel Multiparameter Decision Support System on Intraoperative Processes of Care and Postoperative Outcomes

Log in to access full content

You must be logged in to access this feature.

A new password is required for Anesthesiology.

We've recognized your username...

Forgot Password

Forgot Username