Background: Screening endoscopy for varices may be deferred when the calculated EVendo score is ≤3.90. This novel score has not been validated in an external cohort. This study aimed to assess the performance of the EVendo score and compare it with the Baveno VI criteria.
Methods: We identified and calculated this score in all cirrhotic patients who underwent screening endoscopy for the first time with laboratory tests and liver stiffness measurements within 6 months of the endoscopy date.
Results: In total, 103 patients were included. An EVendo score of ≤3.90 identified patients with no gastroesophageal varices (GEV) and varices needing treatment (VNT) with sensitivities of 82% and 83% and specificities of 57% and 34%, respectively. The negative predictive value for VNT was 94%. A comparison with the Baveno VI criteria in Child–Turcotte–Pugh-A patients showed spared endoscopy and missed VNT rates with EVendo score cutoffs of ≤3.9 and ≤4.5 and the Baveno VI criteria of 25%, 33%, and 16.6% and 1.7%, 1.7%, and 0%, respectively.
Conclusions: EVendo score is reliable in clinical practice for predicting GEV and VNT. The number of spared endoscopies was higher than that with the Baveno VI criteria; however, there were more missed VNT cases.
Keywords: Baveno VI criteria, cirrhosis, EVendo score, noninvasive, varices
How to cite this article:Variceal bleeding is one of the leading causes of liver-related mortality in cirrhotic patients.[1] The prevalence of gastroesophageal varices (GEV) increases with the severity of liver cirrhosis; approximately 30%–40% of compensated cirrhosis patients have GEV, and only a minority (10%–20%) have varices needing treatment (VNT). However, most decompensated cirrhosis patients (approximately 85%) have GEV as the majority have clinically significant portal hypertension (CSPH).[2],[3],[4] Therefore, screening cirrhotic patients to diagnose GEV, especially VNT, is recommended so that prophylactic bleeding measures can be applied pharmacologically or endoscopically. Until recently, guidelines recommended using esophagogastroduodenoscopy (EGD) to screen GEV in all cirrhotic patients.[5],[6] However, several studies have shown that a significant proportion of cirrhotic patients subjected to screening endoscopies had negative exams with no GEV identified with EGD, in addition to the sedation risk of cirrhotic patients and higher costs.[7],[8]
Therefore, efforts have been made to develop and investigate the performance of several noninvasive tools that can serve as primary screening methods to limit unnecessary screening of EGD in cirrhotic patients. Examples of these include platelet count-to-spleen diameter ratio, liver or spleen stiffness, combination algorithms, and scores such as aspartate aminotransferase (AST)-to-platelet ratio index (APRI), AST-to-alanine aminotransferase (ALT) ratio (AAR), fibrosis 4 index (FIB-4), and the King, Lok, and Liaoning scores.[9],[10],[11],[12] One of the recommended modalities in the new guidelines and most validated method is the Baveno VI consensus criteria, which rely on liver stiffness measurement (LSM) and platelet counts. This suggests that in compensated cirrhosis, patients with both LSM <20 kPa and platelet count >150 × 109 cells/L can safely avoid screening EGD.[13] These criteria have been validated and showed good sensitivity with low specificity but still had high rates of unnecessary endoscopy.[14],[15] The refinement of these criteria was made in the expanded Baveno VI criteria, which allows for more spared endoscopy rates (SER); however, this was at the expense of a higher missed VNT rate, which is above the accepted threshold of 5%.[15],[16] Therefore, despite the better performance of these criteria compared to other methods, these criteria are not perfect and require the availability of LSM, which is not available in all clinical settings. For these reasons, there is an unmet need for better noninvasive GEV screening methods.
Recently, a new score formula named the EVendo score was developed using a machine-learning algorithm to identify factors significantly associated with GEV and VNT. The formula is based on readily available laboratory tests: hemoglobin (Hgb), platelet counts, international normalized ratio (INR), level of AST, blood urea nitrogen (BUN), and presence of ascites.[17] This score showed robust performance characteristics across a broad array of liver disease etiologies and is readily available using a published online calculator.[18] This novel score has not been validated by an independent group other than the inventors. Therefore, the primary aim of our study was to validate the performance of the EVendo score for the prediction of GEV and VNT in cirrhotic patients. The secondary aim was to compare the performance of the EVendo score with the Baveno VI criteria in the subgroup of patients with compensated cirrhosis.
Patients And MethodsStudy design and settings
This was a retrospective cohort study conducted at King Saud University Medical City and included all adult patients with cirrhosis (age >18) with laboratory investigations and LSM within 6 months of screening EGD, from January 2018 to July 2020. Data were collected using the endoscopy unit's database and medical records. The exclusion criteria included patients with a history of GEV bleeding or varices, endoscopic interventions, noncirrhotic portal hypertension, portal vein thrombosis, splenectomy, or hepatocellular carcinoma. Similarly, patients undergoing dialysis or using beta-blockers or anticoagulants were excluded from the study. The variables collected included age, sex, etiology of liver diseases, hepatic encephalopathy, ascites, platelet count, total bilirubin (TBIL), albumin (ALB), Hgb, ALT, AST, alkaline phosphatase, γ-glutamine transferase, presence of ascites, BUN, serum sodium, serum creatinine, prothrombin time, activated partial thromboplastin time, and INR. The EVendo score was calculated using the equation in the original study and rechecked with calculation results from the Med calculator for every patient.[17],[18] LSM was performed by FibroScan® (Echosens, Paris) based on the standard procedure.[19] Cirrhosis diagnoses were reviewed in all cases, including patients diagnosed based on LSM >15 kPa and/or by histology, regardless of LSM values or the presence of liver decompensation in patients who met other inclusion criteria. VNT in our study was defined as the presence of esophageal varices with grade ≥F2, varices of any size with high-risk stigmata, or any size of gastric varices. Other varices not requiring treatment were named varices not needing treatment (VNNT).
The study was approved by the Institutional Ethical Review Board for Health Sciences Colleges Research on Human Subjects at King Saud University Medical City (E-21-5759). The requirement for informed consent was waived by the same ethics committee as we retrospectively reviewed de-identified information available in database and medical records and did not cause affect patients and their rights adversely. The study was conducted in accordance with the relevant guidelines and regulations stipulated by the King Saud University Medical City.
Statistical analysis
We used absolute numbers and percentages to summarize categorical variables and used means and standard deviations (SDs) or medians and interquartile ranges (IQRs) to summarize continuous data. Comparisons of categorical variables between groups were made using the Chi-square test or Fisher's exact test, whereas comparisons of continuous data were made using Student's t test or the Mann–Whitney U test. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and positive and negative likelihood ratios (LR+, LR−) with 95% confidence intervals (CIs) were estimated to study the diagnostic accuracy of the EVendo score. Receiver operating characteristic (ROC) analysis was performed to examine the overall diagnostic performance of the EVendo score and other markers. The missed VNT rate was calculated as false-negative cases/the total number of patients. The SER was calculated as (false-negative cases + true negative cases)/the total number of patients. An association with P ≤ 0.05 was considered statistically significant. All analyses were performed using SAS version 9.4 (SAS Institute, Inc., Cary, NC) and R software (R foundation for statistical computing, Vienna, Austria).
ResultsThe study cohort included 103 patients who underwent GEV screening [Figure 1]. The etiology distribution among the included patients was as follows: hepatitis C virus 33 (32%), nonalcoholic steatohepatitis 20 (19.5%), hepatitis B virus (HBV) 13 (12.5%), cryptogenic cirrhosis 13 (12.5%), autoimmune liver disease 9 (8.7%), alcoholic liver disease 3 (2.9%), and others 12 (11.6%). The majority of patients in this cohort, 60 (58.2%), had Child–Turcotte–Pugh (CTP)-A cirrhosis, and 40 (38.8%) and 3 (2.9%) patients had CTP-B and CTP-C cirrhosis, respectively.
GEV and VNT were present in 66 (64%) and 12 (11.65%) patients, respectively. The prevalence of GEV based on CTP class showed that GEV was present in all CTP-C patients and present in 26 (65%) CTP-B patients and 37 (61.6%) CTP-A patients. We found that patients with GEV had significantly lower platelet counts and ALB and higher APRI, FIB4, LSM, and EVendo scores than those with no GEV. Comparing patients with VNT with those with VNNT, patients with VNT were younger; otherwise, there were no significant differences in the basic laboratory parameters, such as ALT, AST, ALB, TBIL, INR, and platelet count. The same observation was found for noninvasive parameters, including EVendo score, APRI, FIB4, and LSM [Table 1].
Performance of the EVendo score
The overall performance of the EVendo score for the detection of GEV and VNT showed areas under the receiver operating characteristic curves (AUROCs) of 0.75 (95% CI: 0.65–0.85) and 0.59 (95% CI: 0.54–0.63), respectively. A comparison of the performance based on CTP scores showed that the AUROCs for GEV and VNT were 0.75 (95% CI: 0.62–0.87) and 0.65 (95% CI: 0.54–0.73) for CTP-A and 0.78 (95% CI: 0.62–0.94) and 0.59 (95% CI: 0.52–0.66) for CTP-B and CTP-C.
Using an EVendo score of ≤3.90 identified patients with no GEV and patients with no VNT with sensitivities of 82% and 83% and specificities of 57% and 34%, respectively. The NPV of EVendo score ≤3.90 for ruling out VNT in the study cohort was 94%. Within all performed EGDs, an EVendo score of ≤3.90 could potentially spare 21 (20.38%) patients, with a risk of missing VNT in two patients (1.9%). In our analysis, we identified another potential cutoff value for the EVendo score of 4.5. The performance of this cutoff was close to that of 3.9 [Table 2]. However, with this cutoff point, an EVendo score of ≤4.50 could potentially spare more EGDs in 27 patients (26.21%), with a similar risk of missing VNT in two patients (1.9%) [Table 3].
Table 2: Comparison of the performance of EVendo score with two cutoff values*Comparison of the performance of the EVendo score and Baveno VI criteria in CTP-A patients
The performance of the Baveno VI criteria was assessed in the whole cohort and then in CTP-A patients and compared to that of the EVendo score. The Baveno VI criteria ruled out GEV and VNT with sensitivities of 92% and 100% and specificities of 46% and 24%, respectively, for the whole cohort.
When the analysis was restricted to CTP-A patients, the Baveno VI criteria were able to rule out GEV and VNT with sensitivities of 89% and 100%, specificities of 43% and 26%, and NPVs of 71% and 100%, respectively [Table 4]. The Baveno VI criteria were able to spare 22 (21.35%) endoscopies with a missing rate of VNT of 0%. However, the number of spared endoscopies in CPT-A was less than the number spared using the EVendo score with cutoff points of 3.9 and 4.5: 16.6% versus 25% and 33.3% [Table 3].
Table 4: Comparison of the performance of EVendo score with Baveno VI criteria in Child A cirrhosis patients* DiscussionThe need for high-performing, noninvasive screening tests to identify cirrhotic patients with GEV, especially VNT, cannot be underscored. In this study, we validated the performance of the novel EVendo score as a noninvasive screening tool for predicting GEV and VNT in a cohort of cirrhotic patients in a real-world clinical setting. In addition, we proposed a new cutoff value and compared this score's performance with that of the recommended Baveno VI criteria in the subgroup of CTP-A patients, which is more clinically relevant for noninvasive screening recommendations. We used similar parameters and cutoff points of the EVendo score as in the original work for validation.[17]
In our study, the proportion of disease etiologies was comparable to that in the Dong et al.[17] study. However, we had more HBV patients (12% vs. <1%) and very few alcohol-related cirrhosis patients (3% vs. 23%). In addition, our population age was younger, with more female patients. Several studies have shown that most patients who undergo screening EGD have no varices.[20],[21] The prevalence of GEV in our study was comparable to that in several studies; however, wide variation exists in the literature. In a recent large meta-analysis for varices screening that included 30 studies, the prevalence of any GEV ranged from 15% to 72%, and that of VNT ranged from 6% to 26%.[15] In our cohort, we had a higher prevalence of GEV than that in the Dong et al.[17] study (64% vs. 45%), but we had a lower VNT (12% vs. 16%). This finding was observed even when the analysis was restricted to CTP-A patients. This variation in the reported prevalence of varices in these studies may be related to differences in demographic and clinical factors and the tools used to diagnose cirrhosis.[22],[23] Furthermore, in our cohort, which was gathered from a tertiary care referral center, a higher proportion of CTP-B patients were included in the EVendo performance analyses, which may explain the higher GEV prevalence.
We found that patients with GEV had significantly lower platelet counts and ALB and higher APRI, FIB4, EVendo score, and LSM values than those without GEV. These findings are clinically plausible as most of these parameters are associated with CSPH and consistent with the findings of previous studies.[4],[7] Similar to the original work of the EVendo score, most of the laboratory parameters and noninvasive scores in our study could not segregate the degree of varices and categorize patients who had VNNT from those who had VNT.
The reported performance of the EVendo score was promising, with a score of ≤3.90 cutoff giving high NPVs of 95.8% and 100% to rule out VNT in the training and validation cohorts, respectively.[17] In our analysis, we tested the performance of two cutoff points, and both points had lower sensitivity than the original EVendo score performance. However, both demonstrated high NPVs of approximately 94%–95% to rule out VNT. The advantage of our proposed cutoff of 4.5 compared to 3.9 is the potential of sparing more endoscopies (26% vs. 20%) without compromise in the missing rates of VNT (1.9% with both cutoff values). This finding also holds for the subanalysis of CTP-A patients. These findings are close, albeit lower than the reported figure in the original work of the EVendo score, and can be attributed to patient profile and sample size differences.
The reported sensitivity and specificity of the Baveno VI criteria in previous studies were 97% and 41%, respectively, with a pooled missed VNT rate of 0.3% and a pooled SER of 32.8%.[15] Our analysis showed the excellent performance of the Baveno VI criteria, with the highest sensitivity and NPV (i.e., 100%) in CTP-A patients compared to the EVendo score and with a missing rate of 0% VNT. However, the SER of EGD (17%) was less than that obtained by applying the EVendo score. This low SER is related to the lower specificity of these criteria in most studies assessing and validating these criteria.[14],[21],[24]
This low SER with the use of the Baveno VI criteria, in addition to the limited access of LSM in many clinical settings, favors the use of an easily accessible tool potentially with a better SER such as the EVendo score, which uses parameters readily available in most clinical settings, including primary care and low-income countries. Furthermore, several challenges with the Baveno VI criteria limit their use and are worth considering. LSM is affected by the degree of concomitant inflammation, cholestasis, and technical factors. Some experts have suggested repeated measurements in two settings, but this may not be convenient and may be challenging in busy clinical practice. Furthermore, LSM is not available in every clinical setting.[24],[25],[26],[27],[28]
In conclusion, our analysis shows that the EVendo score has excellent and reliable performance as a screening tool for GEV and VNT in cirrhotic patients. The two cutoff points of the EVendo score have comparable sensitivity; however, an EVendo score of 4.5 has a higher SER. We demonstrated excellent performance of the Baveno VI criteria to rule out VNT; however, the SER was lower than that in previous studies. The EVendo score has the advantages of using easily accessible clinical and laboratory data and having a better SER than the Baveno VI criteria. A large prospective study is required to validate the performance of the EVendo score and compare it with other noninvasive tools.
The strength of our study is that it is the first validation study for the EVendo score in an external cohort. In addition, we included patients from real clinical practice with strict criteria and performed a detailed analysis with a proposal of a new cutoff point and a comparison to the Baveno VI criteria in CTP-A cirrhosis. Although the cohort included CTP-B and CTP-C patients, these patients were a minority. Moreover, they were included in only the EVendo score analysis and excluded from the Baveno VI criteria comparison analysis.
Our study has some limitations. The study is retrospective with potential for bias, especially referral bias. However, we applied strict criteria; our findings are consistent with those of the original work of the EVendo score, and the Baveno VI criteria results are consistent with those of several earlier studies. In addition, the majority of studies assessing varices screening were retrospective in design,[21],[24],[29] with similar results among several prospective and retrospective studies.[17],[24],[30] Another limitation that exists in most studies assessing varices is the interobserver variability in assessing varices.
Acknowledgements
The authors thank and acknowledge the support and fund from the National Plan for Science, Technology, and Innovation (MAARIFAH), King Abdulaziz City for Science and Technology, Riyadh, Kingdom of Saudi Arabia, grant Number 08-MED512-02. The authors also thank and acknowledge the efforts and contribution from the staff of Liver Disease Research Center at the College of Medicine, King Saud University.
Financial support and sponsorship
This work is funded by the National Plan for Science, Technology, and Innovation (MAARIFAH), King Abdulaziz City for Science and Technology, Riyadh, Kingdom of Saudi Arabia.
Conflicts of interest
There are no conflicts of interest.
References
Correspondence Address:
Dr. Khalid Alswat
Liver Disease Research Center, Department of Medicine, College of Medicine, King Saud University, P.O. Box 2925 (59), Riyadh 11461
Saudi Arabia
Source of Support: None, Conflict of Interest: None
CheckDOI: 10.4103/sjg.sjg_624_21
留言 (0)