Evaluation of Artificial Intelligence (AI)-based in silico tools for variant classification in clinically actionable NSCLC variants

Abstract

Introduction/Background: Genetic variants beyond FDA-approved drug targets are often identified in non-small cell lung cancer (NSCLC) patients. Although the performances of in silico tools in predicting variant pathogenicity have been analyzed in previous studies, they have not been analyzed for actionable targets of FDA-approved therapies for NSCLC. The aim of this study is to compare the performance of commonly used in silico tools in classifying the pathogenicity of actionable variants in NSCLC. Materials and Methods: We evaluated the performance of the following in silico tools: Polyphen-2 (HumDiv, HumVar), Align-GVGD, MutationTaster2021, CADD, CONDEL, and REVEL. A curated set of targetable NSCLC missense variants (n=236) was used. The overall accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and Matthews correlation coefficient (MCC) of each in silico tool was determined. Results: The most recently released MutationTaster2021 demonstrated the highest performance in terms of accuracy, specificity, PPV, and MCC, but was outperformed by CADD for both sensitivity and NPV. Although some tools demonstrated high sensitivities, all tools except MutationTaster2021 displayed markedly low overall specificities, as low as 23%. Conclusion: The collective results indicate that the evaluated in silico tools can provide guidance in predicting the pathogenicity of NSCLC missense variants, but are not fully reliable. The tools analyzed in this study could be acceptable to rule out pathogenicity in variants given their higher sensitivities, but are limited when it comes to identifying pathogenicity in variants due to low specificities.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study did not receive any funding.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

All data produced in the present study are available upon reasonable request to the authors.

留言 (0)

沒有登入
gif