Background: Fine-needle aspiration cytology (FNAC) is the most practiced initial method for evaluation of breast lesions. The International Academy of Cytology Yokohama System for Reporting Breast (IAC YSRB) Fine-Needle Aspiration Biopsy Cytopathology has been developed to standardize the reporting system. However, literature available on the inter-observer reproducibility of 5 IAC YSRB categories is limited. Aim: We investigated the inter-observer reproducibility of the IAC YSRB system. Method and Materials: A total of 70 consecutive specimens obtained from FNAC of breast lesions were reviewed retrospectively by 3 experienced cytopathologists who allotted 1 to 5 IAC YSRB categories. Results: The percent overall agreement between observers was 70.48% and the free marginal kappa was 0.63, which signifies substantial agreement. After combining “Suspicious” and “Malignant” categories, overall agreement was 80.95% and free marginal kappa became 0.75. Conclusions: Inter-observer agreement of three (70.48%) cytopathologists was substantial. Agreement can be improved by combining certain categories, especially “Suspicious” and “Malignant”. Technical quality limitation plays a significant role in a proportion of cases, mainly the “Atypical” and “Suspicious of malignancy” categories. Application of the IAC YSRB system in day-to-day practice will increase the inter-observer agreement.
Keywords: International Academy of Cytology Yokohama System, breast cytology, reproducibility
How to cite this article:Breast cancer is the most common cancer in women and is the leading cause of death in women aged 20–59 years. It accounts for 26% of all newly diagnosed cancer in females and is responsible for 15% of cancer-related deaths in females.[1] Initial evaluations for breast lesions include clinical and radiological examinations along with fine-needle aspiration cytology (FNAC). A number of guidelines have been developed to improve standardization of the terminology and criteria for cytological specimens obtained from the thyroid, pancreas, lungs, and salivary glands.[2] The International Academy of Cytology Yokohama System for Reporting Breast (IAC YSRB) recently developed a set of guidelines for reporting breast cytology. Five diagnostic categories were used in this IAC YSRB system to standardize breast cytology reporting. Each category is associated with a risk of malignancy (ROM) and management recommendation after FNAC. Diagnostic accuracy depends on a variety of factors, including clinical features[3],[4] and the skill of the cytopathologist in obtaining the cytologic materials.[5],[6],[7] However, very little information is available on the inter-observer reproducibility of five IAC YSRB categories. In this present study, 3 experienced cytopathologists examined and classified 70 consecutive cases according to the IAC YSRB categorical system to establish the inter-observer reproducibility.
Materials and MethodsSince it was a retrospective study of specimens already collected and diagnosed, the study was exempt from approval by the Institutional Ethics Committee. The study population consisted of 70 consecutive FNAC samples of breast, performed over a period of one year (September 2020–June 2021). Out of the total patients, 69 were female and 1 was male. The age range was 17–60 years and all presented with palpable breast lesions. FNAC was performed using 22-gauge needle and a 10-ml syringe.[8] The cytology smears were stained by Papanicolaou stain, Haematoxylin and Eosin stain, and Leishman stain. Three experienced cytopathologists independently reviewed each slide and were unaware of the original diagnosis, clinical history, and image findings. Among the 3 cytopathologists, 1 had approximately 20 years of experience and the other 2 had 12 years and 8 years of experience, respectively. The cytopathologists each assigned the cases 1 to 5 diagnostic categories of the IAC YSRB system using the published criteria.[9] The inter-observer agreement was then established by statistical methods.
Statistical analysis
The guidelines for finding agreement among reviewers were followed using Fleiss' Kappa.[10],[11] Fleiss' Kappa is a generalization of Scott's pi statistic. It is a useful method for calculating inter-observer reliability.[12],[13],[14] Percent overall agreement statistics were performed with and without certain categories, to determine if agreement improved or deteriorated when different combinations of categories were made.
ResultsA total of 70 cases have been taken. An individual observer's diagnosis, as a percentage of the total number of cases, is in [Figure 1].
Figure 1: Individual observers' diagnosis, as a percentage of total number of cases (n = 70)Percent overall agreement among three observers was 70.48% when interpretation was done according to original five IAC YSRB categories [Table 1]. The free marginal kappa was 0.63 which signifies substantial agreement.
When category 4 (Suspicious) was merged with category 5 (Malignant), the percent overall agreement improved to 80.95%, and free marginal kappa value became 0.75 [Table 1].
Similarly, when category 2 (Benign) and category 3 (Atypical) were merged, the percent overall agreement improved to 78.10% and the free marginal kappa became 0.71 [Table 1].
However, when category 1 (Inadequate) and category 2 (Benign) were merged, there was no considerable improvement in agreement statistics [Table 1].
There were a total of 210 comparisons (3 observers × 70 cases). A concordant diagnosis was seen in the majority [132/210 (62.86%)]. Discordant diagnoses, like single category difference, were seen in 66/210 (31.43%) and three category difference was seen in 12/210 (5.71%) [Table 2].
The pairwise observed overall agreement between cytopathologists ranged from 67 to 72% and the pairwise kappa value ranged from 0.59 to 0.66 [Table 3].
Thirty-two cases had a final histological diagnosis. Out of those, 19 cases had inter-observer disagreement [Table 4]. For the rest of the cases, follow-up data was retrieved from archive.
Table 4: Cases with inter-observer disagreement correlated with final histological diagnosis DiscussionMany guidelines have been proposed over the last decade aimed at producing definitions and diagnostic criteria that can be universally applied for reporting cytology specimens.
Some of these classification systems have gone one step further, toward providing an estimate of ROM for each of the proposed categories.[15],[16],[17] A major goal of these guidelines is to improve reproducibility and understanding of the reporting of diagnostic results among cytopathologists and between cytopathologists and clinicians.[2]
Therefore, in our study, we report the inter-observer reproducibility and their overall agreement, in line with the recently proposed IAC YSRB guidelines for breast cytology. Seventy consecutive cytology specimens obtained by FNAC of breast lesions were examined.
Inter-observer agreement among the observers was 70.48%. The majority of the discrepancy was seen between category 4 and category 5. When we merged category 4 and category 5, the percent overall agreement improved to 80.95%. This could be due to a lack of definite objective criteria between category 4 and category 5 of the IAC Yokohama system.
Of 70 cases, 32 cases had their final histological diagnosis. The majority of diagnostic disagreements were seen in low-grade carcinoma of no special type (NST), carcinoma with scanty material and in poorly stained smears. For example, in one case [shown in [Figure 2]a and [Figure 2]b] first observer rendered the diagnosis of category 4 due to low nuclear grade of the malignant cells. However, the other two observers rightly considered the lesion as category 5 as they stressed upon dispersal of cells, nuclear atypia (although mild), and occasional tubule formation. Another case of carcinoma NST (where malignant cells were mixed with benign cells and bare bipolar nuclei) was categorized as category 3 by the first two observers and category 4 by the third observer. This could be due to overshooting of the needle from the mass [Figure 2]c. Similar diagnostic discrepancies occurred in a case of low-grade ductal carcinoma due to the presence of cohesive papillary clusters, low nuclear grade, and occasional stripped nuclei [Figure 2]d. Three lobular carcinoma cases led to disagreement between observers due to low cellularity and mild nuclear atypia [Figure 3]. A single case of mucinous carcinoma was missed by all three observers due to the focal presence of scanty mucin and was diagnosed as fibroadenoma with prominent myxoid stroma [Figure 4]. The case of fat necrosis was reported as category 3 by one observer, which could be due to the presence of degenerated epithelial cells in the background [Figure 5].
Figure 2: Diagnostic discrepancy in infiltrating carcinoma NST: (a and b) This case of low grade carcinoma NST was missed by one observer due to cohesive fragments and mild nuclear atypia. (c) This case of carcinoma NST was missed by two observers due to the presence of admixed benign ductal epithelial cells (arrow) and bare nuclei, which could be due to overshooting of the needle from the mass. (d) This case was diagnosed as atypical by two observers due to presence of cohesive papillary clusters and occasional stripped nuclei. [Leishman stain, x40]Figure 3:Diagnostic discrepancy in lobular carcinoma: (a and b) The left panel shows a case of lobular carcinoma diagnosed as atypical by two observers and benign by one observer. This error occurred due to mild nuclear atypia of the malignant cells. (Leishman stain, x40) (c and d) The right panel shows a case, which was diagnosed as atypical by first observer, insufficient/inadequate by second observer and benign by third observer. We believe the discrepancy occurred due to sampling issue. (Hematoxylin and Eosin stain, x40)Figure 4: Diagnostic discrepancy in Mucinous carcinoma: (a–d) Due to the focal presence of scanty mucin, this case was diagnosed as fibroadenoma with prominent myxoid stroma by all three observers. (upper panel: Pap stain, x40; lower panel: Leishman stain, x40)Figure 5: This case of fat necrosis was reported as atypical by one observer due to the presence of degenerated lipocytes in granular necrotic background. (Leishman stain, x 40) The lower left panel shows birefringent calcified necrotic fat under polarized light microscopeThus, we can conclude that a few modifications could be made in the IAC Yokohama categories especially merging category 4 and category 5 that will increase inter-observer agreement. Technical quality limitation plays a significant role in a proportion of cases, especially in the “Atypical” and “Suspicious of malignancy” categories. However, application of the Yokohama system in reporting breast cytology cases in day-to-day practice will increase inter-observer agreement.
Acknowledgments
The authors are thankful to Dr. Goutam Banerjee, Dr. Rupam Karmakar, and Dr. Debasis Chakraborty for their help and support.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
References
Correspondence Address:
Dr. Arghya Bandyopadhyay
Department of Pathology, Burdwan Medical College, Burdwan – 713 104, West Bengal
India
Source of Support: None, Conflict of Interest: None
CheckDOI: 10.4103/joc.joc_203_21
留言 (0)