We would first like to thank the author of this commentary for their interest and reflection on our paper [1, 2]. Increasing the discussion around historically stigmatized topics in healthcare, especially sexual health, is of extreme importance and is one thing we hoped to achieve from our research. The author discusses the limitations of our study which we completely agree with and that is why we made sure to list them in the limitations section of our paper. It is evident that the AI chatbots can change their answers based on the exact wording of the prompt and with repeated questioning. Due to the nature of AI, this problem will likely continue to improve as the technology improves and as users get more experience writing prompts. This is why we made sure to use frequently asked questions exactly as they are seen on major health websites, attempting to imitate a prompt the average patient would use. We are aware that having only 3 urologists grade responses, not using blinding techniques, and not using a standardized and validated tool for grading responses can lead to bias within the results. While these limitations are valid, we do not believe that they take away from the importance of this work, especially in our current time. This work stands as a preliminary effort to show that AI can provide quality information regarding vasectomies, and that there is a statistically significant difference in response quality between popular AI chatbots. As a foundational study, there is room to work on the limitations to reduce bias. We hope this paper can spark interest and provide inspiration to future researchers. We look forward to seeing more papers studying AI in the field of urology, with efforts made to increase scale and applicability.
With the recent overturning of Roe v Wade, vasectomies have increased in popularity in the United States [3]. At the same time, medical information on the internet has never been more accessible. In a sensitive field like men’s health, it is important that our patients are using the proper resources when seeking medical information. We know that there is significant medical misinformation online that can be difficult to navigate for patients [4]. AI chatbots are the new technical innovation in internet query technology, and we wanted to see how accurate they were when it came to vasectomies and if they were created equal. As physicians, our patients are going to use this technology, whether we like it or not, either because it is more convenient, or because the subject matter is sensitive. That makes it in our best interest to find out where to direct our patients so they can get the most accurate information.
留言 (0)