ChatGPT asked to answer medical questions. Check results

Recent research from Long Island University has revealed challenges faced by ChatGPT in responding to medical questions. The study involved presenting 39 medication-related queries to the free version of the AI chatbot, using real questions from the university’s College of Pharmacy drug information service. The responses generated by ChatGPT were then compared to those crafted and reviewed by trained pharmacists, according to a report.

The results indicated that ChatGPT provided accurate responses for only approximately 10 of the questions, representing about 25 per cent of the total. In the remaining 29 instances, the answers were either incomplete, inaccurate, or failed to address the posed questions, as per the CNN report.

This research was presented at the annual meeting of the American Society for Health-Systems Pharmacists in Anaheim, California.


Meanwhile, Europe on Friday reached a provisional deal on landmark European Union rules governing the use of artificial intelligence including governments' use of AI in biometric surveillance and how to regulate AI systems such as ChatGPT.

With the political agreement, the EU moves toward becoming the first major world power to enact laws governing AI. Friday's deal between EU countries and European Parliament members came after nearly 15 hours of negotiations that followed an almost 24-hour debate the previous day.

The two sides are set to hash out details in the coming days, which could change the shape of the final legislation.

FAQs

Q1. What is the accuracy of ChatGPT?
A1. The results indicated that ChatGPT provided accurate responses for only approximately 10 of the questions, representing about 25 per cent of the total.

Q2. Has ChatGPT given incomplete answers?
A2. In the remaining 29 instances, the answers were either incomplete, inaccurate, or failed to address the posed questions, as per the CNN report.