We have been observing ChatGPT’s amazing potential ever since its November launch. People have been exploring the chatbot and asking questions on issues around the world, from students to artists. There have been numerous speculations regarding how the chatbot’s superior subject knowledge would revolutionize the education industry. After passing the coveted Wharton examinations and the bar exams, ChatGPT’s unstoppable path even exceeded a few benchmarks. All was OK until the chatbot showed up for the UPSC preliminary exams.
According to Analytics India Magazine, ChatGPT scored only 54 out of 100, failing to pass the UPSC prelims. The magazine used Set A of the UPSC prelims 2022 questions to test ChatGPT. According to the magazine, the AI chatbot fell short of the 87.54% mark required for general category UPSC applicants in 2021.
The popular chatbot from OpenAI was unable to directly respond to inquiries about geography, economics, history, science, or even current events. When the magazine questioned whether ChatGPT could pass the UPSC prelims, it responded that while it is knowledgeable in many academic areas, passing the UPSC requires critical thinking and time management. The chatbot didn’t provide a clear response as to whether it would succeed in the test, though.
According to the study, the bot was unable to respond to inquiries on current events because its knowledge base was restricted to 2021. Sometimes the bot even came up with options that weren’t included in the test. The bot was unable to respond to several geography-related inquiries even though they were not time-specific. Interestingly, the same chatbot has succeeded in both the University of Minnesota law tests and the esteemed Wharton exam. Around 11–12 lakh students take the Union Public Service Commission’s Indian Civil Service Examination each year, and just 5% of them advance to the main exams, making it the toughest exam in India.
