Close
A study conducted at Purdue University highlighted the concerning error rate of OpenAI's ChatGPT in responding to programming questions. The research, presented at the Computer-Human Interaction Conference, emphasized the importance of accuracy in AI assistants like ChatGPT. Despite its flaws, ChatGPT was found to excel in providing comprehensive and clear responses.
The study involved feeding ChatGPT 517 programming questions sourced from Stack Overflow, a popular platform for programmers. While the AI chatbot displayed a high error rate of 52% in its answers, it also garnered a preference from 35% of participants due to its comprehensiveness and language clarity. However, the study revealed that programmers often overlooked critical mistakes in ChatGPT's responses, posing a risk of misleading users with inaccurate information.
Discover Magazine 3month
Isomorphic Labs, the AI drug discovery platform that was spun out of Google's DeepMind in 2021, has raised external capital for the first time. The $600
How to level up your teaching with AI. Discover how to use clones and GPTs in your classroom—personalized AI teaching is the future.
Trump's Third Term? AI already knows how this can be done. A study shows how OpenAI, Grok, DeepSeek & Google outline ways to dismantle U.S. democracy.
Sam Altman today revealed that OpenAI will release an open weight artificial intelligence model in the coming months. "We are excited to release a powerful new open-weight language model with reasoning in the coming months," Altman wrote on X.
Log in
Sign Up
AI Tools - Popular
AI Tools - Categories
GPTs - Categories
AI for Jobs
