Google's Gemini project is under scrutiny as new guidelines require contractors to evaluate AI responses outside their expertise. This shift raises concerns about the accuracy of AI outputs, particularly in sensitive areas like healthcare. Contractors previously had the option to skip prompts they were unqualified to assess, but this is no longer allowed.
The change mandates that contractors rate responses they may not fully understand, potentially compromising the quality of information provided. This has sparked internal debates about the effectiveness of the new approach, with some questioning whether it truly enhances accuracy. The situation highlights the challenges in AI training and the importance of domain expertise in evaluating complex topics.
• New guidelines force contractors to evaluate AI responses beyond their expertise.
• Concerns arise over Gemini's accuracy in sensitive topics like healthcare.
Generative AI refers to systems that can create content, such as text or images, based on input data.
Prompt engineering involves crafting inputs to guide AI models in generating desired outputs.
AI accuracy measures how correctly an AI system produces outputs compared to expected results.
Google is a leading technology company known for its advancements in AI, including the Gemini project.
OpenAI focuses on developing AI technologies and models, contributing to the broader AI landscape.
GlobalLogic is an outsourcing firm that collaborates with Google on AI evaluation tasks.
Hitachi owns GlobalLogic and is involved in various technology and AI-related initiatives.
Isomorphic Labs, the AI drug discovery platform that was spun out of Google's DeepMind in 2021, has raised external capital for the first time. The $600
How to level up your teaching with AI. Discover how to use clones and GPTs in your classroom—personalized AI teaching is the future.
Trump's Third Term? AI already knows how this can be done. A study shows how OpenAI, Grok, DeepSeek & Google outline ways to dismantle U.S. democracy.
Sam Altman today revealed that OpenAI will release an open weight artificial intelligence model in the coming months. "We are excited to release a powerful new open-weight language model with reasoning in the coming months," Altman wrote on X.