Exclusive: Google's Gemini is forcing contractors to rate AI responses outside their expertise

Full Article
Exclusive: Google's Gemini is forcing contractors to rate AI responses outside their expertise

Google's Gemini project is under scrutiny as new guidelines require contractors to evaluate AI responses outside their expertise. This shift raises concerns about the accuracy of AI outputs, particularly in sensitive areas like healthcare. Contractors previously had the option to skip prompts they were unqualified to assess, but this is no longer allowed.

The change mandates that contractors rate responses they may not fully understand, potentially compromising the quality of information provided. This has sparked internal debates about the effectiveness of the new approach, with some questioning whether it truly enhances accuracy. The situation highlights the challenges in AI training and the importance of domain expertise in evaluating complex topics.

• New guidelines force contractors to evaluate AI responses beyond their expertise.

• Concerns arise over Gemini's accuracy in sensitive topics like healthcare.

Key AI Terms Mentioned in this Article

Generative AI

Generative AI refers to systems that can create content, such as text or images, based on input data.

Prompt Engineering

Prompt engineering involves crafting inputs to guide AI models in generating desired outputs.

AI Accuracy

AI accuracy measures how correctly an AI system produces outputs compared to expected results.

Companies Mentioned in this Article

Google

Google is a leading technology company known for its advancements in AI, including the Gemini project.

OpenAI

OpenAI focuses on developing AI technologies and models, contributing to the broader AI landscape.

GlobalLogic

GlobalLogic is an outsourcing firm that collaborates with Google on AI evaluation tasks.

Hitachi

Hitachi owns GlobalLogic and is involved in various technology and AI-related initiatives.

Get Email Alerts for AI News

By creating an email alert, you agree to AIleap's Terms of Service and Privacy Policy. You can pause or unsubscribe from email alerts at any time.

Latest Articles

Alphabet's AI drug discovery platform Isomorphic Labs raises $600M from Thrive
TechCrunch 6month

Isomorphic Labs, the AI drug discovery platform that was spun out of Google's DeepMind in 2021, has raised external capital for the first time. The $600

AI In Education - Up-level Your Teaching With AI By Cloning Yourself
Forbes 6month

How to level up your teaching with AI. Discover how to use clones and GPTs in your classroom—personalized AI teaching is the future.

Trump's Third Term - How AI Can Help To Overthrow The US Government
Forbes 6month

Trump's Third Term? AI already knows how this can be done. A study shows how OpenAI, Grok, DeepSeek & Google outline ways to dismantle U.S. democracy.

Sam Altman Says OpenAI Will Release an 'Open Weight' AI Model This Summer
Wired 6month

Sam Altman today revealed that OpenAI will release an open weight artificial intelligence model in the coming months. "We are excited to release a powerful new open-weight language model with reasoning in the coming months," Altman wrote on X.

Popular Topics