NIST releases a tool for testing AI model risk

Full Article
NIST releases a tool for testing AI model risk

The National Institute of Standards and Technology (NIST) has re-released a testbed called Dioptra to measure how malicious attacks, like poisoning AI model training data, can impact AI system performance. Dioptra is an open-source web-based tool designed to help companies and users assess, analyze, and track AI risks by benchmarking and researching models. It aims to provide a common platform for exposing models to simulated threats in a 'red-teaming' environment.

Dioptra's goal is to test the effects of adversarial attacks on machine learning models and help evaluate AI developers' claims about their systems' performance. The tool was developed in response to President Joe Biden's executive order on AI, which mandates NIST to assist with AI system testing and establish standards for AI safety and security. However, Dioptra has limitations, as it currently only works on models that can be downloaded and used locally.

Get Email Alerts for AI News

By creating an email alert, you agree to AIleap's Terms of Service and Privacy Policy. You can pause or unsubscribe from email alerts at any time.

Latest Articles

Alphabet's AI drug discovery platform Isomorphic Labs raises $600M from Thrive
TechCrunch 6month

Isomorphic Labs, the AI drug discovery platform that was spun out of Google's DeepMind in 2021, has raised external capital for the first time. The $600

AI In Education - Up-level Your Teaching With AI By Cloning Yourself
Forbes 6month

How to level up your teaching with AI. Discover how to use clones and GPTs in your classroom—personalized AI teaching is the future.

Trump's Third Term - How AI Can Help To Overthrow The US Government
Forbes 6month

Trump's Third Term? AI already knows how this can be done. A study shows how OpenAI, Grok, DeepSeek & Google outline ways to dismantle U.S. democracy.

Sam Altman Says OpenAI Will Release an 'Open Weight' AI Model This Summer
Wired 6month

Sam Altman today revealed that OpenAI will release an open weight artificial intelligence model in the coming months. "We are excited to release a powerful new open-weight language model with reasoning in the coming months," Altman wrote on X.

Popular Topics