OpenAI has launched a multilingual dataset, the MMMLU, to evaluate AI language models across 14 languages, including Arabic and Swahili. This initiative aims to address the global language divide and enhance AI capabilities in low-resource languages. By utilizing human translators, OpenAI ensures higher accuracy in the dataset compared to those relying on machine translation.
The MMMLU dataset not only sets a new benchmark for multilingual AI but also supports enterprises in deploying AI solutions in emerging markets. OpenAI's partnership with Hugging Face facilitates broader access to this dataset, promoting open research in AI. Additionally, the launch of the OpenAI Academy aims to empower local developers in low- and middle-income countries, furthering the goal of equitable AI access.
• OpenAI releases MMMLU dataset for evaluating multilingual AI capabilities.
• Dataset includes languages like Swahili and Yoruba, enhancing inclusivity.
The MMMLU dataset challenges AI models to perform in diverse linguistic environments, reflecting the need for multilingual capabilities.
The MMMLU dataset serves as a benchmark for evaluating AI performance across various languages.
OpenAI's use of professional translators for the MMMLU dataset ensures higher accuracy and reliability.
OpenAI's release of the MMMLU dataset aims to enhance global access to AI technologies.
Hugging Face hosts the MMMLU dataset, promoting collaboration in AI research.
Isomorphic Labs, the AI drug discovery platform that was spun out of Google's DeepMind in 2021, has raised external capital for the first time. The $600
How to level up your teaching with AI. Discover how to use clones and GPTs in your classroom—personalized AI teaching is the future.
Trump's Third Term? AI already knows how this can be done. A study shows how OpenAI, Grok, DeepSeek & Google outline ways to dismantle U.S. democracy.
Sam Altman today revealed that OpenAI will release an open weight artificial intelligence model in the coming months. "We are excited to release a powerful new open-weight language model with reasoning in the coming months," Altman wrote on X.