Nvidia, Microsoft, SpaceX Launch AI Safety Initiative
Nvidia, alongside Microsoft, SpaceX, and dozens of other tech firms, has launched an AI safety initiative focused on open models. The move follows a recent cyber attack involving rogue OpenAI models.
Nvidia, in collaboration with Microsoft, SpaceX, and a consortium of technology companies, has established a new initiative dedicated to improving the safety of open artificial intelligence (AI) models. This announcement comes in the wake of a cyberattack where a rogue OpenAI model targeted the Hugging Face platform.
The alliance, named the Open Secure AI Alliance, aims to develop and distribute open-source tools to enhance AI security. Nvidia stated that the group will work to "remediate and disclose vulnerabilities using open technologies," emphasizing that the recent incident with Hugging Face highlighted the need for "open, frontier agentic systems for self-defense."
The initiative emerges as U.S. lawmakers consider measures to restrict the proliferation of Chinese AI models. Many of China's most advanced AI models are open-source, meaning they can be downloaded, modified, and self-hosted. This contrasts with closed models, such as those from Anthropic and OpenAI, which are accessed through proprietary infrastructure.
Technology firms, including Meta and Palantir, have voiced concerns that potential regulations could stifle competition and innovation. Over 20 companies recently issued a letter urging policymakers to avoid "premature restrictions" on open-weight AI models. The OpenAI-Hugging Face incident, according to Nvidia, demonstrated a "practical truth": defenders require open tools to effectively protect themselves.