Darker Aspects of AI in Canada's Federal CoUS AI Safety Inst. Teams with Anthropic, OpenAI for Enhanced AI Safety in Dev.urt

Published Date: 29/08/2024

The US AI Safety Institute at NIST announces agreements with Anthropic and OpenAI to advance AI safety research, testing, and evaluation.

GAITHERSBURG, Md. — Today, the US Artificial Intelligence Safety Institute at the US Department of Commerce’s National Institute of Standards and Technology (NIST) announced agreements that enable formal collaboration on AI safety research, testing, and evaluation with both Anthropic and OpenAI.

Each company’s Memorandum of Understanding establishes the framework for the US AI Safety Institute to receive access to major new models from each company prior to and following their public release. The agreements will enable collaborative research on how to evaluate capabilities and safety risks, as well as methods to mitigate those risks.

Safety is essential to fueling breakthrough technological innovation. With these agreements in place, we look forward to beginning our technical collaborations with Anthropic and OpenAI to advance the science of AI safety, said Elizabeth Kelly, director of the US AI Safety Institute. These agreements are just the start, but they are an important milestone as we work to help responsibly steward the future of AI.

Additionally, the US AI Safety Institute plans to provide feedback to Anthropic and OpenAI on potential safety improvements to their models, in close collaboration with its partners at the UK AI Safety Institute.

The US AI Safety Institute builds on NIST’s more than 120-year legacy of advancing measurement science, technology, standards, and related tools. Evaluations under these agreements will further NIST’s work on AI by facilitating deep collaboration and exploratory research on advanced AI systems across a range of risk areas.

Evaluations conducted pursuant to these agreements will help advance the safe, secure, and trustworthy development and use of AI by building on the Biden-Harris administration’s Executive Order on AI and the voluntary commitments made to the administration by leading AI model developers.

About the US AI Safety Institute

The US AI Safety Institute, located within the Department of Commerce at the National Institute of Standards and Technology (NIST), was established following the Biden-Harris administration’s 2023 Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence to advance the science of AI safety and address the risks posed by advanced AI systems. It is tasked with developing the testing, evaluations, and guidelines that will help accelerate safe AI innovation here in the United States and around the world.

About Anthropi

Anthropic is an AI safety and research company that focuses on developing more reliable, interpretable, and steerable AI systems. Its mission is to make AI more trustworthy and beneficial for society.

About OpenAI

OpenAI is an AI research and development company that aims to promote and develop friendly AI in order to benefit humanity as a whole. Its research focuses on building safe and beneficial AI systems that can be used for the betterment of society.

FAQS:

Q: What is the purpose of the agreements between the US AI Safety Institute and Anthropic and OpenAI?

A: The agreements enable formal collaboration on AI safety research, testing, and evaluation, with the goal of advancing the science of AI safety and addressing the risks posed by advanced AI systems.

Q: What is the role of the US AI Safety Institute in the development of AI safety guidelines?

A: The US AI Safety Institute is tasked with developing the testing, evaluations, and guidelines that will help accelerate safe AI innovation in the United States and around the world.

Q: How will the agreements with Anthropic and OpenAI benefit the development of AI safety?

A: The agreements will enable collaborative research on how to evaluate capabilities and safety risks, as well as methods to mitigate those risks, ultimately leading to safer and more trustworthy AI systems.

Q: What is the significance of the Biden-Harris administration’s Executive Order on AI?

A: The Executive Order promotes the safe, secure, and trustworthy development and use of AI, and the voluntary commitments made by leading AI model developers aim to advance the development of AI safety guidelines.

Q: How will the US AI Safety Institute provide feedback to Anthropic and OpenAI on potential safety improvements to their models?

A: The US AI Safety Institute will provide feedback in close collaboration with its partners at the UK AI Safety Institute.

More Topics :