Anthropic has granted six researchers from nonprofit METR employee-level access to its internal systems to independently evaluate AI models, safety practices and risk management, according to an October 15 company announcement.
The researchers have company hardware, office space and access to tools comparable to Anthropic’s internal risk assessment teams. METR can publish findings on AI risks, incidents and safety practices without company approval, although Anthropic can require limited redactions involving customer data, privileged information and model architecture.
Anthropic is establishing three levels of evaluator access, with METR receiving the highest. The company is also working with SecureBio and Accenture on independent evaluations and is in early discussions with Hugging Face.
ㅤDarin Fredde, Sr. Director of Technical Marketing Engineering, Ridge Security:
“Giving independent researchers meaningful access to AI systems is an encouraging step. There’s a difference between asking someone to review your homework and letting them see how you arrived at the answers. Both have value, but the second offers a much better opportunity to discover what might have been overlooked. From an offensive security perspective, independent evaluation brings fresh eyes, different assumptions, and the freedom to ask questions that internal teams may not have considered. That’s especially important as AI systems become more capable and increasingly connected to tools, data, and operational workflows. The real value will come from what researchers can examine, what they discover, and how those findings improve the systems being evaluated. Independent testing isn’t about proving someone wrong. It’s about building confidence through evidence rather than assumptions.”
ㅤ
Jacob Krell, Senior Director: Secure AI Solutions & Cybersecurity, Suzu Labs:
“Six people cannot audit a frontier AI lab. Anthropic giving METR employee-level access is a real step, and I would rather have it than not, but the bank examiner analogy Anthropic itself uses works against them here. Large banks get teams of resident examiners, rotating staff, and decades of examined process. Six embedded researchers get one slice of one company’s output.
“Employee-level access means employee-level volume. Internal risk reviews, training run documentation, incident reports, eval results. A six-person team reading that firehose while also designing its own evaluations will spend most of its capacity just keeping up. Something goes unreviewed, and the things that go unreviewed are never the things a press release mentions.
“I’ve seen this pattern in security audits of large environments. Two auditors find real findings in the areas they had time to reach. The rest is sampling error dressed up as assurance.
“The test is whether Anthropic scales embedded headcount with model capability. Six researchers against a frontier lab is a pilot. Treat the findings accordingly.”
ㅤ
John Strand, Owner, Black Hills Information Security:
“This is the best news I’ve seen all week. This is exactly the type of oversight and transparency people have been asking for. It’s rare to see a company voluntarily give an independent third party employee-level access to conduct research, evaluate safety practices, and assess risk. I hope this becomes standard across the companies building frontier models.
“A lot of these companies believe oversight will slow things down or reduce innovation. But they’re forgetting something pretty basic. Their AI models going rogue is an actual business risk. Good governance means doing more than moving as fast as possible and maximizing profits at every turn. You have to build something you can sustain.
“It’s great to see Anthropic taking a step in that direction. Responsible oversight is part of keeping a company around for the long term.”
ㅤWhat needs to happen is that there have to be more people given more access to more places. Only then will their find something that moves the needle. Frankly speaking this is a start, but it is only a start.
Related
This entry was posted on October 18, 2026 at 10:39 am and is filed under Commentary with tags Anthropic. You can follow any responses to this entry through the RSS 2.0 feed.
You can leave a response, or trackback from your own site.
Anthropic grants independent researchers employee-level access to assess AI risks
Anthropic has granted six researchers from nonprofit METR employee-level access to its internal systems to independently evaluate AI models, safety practices and risk management, according to an October 15 company announcement.
The researchers have company hardware, office space and access to tools comparable to Anthropic’s internal risk assessment teams. METR can publish findings on AI risks, incidents and safety practices without company approval, although Anthropic can require limited redactions involving customer data, privileged information and model architecture.
Anthropic is establishing three levels of evaluator access, with METR receiving the highest. The company is also working with SecureBio and Accenture on independent evaluations and is in early discussions with Hugging Face.
ㅤDarin Fredde, Sr. Director of Technical Marketing Engineering, Ridge Security:
“Giving independent researchers meaningful access to AI systems is an encouraging step. There’s a difference between asking someone to review your homework and letting them see how you arrived at the answers. Both have value, but the second offers a much better opportunity to discover what might have been overlooked. From an offensive security perspective, independent evaluation brings fresh eyes, different assumptions, and the freedom to ask questions that internal teams may not have considered. That’s especially important as AI systems become more capable and increasingly connected to tools, data, and operational workflows. The real value will come from what researchers can examine, what they discover, and how those findings improve the systems being evaluated. Independent testing isn’t about proving someone wrong. It’s about building confidence through evidence rather than assumptions.”
ㅤ
Jacob Krell, Senior Director: Secure AI Solutions & Cybersecurity, Suzu Labs:
“Six people cannot audit a frontier AI lab. Anthropic giving METR employee-level access is a real step, and I would rather have it than not, but the bank examiner analogy Anthropic itself uses works against them here. Large banks get teams of resident examiners, rotating staff, and decades of examined process. Six embedded researchers get one slice of one company’s output.
“Employee-level access means employee-level volume. Internal risk reviews, training run documentation, incident reports, eval results. A six-person team reading that firehose while also designing its own evaluations will spend most of its capacity just keeping up. Something goes unreviewed, and the things that go unreviewed are never the things a press release mentions.
“I’ve seen this pattern in security audits of large environments. Two auditors find real findings in the areas they had time to reach. The rest is sampling error dressed up as assurance.
“The test is whether Anthropic scales embedded headcount with model capability. Six researchers against a frontier lab is a pilot. Treat the findings accordingly.”
ㅤ
John Strand, Owner, Black Hills Information Security:
“This is the best news I’ve seen all week. This is exactly the type of oversight and transparency people have been asking for. It’s rare to see a company voluntarily give an independent third party employee-level access to conduct research, evaluate safety practices, and assess risk. I hope this becomes standard across the companies building frontier models.
“A lot of these companies believe oversight will slow things down or reduce innovation. But they’re forgetting something pretty basic. Their AI models going rogue is an actual business risk. Good governance means doing more than moving as fast as possible and maximizing profits at every turn. You have to build something you can sustain.
“It’s great to see Anthropic taking a step in that direction. Responsible oversight is part of keeping a company around for the long term.”
ㅤWhat needs to happen is that there have to be more people given more access to more places. Only then will their find something that moves the needle. Frankly speaking this is a start, but it is only a start.
Share this:
Like this:
Related
This entry was posted on October 18, 2026 at 10:39 am and is filed under Commentary with tags Anthropic. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.