AI Safety

GLM-5.3: Last Week in AI discusses Anthropic’s cyber capability findings

The podcast examines the spread of advanced cyber capabilities to downloadable models.

Source: Last Week in AINovember 1, 20263 sections
18
On this page
  1. The study discussed in the podcast
  2. What the comparisons show
  3. Why downloadable models enter the discussion
  4. Source
The turtle mascot examines a glowing network shield beside an open model cube; conceptual AI illustration.A new cyber threshold

Conceptual cover created with AI.

The study discussed in the podcast

According to the Last Week in AI channel, GLM-5.3 illustrates how advanced cyber capabilities are spreading to open-weight models. Andrey Kurenkov and Jeremie Harris discuss Anthropic’s September 29 analysis in episode 259. Open weights means the model’s numerical parameters can be downloaded and run outside a hosted chat service.

The channel describes a model approaching Claude Mythos Preview on some cyber tests. Anthropic’s evaluation used isolated test environments. On its V8 exploit test, GLM-5.3 completed 50 of 410 attempts, compared with Mythos Preview’s 56 of 410. The charts show this as approximately 12% and 14%.

Anthropic’s overview compares exploit results and response behavior under different test conditions.
Anthropic’s overview compares exploit results and response behavior under different test conditions. Anthropic

What the comparisons show

A second benchmark tested whether models could find a vulnerability and achieve control-flow hijacking in open-source projects. GLM-5.3 reached the full outcome in 4% of trials and Mythos Preview in 6%. Earlier models in that comparison did not complete the full outcome.

The podcast separates the ability to carry out a task from the safeguards that govern whether a model will accept it. Anthropic’s report compares different testing conditions and reports that GLM-5.3’s refusal behavior can be substantially changed. The published figures illustrate both capability and refusal rates.

Anthropic’s capability curves for ExploitBench and its internal binary-exploitation benchmark.
Anthropic’s capability curves for ExploitBench and its internal binary-exploitation benchmark. Anthropic

Why downloadable models enter the discussion

Kurenkov and Harris connect these findings with the difference between hosted systems and models that people can operate themselves. They also discuss how the same technical capabilities can be relevant to security researchers and to attackers.

The channel places the release within a wider discussion of international competition, open models and the pace of AI development. Its focus is the availability of powerful cyber capabilities across a growing number of models.

Anthropic’s comparison of refusal rates and capability scores before and after model modification.
Anthropic’s comparison of refusal rates and capability scores before and after model modification. Anthropic

The source behind this story

Source:Last Week in AI ↗Official source · Opens in a new tab

This editorial story is based on the source’s explanations. The creator’s experience and claims are distinct from independently verified findings. Video and source images belong to their respective creators.

Your favourites

This list stays in this browser on your device. No account is needed, and other visitors cannot see it.

Use a story’s bookmark button to add your first favourite.