Model Guides

CLM-8B: an open model that scores possible agent actions

Last Week in AI explains an alternative to generating a long answer for every small decision.

Source: Last Week in AINovember 1, 20263 sections
18
On this page
  1. A model for choosing
  2. How the scoring works
  3. Speed, tests and availability
  4. Source
The panda mascot studies three possible routes and selects one glowing path; conceptual AI illustration.Choose the next step

Conceptual cover created with AI.

A model for choosing

According to the Last Week in AI channel, CLM-8B takes a different approach to small AI decisions: it scores possible actions instead of composing a long answer. Andrey Kurenkov and Jeremie Harris explain the release in podcast episode 259. The model receives the current situation and a set of candidate actions, then indicates which choices fit best.

The episode describes it as a System One model: a fast decision component that can sit inside a larger agent. A language model can still handle broader reasoning, while a smaller specialized component chooses between defined options. The discussion compares this role with Jev, another service for structured decisions.

The CLM playground separates a customer message from urgency, department and score questions.
The CLM playground separates a customer message from urgency, department and score questions. Contrastive-LM

How the scoring works

The channel describes a frozen eight-billion-parameter base model with a much smaller trainable projection head of about 20 million parameters. The base converts text into numerical representations, and the added component helps compare situations with candidate actions. Reused candidates can be stored so that they do not need to be encoded again for every decision.

The project’s playground makes this visible with typed questions: a yes-or-no answer, a choice between departments, or a score. Its example combines a customer message with separate decisions about urgency, department and frustration. The output is a distribution across available answers, rather than a free-form paragraph.

CLM’s published latency and success-rate comparison with Jev across four tasks.
CLM’s published latency and success-rate comparison with Jev across four tasks. Contrastive-LM

Speed, tests and availability

The channel reports speedups of up to nine times over Jev in the project’s tests. These tests include the T-Rex game, tool calling, WikiRacing and Super Mario. The comparison records both response time and success rate, so the speed figure belongs to the tested tasks.

The project also tests CLM as a verifier: it chooses among candidate solutions for software tasks instead of writing all solutions itself. The published charts include DeepSWE and Terminal-Bench 2.1. Code and model weights are available under Apache 2.0. Kurenkov and Harris connect the release with a wider range of compact decision models that can be combined with larger language models.

The project’s software-task verification comparison for DeepSWE and Terminal-Bench 2.1.
The project’s software-task verification comparison for DeepSWE and Terminal-Bench 2.1. Contrastive-LM

The source behind this story

Source:Last Week in AI ↗Official source · Opens in a new tab

This editorial story is based on the source’s explanations. The creator’s experience and claims are distinct from independently verified findings. Video and source images belong to their respective creators.

Your favourites

This list stays in this browser on your device. No account is needed, and other visitors cannot see it.

Use a story’s bookmark button to add your first favourite.