# When an agent learns a procedure, what else does it carry forward?

ShadowSkillBench: Software & methods preview. Published 22 Sep 2026. Question: What carries over?
Scope: Software and methods preview · synthetic procedures
Page: https://jasonlovell.ai/work/shadowskillbench
Code: https://github.com/jlov7/ShadowSkillBench

A synthetic testbed for investigating learned procedures and the boundaries of authorised action.

## Status

The release is the experimental machinery: a synthetic testbed for asking whether a learned procedure stays within authorised action. There is no confirmatory result yet.

## In practice

Knowing how to do a task and being allowed to do it are separate questions. Test them separately.

## What I built

Research software and a methods package for controlled experiments on learned procedures, with explicit separation between the testbed and any confirmatory result.

## Where the evidence stops

A software and methods preview. No confirmatory provider study, model ranking or production finding is claimed.

---
By Jason Lovell. Independent work, separate from my role at PwC. I build everything here myself, end to end, with Claude Code and Codex. I write the question and the test first, read the runs, and keep the results that go against me.