Notes
Working notes.
Short write-ups on evaluations, monitors and agent guardrails, including what didn't work.
-
Rules of engagement as a control signal
A design note for monitoring authorised offensive-cyber agents. It pairs a rules-of-engagement check with a suspicion score for agents that reach beyond their task.
-
A weak monitor, and an attacker that never landed
A small trusted-monitoring experiment in ControlArena. A Llama-3.1-8B monitor screening code for backdoors did modestly on replayed data. The live attack round taught me more about eval design than about the monitor.
-
A regex is not a rules of engagement
Lessons from putting guardrails on an autonomous pentest agent, and why a pattern-matching classifier is the wrong kind of control for a tool-using model.