Designing a fair benchmark for local security agents
A practical test plan for comparing local models on instruction following, tools, scope control and repeatability.
Study notes say what is still theoretical. Field logs document the method. Investigations make evidence explicit.
A practical test plan for comparing local models on instruction following, tools, scope control and repeatability.
A study note on context, token relationships and why model understanding is not the same as a security boundary.
A boundary map for automation, evidence, manual verification and accountable reporting.