mirror of
https://github.com/PR0M3TH3AN/TORCH.git
synced 2026-11-07 21:32:13 +00:00
feat: Weekly Prompt Safety Audit
Co-authored-by: PR0M3TH3AN <[email protected]>
This commit is contained in:
1 parent
f9dd9ea361
commit
b23b9e4982
10 files changed
+311
-14
No files matched your search
@@ -0,0 +1,18 @@
|
||||
---
|
||||
run-start: 2026-02-20-05-02-56
|
||||
cadence: weekly
|
||||
---
|
||||
|
||||
# Prompt Safety Agent Context
|
||||
|
||||
## Goal
|
||||
Audit all daily and weekly agent prompts to ensure they contain explicit safety mechanisms (failure modes, skip allowances, no-op paths).
|
||||
|
||||
## Scope
|
||||
- `src/prompts/daily/*.md`
|
||||
- `src/prompts/weekly/*.md`
|
||||
|
||||
## Constraints
|
||||
- Do not modify prompts to change core behavior.
|
||||
- Only add safety sections if missing and safe to do so.
|
||||
- Report findings.
|
||||
@@ -0,0 +1,12 @@
|
||||
---
|
||||
run-start: 2026-02-20-05-02-56
|
||||
cadence: weekly
|
||||
---
|
||||
|
||||
# Prompt Safety Agent Decisions
|
||||
|
||||
## Decision 1: Use heuristic script for audit
|
||||
**Rationale:** Manually checking 40+ files is error-prone. A script looking for keywords (`FAILURE MODES`, `EXIT CRITERIA`) is more reliable and repeatable.
|
||||
|
||||
## Decision 2: Auto-fix `governance-agent.md`
|
||||
**Rationale:** The prompt was clearly missing a failure mode section. Adding a standard one was low-risk and high-value.
|
||||
@@ -41,6 +41,13 @@ GOALS & SUCCESS CRITERIA
|
||||
2. Verify Outcomes — Check logs and verify that valid proposals were applied and invalid ones rejected.
|
||||
3. Document Actions — Log processed proposals in `src/decisions/DECISIONS_<timestamp>.md`.
|
||||
|
||||
───────────────────────────────────────────────────────────────────────────────
|
||||
FAILURE MODES
|
||||
|
||||
- If `process-proposals.mjs` fails, log the error and stop.
|
||||
- If no proposals are found, do nothing (this is normal).
|
||||
- If validation fails, reject the proposal and log the reason.
|
||||
|
||||
───────────────────────────────────────────────────────────────────────────────
|
||||
WORKFLOW
|
||||
|
||||
|
||||
@@ -0,0 +1,11 @@
|
||||
---
|
||||
run-start: 2026-02-20-05-02-56
|
||||
cadence: weekly
|
||||
---
|
||||
|
||||
# Prompt Safety Agent Test Logs
|
||||
|
||||
- Command: `node scripts/agent/prompt-safety-audit.mjs`
|
||||
Result: Found 1 issue (`governance-agent.md` missing safety section).
|
||||
- Command: `node scripts/agent/prompt-safety-audit.mjs` (after fix)
|
||||
Result: Found 0 issues. All prompts SAFE.
|
||||
@@ -0,0 +1,16 @@
|
||||
---
|
||||
run-start: 2026-02-20-05-02-56
|
||||
cadence: weekly
|
||||
---
|
||||
|
||||
# Prompt Safety Agent Todo
|
||||
|
||||
## Pending
|
||||
- None
|
||||
|
||||
## Completed
|
||||
- [x] Create audit script.
|
||||
- [x] Run audit on all prompts.
|
||||
- [x] Identify `governance-agent.md` as missing safety section.
|
||||
- [x] Add `FAILURE MODES` section to `governance-agent.md`.
|
||||
- [x] Verify fix with re-audit.
|
||||
Reference in new issue
Block a user