Weekly prompt-safety-agent run: Audited 41 prompts

Co-authored-by: PR0M3TH3AN <[email protected]>
This commit is contained in:
google-labs-jules[bot]andPR0M3TH3AN committed 2026-02-15 01:46:24 +00:00
1 parent 473533d78e
commit eddfbd7039
11 files changed
+582

No files matched your search

@@ -0,0 +1 @@
MEMORY_RETRIEVED
+1
View File
@@ -0,0 +1 @@
MEMORY_STORED
@@ -0,0 +1,18 @@
{
"cadence": "weekly",
"operation": "retrieve",
"runId": "session-mln2x0te",
"servicePath": "src/services/memory/index.js#getRelevantMemories",
"inputs": {
"agentId": "prompt-safety-agent",
"promptPath": "src/prompts/weekly/prompt-safety-agent.md",
"promptIntent": "## Required startup + artifacts + memory + issue capture",
"query": "scheduler | weekly | agent | prompt-safety-agent | intent | Required startup + artifacts + memory + issue capture",
"events": 1
},
"outputs": {
"ingestedCount": 1,
"retrievedCount": 1
},
"status": "ok"
}
@@ -0,0 +1 @@
MEMORY_RETRIEVED
@@ -0,0 +1,19 @@
{
"cadence": "weekly",
"operation": "store",
"runId": "session-mln2ytlb",
"servicePath": "src/services/memory/index.js#ingestEvents",
"inputs": {
"agentId": "prompt-safety-agent",
"promptPath": "src/prompts/weekly/prompt-safety-agent.md",
"promptIntent": "## Required startup + artifacts + memory + issue capture",
"events": 2
},
"outputs": {
"storedCount": 1,
"summaries": [
"Store memory event A for weekly :: ## Required startup + artifacts + memory + issue capture Store memory event B for weekly :: ## Required startup + artifacts + memory + issue capture"
]
},
"status": "ok"
}
@@ -0,0 +1 @@
MEMORY_STORED
+247
View File
@@ -0,0 +1,247 @@
# Prompt Safety Audit Report - 2026-02-15
## Summary
- Total Prompts: 41
- Safe Prompts: 17
- Prompts Needing Improvement: 24
## Prompts Needing Improvement
### audit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### const-refactor-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### content-audit-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### decompose-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### deps-security-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### design-system-audit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### docs-code-investigator
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### innerhtml-migration-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### log-fixer-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### perf-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### protocol-research-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### test-audit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### todo-triage-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### torch-garbage-collection-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### bug-reproducer-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### feature-proposer-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### perf-deepdive-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### pr-review-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### prompt-maintenance-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### race-condition-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### repo-fit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### test-coverage-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### ui-ux-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### weekly-synthesis-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
## Safe Prompts
- ci-health-agent
- docs-agent
- docs-alignment-agent
- known-issues-agent
- load-test-agent
- onboarding-audit-agent
- scheduler-update-agent
- style-agent
- changelog-agent
- dead-code-agent
- frontend-console-debug-agent
- fuzz-agent
- perf-optimization-agent
- prompt-safety-agent
- refactor-agent
- smoke-agent
- telemetry-agent
+3
View File
@@ -0,0 +1,3 @@
set -euo pipefail
node --input-type=module -e "import { ingestEvents, getRelevantMemories } from './src/services/memory/index.js'; import { mkdirSync, readFileSync, writeFileSync } from 'node:fs'; const fallbackCadence='weekly'; const cadence=process.env.SCHEDULER_CADENCE || fallbackCadence; const agentId=process.env.SCHEDULER_AGENT || ('scheduler-memory-' + cadence); const promptPath=process.env.SCHEDULER_PROMPT_PATH || ''; const runId=(process.env.SCHEDULER_RUN_ID || process.env.SCHEDULER_SESSION_ID || process.env.RUN_ID || ('session-' + Date.now().toString(36))); const promptRaw=promptPath ? readFileSync(promptPath, 'utf8') : ''; const promptLines=promptRaw.split(/\\r?\\n/).map((line)=>line.trim()).filter(Boolean); const promptIntent=promptLines.find((line)=>line.startsWith('#') || line.toLowerCase().startsWith('goal')) || promptLines[0] || 'scheduler memory retrieval'; const query=['scheduler', cadence, 'agent', agentId, 'intent', promptIntent.replace(/^#+\\s*/, '')].join(' | '); const timestamp=Date.now(); const events=[{ agent_id: agentId, content: 'Memory retrieval seed for ' + cadence + ' :: ' + promptIntent, timestamp, tags:['scheduler', cadence, 'retrieve'], metadata:{ session_id:runId, source:'scheduler-retrieve', importance:0.4, prompt_path:promptPath } }]; const ingested=await ingestEvents(events,{ agent_id: agentId }); const retrieved=await getRelevantMemories({ agent_id: agentId, query, k: 5 }); const sessionDir='.scheduler-memory/' + runId; const latestDir='.scheduler-memory/latest/' + cadence; mkdirSync(sessionDir,{ recursive:true }); mkdirSync(latestDir,{ recursive:true }); const artifact={ cadence, operation:'retrieve', runId, servicePath:'src/services/memory/index.js#getRelevantMemories', inputs:{ agentId, promptPath, promptIntent, query, events:events.length }, outputs:{ ingestedCount:ingested.length, retrievedCount:retrieved.length }, status:'ok' }; writeFileSync(sessionDir + '/retrieve.json', JSON.stringify(artifact, null, 2)); writeFileSync(sessionDir + '/retrieve.ok', 'MEMORY_RETRIEVED\\n'); writeFileSync(latestDir + '/retrieve.ok', 'MEMORY_RETRIEVED\\n');"
echo MEMORY_RETRIEVED
+3
View File
@@ -0,0 +1,3 @@
set -euo pipefail
node --input-type=module -e "import { ingestEvents } from './src/services/memory/index.js'; import { mkdirSync, readFileSync, writeFileSync } from 'node:fs'; const fallbackCadence='weekly'; const cadence=process.env.SCHEDULER_CADENCE || fallbackCadence; const agentId=process.env.SCHEDULER_AGENT || ('scheduler-memory-' + cadence); const promptPath=process.env.SCHEDULER_PROMPT_PATH || ''; const runId=(process.env.SCHEDULER_RUN_ID || process.env.SCHEDULER_SESSION_ID || process.env.RUN_ID || ('session-' + Date.now().toString(36))); const promptRaw=promptPath ? readFileSync(promptPath, 'utf8') : ''; const promptLines=promptRaw.split(/\\r?\\n/).map((line)=>line.trim()).filter(Boolean); const promptIntent=promptLines.find((line)=>line.startsWith('#') || line.toLowerCase().startsWith('goal')) || promptLines[0] || 'scheduler memory store'; const baseTs=Date.now(); const events=[{ agent_id: agentId, content: 'Store memory event A for ' + cadence + ' :: ' + promptIntent, timestamp: baseTs, tags:['scheduler', cadence, 'store'], metadata:{ session_id:runId, source:'scheduler-store', importance:0.55, prompt_path:promptPath } },{ agent_id: agentId, content: 'Store memory event B for ' + cadence + ' :: ' + promptIntent, timestamp: baseTs + 1, tags:['scheduler', cadence, 'store'], metadata:{ session_id:runId, source:'scheduler-store', importance:0.55, prompt_path:promptPath } }]; const stored=await ingestEvents(events,{ agent_id: agentId }); const sessionDir='.scheduler-memory/' + runId; const latestDir='.scheduler-memory/latest/' + cadence; mkdirSync(sessionDir,{ recursive:true }); mkdirSync(latestDir,{ recursive:true }); const artifact={ cadence, operation:'store', runId, servicePath:'src/services/memory/index.js#ingestEvents', inputs:{ agentId, promptPath, promptIntent, events:events.length }, outputs:{ storedCount:stored.length, summaries:stored.map((m)=>m.summary) }, status:'ok' }; writeFileSync(sessionDir + '/store.json', JSON.stringify(artifact, null, 2)); writeFileSync(sessionDir + '/store.ok', 'MEMORY_STORED\\n'); writeFileSync(latestDir + '/store.ok', 'MEMORY_STORED\\n');"
echo MEMORY_STORED
@@ -0,0 +1,30 @@
# Prompt Safety Audit Findings
See full report at: /app/artifacts/prompt-safety-audit.md
The following prompts were found to be missing standard safety mechanisms:
- audit-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section
- const-refactor-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found
- content-audit-agent: Does not clearly explicitly allow for no-op/stopping
- decompose-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section
- deps-security-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found
- design-system-audit-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section
- docs-code-investigator: Missing explicit FAILURE MODES or EXIT CRITERIA section
- innerhtml-migration-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section
- log-fixer-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- perf-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found
- protocol-research-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- test-audit-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- todo-triage-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- torch-garbage-collection-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section
- bug-reproducer-agent: Does not clearly explicitly allow for no-op/stopping
- feature-proposer-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- perf-deepdive-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- pr-review-agent: Does not clearly explicitly allow for no-op/stopping
- prompt-maintenance-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- race-condition-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found
- repo-fit-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found, Does not clearly explicitly allow for no-op/stopping
- test-coverage-agent: Does not clearly explicitly allow for no-op/stopping
- ui-ux-agent: Missing explicit FAILURE MODES or EXIT CRITERIA section, No clear conditional stop/exit logic found
- weekly-synthesis-agent: Does not clearly explicitly allow for no-op/stopping
@@ -0,0 +1,258 @@
---
agent: prompt-safety-agent
status: completed
date: Sun Feb 15 01:43:42 UTC 2026
---
# Prompt Safety Audit Completed
Audit report generated at artifacts/prompt-safety-audit.md
Issue generated at src/issues/prompt-safety-audit-2026-02-15.md
# Prompt Safety Audit Report - 2026-02-15
## Summary
- Total Prompts: 41
- Safe Prompts: 17
- Prompts Needing Improvement: 24
## Prompts Needing Improvement
### audit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### const-refactor-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### content-audit-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### decompose-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### deps-security-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### design-system-audit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### docs-code-investigator
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### innerhtml-migration-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### log-fixer-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### perf-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### protocol-research-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### test-audit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### todo-triage-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### torch-garbage-collection-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
**Existing Safety Features:**
- Has conditional stop logic
- Allows no-op/stopping
---
### bug-reproducer-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### feature-proposer-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### perf-deepdive-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### pr-review-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### prompt-maintenance-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### race-condition-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### repo-fit-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- None detected
---
### test-coverage-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
### ui-ux-agent
**Issues:**
- Missing explicit FAILURE MODES or EXIT CRITERIA section
- No clear conditional stop/exit logic found
**Existing Safety Features:**
- Allows no-op/stopping
---
### weekly-synthesis-agent
**Issues:**
- Does not clearly explicitly allow for no-op/stopping
**Existing Safety Features:**
- Has FAILURE MODES section
---
## Safe Prompts
- ci-health-agent
- docs-agent
- docs-alignment-agent
- known-issues-agent
- load-test-agent
- onboarding-audit-agent
- scheduler-update-agent
- style-agent
- changelog-agent
- dead-code-agent
- frontend-console-debug-agent
- fuzz-agent
- perf-optimization-agent
- prompt-safety-agent
- refactor-agent
- smoke-agent
- telemetry-agent