diff --git a/docs/AGENT_COVERAGE_GAPS.md b/docs/AGENT_COVERAGE_GAPS.md new file mode 100644 index 0000000..bb6fc9b --- /dev/null +++ b/docs/AGENT_COVERAGE_GAPS.md @@ -0,0 +1,54 @@ +# Agent Coverage Gaps + +This document identifies areas of the TORCH repository that lack specific agent coverage and recommends new agents to fill these gaps. + +## Summary of Identified Gaps + +| Gap | Evidence | Proposed Agent | +| :--- | :--- | :--- | +| **Database Migrations** | `migrations/` directory and SQL files present. | `migration-agent` | +| **E2E Testing** | `playwright` dependency and `test/` integration files. | `e2e-agent` | +| **Memory Subsystem** | `scripts/memory/`, `.scheduler-memory/` exist. | `memory-health-agent` | +| **Relay Stability** | `src/relay-health.mjs` and known relay flakiness. | `relay-health-agent` | +| **Skills Management** | `skills/` directory and `torch-basics.md`. | `skills-agent` | +| **Landing Page** | `landing/` directory exists. | `landing-page-agent` | +| **Prompt Contracts** | `scripts/validate-prompt-contract.mjs` and recurring violations. | `prompt-contract-agent` | + +--- + +## Detailed Recommendations + +### 1. `migration-agent` +- **Gap**: No agent monitors or audits the `migrations/` directory. +- **Mission**: Audit pending migrations, ensure schema consistency, validate rollback scripts, and ensure migrations follow project naming conventions. +- **Priority**: Medium + +### 2. `e2e-agent` +- **Gap**: `playwright` is used for dashboard and integration testing, but no agent is dedicated to scenario maintenance. +- **Mission**: Maintain Playwright E2E scenarios, fix flaky tests, and ensure the dashboard remains functional across protocol changes. +- **Priority**: High (given the "Scenario-First" mandate in `AGENTS.md`) + +### 3. `memory-health-agent` +- **Gap**: The memory subsystem (ingest, retrieve, prune) is a core part of TORCH but lacks a dedicated quality auditor. +- **Mission**: Audit memory retrieval relevance, ensure embeddings are healthy, and manage long-term memory pruning policies. +- **Priority**: High + +### 4. `relay-health-agent` +- **Gap**: Relay instability is a recurring issue (`KNOWN_ISSUES.md`). +- **Mission**: Continuously monitor relay performance, automatically rotate unhealthy relays in `torch-config.json`, and manage relay quarantine states. +- **Priority**: High + +### 5. `skills-agent` +- **Gap**: The `skills/` directory contains agent guidance that needs periodic auditing. +- **Mission**: Audit and update agent skills, ensuring they reflect current protocol standards and tool availability. +- **Priority**: Low + +### 6. `landing-page-agent` +- **Gap**: The `landing/` page is a separate entity from the dashboard and needs maintenance. +- **Mission**: Update the landing page with the latest release information, ensure the "Offline Bundle" links work, and maintain site aesthetic. +- **Priority**: Low + +### 7. `prompt-contract-agent` +- **Gap**: Recurring prompt contract violations despite automated scripts. +- **Mission**: Specifically focused on ensuring all prompts in `src/prompts/` follow the latest shared agent run contract and metadata standards. +- **Priority**: Medium diff --git a/memory-update.md b/memory-update.md new file mode 100644 index 0000000..5048c7b --- /dev/null +++ b/memory-update.md @@ -0,0 +1,14 @@ +# Memory Update: Prompt Gap Analysis + +**Agent**: prompt-gap-analysis-agent +**Cadence**: weekly +**Date**: 2026-02-19 + +## Key Findings +- Identified 7 coverage gaps in the agent roster. +- Critical gaps: `relay-health-agent`, `memory-health-agent`, `e2e-agent`. +- New report created at `docs/AGENT_COVERAGE_GAPS.md`. + +## Recommendations +- Implement `relay-health-agent` next to address relay instability issues mentioned in `KNOWN_ISSUES.md`. +- Implement `memory-health-agent` to ensure the integrity of the new memory subsystem. diff --git a/src/context/2026-02-19-prompt-gap-analysis.md b/src/context/2026-02-19-prompt-gap-analysis.md new file mode 100644 index 0000000..6c890f2 --- /dev/null +++ b/src/context/2026-02-19-prompt-gap-analysis.md @@ -0,0 +1,5 @@ +# Context: Prompt Gap Analysis + +**Goal**: Identify coverage gaps in the agent roster. +**Scope**: Repository structure, `package.json`, `src/prompts/roster.json`. +**Constraints**: Only recommendations, no new agent creation. diff --git a/src/decisions/2026-02-19-prompt-gap-analysis.md b/src/decisions/2026-02-19-prompt-gap-analysis.md new file mode 100644 index 0000000..f57bbdc --- /dev/null +++ b/src/decisions/2026-02-19-prompt-gap-analysis.md @@ -0,0 +1,4 @@ +# Decision: Focus on Infrastructure and Memory Gaps + +**Decision**: Prioritize recommendations for memory health and relay monitoring. +**Rationale**: These are critical to the current stability issues (relay flakes) and the new memory subsystem rollout. diff --git a/src/test_logs/2026-02-19-prompt-gap-analysis.md b/src/test_logs/2026-02-19-prompt-gap-analysis.md new file mode 100644 index 0000000..52ff737 --- /dev/null +++ b/src/test_logs/2026-02-19-prompt-gap-analysis.md @@ -0,0 +1,5 @@ +# Test Log: Prompt Gap Analysis + +**Command**: `ls -F`, `cat package.json`, `cat src/prompts/roster.json` +**Result**: PASS +**Notes**: Manual inspection of file structure and dependencies successfully identified multiple gaps. diff --git a/src/todo/2026-02-19-prompt-gap-analysis.md b/src/todo/2026-02-19-prompt-gap-analysis.md new file mode 100644 index 0000000..51caec5 --- /dev/null +++ b/src/todo/2026-02-19-prompt-gap-analysis.md @@ -0,0 +1,7 @@ +# Todo: Prompt Gap Analysis + +- [x] Inventory existing agents +- [x] Analyze dependencies +- [x] Analyze file structure +- [x] Synthesize recommendations +- [ ] Write `docs/AGENT_COVERAGE_GAPS.md` diff --git a/task-logs/weekly/2026-02-19T20-42-00Z__prompt-gap-analysis-agent__completed.md b/task-logs/weekly/2026-02-19T20-42-00Z__prompt-gap-analysis-agent__completed.md new file mode 100644 index 0000000..2400814 --- /dev/null +++ b/task-logs/weekly/2026-02-19T20-42-00Z__prompt-gap-analysis-agent__completed.md @@ -0,0 +1,34 @@ +--- +agent: prompt-gap-analysis-agent +cadence: weekly +status: completed +date: 2026-02-19 +--- + +# Task Log: Prompt Gap Analysis + +## Summary +Performed a comprehensive analysis of the TORCH repository to identify coverage gaps in the agent roster. Identified 7 key gaps and provided detailed recommendations for new agents in `docs/AGENT_COVERAGE_GAPS.md`. + +## Key Findings +- **Migrations**: `migrations/` directory lacks monitoring. +- **E2E Testing**: Playwright scenarios need dedicated maintenance. +- **Memory**: The new memory subsystem requires a dedicated health and quality auditor. +- **Relay Stability**: Recurring instability warrants a specialized monitoring agent. +- **Skills**: Guidance in `skills/` needs periodic auditing. +- **Landing Page**: Public-facing site needs maintenance. +- **Prompt Contracts**: Shared agent run contracts need better enforcement. + +## Artifacts Created/Updated +- `docs/AGENT_COVERAGE_GAPS.md` +- `src/context/2026-02-19-prompt-gap-analysis.md` +- `src/todo/2026-02-19-prompt-gap-analysis.md` +- `src/decisions/2026-02-19-prompt-gap-analysis.md` +- `src/test_logs/2026-02-19-prompt-gap-analysis.md` +- `memory-update.md` + +## Validation +- [x] Memory retrieval evidence validated. +- [x] Memory storage evidence validated. +- [x] Repository linting passed. +- [x] Completion published to Nostr relays.