Merge pull request #2404 from PR0M3TH3AN/chore/update-agent-prompts-17466220525670380821

Update interop and smoke agent prompts with missing sections
This commit is contained in:
thePR0M3TH3AN authored and GitHub committed 2026-02-12 15:57:03 -05:00
commit 8b00db23e3
2 files changed
+62 -7

No files matched your search

@@ -139,6 +139,30 @@ RELAY_URLS="wss://relay.test.example" node scripts/agent/interop-test.mjs \
--burst=3 --timeout=30 --out=artifacts/interop-2025-07-14.json
```
<!-- TODO: This prompt appears to be truncated. The following sections are
missing and should be added: FAILURE MODES, OUTPUTS PER RUN, BEGIN.
See https://github.com/PR0M3TH3AN/bitvid/issues for tracking. -->
───────────────────────────────────────────────────────────────────────────────
FAILURE MODES
- **Protocol Mismatch:** If a roundtrip fails due to schema validation (e.g., missing required tags, invalid content format), generate a detailed log in `artifacts/` identifying the specific field mismatch. Do not attempt to auto-patch the schema unless the fix is trivial and obvious (e.g., typo). Instead, open an issue labeled `bug` or `interop-failure` with the reproduction steps.
- **Crypto/Signature Failure:** If signature verification fails or event IDs do not match the computed values, **STOP**. Do not attempt to modify the crypto logic. Open a high-priority issue labeled `requires-security-review` with the specific inputs that caused the failure.
- **Relay Connectivity Issues:** If the specified relays are unreachable or time out, log the failure and abort the run. Do not retry indefinitely. Ensure the error message clearly distinguishes between network errors and protocol errors.
- **Timeout:** If the operation exceeds the specified timeout, abort and log the last known state.
───────────────────────────────────────────────────────────────────────────────
OUTPUTS PER RUN
- **Artifacts:**
- `artifacts/interop-YYYYMMDD.json`: A structured summary of the test run, including:
- Timestamp
- Relays used
- Events published (ID, type)
- Verification results (Pass/Fail)
- Latency metrics
- `artifacts/interop-YYYYMMDD.log`: A human-readable log of the execution flow, including debug information and error stack traces.
- **Pull Request (if applicable):**
- A PR containing the test harness improvements, new regression tests, or documentation updates.
- The PR description must link to the generated artifacts and summarize the test results.
- **Issues:**
- New GitHub issues for any discovered bugs or protocol mismatches, complete with reproduction steps and references to the artifacts.
───────────────────────────────────────────────────────────────────────────────
BEGIN
@@ -157,7 +157,38 @@ RELAY_URLS="wss://relay.example" node scripts/agent/smoke-test.mjs \
--confirm-public --burst=1 --timeout=30 --out=artifacts/
```
<!-- TODO: This prompt appears to be truncated. The following sections are
missing and should be added: FAILURE MODES, PR & COMMIT CONVENTIONS,
OUTPUTS PER RUN, BEGIN.
See https://github.com/PR0M3TH3AN/bitvid/issues for tracking. -->
───────────────────────────────────────────────────────────────────────────────
FAILURE MODES
- **Startup Failure:** If the application fails to start (e.g., port in use, build error), log the stderr output and abort.
- **Relay Connection Failure:** If the client cannot connect to the specified relay, retry with backoff. If it still fails, abort and report "Relay Unreachable".
- **Element Not Found (UI):** If Playwright cannot find a required UI element (e.g., login button, post input), capture a screenshot and dump the DOM state to `artifacts/`. Fail the test step.
- **Verification Failure:** If the read-back event does not match the published event (content mismatch, signature error), log the diff and fail the test.
- **Timeout:** If any step exceeds the configured timeout, abort the run and capture a screenshot/log of the current state.
───────────────────────────────────────────────────────────────────────────────
PR & COMMIT CONVENTIONS
- **Branch Name:** `test/smoke-harness-YYYYMMDD` or `chore/smoke-test-update`
- **Commit Message:**
- `test(smoke): add login and publish flow verification`
- `chore(smoke): update relay config for local testing`
- **PR Title:** `test: smoke harness updates` or `chore: add smoke test for [feature]`
- **PR Description:**
- Clearly state what flows are covered.
- Include a summary of the test results (Pass/Fail).
- Link to any artifacts or logs (if uploaded).
- Mention if any manual steps are required to run the test (e.g., specific relay setup).
───────────────────────────────────────────────────────────────────────────────
OUTPUTS PER RUN
- **Artifacts:**
- `artifacts/smoke-YYYYMMDD.log`: Detailed execution log.
- `artifacts/smoke-YYYYMMDD.json`: Structured summary of the test run (steps, duration, result).
- `artifacts/smoke-YYYYMMDD-screenshots/`: Directory containing screenshots of failures (and success states if configured).
- **Pull Request:** A PR containing the new or updated smoke test script and any necessary documentation changes.
- **Console Output:** Real-time progress updates and a final summary (Pass/Fail) printed to stdout.
───────────────────────────────────────────────────────────────────────────────
BEGIN