From a7d18e232a7caaba3df330e4b6414f9078413b8a Mon Sep 17 00:00:00 2001 From: "google-labs-jules[bot]" <161369871+google-labs-jules[bot]@users.noreply.github.com> Date: Thu, 12 Feb 2026 20:49:15 +0000 Subject: [PATCH] chore(docs): update interop and smoke agent prompts - Add missing FAILURE MODES, OUTPUTS PER RUN, and BEGIN sections to `docs/agents/prompts/weekly/bitvid-interop-agent.md` - Add missing FAILURE MODES, PR & COMMIT CONVENTIONS, OUTPUTS PER RUN, and BEGIN sections to `docs/agents/prompts/weekly/bitvid-smoke-agent.md` - Ensure consistency with other agent prompts in the repository Co-authored-by: PR0M3TH3AN <53631862+PR0M3TH3AN@users.noreply.github.com> --- .../prompts/weekly/bitvid-interop-agent.md | 30 ++++++++++++-- .../prompts/weekly/bitvid-smoke-agent.md | 39 +++++++++++++++++-- 2 files changed, 62 insertions(+), 7 deletions(-) diff --git a/docs/agents/prompts/weekly/bitvid-interop-agent.md b/docs/agents/prompts/weekly/bitvid-interop-agent.md index 7c4eaba3..f3995b2c 100644 --- a/docs/agents/prompts/weekly/bitvid-interop-agent.md +++ b/docs/agents/prompts/weekly/bitvid-interop-agent.md @@ -139,6 +139,30 @@ RELAY_URLS="wss://relay.test.example" node scripts/agent/interop-test.mjs \ --burst=3 --timeout=30 --out=artifacts/interop-2025-07-14.json ``` - \ No newline at end of file +─────────────────────────────────────────────────────────────────────────────── +FAILURE MODES + +- **Protocol Mismatch:** If a roundtrip fails due to schema validation (e.g., missing required tags, invalid content format), generate a detailed log in `artifacts/` identifying the specific field mismatch. Do not attempt to auto-patch the schema unless the fix is trivial and obvious (e.g., typo). Instead, open an issue labeled `bug` or `interop-failure` with the reproduction steps. +- **Crypto/Signature Failure:** If signature verification fails or event IDs do not match the computed values, **STOP**. Do not attempt to modify the crypto logic. Open a high-priority issue labeled `requires-security-review` with the specific inputs that caused the failure. +- **Relay Connectivity Issues:** If the specified relays are unreachable or time out, log the failure and abort the run. Do not retry indefinitely. Ensure the error message clearly distinguishes between network errors and protocol errors. +- **Timeout:** If the operation exceeds the specified timeout, abort and log the last known state. + +─────────────────────────────────────────────────────────────────────────────── +OUTPUTS PER RUN + +- **Artifacts:** + - `artifacts/interop-YYYYMMDD.json`: A structured summary of the test run, including: + - Timestamp + - Relays used + - Events published (ID, type) + - Verification results (Pass/Fail) + - Latency metrics + - `artifacts/interop-YYYYMMDD.log`: A human-readable log of the execution flow, including debug information and error stack traces. +- **Pull Request (if applicable):** + - A PR containing the test harness improvements, new regression tests, or documentation updates. + - The PR description must link to the generated artifacts and summarize the test results. +- **Issues:** + - New GitHub issues for any discovered bugs or protocol mismatches, complete with reproduction steps and references to the artifacts. + +─────────────────────────────────────────────────────────────────────────────── +BEGIN \ No newline at end of file diff --git a/docs/agents/prompts/weekly/bitvid-smoke-agent.md b/docs/agents/prompts/weekly/bitvid-smoke-agent.md index 7879d5cf..a4f3caba 100644 --- a/docs/agents/prompts/weekly/bitvid-smoke-agent.md +++ b/docs/agents/prompts/weekly/bitvid-smoke-agent.md @@ -157,7 +157,38 @@ RELAY_URLS="wss://relay.example" node scripts/agent/smoke-test.mjs \ --confirm-public --burst=1 --timeout=30 --out=artifacts/ ``` - \ No newline at end of file +─────────────────────────────────────────────────────────────────────────────── +FAILURE MODES + +- **Startup Failure:** If the application fails to start (e.g., port in use, build error), log the stderr output and abort. +- **Relay Connection Failure:** If the client cannot connect to the specified relay, retry with backoff. If it still fails, abort and report "Relay Unreachable". +- **Element Not Found (UI):** If Playwright cannot find a required UI element (e.g., login button, post input), capture a screenshot and dump the DOM state to `artifacts/`. Fail the test step. +- **Verification Failure:** If the read-back event does not match the published event (content mismatch, signature error), log the diff and fail the test. +- **Timeout:** If any step exceeds the configured timeout, abort the run and capture a screenshot/log of the current state. + +─────────────────────────────────────────────────────────────────────────────── +PR & COMMIT CONVENTIONS + +- **Branch Name:** `test/smoke-harness-YYYYMMDD` or `chore/smoke-test-update` +- **Commit Message:** + - `test(smoke): add login and publish flow verification` + - `chore(smoke): update relay config for local testing` +- **PR Title:** `test: smoke harness updates` or `chore: add smoke test for [feature]` +- **PR Description:** + - Clearly state what flows are covered. + - Include a summary of the test results (Pass/Fail). + - Link to any artifacts or logs (if uploaded). + - Mention if any manual steps are required to run the test (e.g., specific relay setup). + +─────────────────────────────────────────────────────────────────────────────── +OUTPUTS PER RUN + +- **Artifacts:** + - `artifacts/smoke-YYYYMMDD.log`: Detailed execution log. + - `artifacts/smoke-YYYYMMDD.json`: Structured summary of the test run (steps, duration, result). + - `artifacts/smoke-YYYYMMDD-screenshots/`: Directory containing screenshots of failures (and success states if configured). +- **Pull Request:** A PR containing the new or updated smoke test script and any necessary documentation changes. +- **Console Output:** Real-time progress updates and a final summary (Pass/Fail) printed to stdout. + +─────────────────────────────────────────────────────────────────────────────── +BEGIN \ No newline at end of file