mirror of
https://github.com/PR0M3TH3AN/SeedPass.git
synced 2026-10-27 16:02:05 +00:00
This commit delivers four related improvements focused on reliability and automation while preserving existing human/TUI workflows. 1) Agent-first CLI mode (additive) - Added new `seedpass agent` command group (`src/seedpass/cli/agent.py`) and wired it into CLI root. - Implemented non-interactive profile bootstrap: `seedpass agent init` with `--seed|--seed-file|--generate-seed` and password env injection (`--password-env`). - Added policy management commands: `agent policy-show` and `agent policy-set` with allow/deny kind controls. - Added JSON-based secret retrieval: `seedpass -f <fingerprint> agent get <query> --ttl <sec>` with lease metadata and policy enforcement. - Kept regular human mode fully available; no behavioral changes to interactive TUI entrypoint. 2) TUI agent harness deepening and stabilization - Refactored harness into scenario profiles: `core`, `extended`, `stress` with `--scenario` selection. - Added deterministic seeded stress campaigns: `--stress-cycles`, `--stress-seed`. - Added scenario-specific required coverage keys and report metadata. - Added post-condition assertions in extended scenario (archive/restore consistency, lock/unlock retrieval recovery). - Hardened prompt matching for output variants and fail-fast behavior on non-zero SeedPass exit codes. - Added harness unit tests for helper logic and control flow. 3) Critical module coverage gate tooling - Added `scripts/check_critical_coverage.py` to enforce per-module thresholds from coverage JSON and report uncovered functions. - Added override controls (`--threshold`, `--no-default-thresholds`) and optional JSON result output. - Integrated coverage JSON generation into CI helper script and optional gate execution via `CRITICAL_COVERAGE_GATE=1`. - Tuned default thresholds using full-suite baseline and increased strictness: - `src/main.py >= 50%` - `src/seedpass/core/manager.py >= 60%` - `src/seedpass/core/encryption.py >= 80%` - `src/seedpass/core/migrations.py >= 90%` - Added tests for coverage gate parser/analysis logic and targeted manager worker path tests. 4) Installer validation framework for beta/main - Added cross-platform installer smoke scripts: - `scripts/installer_smoke_unix.sh` - `scripts/installer_smoke_windows.ps1` - Added GitHub Actions workflow `.github/workflows/installer-smoke.yml` with: - reduced PR matrix - full scheduled/manual matrix across OS/branch/mode - per-job log capture and artifact uploads for failure triage - Added installer testing documentation and linked from README. Additional housekeeping - Added `.venv/` to `.gitignore`. - Updated docs for new harness scenarios, seeded stress mode, post-condition metadata, coverage gate usage, and installer testing workflow.
45 lines
1.1 KiB
Markdown
45 lines
1.1 KiB
Markdown
# Installer Testing
|
|
|
|
This document describes how SeedPass installer smoke tests are validated across
|
|
operating systems and branches (`main`, `beta`).
|
|
|
|
## CI Workflow
|
|
|
|
GitHub Actions workflow: `.github/workflows/installer-smoke.yml`
|
|
|
|
- `pull_request` (reduced matrix):
|
|
- Ubuntu + Windows
|
|
- `beta` branch
|
|
- `tui` mode
|
|
- `schedule` + `workflow_dispatch` (full matrix):
|
|
- Ubuntu / macOS / Windows
|
|
- `main` + `beta`
|
|
- `tui` and GUI-capable modes (`both` where supported)
|
|
|
|
Each job verifies:
|
|
|
|
1. installer exits successfully
|
|
2. launcher is created
|
|
3. installed git branch matches requested branch
|
|
4. `seedpass --help` runs through launcher
|
|
5. installer can be re-run (idempotence smoke check)
|
|
|
|
## Local Smoke Tests
|
|
|
|
### Linux / macOS
|
|
|
|
```bash
|
|
bash scripts/installer_smoke_unix.sh beta tui
|
|
bash scripts/installer_smoke_unix.sh beta both
|
|
```
|
|
|
|
### Windows (PowerShell)
|
|
|
|
```powershell
|
|
./scripts/installer_smoke_windows.ps1 -Branch beta -Mode tui
|
|
./scripts/installer_smoke_windows.ps1 -Branch beta -Mode both
|
|
```
|
|
|
|
The smoke scripts use an isolated temporary home/profile directory so local
|
|
user data is not modified.
|