surfaces/.planning/phases/05-mvp-deployment/05-VALIDATION.md

phase	slug	status	nyquist_compliant	wave_0_complete	created
5	mvp-deployment	draft	false	false	2026-04-27

Phase 5 — Validation Strategy

Per-phase validation contract for feedback sampling during execution.

---

Test Infrastructure

Property	Value
Framework	pytest
Config file	pyproject.toml
Quick run command	pytest tests/adapter/matrix/ -v -x
Full suite command	pytest tests/ -v
Estimated runtime	~30 seconds

---

Sampling Rate

• After every task commit: Run pytest tests/adapter/matrix/ -v -x
• After every plan wave: Run pytest tests/ -v
• Before /gsd-verify-work: Full suite must be green
• Max feedback latency: 30 seconds

---

Per-Task Verification Map

Task ID	Plan	Wave	Requirement	Threat Ref	Secure Behavior	Test Type	Automated Command	File Exists	Status
05-A-01	A	1	D-02/D-03	—	agent_id lookup by matrix_user_id only	unit	pytest tests/adapter/matrix/test_agent_registry.py -v	❌ W0	⬜ pending
05-A-02	A	1	D-04	—	per-agent URL used in delegates	unit	pytest tests/adapter/matrix/test_routed_platform.py -v	❌ W0	⬜ pending
05-B-01	B	1	D-04/D-05	—	welcome message sent on invite	unit	pytest tests/adapter/matrix/test_onboarding.py -v	❌ W0	⬜ pending
05-B-02	B	1	D-10	—	unauthorized user gets access-denied message	unit	pytest tests/adapter/matrix/test_onboarding.py::test_unauthorized -v	❌ W0	⬜ pending
05-B-03	B	1	D-11	—	!clear closes and reopens AgentApi	unit	pytest tests/adapter/matrix/test_commands.py::test_clear -v	❌ W0	⬜ pending
05-C-01	C	2	D-05/D-06	—	incoming file written to workspace_path/incoming/	unit	pytest tests/adapter/matrix/test_files.py -v	✅	⬜ pending
05-C-02	C	2	D-07	—	outgoing MsgEventSendFile reads from workspace_path	unit	pytest tests/adapter/matrix/test_files.py::test_outgoing_file -v	❌ W0	⬜ pending
05-C-03	C	2	D-08/D-09	—	docker-compose.prod.yml has agents volume and both services	manual	see below	N/A	⬜ pending

Status: ⬜ pending · ✅ green · ❌ red · ⚠️ flaky

---

Wave 0 Requirements

• tests/adapter/matrix/test_agent_registry.py — tests for user_agents lookup and per-agent base_url/workspace_path
• tests/adapter/matrix/test_routed_platform.py — updated tests for _resolve_delegate using user_agents
• tests/adapter/matrix/test_onboarding.py — tests for invite handling, welcome message, unauthorized user response
• tests/adapter/matrix/test_commands.py — tests for !clear command behavior
• Update tests/adapter/matrix/test_files.py — add outgoing file test

Existing: tests/adapter/matrix/test_files.py — already exists, covers incoming file path logic

---

Manual-Only Verifications

Behavior	Requirement	Why Manual	Test Instructions
docker-compose.prod.yml full-stack launch	D-08/D-09	Requires Docker daemon and lambda-agent:latest image	docker compose -f docker-compose.prod.yml up — verify both services start, volume mounts at /agents/
Matrix bot invite + DM flow	D-04/D-05	Requires live Matrix homeserver	Invite bot to DM, verify welcome message appears

---

Validation Sign-Off

• All tasks have <automated> verify or Wave 0 dependencies
• Sampling continuity: no 3 consecutive tasks without automated verify
• Wave 0 covers all MISSING references
• No watch-mode flags
• Feedback latency < 30s
• nyquist_compliant: true set in frontmatter

Approval: pending