Assignment
Prepare twelve tasks: direct lookup, ambiguous lookup, missing policy, and conflicting evidence. Use identical underlying documents.
Build sequence
- Implement a fixed workflow and a router with an explicit unknown route.
- Add one reflection step that receives a claim-support check.
- Validate any proposed search or tool action before execution.
- Compare quality and calls used, including cases where reflection makes the result worse.
Acceptance checks
- Unrecognized routes lead to clarification or a safe stop.
- Every revision has a recorded trigger and a bounded budget.
- The report identifies whether reflection improves actual evidence support.
Evidence to keep
Submit the working artifact or decision document described above, the inputs used, and the observed results for every acceptance check. Include one failed attempt and the change you made after investigating it. Label fixture-based outcomes separately from live-system measurements. These artifacts become part of your final portfolio review.