Assignment
Collect or synthesize 40 examples for a narrow classification or formatting task. The required exercise is dataset preparation and a decision report; a training run is optional if compute is available.
Build sequence
- Label failures as knowledge, instruction, format, or reasoning failures.
- Build deduplicated development and held-out splits with provenance.
- Compare prompt-only and retrieval-based alternatives where appropriate.
- Estimate training and serving requirements; specify a pass/fail rubric for any later tuned model.
Acceptance checks
- The report can recommend no tuning when evidence does not justify it.
- Held-out examples are not copied into demonstrations or training data.
- Any actual training results are clearly separated from a proposed experiment.
Evidence to keep
Submit the working artifact or decision document described above, the inputs used, and the observed results for every acceptance check. Include one failed attempt and the change you made after investigating it. Label fixture-based outcomes separately from live-system measurements. These artifacts become part of your final portfolio review.