Question 10: CCAR-P: Claude Certified Architect - Professional

You are evaluating an evaluation set used to score a Claude-based hiring-support tool. The set is drawn from one geographic region and one tenure band. Which response is most appropriate?

1. A. Expand the evaluation set to cover the geographic regions and tenure bands the tool will serve, and rescore the system on the expanded set before broader release. — đáp án hiện tại
2. B. Continue using the narrow evaluation set drawn from one region and one tenure band because the existing benchmark scores are already high on that subset.
3. C. Reduce the evaluation set further to a single demographic subgroup to simplify score interpretation, narrowing coverage rather than expanding it to match the intended user population.
4. D. Discard all quantitative evaluation and replace it with qualitative impressions collected from a small, convenience-selected group that may not represent the tool’s full user population.