Blog
1. Know What You’re Trying to Predict
It sounds obvious, but any assessment is only valid insofar as it can successfully predict what you are trying to predict. Therefore, the very first, and perhaps most critical, step in creating a valid certification or licensure assessment is to know exactly what it is you want that assessment to predict. Are you creating a licensure examination aimed at ensuring the safety of the public? If so, what knowledge, skills and abilities would the licensed job incumbent need to possess in order to ensure safe and effective job performance? Is your certification examination designed to successfully predict performance in a particular job or to demonstrate knowledge of a particular set of standards? The predictive validity of any examination depends on your ability to answer these questions at the outset.
It sounds obvious, but any assessment is only valid insofar as it can successfully predict what you are trying to predict. Therefore, the very first, and perhaps most critical, step in creating a valid certification or licensure assessment is to know exactly what it is you want that assessment to predict. Are you creating a licensure examination aimed at ensuring the safety of the public? If so, what knowledge, skills and abilities would the licensed job incumbent need to possess in order to ensure safe and effective job performance? Is your certification examination designed to successfully predict performance in a particular job or to demonstrate knowledge of a particular set of standards? The predictive validity of any examination depends on your ability to answer these questions at the outset.