Design and Psychometric Consulting

Program Design

As part of a feasibility study or a stand-alone process, Castle psychometricians can determine what type of examination best fits the skill set a client wishes to measure. In addition, they can provide guidance on which type of examination best fits the candidates’ and the client’s time frame, budget, and goals.

Policies and Procedures Manuals

Our psychometricians can help prepare policies and procedures manuals to govern the actions of an organization’s staff and candidates; issues that are addressed include application processes, content challenges, testing procedures, boards of directors, etc.

Standards Compliance/Accreditation Support

The psychometric staff at Castle is well versed in third-party accreditation standards including ANSI, ABSNC, American College of Education, and NCCA.

Research Studies/Feasibility Studies

Castle can provide ongoing recommendations on existing certification programs, emerging issues in testing and certification, and other research projects. If for any reason a client decides to conduct a feasibility study before beginning or changing a certification program, we can help with consultation, surveys, focus groups, industry research, and more.

Content with Integrity

For its exam development clients, Castle uses legally defensible procedures to record, document, and maintain records that demonstrate the validity of the test items developed and the examinations assembled. We’re proud of the psychometric integrity of our examinations. Our staff is qualified and available to testify in any state investigations or prosecutions involving any aspect of the item development or examination construction.

Program Evaluation

The psychometricians at Castle can review an organization’s existing testing policies and programs and recommend ways to bring them into line with current industry standards and applicable laws.

Expert Guidance and Support

Castle’s psychometricians also train item writers in how to use online development in place of face-to-face, paper-based meetings. They make sure that psychometric guidelines addressing common item writing errors (for example, the system will not permit item writers to use “All/none of the above”) are incorporated and that more advanced psychometric principles, such as consistency in the length of all response options, are addressed.

Our psychometricians use traditional and modern testing theory to determine if examinations are structured so that valid decisions can be made based on test results. They analyze scoring data to help improve examination quality, and to determine if some items are too easy or too difficult. They determine whether any items reflect bias against a particular group and recommend rewriting or discarding such questions. And, they are trained to develop and validate assessment tools that measure whether or not a professional can perform his or her job-related duties with competence.

Please visit our Learning Center for white papers, articles, resources, and news about our psychometric expertise.