Chapter 12 of 125.3% of exam

Research, Methodology, and Performance Management

The smallest domain covers psychometrics, basic statistics, levels of evidence, and program evaluation. Calculation items are simple if the definitions are firm.

Measurement concepts

Reliability is consistency; validity is whether score interpretations are supported for a use. Standard scores put results on a common scale. Every obtained score contains some error, so scores are best reported as bands. Standard scores let a counselor compare results across different tests.

Test-retest reliability
Consistency of scores when the same test is given twice.
AERA/APA/NCME Standards (2014)
Standard error of measurement
About 68% of true scores fall within plus or minus one SEM of the obtained score.
AERA/APA/NCME Standards (2014)
T-scores
Mean 50, standard deviation 10; T = 50 + 10z.
AERA/APA/NCME Standards (2014)

Describing data

Choosing the right summary depends on the shape of the distribution. Program outcome data such as wages are often skewed by a few high values. In those cases the median gives a better picture of the typical client. The e-Handbook shows how extreme values distort the mean.

Skew
In a right-skewed distribution the mean is pulled above the median.
NIST/SEMATECH e-Handbook 1.3.5.1
Robust measures
The median and interquartile range are less affected by extreme values than the mean and standard deviation.
NIST/SEMATECH e-Handbook 1.3.5.1, 1.3.5.6
Normal distribution
Mean, median, and mode coincide in a symmetric normal distribution.
NIST/SEMATECH e-Handbook 1.3.5.1

Evidence and evaluation

Evidence-based practice relies on the strongest available research, and program evaluation follows a structured sequence. Rehabilitation counselors are expected to use interventions grounded in theory or evidence. Program evaluation helps agencies learn whether services achieve their intended outcomes. The CDC framework was revised in 2024, so older six-step lists with different first steps are outdated.

Levels of evidence
Systematic reviews and meta-analyses are the gold standard; expert opinion is the lowest level.
CRCC 2021 JTA, Domain 12.C
CDC evaluation steps
Assess the context, describe the program, focus the design, gather credible evidence, generate conclusions, act on findings.
CDC Program Evaluation Framework (2024)
Evaluation standards
Relevance and utility, rigor, independence and objectivity, transparency, and ethics.
CDC Program Evaluation Framework (2024)

Keep going: the full CRC — Certified Rehabilitation Counselor Examination guide covers every section of the exam. CRC Study Guide — 2026 Edition — PDF + EPUB, $24.99 · 14-day refund →

Studying in order?

Practice stays free. The full CRC — Certified Rehabilitation Counselor Examination study guide is the material itself, taught start to finish — a downloadable PDF + EPUB you keep.

Get the book — $24.99
Report