Annual Report Highlights
Licensure and employer satisfaction with graduates
- National licensure exam pass rate for graduates: 100%
- Employer overall satisfaction with graduates: 5.5 out of 6
Skill integrating faith and worldview with counseling
- Alumni satisfaction with relating theology to counseling: 5.3 out of 6
- Employer rating of RTS graduates handling of spiritual issues: 5.6 out of 6
Summary of the Program Evaluation Results
Program Objective |
Excellence Achieved? |
| PO 1: Faith and Worldview. Graduates demonstrate a lively Christian faith and the ability to integrate their Christian faith and Reformed worldview with their counseling. Our benchmark for excellence in achieving PO 1 is achieving excellence on each of the measures below. | Yes |
| 1. Clinical performance
Our benchmark for excellence on this item is 90% of students achieving a summative evaluation score of 3 or better on the Student Counselor Outcome Report question “Graciously and appropriately addresses spiritual issues in treatment conceptualization and implementation” at the end of their third internship semester Result: 100% |
Yes |
| 2. Capstone Interview performance
Our benchmark for excellence on this item is 90% of student responses score of 3 or more on a 4 point scale on the Capstone Topic Presentation Evaluation. Result: 95% |
Yes |
| 3. Internship/Externship site administrative assessments
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the Internship Information Survey question 5, “Please rate…the most recent RTS students you have had as interns (on): Handling of spiritual issues.” Result: 5.6 |
Yes |
| 4. Employer Assessments
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the Employer Information Survey question 5, “Please rate…RTS graduates that you have recently hired (on): Handling of spiritual issues.” Result: Mean score of 5.6 |
Yes |
| 5. Alumni Assessments
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the following two questions of the Alumni Information Survey: How satisfied were you with your training…relating theology to therapy? Result: Mean score of 5.3 How satisfied were you with…the impact of your training on your spiritual life? Result: Mean score of 5.4 |
Yes |
| PO 2: Professional Competence (Eight Core areas, Clinical Mental Health Specialty, Dispositions). Graduates have the necessary knowledge, skills, and dispositions to be professionally competent conceptually and clinically in the areas of (1) professional counseling orientation and ethical practice, (2) social and cultural diversity, (3) human growth and development, (4) career development, (5) counseling and helping relationships, (6) group counseling and group work, (7) assessment and testing, (8) research and program evaluation, and (9) clinical mental health counseling. Our benchmark for excellence on PO 2 is achieving excellence on each of the measures below. | Yes |
| 1. Employer Evaluation
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the following two questions on the Employer Information Survey: RTS Graduate Performance. Rate RTS graduates’… General knowledge Result: Mean score of 5.29 Clinical skills Result: Mean score of 5.29 |
Yes |
| 2. Alumni Assessments
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the following three questions of the Alumni Information Survey: Training Satisfaction. How satisfied were you with… Training in techniques and clinical skills Result: Mean score of 5.5 Theoretical perspective of the program Result: Mean score of 5.5 Preparation for Professional Practice. How satisfied were you with… Preparation compared with other Master’s level counselors you have encountered Result: Mean score of 5.6 |
Yes |
| 3. Key Performance Indicators of knowledge and skills
The benchmark for program excellence is that annually students meet expectations in 90% of the 18 Key Performance Indicators (KPI) of student achievement in the core and specialty areas required of professional counselors. Result: 99.1% of KPIs measured achieved this benchmark |
Yes |
| 4. Key Professional Disposition Indicators
Our benchmark for excellence on this item is 90% of students achieving a summative evaluation score of 3 or better on Student Counselor Outcome Report questions 1,2,3,5,11,12,22 and 23 and a mean score of 5 or more on Client Feedback Form questions 1-5 in their third internship semester. Result: 100% of students achieved this benchmark |
Yes |
| PO 3: Diverse populations. Graduates have the necessary knowledge, skills, and dispositions to render service to churched and unchurched populations in our multicultural and pluralistic society. Taken together, the four items below contribute to evaluation of program effectiveness in achieving PO3. Our benchmark for excellence on PO 3 is achieving excellence on each of the measures below. | Yes |
| 1. Supervisor evaluation
Our benchmark for excellence on this item is 90% of students achieving a summative evaluation score of 3 or better on SCOR questions 11 and 12 at the end of their third internship semester. Result: 100% |
Yes |
| 2. Client evaluation
Our benchmark for excellence on this item is 90% of students achieving a mean score of 5 or better on Client Feedback Form Questions 1, 2, 3 during the first half their third internship semester. Result: 100% |
Yes |
| 3. Internship site administrator evaluation
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the following two questions on the Internship Information Survey: Intern performance. Rate RTS interns’… Overall performance Result: 5.83 Handling of Spiritual matters Result: 5.60 |
Yes |
| 4. Employer evaluation
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the following two questions on the Employer Information Survey: RTS Graduate Performance. Rate RTS graduates’… Overall performance Result: Mean score of 5.29 Handling of spiritual matters Result: Mean score of 5.25 |
Yes |
| PO4: Licensure. Graduates have the necessary knowledge, skills, and dispositions successfully to be licensed as professional counselors. Our benchmark for effectiveness in achieving PO 4 is achieving excellence on both measures below. | Yes |
| 1. National Exam Pass Rate
Our benchmark for excellence on this item is a pass rate of 90% or more as reported by alumni on the Alumni Information Survey on the question: Did you pass the licensure exam? Result: 100% |
Yes |
| 2. Favorable Employer Review
Our benchmark for excellence on this item is a mean respondent score of 5 or more on a 6 point scale on the Employer Information Survey on the question: Rate RTS graduates’ Overall performance. Result: Mean score of 5.5 |
Yes |
Program Modifications Since Last Report
In 2017 and 2018 Reformed Theological Seminary combined and upgraded its two professional counseling programs (Jackson and Orlando) to be compliant with CACREP standards. This new single multi-site Masters of Counseling (MAC) program began accepting students in the summer of 2018. The Jackson campus transferred a number of students from another program into the MAC program when the program started and will graduate its first class of MAC students in May of 2019. This document represents the first annual report of the new program.
Other substantial program changes
All substantial program changes have been described above.