The purpose of this report is to inform our department’s stakeholders (e.g., students, alumni, site supervisors, etc.) on the assessment data collected by the department, as well as inform those stakeholders on program modifications we have made because of collecting and analyzing those data. While our department is in a constant process of collecting and analyzing data, this report will outline several specific data elements that have been integral in assessing the work of our program, our faculty, and our students. Specifically, this report will discuss data collected on:
Our New Student Orientation program held each semester for newly matriculated students;
The survey conducted annually to collect data from our site supervisors on program and student performance;
The survey conducted annually to collect data from our alumni on program performance;
The survey conducted annually to collect data from our alumni employers on student and program performance;
Data collected regarding administration of our comprehensive examination;
Data collected on student performance on the National Counselor Examination (NCE) and PRAXIS II exam for school counseling candidates
Aggregate data regarding student learning related to standards established by the Council for the Accreditation of Counseling and Related Academic Programs (CACREP).
This report will also outline program modifications made because of this data, as well as other substantial program changes made during the 2022-23 academic year.
It is our hope that through this report, we can inform our stakeholders on the effectiveness of our program, the successes of our students, the modifications made, and the ways in which we are constantly working to improve our teaching, student learning, and our overall academic program. Thank you for your attention and we hope this report is useful. If you have any feedback, please do not hesitate to reach out to our department’s Assessment Coordinator, Dr. Bridget Asempapa (basempapa@wcupa.edu).
At the beginning of each academic year, we hold an orientation program for new students who have matriculated to the department. Goals of the New Student Orientation are as follows:
Students will connect with faculty and other students to help with transition to a new environment, college, program.
Students will articulate the expectations of graduate level work in the Department of Counselor Education.
Students will develop an emerging understanding of the ethical, legal, and professional obligations of professional counselors/counselors-in-training, and the consequences for violation of these standards.
Students will understand course sequencing for their track.
Students will be exposed to information in their track, which will help them to be successful in the program.
Students will understand the requirements for licensure and/or certification.
At the conclusion of the program, we assess how well we met these goals through a simple survey instrument. The results of the survey for fall 2022 are as follows:
Total Responses: 28
CMH= 18
SC= 10
Question 1: This orientation helped me to connect to fellow students. Number of responses: 28
Agree = 22 Somewhat Agree = 5
Neither Agree or Disagree = 1
Question 2: This orientation helped me feel better prepared to start the program. Number of responses: 28
Agree = 25 Somewhat Agree = 3
Question 3: I understand the expectations for me as a graduate student. Number of responses: 28
Agree = 27
Neither Agree or Disagree = 1
Question 4: I understand the course sequencing for my specialty. Number of responses: 28
Agree = 18
Somewhat agree = 7
Neither Agree or Disagree = 1 Somewhat disagree = 2
Question 5: I know where I can go to additional information if I have questions. Number of responses: 28
Agree = 26 Somewhat Agree = 1
Somewhat Disagree = 1
Question 6: It was helpful to hear about the program from a current student. Number of responses: 28
Agree = 26 Somewhat Agree = 1 Disagree = 1
The department surveys our site supervisors to better understand their experiences working with our department. Specifically, the survey is designed to determine how well the department liaises with our sites, aggregate student performance on site, and evaluate how well students are prepared for their work in the field.
Overall, there were 39 participants who completed the Site Supervisor Survey. Of the 39, 14 supervised WCU counselor education students for internship, 6 supervised WCU counselor education students for practicum, and 19 supervised WCU counselor education students for both internship and practicum. The breakdown of settings included: 6 Elementary school; 4 Middle school; 2 Elementary & Middle School; 15 High School; 10 Clinical; and 2 College settings.
When asked about the Quality of Communication between the Site Supervisor and their WCU faculty member, all 39 participants responded to the item with the following breakdown of responses: 21 responded “Very Good”; 17 responded “Good”; and 1 responded “Fair”.
The following set of questions answered by Site Supervisors (39 participants) gauged how well we prepared our students regarding specific counseling skills and characteristics. The first question centered on acting in an ethical manner. Responses showed that approximately 100% of participants either Strongly Agree (90%) or Somewhat Agree (10%) that WCU prepared our students to act in an ethical manner when working with clients. Next, participants were asked if they agreed that WCU prepared students with the necessary skills to be effective for that individual site. Data showed 92% of Site Supervisors Strongly Agree (54%) or Somewhat Agree
(38%) concerning necessary skills for the site. However, 8% indicated Neither agree nor
disagree.
Site Supervisors were asked if they agreed that WCU prepared the supervisees to meet the counseling needs of clients from diverse backgrounds. Overall, the majority (95%) of Site Supervisors indicated they Strongly agree (59%) or somewhat agree (36%) students were prepared to work with client from a diverse background, with 5% selecting Neither agree nor disagree. In regard to preparing students to maintain appropriate records, the majority (92%) of Site Supervisors indicated they Strongly agree (69%) or somewhat agree (23%), with 5% selecting Neither agree nor disagree and 3% Strongly disagree. The next question focused on being an effective advocate, where majority of the Site Supervisors (95%) of participants selected Strongly agree (62%), or somewhat agree (33%), with the remaining respondents (5%) selecting Neither agree nor disagree (3%) or somewhat disagree (2%).
The last two questions were in relation to Site Supervisors' level of agreement with how we prepared our students to empower clients and work them in a holistic manner. Again, the majority of Site Supervisors (98%) selected Strongly agree (66%) or somewhat agree (32%) and two participants indicated Neither agree nor disagree (2%).
We also gave the Site Supervisors an opportunity to openly respond to how WCU might improve the preparation of our counseling students to meet the needs of the sites and their clients, as well as to leave any additional feedback to any of the above questions. Minimal suggestions for how to improve were provided and no specific theme appeared in the data.
Similar to the Site Supervisor Survey, at the end of each academic year, the department surveys our alumni to better understand their experiences as students in our programs. Our goals are to understand their level of preparation, support, and overall experience as master’s students in our department. In 2022/2023, there were 55 participants who completed the Alumni survey. When participants were asked about professional organizations they belong to, 27 participants responded. Of the professional organizations in which participants were members, 2 were members of the American Counseling Association (ACA) only, 9 were American School Counseling Association (ASCA) only, 0 American Psychological Association (APA), 6 (ASCA) and Pennsylvania School Counseling Association (PSCA), 3 (ASCA) and other, 1 (ACA) and other, 1 (ACA) and (PSCA), 3 indicated other, 28 did not indicate affiliation with any association, and 2 indicated they were part of three associations (ACA), (ASCA), and (PSCA).
When asked about their current employment status 49 reported that they are currently employed in the field compared to 6 reporting they are not currently employed in the field. Of the alumni, 12 secured a job prior to graduation, 14 secured a job within 3 months of graduation, 5 secured a job within 6 months of graduation, and 24 did not report an answer.
The department has attempted to survey employers of our alumni to understand how well graduates are prepared for their work as professional counselors. In 2022/23 none of those surveyed responded. Given that our response rate in 2020-2022 was equally poor, we plan to review our collection process to assess if any changes can be made to increase the employer response rate. Or better still whether other data collected will suffice for this purpose. It is also possible that this is an impact of the COVID-19 pandemic.
Students in the department must take the Counselor Preparation Comprehensive Exam (CPCE) at the end of their academic program. This exam serves as a final gatekeeper in ensuring the students have acquired the core content necessary to be competent in the field. A passing score is set at one standard deviation below the national mean.
During the fall 2022-summer 2023, students who were at the end of their academic program registered for the traditional CPCE. The department of Counselor Education opted to cancel the traditional CPCE because of technical issues with Pearson Vue on the day of the exam.
In Fall of 2022, 20 students registered for the CPCE but were sent home by the proctors of the exam because of technical difficulties. As a result, there are no results to be reported.
During the Spring 2023 term, the department of Counselor Education opted to cancel the traditional CPCE because of technical issues with Pearson Vue on the day scheduled for test administration. 25 students who had registered for the exam could not take it because Pearson Vue was unable to fix the technical problem. In response, a CPCE Alternative, developed in- house by the faculty in the department, was administered to the candidates. The alternative exam covered the original content areas represented in the CPCE. All 25 students were determined to have passed. The alternative exam was unstandardized and thus scores could not be compared to national results.
In Summer of 2023, 10 students registered for the CPCE but were sent home by the proctors of the exam because of technical difficulties. As a result, there are no results to be reported.
During the 2022/23 academic year, nine (9) WCU students took the National Counselors Examination (NCE) and six (6) passed. Thirty-seven (31) students took the Praxis II, and 31 students (100%) successfully completed the exam.
In our ongoing commitment to providing an educational experience that is true to our department statement and in accordance with CACREP standards, faculty members collected data on Key Performance Indicators (KPIs) to determine the effectiveness of our teaching, as well as the outcomes for our students. To assess student learning for each KPI, faculty determine the
percentage of students who successfully complete the given course assignment (e.g., exam, case study, etc.) and report those data back to the department.
Synopsis of Fall 2022/Spring 2023 KPI CACREP Data:
In Fall 2022, all goals were met. However, goals associated with performance on the CPCE were not measured due to exam cancellation. In Spring 2023, all goals were met. Again, goals associated with the CPCE were not measured.
Last Updated 2/14/24