Search

Council for the Accreditation of Educator Preparation (CAEP)

CAEP has four revised annual reporting measures, which are used to provide data to the public on program impact, program outcomes, and consumer information.

Measure One: Completer Impact and Effectiveness (Initial Programs)

Under Measure One, this item evaluates by observation or P-12 student and administration surveys how program completers apply the professional knowledge, skills, and dispositions acquired in their preparation programs effectively in their P-12 classrooms. Generally the EPP sends all completers an annual survey, grounded in the InTASC standards. The survey prompts a self-assessment regarding their effectiveness in the P-12 classroom. The EPP also surveys principals regarding completer performance and their P-12 learners' growth. Further, some EPP programs engage in observations of completers in the P-12 classroom. Unfortunately, during COVID the EPP was not permitted in-person access to teachers' classrooms and guests were not allowed in virtual classrooms, thereby limiting data collection for the 2020-21 academic year.  The EPP implemented a revised strategy in Spring 2021 and asked teachers to complete a self reflection table on P-12 growth as of mid-year 2021-22 and on progress on self-effectiveness goals. While some teachers reported not being able to meet their goals for effective teaching, others responded that they exceeded their goals in 2020-21. Moving forward, this new tool was used again late Fall 2021 to check in once again with classroom teachers to ask about P-12 mid-year growth in the classroom and how teachers are meeting their own effectiveness goals.  Teachers were able to respond via email or via Qualtrics anonymously.  This second data collection compares 2020-21 with mid-year 2021-22, thus allowing to compare previous and current years as well as support reliability and validity of this measure as it is used in concert with additional indicators of completer effectiveness. One aspect of this simpler tool is the personal details shared back to the EPP about the teachers' classrooms, what student growth has looked like over the past two years, and how they have impacted this growth. These rich responses have provided the EPP with excellent data to consider.

There were 16 survey responses across Elementary, Secondary, and Special Education teachers.  As a collective group, meeting personal goals for creating an effective learning environment, effectively teaching content, effectively using teaching strategies and effectively evaluating your teacher practice were just slightly higher by mid-2021 than they were for the AY 2020-21.  For example, in 2020-21, 14 counts teachers reported not meeting one or more effectiveness goals, but by mid-year 2021, that number had dropped to just seven.  In 2020-21, five counts teachers reported exceeding one or more effectiveness goals, but by mid-year 2021, that number had climbed to eight.

 

As documented  in the teaching effectiveness section above, teachers also reported percentages of their students who were exceeding, meeting, and not meeting district goals.  Again, reporting in the aggregate, teachers overall reported that P-12 learners met or exceeded district goals at a higher level during 2020-21 than at mid-year 2021-22.  This puzzled the EPP until reading some of the optional comments teacher provided.  During 2020-21, there were very low to no expections from many of the districts represented so any and all growth was exceptional.  Expectations were in place for the 2021-22 school year and teachers felt they struggled with impacting student growth as the students themselves struggled with in-person classes and relearning classroom and school rules.

Finally, the College has requested the latest copy of the PVAAS report from the Pennsylvania Department of Education.  This report shows value-added data for Pennsylvania educator preparation programs. The latest report will be linked here.

Measure Two: Employers and Stakeholders (Initial and Advanced Programs)

Employer Satisfaction:

For the 2021-22 academic year, the EPP compared two years of aggregated survey responses from principals on where Penn State teachers need improvement to see how intentional changes in methods classes, dispositions, and student teaching seminars have made a difference.  In 2019, principals indicated inTASC 2 (diverse cultures), 5 (connect concepts), 6 (assessment), 7 (plan instruction) and 9 (professionalism) as areas that received scores below proficient.  In 2021, inTASC 2 (diverse cultures), 6 (assessment), 7 (plan instruction), 9 (professionalism)  and 10 (seek leadership roles) were areas that received scores below proficient.  Especially disappointing was the continued indication of additional work needed in diverse cultures, as the College has been implimenting anti-racism and equity into its curriculum, beginning in late 2020.  However the percentage of scores below proficient in almost every category decreased from 2019 to 2021, indicating that small changes have begun.  Puzzling was the added "seek leadership roles" as an area that needs improvement.  This has not been an area where Penn State teachers have typically faltered and the faculty questions if reduced field experiences in 2020 impacted new teacher confidence in seeking leadershp roles. This is an area that will receive additional scrutiny in the 2023 survey.

Also this year, in conjunction with field experience partner district visitations to discuss student teaching expectations and MOUs, the director of field experiences also asked principals and senior school personnel to share what they would like the program to know about first year teachers from Penn State, what the program is doing well and in what areas are the new teachers weak.  Overall, positive responses included the strengths and proficiencies that these teachers bring to their classrooms and buildings. Two common themes for improvement were management of courses and the idea to do the best they could do in unexpected moments - don't freeze.  As unexpected moments was also a theme that student teachers who took advantage of subbing experiences also reported, this topic will be discussed and reinforced during student teaching seminars.

Advanced Programs: Although the EPP has some of the same tracking completers into the field issues with the advanced preparation programs, there are some data for students completing Principal Certification programs. This program has begun surveying program completers to provide data for its SPA reporting and by looking at the question, "Did you change jobs after receiving your principal certification from Penn State?" the EPP can make judgments on the satisfaction of employers by the percentage of completers who were able to change positions. Of the 75 respondents who completed in 2016-2019, 17 of the 18 who changed jobs, did so into an administrative or supervisory role. Of the 58 completers who did not change positions, 15 were already in administrative or supervisory positions.

A second round of surveys were sent in 2022, and 20 of 37 responders indicated that receiving an advanced certification had a positive impact on their career including additional pay, additional responsibilities, promotions within the district, or new positions - all indications of Employer Satisfaction.

Because of the limited nature of the collected data, we developed a plan to collect additional data to demonstrate Employer Satisfaction. We modeled our Employer Satisfaction Survey from the Completer Survey administered and validated by institutions in the State of Mississippi. The instrument demonstrates sound psychometric properties as administered to completers of their advanced program. Aligned to CAEP key competencies and our Advanced Completer Survey, data from administration of the Employer Satisfaction Survey will inform advanced programs' continued improvement. As part of the 4.1 plan we demonstrate how we will assure the instrument meets standards for CAEP EPP-Created Assessments that provide data about our key competencies for Advanced Completers from all programs and allow for desegregated data and assessment of program-specific objectives. The 4.1 Plan includes a human subjects approved research study to further refine and test a measure that captures Employers' Satisfaction.

A test pilot of the survey was sent to two professional stakeholders, one for principal completers and one for superintendent completers.  These initial data show 100% Strongly Satisfied or Satisfied responses out of a rating scale of Strongly Satisfied, Satisfied, Dissatisfied, Strongly Dissatisfied.  Feedback for areas of improvement included the importance of developing, implementing, and measuring long-term strategic goals and measures, leading system-wide change processes including curriculum development for principals.  Feedback for superintendent development included high knowledge of personnel management, finance, contract negotiations, community relations, and personnel evaluations.  The EPP will review course curriculum for alignment with these feedback areas and discuss ways of strengthening instruction and assessment of these items. A full data collection is scheduled for June 2023.

 

While many institutions target a day for data and reflection to meet CAEP Standards, the EPP employs the use of the Data Roundtable series. Each session in the series targets a specific topic or issue. The EPP seeks feedback from district faculty and staff, EPP faculty, staff, and students, alumni completers, and alumni who serve in district leadership roles. These valuable sessions provide opportunity to share data with stakeholders, interrogate the data together, and listen to stakeholder feedback and suggestions for programs based upon these data.

Our Roundtable Talks for the 2022-23 year included:

Developing and Supporting an Equitable Society through Education - ways to improve our preparation of educators through an equity lens

Recruiting Education Professionals into Shortage Areas Update - how are schools coping; feedback on new College initiatives

Mental Health in Our Schools – What is Working; What is Needed - what are schools doing; how can we prepare resilient teachers

Teacher Candidates as Substitute Teachers – One Year Later - feedback on a state law change that impacted student teachers

An additional example of intense data-examination for program review and potential revision was the need for all programs to undergo state review in 2021- 2022. Responding to PDE as a primary EPP stakeholder initiated with program faculty and PCCC and was informed by SPA data and non-SPA program data,  data derived through the QAS systematic use of data, and data from other stakeholders, including mentors, principals, and superintendents. Discussion of the PDE major review data was held at PCCC and two retreats were held with program stakeholders review and discuss essential data for their program reviews. PDE approved all CAEP and non-CAEP educator licensure programs at Penn State by July 1, 2022.

 

 

Measure Three: Candidate Competency at Program Completion (Initial and Advanced Programs)

All students completing a teacher preparation program at Penn State must meet program course requirements by passing with a C grade or higher, maintain a 3.0 GPA overall in the program, and pass a PDE-required content exam. The following table of data presents three years of completers with Praxis or Pearson testing pass rates and the average pass score. For programs that have less than 5 students per year, the completer data have been aggregated into one or more blocks to preserve student privacy.

Program Completers with GPA and Certification Exam Pass Rates
AY 2019-20 through 2023-24

Grade PK-4
CEAED PK-4 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 205 245 240    
GPA 3.69 3.68  

 

 
PA certified 172 197 195    
Pass Rate 95% 92% 94%    
PECT 8006 229 222 223

 

 
PECT 8007 224 219 219    
PECT 8008 221 216 211    

Middle Level Grades 4-8

English 4-8 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 4 4 6 5  
GPA 3.73 3.63 3.65 3.65  
PA certified 4 3 4    
Pass Rate 100% 100% 80%    
Praxis 5153 181 176 175    
Praxis 5154 161 164 163    
Praxis 5155 172 170 165    
Praxis 5156 176 168 166    
Math 4-8 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 18 16 13 7  
GPA 3.63 3.63 3.62 3.68  
PA certified 15 12 13    
Pass Rate 94% 80% 100%    
Praxis 5153 180 175 178    
Praxis 5154 159 151 160    
Praxis 5155 182 175 187    
Praxis 5158 183 179 188    
Soc St 4-8 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 12 6 3 6  
GPA 3.61 3.64 3.61 3.63  
PA certified 10 6 low    
Pass Rate 83% 100% N/A    
Praxis 5153 176 176

low

   
Praxis 5154 165 161 low    
Praxis 5155 172 171 low    
Praxis 5157 163 159 low    

 

Secondary Science Education

Biology 7-12 2019-2023    
Completers      
GPA      
PA certified      
Pass Rate 100%    
Praxis 5235      
Chemistry 7-12 2019-2023    
Completers      
GPA      
PA certified      
Pass Rate 100%    
Praxis 5245      
Earth & Space 7-12 2019-2023    
Completers 6    
GPA 3.72    
PA certified 5    
Pass Rate 100%    
Praxis 5571 172    
Physics 7-12 2019-2023    
Completers      
GPA      
PA certified      
Pass Rate 100%    
Praxis 5265      

 

Secondary English 7-12
English 7-12 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 24 20 16 29  
GPA 3.75 3.64 3.75 3.77  
PA certified 21 19 13 25  
Pass Rate 89% 100% 93% 100%  
Praxis 5038 183 184 184 179  

 

Secondary Math 7-12
Math 7-12 2019-2020 2020-21 2021-22 2022-23 2023-24
Completers 7 19 12 18  
GPA 3.77 3.58   3.66  
PA certified 6 16 11 15  
Pass Rate 85% 89% 100% 100%  
Praxis 5161 183 173 173 178  

 

Secondary Social Studies 7-12

SOCST 7-12 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 28 30 44 44  
GPA 3.65 3.58 3.57 3.70  
PA certified 26 26 40 32  
Pass Rate 93% 96% 100% 97%  
Praxis 5081 174 170 171 170  

 

Special Education

B.S. 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 10 12 12 17  
GPA 3.56 3.59 3.7 3.78  
PA certified 4 6 11 16  
Pass Rate 90% 100% 92%

100%

 

PECT Mod 1/

Praxis 5354

242 241

 

169

 

173

 
PECT Mod 2 245 234 NA NA  

 

M.ED. 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 9 19 21 25  
GPA 3.96 3.90 3.89 3.98  
PA certified 4 13 15 19  
Pass Rate 100% 93% 100% 100%  

PECT Mod 1/

Praxis 5354

249 239

 

177

 

182

 
PECT Mod 2 251 246 NA NA  

 

World Languages Education

Spanish 2019-2022
Certified Completers 11
GPA 3.58
ACTFL OPI  
ACTFL WPT  
French 2019-2023
Certified Completers 5
German 2019-2023
Certified Completer 4
Latin 2019-2023
Certified Completer 1

 

Agriculture Education PK-12
AG ED 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 11 8 12 12  
GPA   3.58 3.63 3.59  
PA certified 10 7 11 12  
Pass Rate 91% 100% 100% 100%  
Praxis 5701 166 174 173 168  

 

 

Health & Physical Education PK-12
KINES 2019-20 2020-21 2021-22 2022-23 2023-24
Completers 6 17 7 12  
GPA 3.69 3.51 3.28 3.58  
PA certified 6 16 6 12  
Pass Rate 100% 100% 100% 100%  
Praxis 5857 175 173 174 173  

 

Advanced Completers

Reading Specialist
Reading 2019-20 2020-21 2021-23
Completers 5 10 2
GPA 3.98 3.94 4
PA certified 5 9 2
Pass Rate 100% 88% 100%
Praxis 5301 174 180 167

 

Principalship
Principals 2019-20 2020-21 2021-22 2022-23
Completers 18 25    
GPA 3.97 3.94    
PA certified 16 22    
Pass Rate 100% 100%    
Praxis 6011 178 180    

 

Superintendency
  2017-22
Completers 4
GPA 3.88
PA certified 4
Pass Rate 100%
Praxis 6021 175

 

ESL Program Specialists
  2018-19 2019-20 2020-21
Completers 10 12 5
GPA 3.98 3.99 3.97
PA certified 10 12 5
Pass Rate NA NA NA
No Exam      

 

CTE Directors
  2017-2022
Completers 7
GPA 3.89
PA certified 7
Pass Rate 100%
Praxis 6990 171

 

Cooperative Education
  2017-2022
Completers 9
GPA 3.9
PA certified 9
Pass Rate 100%
Praxis 811 or NOCTI 5961  

Measure Four: Ability of Completers to be Hired (Initial and Advanced Programs)

One of the measures on program outcome that the College of Education is required to list in its annual report to CAEP is the ability of our program completers to be hired into positions for which they have been prepared. The Pennsylvania Department of Education (PDE) provides a list of Penn State students who have been hired in Pennsylvania and the school districts that have hired them. However, because a significant number of completers choose to seek teaching positions in other states, the College has been working on ways to maintain connections with those students using emails and surveys, so as to include their data in our self assessments.

The following tables reports PDE data on the number of Penn State completers hired into Pennsylvania school districts for  five calendar years at the initial and at the advanced program levels. Please note that 2022 initial completers were new to the job search process, and any recent hires would not yet be loaded into the PDE system.

Educator Hiring Data

Certification Year Total Certified Initial Teaching in PA
2016 353 158
2017 387 167
2018 423 163
2019 419 158
2020 382 142
2021 451 144
2022 434 19
Certification Year     Total Certified Advanced     Working in PA
2016 118 82
2017 98 82
2018 101 68
2019 116 79
2020 60 39
2021 61 34
2022 56 34

 

An example of less formal data was collected in 2017, a year after the first cohort of the new dual degree CEAED PK- Grade 4 bachelor's program with a one year Special Education PK- Grade 8 Master's degree graduated. Seven completers were emailed asking for feedback on the following questions: Are you working in an elementary school, are you in a general or special education classroom, and do you believe that your master's degree helped you obtain your position or made you better qualified.  In 2021 26 completers were contacted for their feedback, to compare responses between co-horts and with additional completers..

Initially, six students (85.1%) responded, and all six reported that they were working in an elementary school. Three were working in general education and three were working in special education. All six reported that their second degree helped them obtain their position over the other candidates. Additional comments described satisfaction with their program, such as "I feel much more comfortable as a teacher" and "I thinking staying and getting my Master's was the best decision I could have made" and "I'm thankful to have had such a great education to prepare me!"

For the second survey, eight responses (30.8%) indicated that having the special education Master's  "made me WAY more prepared and WAY more marketable," and "In that short year, I learned so many strategies and techniques that I use in my classroom today."  

In Spring 2023, 50 completers from Fall 2020 to Summer 2022 were emailed the same questions to look at responses across years and to consider differences with the addition of other undergraduate majors such as music, agriculture, secondary and middle level education added to the 4 + 1 model.