2023 edTPA Administrative Report

Introduction

This report presents analyses based on teacher candidate performance from January 1 to December 31, 2023.

The map below shows the states participating in edTPA as of January 2023. The map indicates states with edTPA implementation policy in place and those expecting to have an implementation policy in place soon. Visit the "About" page of this website for up-to-date information on states and their policies.

Map of the states participating in edTPA in 2023

Policy in Place. In general, these states have statewide policies in place requiring a state-approved performance assessment as part of program completion or for state licensure and/or state program accreditation/review. In these states, edTPA also has been approved as a performance assessment for these purposes. States with a policy in place are colored red, and include:

Alabama
Arkansas
California
Connecticut
Hawaii
Illinois
Maryland
Minnesota
North Carolina
Ohio
Oregon
South Carolina
Tennessee
Utah
West Virginia
Wisconsin

Taking Steps Toward Implementation. edTPA is being considered at the state level as a licensure requirement. States taking steps toward implementation are colored gray, and include:

Texas

Teacher Preparation Program Participation in edTPA. At least one provider of teacher preparation, either traditional or alternative, is exploring or implementing edTPA. States with teacher preparation participation in edTPA are colored gold, and include:

Alaska
Arizona
Colorado
Delaware
District of Columbia
Florida
Georgia
Idaho
Indiana
Iowa
Kentucky
Louisiana
Michigan
Mississippi
Nebraska
New Jersey
New York
Oklahoma
Pennsylvania
Rhode Island
South Dakota
Vermont
Virginia
Washington
Wyoming

Reliability and Validity Evidence

Inter-Rater Agreement

The Inter-Rater Agreement Rates table provides agreement rates for each rubric as well as for judgments overall. Inter-rater agreement (IRA) measures to what extent multiple raters provide ratings of items or performance tasks consistently. The check of IRA is part of the general quality control for a scoring process, and it requires a process that randomly assigns portfolios to be read by two scorers, independently.

Exact agreement—proportion of cases in which the first and second scores match exactly;
Adjacent agreement—proportion of cases in which the first and second scores are apart by one score point, in absolute value; and
Exact + Adjacent agreement—proportion of cases in which the pairs of scores are +/- 1 score point apart from each other.

The kappa-n provides chance-corrected agreement, or inter-rater agreement measures that result from removing exact + adjacent agreement that may have occurred randomly (Brennan & Prediger, 1981). Chance-corrected agreement ranges from zero to one. There are no widely accepted guidelines for what constitutes an adequate value of the coefficients, although higher values represent greater levels of agreement. The table below shows kappa-n for both exact agreement and exact + adjacent agreement.

The data set included 3,224 complete submissions from 13-rubric, 15-rubric, and 18-rubric handbooks that were scored independently by two scorers as part of the random sample of double-scored portfolios for the 2023 administration cycle. (Note: 13-rubric handbooks do not have rubrics 4 and 14.)

Task by Inter-Rater Agreement

Task 1: Planning

Rubric	Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
Rubric 1	0.693	0.293	0.986	0.616	0.972
Rubric 2	0.591	0.362	0.952	0.488	0.900
Rubric 3	0.587	0.394	0.981	0.484	0.960
Rubric 4	0.599	0.380	0.979	0.499	0.957
Rubric 5	0.659	0.297	0.957	0.574	0.910

Task 2: Instruction

Rubric	Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
Rubric 6	0.874	0.122	0.996	0.842	0.992
Rubric 7	0.674	0.316	0.990	0.593	0.979
Rubric 8	0.663	0.320	0.984	0.579	0.966
Rubric 9	0.617	0.360	0.978	0.522	0.953
Rubric 10	0.579	0.404	0.983	0.474	0.965

Task 3: Assessment

Rubric	Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
Rubric 11	0.577	0.387	0.964	0.471	0.925
Rubric 12	0.553	0.390	0.943	0.441	0.882
Rubric 13	0.529	0.434	0.963	0.411	0.924
Rubric 14	0.595	0.380	0.975	0.493	0.947
Rubric 15	0.569	0.403	0.972	0.461	0.942

Overall Average

Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
0.624	0.350	0.974	0.530	0.945

Intraclass Correlation Coefficient (ICC)

The intraclass correlation coefficient (ICC) is a reliability estimate that provides information about both the degree of correlation and agreement between measurements. For edTPA, SAS GLM was used to obtain information necessary for calculating the ICCs following the procedures of McGraw & Wong (1996). The ICC is an estimate of inter-rater reliability and shows the variation between two raters across candidates and is provided for edTPA handbooks with 35 or more double scored reliability submissions. The table also provides the 95% confidence interval (CI), quantifying the stability of the estimate. For the purposes of the table, these ICCs were obtained assuming one-way random effects, absolute agreement, using a single rater/measure.

Note: The submissions used in this analysis had scores reported in 2023, were part of the reliability double scoring sample, and included the 15 national rubrics. Language fields of study were removed as were any fields without at least 30 pairs of candidate scores.

Handbook	N	ICC	95% CI Lower Bound	95% CI Upper Bound
Agricultural Education	13	0.75	0.52	0.99
Early Childhood	198	0.72	0.66	0.78
Elementary Education: Literacy with Mathematics Task 4	482	0.72	0.68	0.76
Elementary Education: Mathematics with Literacy Task 4	60	0.63	0.51	0.75
Elementary Literacy	238	0.76	0.71	0.81
Elementary Mathematics	199	0.68	0.62	0.75
K–12 Performing Arts	115	0.59	0.50	0.68
Middle Childhood English-Language Arts	17	0.74	0.53	0.95
Middle Childhood History/Social Studies	24	0.41	0.21	0.61
Middle Childhood Mathematics	33	0.84	0.72	0.97
Middle Childhood Science	31	0.68	0.52	0.84
Physical Education	64	0.66	0.54	0.78
Secondary English-Language Arts	168	0.75	0.69	0.82
Secondary History/Social Studies	174	0.53	0.46	0.60
Secondary Mathematics	118	0.78	0.71	0.86
Secondary Science	116	0.60	0.51	0.69
Special Education	289	0.66	0.61	0.72
Special Education for California	14	0.84	0.65	1.03
Visual Arts	59	0.76	0.65	0.87

Candidate Performance

Overall Scores

The histogram presents the frequency distribution of scores from the edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1, 2023, to December 31, 2023.

This represents the distribution of final scores on all complete portfolios scored on five separate rubrics within each of the three major edTPA tasks: planning, instruction, and assessment.

the score distribution of edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1 to December 31, 2023. This represents the distribution of final scores on all complete portfolios scored on five separate rubrics within each of the three major edTPA tasks: planning, instruction, and assessment. There are five levels of possible performance for each rubric, with level 3 characterizing "ready to teach" and a total score range from 15 to 75. This figure shows that scores are approximately normally distributed across this range.

Task and Rubric Scores

Summary descriptive statistics and distributions for each task and rubric for the 27,094 edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1 to December 31, 2023, are presented in the following table, including Mean, Standard Deviation, Standard Error of the Mean, and Minimum/Maximum score obtained.*

Task 1: Planning

Rubric	Mean	S.D.	SE of Mean	Min	Max
P01	3.0	0.5	0	1	5
P02	2.8	0.7	0	1	5
P03	3.0	0.6	0	1	5
P04	2.9	0.6	0	1	5
P05	2.8	0.6	0	1	5
Task 1 Total	14.5	2.2	.01	5	25

Task 2: Instruction

Rubric	Mean	S.D.	SE of Mean	Min	Max
I06	3.0	0.3	0	1	5
I07	2.9	0.5	0	1	5
I08	2.8	0.5	0	1	5
I09	2.8	0.6	0	1	5
I10	2.7	0.6	0	1	5
Task 2 Total	14.3	1.7	.01	5	25

Task 3: Assessment

Rubric	Mean	S.D.	SE of Mean	Min	Max
A11	2.9	0.7	0	1	5
A12	3.3	0.8	.01	1	5
A13	2.7	0.7	0	1	5
A14	2.8	0.6	0	1	5
A15	2.9	0.7	0	1	5
Task 3 Total	14.5	2.6	.02	5	25

Overall Total

Mean	S.D.	SE of Mean	Min	Max
43.4	5.5	.03	15	75

*Does not include 13-rubric fields (World Language, Classical Languages); includes first 15 rubrics of Elementary Education only.

Modeled Candidate Passing Rates

The Modeled Pass Rates Table reports the percentage of candidates who would have "passed" edTPA at different potential cut scores, within the range of a total score between 35–42, for edTPA assessments with 15 rubrics.

Cut Score	Modeled Overall Passing Rate
35	93.0%
36	91.2%
37	88.8%
38	85.7%
39	81.6%
40	78.1%
41	74.1%
42	69.3%

Performance by Demographic Groups

Teaching Context (School Locale)

The School Locale Table displays mean scores, standard deviations, and submission volumes by teaching placement categories.

School Locale	N	% of N	Mean	Std Dev
City	7,131	32.19%	43.59	5.53
Rural	4,494	20.29%	43.32	5.34
Suburb	6,985	31.54%	43.98	5.38
Town	3,166	14.29%	43.52	5.56
Declined to answer	374	1.69%	43.34	5.56

Teaching Context (Learning Environment)

The Learning Environment Table displays mean scores, standard deviations, and submission volumes by virtual vs non-virtual learning environment.

Learning Environment	N	% of N	Mean	Std Dev
Non-VLE	21,932	99.02%	43.65	5.45
VLE	218	0.98%	42.44	5.51

Teaching Context (Student Characteristics)

The Student Characteristics Table displays a set of variables associated with student characteristics in the candidate's placement.

% ELL Students	N	% of N	Mean	Std Dev
<10%	11,753	53.06%	43.66	5.43
10 to 25%	3,654	16.50%	43.77	5.39
26 to 50%	1,656	7.48%	43.73	5.39
51 to 75%	771	3.48%	43.55	5.54
76 to 100%	1,031	4.65%	42.92	5.88
Decline to answer	3,285	14.83%	43.65	5.47

% Students Free and Reduced-Price Lunch	N	% of N	Mean	Std Dev
<10%	2,386	10.77%	43.83	5.48
10 to 25%	2,566	11.59%	43.89	5.57
26 to 50%	2,693	12.16%	43.73	5.47
51 to 75%	2,532	11.43%	43.76	5.45
76 to 100%	6,697	30.23%	43.37	5.39
Decline to answer	5,276	23.82%	43.69	5.45

% Students SPED Eligibility	N	% of N	Mean	Std Dev
<10%	8,469	38.24%	43.82	5.45
10 to 25%	5,970	26.95%	43.63	5.41
26 to 50%	1,657	7.48%	43.43	5.53
51 to 75%	310	1.40%	42.77	5.51
76 to 100%	1,705	7.70%	42.86	5.17
Decline to answer	4,039	18.23%	43.78	5.57

Program Type

The Program Type Table displays mean scores, standard deviations, and submission volumes for each educator preparation program type.

Teacher Preparation Route	N	% of N	Mean	Std Dev
Traditional EPP	19,054	86.02%	43.77	5.42
Teach for America	163	0.74%	42.12	5.81
Alt - university or college-based program	1,734	7.83%	43.17	5.34
Alt - district provider	355	1.60%	42.23	6.48
Other	386	1.74%	42.06	5.90
Decline to answer	458	2.07%	42.95	5.51

Ethnicity

The Ethnicity Table displays mean scores, standard deviations, and submission volumes of each ethnicity group.

Ethnicity	N	% of N	Mean	Std Dev
African American/Black	1,672	7.55%	41.50	5.79
American Indian or Alaskan Native	97	0.44%	43.49	4.84
Asian or Pacific Islander	932	4.21%	44.02	5.67
Hispanic	2,237	10.10%	43.92	4.98
White	15,902	71.79%	43.81	5.42
Multiracial	756	3.41%	43.71	5.44
Other	194	0.88%	43.47	5.67
Undeclared	360	1.62%	43.44	5.67

Modeled Pass Rates (in %) by Demographic Communities

The Modeled Pass Rates by Demographic Communities reveals the percentage pass rate by gender and ethnicity by cut scores within the range of 35–42.

Gender

Cut Score	All	Not Provided	Male	Female
35	93	93	90	94
36	91	92	88	92
37	89	90	85	90
38	86	86	81	87
39	82	82	76	83
40	78	78	72	80
41	74	75	67	76
42	69	70	62	71

Ethnicity

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	93	87	94	93	94	93	93	91	92
36	91	84	92	90	92	92	91	90	90
37	89	80	90	88	89	90	90	88	88
38	86	76	90	85	86	86	87	85	83
39	82	70	86	82	83	83	82	82	77
40	78	64	81	79	81	79	78	77	74
41	74	59	80	76	77	75	74	73	70
42	69	53	76	72	71	71	71	66	67

Note: Based on 2023 examinees in all states with a total National score based on 15 rubrics

Primary Language

The Primary Language Table displays mean scores, standard deviations, and submission volumes of candidates that identify whether English is their primary language.

Primary Language	N	% of N	Mean	Std Dev
Yes	21,345	96.36%	43.65	5.46
No	571	2.58%	43.12	5.17
Declined to answer	234	1.06%	43.97	5.13

Gender

The Gender Table below displays mean scores, standard deviations, and submission volumes of each candidate identified gender.

Gender	N	% of N	Mean	Std Dev
Not Provided	469	2.12%	43.97	5.84
Male	4,409	19.91%	42.67	5.70
Female	17,262	77.93%	43.88	5.35
Non-binary	10	0.04%	41.40	6.54

Education Level

The Education Level Table below displays mean scores, standard deviations, and submission volumes of the candidates' achieved level of education completed prior to taking edTPA.

Education Level	N	% of N	Mean	Std Dev
High school/Some college	11,617	52.45%	43.45	5.44
Bachelors/Bachelors plus credits	8,971	40.50%	43.89	5.39
Masters/Masters plus credits	1,477	6.67%	43.58	5.82
Doctorate	85	0.38%	44.66	5.59

Regression Analysis

Regression analyses are used to determine whether variables significantly predict an outcome, and the extent to which these variables explain the differences in outcomes within the sample. To examine the contribution of all demographic factors to the performance of the candidates, a multiple regression model including school context variables, program type, student characteristics, ethnicity, gender, education level, and primary language was run to examine the extent to which demographic factors explain the variability in total edTPA scores. It is important to note that finding that a factor is a "statistically significant" predictor does not necessarily indicate that this factor makes a substantial or meaningful difference in outcomes.

Factor	Variance Explained-R² (%)
Teacher Preparation Route	0.47%
School Locale	0.17%
Gender	0.79%
Ethnicity	1.16%
Primary Language	0.06%
Education Level	0.49%
Length of Placement (weeks)	0.25%
Free and Reduced-Price Lunch	0.06%
Special Education Eligibility	0.29%
English Language Learners	0.05%
Overall Model	4.00%

Additional Information

Performance by Content Field

Summary descriptive statistics and distributions for each task and rubric for the 27,094 edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1 to December 31, 2023, are presented in the following table, including N, Total Mean Score, and Average Score for each rubric and task.*

*Does not include 13-rubric fields (World Language, Classical Languages); includes first 15 rubrics of Elementary Education only.

Average candidate performance for 15-rubric content fields

	N	Total Score Mean	Planning					Instruction					Assessment					Mean by Task
	N	Total Score Mean	P01	P02	P03	P04	P05	I06	I07	I08	I09	I10	A11	A12	A13	A14	A15	P	I	A
All 15-Rubric Handbooks	27,094	43.4	3.0	2.8	3.0	2.9	2.8	3.0	2.9	2.8	2.8	2.7	2.9	3.3	2.7	2.8	2.9	14.5	14.3	14.5
Agricultural Education	140	45.3	3.3	2.9	3.1	2.8	3.2	3.0	3.1	2.9	3.3	2.9	3.0	3.1	2.8	2.8	3.0	15.3	15.3	14.7
Business Education	153	45.0	3.0	2.9	2.9	2.9	3.0	3.2	3.2	3.0	3.0	2.9	3.1	3.4	2.7	2.9	3.0	14.7	15.3	15.1
Early Childhood	1,939	41.9	3.0	2.9	2.9	3.0	2.9	3.0	2.9	2.8	2.3	2.7	2.7	2.7	2.5	2.9	2.8	14.5	13.8	13.6
Educational Technology Specialist	1	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n
Elementary Education: Literacy with Mathematics Task 4	6,274	43.7	2.9	2.8	3.1	2.9	2.7	3.0	2.8	2.9	2.8	2.8	2.9	3.5	2.8	2.8	3.0	14.4	14.3	15.0
Elementary Education: Mathematics with Literacy Task 4	731	44.7	3.1	2.8	3.1	2.9	2.8	3.1	3.0	2.9	3.0	2.9	3.1	3.4	2.8	2.8	3.1	14.6	14.9	15.2
Elementary Literacy	2,612	42.9	2.9	2.8	3.0	2.9	2.7	3.0	2.9	2.9	2.9	2.7	2.9	3.2	2.7	2.7	3.0	14.2	14.3	14.5
Elementary Mathematics	1,995	42.4	2.9	2.6	3.0	2.5	2.6	3.0	2.9	2.7	2.9	2.7	2.9	3.2	2.7	2.6	2.9	13.7	14.2	14.4
English as an Additional Language	195	45.4	3.4	3.1	3.3	3.1	3.2	3.1	3.0	2.9	2.8	2.9	3.0	3.1	2.6	2.9	3.1	16.0	14.6	14.8
Family and Consumer Sciences	61	42.8	3.1	3.0	3.0	3.2	2.8	3.0	2.9	2.6	2.8	2.6	2.9	2.9	2.5	2.9	2.6	15.0	14.0	13.8
Health Education	120	41.2	2.8	2.6	2.9	2.7	2.9	3.0	2.7	2.7	2.6	2.7	2.8	3.0	2.6	2.7	2.6	13.8	13.6	13.7
K–12 Performing Arts	1,161	44.5	3.0	3.0	3.1	3.0	3.0	3.0	2.9	2.8	2.9	2.7	3.0	3.2	2.8	2.9	3.0	15.1	14.4	15.0
Middle Childhood English-Language Arts	272	46.9	3.4	3.2	3.3	3.2	3.2	3.2	3.1	3.0	3.0	2.8	3.1	3.4	2.9	3.0	3.1	16.3	15.0	15.5
Middle Childhood History/Social Studies	263	44.9	3.1	3.1	3.3	3.0	3.1	3.1	2.9	2.8	2.8	2.7	3.0	3.4	2.8	2.7	3.0	15.5	14.4	14.9
Middle Childhood Mathematics	356	43.9	3.0	2.8	3.2	2.6	2.8	3.0	2.8	2.8	2.9	2.6	3.1	3.5	2.8	2.8	2.9	14.5	14.2	15.2
Middle Childhood Science	256	44.7	3.2	2.9	3.2	2.9	3.0	3.1	3.0	2.8	2.9	2.8	3.0	3.2	2.9	2.9	3.0	15.2	14.6	14.9
Physical Education	699	38.4	2.8	2.7	2.7	2.6	2.5	2.5	2.8	2.7	2.8	2.3	2.4	2.8	2.2	2.3	2.3	13.2	13.2	12.0
School Librarian/Library Specialist	24	41.7	3.0	2.8	3.3	2.6	2.6	3.2	2.9	2.8	2.5	2.6	3.0	3.0	2.1	2.7	2.7	14.3	13.9	13.5
Secondary English-Language Arts	1,941	45.8	3.2	3.1	3.2	3.0	3.1	3.1	3.1	3.0	2.9	2.8	3.2	3.4	2.8	3.0	3.1	15.5	14.8	15.5
Secondary History/Social Studies	1,812	44.9	3.0	3.0	3.1	3.0	3.0	3.0	3.0	3.0	2.9	2.8	3.1	3.3	2.8	2.9	3.0	15.0	14.8	15.1
Secondary Mathematics	1,181	39.3	2.7	2.4	2.7	2.4	2.5	3.0	2.4	2.5	2.9	2.4	2.6	3.4	2.5	2.5	2.5	12.7	13.2	13.4
Secondary Science	1,219	42.7	3.1	2.5	3.1	2.7	2.9	3.0	2.9	2.8	2.6	2.4	3.1	3.5	2.6	2.9	2.7	14.3	13.7	14.8
Special Education	2,957	42.9	3.0	3.0	2.9	3.0	2.8	3.0	3.0	2.9	2.9	2.6	2.6	3.0	2.6	2.9	2.7	14.6	14.5	13.8
Special Education for California	173	41.4	2.7	2.9	2.7	3.0	2.7	3.0	3.0	2.9	2.9	2.6	1.8	3.2	2.4	2.8	2.7	13.9	14.5	12.9
Technology and Engineering Education	43	43.7	3.1	2.7	2.9	2.9	2.9	3.0	2.8	2.5	2.8	2.7	3.0	3.6	2.9	2.8	3.1	14.6	13.8	15.3
Visual Arts	516	49.3	3.8	3.4	3.5	3.4	3.5	3.2	3.2	3.1	3.2	3.0	3.3	3.4	3.0	3.0	3.3	17.7	15.6	16.0

Average candidate performance for 13-rubric content fields

	N	Total Score Mean	Planning					Instruction					Assessment					Mean by Task
	N	Total Score Mean	P01	P02	P03	P04	P05	I06	I07	I08	I09	I10	A11	A12	A13	A14	A15	P	I	A
All 13-Rubric Handbooks	407	33.8	2.9	2.8	2.9	n/a	2.8	3.0	2.6	2.2	1.8	2.3	2.6	2.9	2.5	n/a	2.6	11.5	11.9	10.4
Classical Languages	5	Low n	Low n	Low n	Low n	n/a	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	n/a	Low n	Low n	Low n	Low n
World Language	402	33.8	2.9	2.8	2.9	n/a	2.8	3.0	2.6	2.2	1.8	2.3	2.6	2.9	2.5	n/a	2.5	11.5	11.9	10.4

Average candidate performance for 18-rubric content fields

	N	Total Score Mean	Planning					Instruction					Assessment					Mathematics			Mean by Task
	N	Total Score Mean	P01	P02	P03	P04	P05	I06	I07	I08	I09	I10	A11	A12	A13	A14	A15	M19	M20	M21	P	I	A
All 18-Rubric Handbooks	6,828	52.3	2.9	2.8	3.1	2.9	2.8	3.0	2.9	2.9	2.8	2.8	2.9	3.5	2.8	2.8	3.0	2.7	2.9	2.7	14.5	14.4	15.1
Elementary Education: Literacy with Mathematics Task 4	6,121	52.2	2.9	2.8	3.1	2.9	2.7	3.0	2.8	2.9	2.8	2.8	2.9	3.5	2.8	2.8	3.0	2.7	3.0	2.7	14.5	14.3	15.0
Elementary Education: Mathematics with Literacy Task 4	707	53.2	3.1	2.8	3.1	2.9	2.8	3.1	3.0	2.9	3.0	2.9	3.1	3.4	2.9	2.8	3.1	2.8	2.7	2.8	14.7	15.0	15.3

Score Distributions by Content Field

Percentage of score distributions, from < 35 through > 42, by handbook, including N and Mean Score.*

*Does not include 13-rubric fields (World Language, Classical Languages); includes first 15 rubrics of Elementary Education only.

Mean scores and distribution of total scores across 15-rubric national content fields

	N	Mean Score	Distribution of Total Score (%)
	N	Mean Score	< 35	35	36	37	38	39	40	41	42	> 42
All 15-Rubric Handbooks	27,094	43.4	7	2	2	3	4	3	4	5	7	62
Agricultural Education	140	45.3	8	1	2	1	3	4	3	2	5	71
Business Education	153	45.0	1	-	1	3	2	3	4	5	7	74
Early Childhood	1,939	41.9	7	2	2	4	6	6	6	7	10	50
Educational Technology Specialist	1	-	-	-	-	-	-	-	-	-	-	-
Elementary Education: Literacy with Mathematics Task 4	6,274	43.7	6	2	2	3	3	3	3	5	6	68
Elementary Education: Mathematics with Literacy Task 4	731	44.7	5	1	2	2	2	2	3	4	5	74
Elementary Literacy	2,612	42.9	9	2	2	3	4	3	3	4	7	63
Elementary Mathematics	1,995	42.4	9	2	4	4	6	3	4	4	8	55
English as an Additional Language	195	45.4	5	3	1	5	3	2	3	4	7	68
Family and Consumer Sciences	61	42.8	8	-	3	3	7	-	2	2	8	67
Health Education	120	41.2	13	2	3	6	8	1	5	7	8	48
K–12 Performing Arts	1,161	44.5	6	1	2	2	4	4	4	3	7	66
Middle Childhood English-Language Arts	272	46.9	3	2	1	3	4	4	3	2	3	76
Middle Childhood History/Social Studies	263	44.9	5	1	2	3	2	3	3	6	6	68
Middle Childhood Mathematics	356	43.9	5	2	2	3	5	4	5	6	6	62
Middle Childhood Science	256	44.7	5	1	1	3	4	4	4	4	7	68
Physical Education	699	38.4	24	3	4	6	9	9	8	8	8	21
School Librarian/Library Specialist	24	41.7	17	4	13	4	-	-	8	13	4	38
Secondary English-Language Arts	1,941	45.8	3	1	1	2	2	2	2	3	5	77
Secondary History/Social Studies	1,812	44.9	1	0	1	1	2	2	3	3	6	80
Secondary Mathematics	1,181	39.3	17	5	8	9	7	5	5	7	8	30
Secondary Science	1,219	42.7	6	3	3	4	6	4	5	6	9	53
Special Education	2,957	42.9	7	1	2	3	4	4	5	6	9	58
Special Education for California	173	41.4	5	-	-	5	6	8	18	12	9	36
Technology and Engineering Education	43	43.7	2	5	5	2	5	-	5	5	5	67
Visual Arts	516	49.3	1	0	0	1	2	0	1	2	3	89

Mean scores and distribution of total scores across 13-rubric national content fields

	N	Mean Score	Distribution of Total Score (%)
	N	Mean Score	< 30	30	31	32	33	34	35	> 35
All 13-Rubric Handbooks	407	33.8	20	8	7	6	4	5	7	41
Classical Languages	5	-	-	-	-	-	-	-	-	-
World Language	402	33.8	20	8	7	6	4	5	7	41

Mean scores and distribution of total scores across 18-rubric national content fields

	N	Mean Score	Distribution of Total Score (%)
	N	Mean Score	< 40	40	41	42	43	44	45	46	47	48	49	> 49
All 18-Rubric Handbooks	6,828	52.3	4	1	1	2	1	2	3	3	2	3	4	75
Elementary Education: Literacy with Mathematics Task 4	6,121	52.2	4	1	1	2	1	2	3	3	2	3	3	75
Elementary Education: Mathematics with Literacy Task 4	707	53.2	4	0	1	1	2	2	2	1	1	1	5	79

Portfolios Represented by State

Approximate percentage of the total sample each state contributed

State	% of Total Sample
AK	0.1%
AL	7.7%
AR	0.9%
AZ	0.4%
CA	15.0%
CO	0.7%
CT	4.4%
DC	0.2%
DE	0%
FL	0.1%
GA	0.6%
HI	0.1%
IA	0.1%
ID	0.3%
IL	1.0%
IN	4.3%
KS	0.1%
KY	0.5%
LA	0%
MA	0%
MD	4.9%
ME	0%
MI	0.3%
MN	8.5%
MO	0.4%
MS	0%
MT	0.1%
NC	13.5%
ND	0%
NE	0.2%
NH	0%
NJ	0.5%
NM	0%
NV	0.3%
NY	0.4%
OH	9.7%
OK	0.1%
OR	2.9%
PA	0.2%
RI	0%
SC	0.6%
SD	0%
TN	7.4%
TX	2.2%
UT	4.6%
VA	2.4%
VT	0%
WA	0.5%
WI	1.2%
WV	0.8%
WY	0.9%

Consequential Use by Content Field

Average scores and standard deviations from all states, from states without policy, and from states with policy for 15-rubric content fields

15 Rubrics

Field	All			Non-Policy			Policy States
Field	N	Mean	Std Deviation	N	Mean	Std Deviation	N	Mean	Std Deviation
Agricultural Education	140	45.31	6.83	32	40.16	8.39	108	46.84	5.46
Business Education	153	45.03	4.55	19	44.00	6.31	134	45.18	4.25
Early Childhood	1,939	41.87	4.45	111	40.21	4.60	1,828	41.97	4.43
Educational Technology Specialist	1	Low n	Low n	-	-	-	1	Low n	Low n
Elementary Education: Literacy with Mathematics Task 4	6,274	43.67	4.99	1,772	42.28	5.51	4,502	44.22	4.66
Elementary Education: Mathematics with Literacy Task 4	731	44.67	5.34	20	36.80	6.17	711	44.89	5.15
Elementary Literacy	2,612	42.90	5.44	538	41.74	5.28	2,074	43.21	5.44
Elementary Mathematics	1,995	42.35	5.43	273	41.58	5.61	1,722	42.47	5.40
English as an Additional Language	195	45.37	6.67	21	43.10	7.73	174	45.64	6.50
Family and Consumer Sciences	61	42.80	4.50	11	43.55	3.14	50	42.64	4.76
Health Education	120	41.18	5.62	8	Low n	Low n	112	41.29	5.65
K–12 Performing Arts	1,161	44.48	6.19	184	42.26	5.48	977	44.90	6.23
Middle Childhood English-Language Arts	272	46.86	7.41	52	44.56	7.46	220	47.41	7.30
Middle Childhood History/Social Studies	263	44.86	5.99	38	43.61	6.12	225	45.08	5.96
Middle Childhood Mathematics	356	43.87	5.51	70	41.86	5.36	286	44.36	5.44
Middle Childhood Science	256	44.71	6.31	27	43.41	5.92	229	44.87	6.35
Physical Education	699	38.40	5.03	71	37.08	5.51	628	38.55	4.95
School Librarian/Library Specialist	24	41.67	7.39	-	-	-	24	41.67	7.39
Secondary English-Language Arts	1,941	45.81	5.45	369	44.53	5.43	1,572	46.11	5.41
Secondary History/Social Studies	1,812	44.93	3.93	257	43.28	4.52	1,555	45.20	3.75
Secondary Mathematics	1,181	39.31	4.86	180	37.96	4.77	1,001	39.55	4.84
Secondary Science	1,219	42.73	5.42	201	41.00	5.82	1,018	43.07	5.27
Special Education	2,957	42.92	5.29	620	42.86	5.33	2,337	42.93	5.28
Special Education for California	173	41.40	3.47	-	-	-	173	41.40	3.47
Technology and Engineering Education	43	43.72	4.93	14	42.57	3.96	29	44.28	5.32
Visual Arts	516	49.32	5.55	56	47.66	5.32	460	49.52	5.55
All 15-Rubric Handbooks	27,094	43.38	5.52	4,944	42.21	5.64	22,150	43.64	5.45

Average scores and standard deviations from all states, from states without policy, and from states with policy for 13-rubric content fields

13 Rubrics

Field	All			Non-Policy			Policy States
Field	N	Mean	Std Deviation	N	Mean	Std Deviation	N	Mean	Std Deviation
Classical Languages	5	Low n	Low n	1	Low n	Low n	4	Low n	Low n
World Language	402	33.83	5.58	48	32.25	5.86	354	34.05	5.51
All 13-Rubric Handbooks	407	33.81	5.56	49	32.27	5.80	358	34.02	5.50

Average scores and standard deviations from all states, from states without policy, and from states with policy for 18-rubric content fields

18 Rubrics

Field	All			Non-Policy			Policy States
Field	N	Mean	Std Deviation	N	Mean	Std Deviation	N	Mean	Std Deviation
Elementary Education: Literacy with Mathematics Task 4	6,121	52.19	6.03	1,722	50.51	6.73	4,399	52.85	5.59
Elementary Education: Mathematics with Literacy Task 4	707	53.20	6.26	16	45.44	5.73	691	53.38	6.16
All 18-Rubric Handbooks	6,828	52.29	6.06	1,738	50.46	6.73	5,090	52.92	5.68

ANOVAs and Post-Hoc Analyses

Analysis of Variance (ANOVA) analyses are used to determine if there is a significant difference between two or more means. To examine whether there was a significant difference in candidates' total edTPA scores (dependent variable/outcome) when candidates were grouped by demographic characteristics (independent variables), a series of One-Way ANOVAs (an ANOVA with one independent variable or factor) were conducted. These demographic characteristics included school context variables, program type, student characteristics, ethnicity, gender, education level, and primary language.

Because a significant ANOVA result does not indicate the specific pair(s) of means that are significantly different, a series of Tukey's HSD Post-Hoc Analyses were conducted. Tukey's HSD Post-Hoc Analyses compares all possible pairs of means and determines whether there are significant differences between pairs of means while controlling for experiment-wise/family-wise error rate.

School Locale

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	4	1362.7584	340.6896	11.48	<.0001
Error	22145	657372.4966	29.6849
Corrected Total	22149	658735.2551

Post-Hoc Analyses

School Locale	Difference Between Means	Sig. at 0.05
Suburb - City	negative 0.26561	***
Suburb - Town	negative 0.65910	***
Suburb - Rural	negative 0.20137
City - Suburb	0.26561
City - Town	negative 0.39349	***
City - Rural	0.06424
Town - Suburb	0.65910	***
Town - City	0.39349	***
Town - Rural	0.45773	***
Rural - Suburb	0.20137
Rural - City	negative 0.06424
Rural - Town	negative 0.45773	***

*** Comparisons significant at the 0.05 level

Percentage ELL

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	623.7177	124.7435	4.20	0.0008
Error	22144	658111.5374	29.7196
Corrected Total	22149	658735.2551

Percent of English Language Learners	Difference Between Means	Sig. at 0.05
<10% – 26-50%	negative 0.06814
<10% – 10-25%	negative 0.11569
<10% – 51-75%	0.10518
<10% – 76-100%	0.73918	***
10-25% – 26-50%	0.04755
10-25% – 51-75%	0.22087
10-25% – 76-100%	0.85487	***
10-25% – <10%	0.11569
26-50% – 10-25%	negative 0.04755
26-50% – 51-75%	0.17332
26-50% – 76-100%	0.80732	***
26-50% – <10%	0.06814
51-75% – 26-50%	negative 0.17332
51-75% – 10-25%	negative 0.22087
51-75% – 76-100%	0.63400
51-75% – <10%	negative 0.10518
76-100% – 26-50%	negative 0.80732	***
76-100% – 10-25%	negative 0.85487	***
76-100% – 51-75%	negative 0.63400
76-100% – <10%	negative 0.73918	***

*** Comparisons significant at the 0.05 level

Percentage Free and Reduced-Price Lunch Eligibility

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	799.5515	159.9103	5.38	<.0001
Error	22144	657935.7036	29.7117
Corrected Total	22149	658735.2551

Percent Qualified for Free and Reduced-Price Lunch	Difference Between Means	Sig. at 0.05
10-25% – 26-50%	0.16381
10-25% – <10%	0.06020
10-25% – 51-75%	0.13496
10-25% – 76-100%	0.52027	***
26-50% – 10-25%	negative 0.16381
26-50% – <10%	negative 0.10361
26-50% – 51-75%	negative 0.02885
26-50% – 76-100%	0.35646	***
<10% – 10-25%	negative 0.06020
<10% – 26-50%	0.10361
<10% – 51-75%	0.07475
<10% – 76-100%	0.46007	***
51-75% – 10-25%	negative 0.13496
51-75% – 26-50%	0.02885
51-75% – <10%	negative 0.07475
51-75% – 76-100%	0.38531	***
76-100% – 10-25%	negative 0.52027	***
76-100% – 26-50%	negative 0.35646	***
76-100% – <10%	negative 0.46007	***
76-100% – 51-75%	negative 0.38531	***

Percentage SPED Eligibility

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	1697.4360	339.4872	11.44	<.0001
Error	22144	657037.8191	29.6711
Corrected Total	22149	658735.2551

Percent of Students Eligible for Special Education	Difference Between Means	Sig. at 0.05
<10% – 76-100%	0.95834	***
<10% – 10-25%	0.19162
<10% – 26-50%	0.39147
<10% – 51-75%	1.04456	***
10-25% – 76-100%	0.76673	***
10-25% – <10%	negative 0.19162
10-25% – 26-50%	0.19986
10-25% – 51-75%	0.85294
26-50% – 76-100%	0.56687	***
26-50% – 10-25%	negative 0.19986
26-50% – <10%	negative 0.39147
26-50% – 51-75%	0.65308
51-75% – 76-100%	negative 0.08622
51-75% – 10-25%	negative 0.85294
51-75% – <10%	negative 1.04456	***
51-75% – 26-50%	negative 0.65308
76-100% – 10-25%	negative 0.76673	***
76-100% – <10%	negative 0.95834	***
76-100% – 26-50%	negative 0.56687	***
76-100% – 51-75%	0.08622

*** Comparisons significant at the 0.05 level

Placement Length

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	6	3131.2807	521.8801	17.20	<.0001
Error	22143	655603.9744	29.6077
Corrected Total	22149	658735.2551

Length of Placement	Difference Between Means	Sig. at 0.05
21-30 – 31-40	0.9520	***
21-30 – 11-20	0.5575	***
21-30 – 1-10	0.6913	***
21-30 – 41+	1.1796	***
21-30 – 0	2.1799	***
31-40 – 21-30	negative 0.9520	***
31-40 – 11-20	negative 0.3945
31-40 – 1-10	negative 0.2607
31-40 – 41+	0.2276
31-40 – 0	1.2278	***
11-20 – 21-30	negative 0.5575	***
11-20 – 31-40	0.3945
11-20 – 1-10	0.1338
11-20 – 41+	0.6221	***
11-20 – 0	1.6223	***
1-10 – 21-30	negative 0.6913	***
1-10 – 31-40	0.2607
1-10 – 11-20	negative 0.1338
1-10 – 41+	0.4883	***
1-10 – 0	1.4886	***
41+ – 21-30	negative 1.1796	***
41+ – 31-40	negative 0.2276
41+ – 11-20	negative 0.6221	***
41+ – 1-10	negative 0.4883	***
41+ – 0	1.0003
0 – 21-30	negative 2.1799	***
0 – 31-40	negative 1.2278	***
0 – 11-20	negative 1.6223	***
0 – 1-10	negative 1.4886	***
0 – 41+	negative 1.0003

*** Comparisons significant at the 0.05 level

Preparation Route

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	2976.1246	595.2249	17.44	<.0001
Error	22144	655759.1304	29.6134
Corrected Total	22149	658735.2551

Teacher Preparation Route	Difference Between Means	Sig. at 0.05
Traditional EPP – Teach for America	1.65110	***
Traditional EPP – Alt – university or college-based program	0.60483	***
Traditional EPP – Alt – district provider	1.54000	***
Traditional EPP – Other	1.70903	***
Teach for America – Traditional EPP	negative 1.65110	***
Teach for America – Alt – university or college-based program	negative 1.04627
Teach for America – Alt – district provider	negative 0.11110
Teach for America – Other	0.05793
Alt – university or college-based program – Traditional EPP	negative 0.60483	***
Alt – university or college-based program – Teach for America	1.04627
Alt – university or college-based program – Alt – district provider	0.93517	***
Alt – university or college-based program – Other	1.10421	***
Alt – district provider – Traditional EPP	negative 1.54000	***
Alt – district provider – Teach for America	0.11110
Alt – district provider – Alt - university or college-based program	negative 0.93517	***
Alt – district provider – Other	0.16904
Other – Traditional EPP	negative 1.70903	***
Other – Teach for America	negative 0.05793
Other – Alt – university or college-based program	negative 1.10421	***
Other – Alt – district provider	negative 0.16904

*** Comparisons significant at the 0.05 level

Ethnicity

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	7	8421.3630	1203.0519	36.23	<.0001
Error	22142	650313.8921	29.3702
Corrected Total	22149	658735.2551

Post-Hoc Analyses

Ethnicity	Difference Between Means	Sig. at 0.05
Asian – White	0.20898
Asian – Multiracial	0.31139
Asian – Hispanic	0.10353
Asian – Native American	0.52554
Asian – Black	2.51560	***
Black – White	negative 2.30662	***
Black – Asian	negative 2.51560	***
Black – Multiracial	negative 2.20421	***
Black – Hispanic	negative 2.41207	***
Black – Native American	negative 1.99006	***
Hispanic – White	0.10545
Hispanic – Asian	negative 0.10353
Hispanic – Multiracial	0.20786
Hispanic – Native American	0.42201
Hispanic – Black	2.41207	***
Multiracial – White	negative 0.10241
Multiracial – Asian	negative 0.31139
Multiracial – Hispanic	negative 0.20786
Multiracial – Native American	0.21415
Multiracial – Black	2.20421	***
Native American – White	negative 0.31656
Native American – Asian	negative 0.52554
Native American – Multiracial	negative 0.21415
Native American – Hispanic	negative 0.42201
Native American – Black	1.99006	***
White – Asian	negative 0.20898
White – Multiracial	0.10241
White – Hispanic	negative 0.10545
White – Native American	0.31656
White – Black	2.30662	***

*** Comparisons significant at the 0.05 level

Primary Language

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	2	186.1787	93.0893	3.13	0.0437
Error	22147	658549.0764	29.7354
Corrected Total	22149	658735.2551

Gender

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	1	5148.0442	5148.0442	162.49	<.0001
Error	21669	637117.6276	29.4023
Corrected Total	21670	642265.6717

Post-Hoc Analyses

Gender	Difference Between Means	Sig. at 0.05
Male – Female	negative 1.21	***
Female – Male	1.21	***

*** Comparisons significant at the 0.05 level

Education Level

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	3	1053.7835	351.2612	11.87	<.0001
Error	22146	657681.4715	29.6975
Corrected Total	22149	658735.2551

Post-Hoc Analyses

Education Level	Difference Between Means	Sig. at 0.05
Bachelor's/Bachelor's plus – High school/Some college	0.43571	***
Bachelor's/Bachelor's plus – Master's/Master's plus credits	0.30446
Bachelor's/Bachelor's plus – Doctorate	negative 0.77007
High school/Some college – Bachelor's/Bachelor's plus	negative 0.43571	***
High school/Some college – Master's/Master's plus credits	negative 0.13125
High school/Some college – Doctorate	negative 1.20578
Master's/Master's plus credits – Bachelor's/Bachelor's plus	negative 0.30446
Master's/Master's plus credits – High school/Some college	0.13125
Master's/Master's plus credits – Doctorate	negative 1.07453
Doctorate – Bachelor's/Bachelor's plus	0.77007
Doctorate – High school/Some college	1.20578
Doctorate – Master's/Master's plus credits	1.07453

*** Comparisons significant at the 0.05 level

Top of Page

Cut Score	All	Not Provided	Male	Female
35	93	93	90	94
36	91	92	88	92
37	89	90	85	90
38	86	86	81	87
39	82	82	76	83
40	78	78	72	80
41	74	75	67	76
42	69	70	62	71

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	93	87	94	93	94	93	93	91	92
36	91	84	92	90	92	92	91	90	90
37	89	80	90	88	89	90	90	88	88
38	86	76	90	85	86	86	87	85	83
39	82	70	86	82	83	83	82	82	77
40	78	64	81	79	81	79	78	77	74
41	74	59	80	76	77	75	74	73	70
42	69	53	76	72	71	71	71	66	67

Cut Score	All	Not Provided	Male	Female
35	93	93	90	94
36	91	92	88	92
37	89	90	85	90
38	86	86	81	87
39	82	82	76	83
40	78	78	72	80
41	74	75	67	76
42	69	70	62	71

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	93	87	94	93	94	93	93	91	92
36	91	84	92	90	92	92	91	90	90
37	89	80	90	88	89	90	90	88	88
38	86	76	90	85	86	86	87	85	83
39	82	70	86	82	83	83	82	82	77
40	78	64	81	79	81	79	78	77	74
41	74	59	80	76	77	75	74	73	70
42	69	53	76	72	71	71	71	66	67

Cut Score	All	Not Provided	Male	Female
35	93	93	90	94
36	91	92	88	92
37	89	90	85	90
38	86	86	81	87
39	82	82	76	83
40	78	78	72	80
41	74	75	67	76
42	69	70	62	71

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	93	87	94	93	94	93	93	91	92
36	91	84	92	90	92	92	91	90	90
37	89	80	90	88	89	90	90	88	88
38	86	76	90	85	86	86	87	85	83
39	82	70	86	82	83	83	82	82	77
40	78	64	81	79	81	79	78	77	74
41	74	59	80	76	77	75	74	73	70
42	69	53	76	72	71	71	71	66	67