2020 edTPA Administrative Report

Introduction

This report presents analyses based on teacher candidate performance from January 1 to December 31, 2020. Reports for previous years are available on the resource library at edTPA.org. link opens in a new window

The map below shows the states participating in edTPA as of January 2020. The map indicates states with edTPA implementation policy in place and those expecting to have an implementation policy in place soon. Visit the "About" page of this website for up-to-date information on states and their policies.

Map of the states participating in edTPA in 2020

Stanford Center for Assessment, Learning, and Equity (SCALE) is the sole developer of edTPA, and Stanford University is the exclusive owner of edTPA. The University has a licensing agreement with the Evaluation Systems group of Pearson to provide operational support for the national administration of edTPA.

Policy in Place. In general, these states have statewide policies in place requiring a state-approved performance assessment as part of program completion or for state licensure and/or state program accreditation/review. In these states, edTPA also has been approved as a performance assessment for these purposes. States with a policy in place are colored red, and include:

Alabama
Arkansas
California
Connecticut
Delaware
Georgia
Hawaii
Illinois
Iowa
Maryland
Minnesota
New Jersey
New York
North Carolina
Ohio
Oregon
South Carolina
Tennessee
Utah
Washington
West Virginia
Wisconsin

Taking Steps Toward Implementation. edTPA is being considered at the state level as a licensure requirement. States taking steps toward implementation are colored gray, and include:

Texas

Teacher Preparation Program Participation in edTPA. At least one provider of teacher preparation, either traditional or alternative, is exploring or implementing edTPA. States with teacher preparation participation in edTPA are colored gold, and include:

Alaska
Arizona
Colorado
District of Columbia
Florida
Idaho
Indiana
Kentucky
Louisiana
Michigan
Mississippi
Nebraska
Oklahoma
Pennsylvania
Rhode Island
South Dakota
Vermont
Virginia
Wisconsin
Wyoming

Western Governors University is a participating member in edTPA and offers online accredited teacher preparation programs across the US.

Reliability and Validity Evidence

Inter-Rater Agreement

The Inter-Rater Agreement Rates table provides agreement rates for each rubric as well as for judgments overall. Inter-rater agreement (IRA) measures to what extent multiple raters provide ratings of items or performance tasks consistently. The check of IRA is part of the general quality control for a scoring process, and it requires a process that randomly assigns portfolios to be read by two scorers, independently.

Exact agreement—proportion of cases in which the first and second scores match exactly;
Adjacent agreement—proportion of cases in which the first and second scores are apart by one score point, in absolute value; and
Exact + Adjacent agreement—proportion of cases in which the pairs of scores are +/- 1 score point apart from each other.

The kappa-n provides chance-corrected agreement, or inter-rater agreement measures that result from removing exact + adjacent agreement that may have occurred randomly (Brennan & Prediger, 1981). Chance-corrected agreement ranges from zero to one. There are no widely accepted guidelines for what constitutes an adequate value of the coefficients, although higher values represent greater levels of agreement. The table below shows kappa-n for both exact agreement and exact + adjacent agreement.

The data set included 4,814 complete submissions from 13-rubric, 15-rubric, and 18-rubric handbooks that were scored independently by two scorers as part of the random sample of double-scored portfolios for the 2020 administration cycle. (Note: 13-rubric handbooks do not have rubrics 4 and 14.)

Task by Inter-Rater Agreement

Task 1: Planning

Rubric	Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
Rubric 01	0.657	0.324	0.981	0.571	0.960
Rubric 02	0.575	0.376	0.951	0.468	0.897
Rubric 03	0.580	0.391	0.971	0.475	0.939
Rubric 04	0.588	0.383	0.971	0.485	0.939
Rubric 05	0.635	0.324	0.959	0.544	0.915

Task 2: Instruction

Rubric	Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
Rubric 06	0.835	0.157	0.991	0.793	0.982
Rubric 07	0.650	0.329	0.978	0.562	0.955
Rubric 08	0.615	0.361	0.976	0.519	0.950
Rubric 09	0.601	0.369	0.970	0.502	0.938
Rubric 10	0.585	0.388	0.973	0.481	0.944

Task 3: Assessment

Rubric	Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
Rubric 11	0.564	0.388	0.952	0.454	0.900
Rubric 12	0.503	0.436	0.939	0.379	0.873
Rubric 13	0.523	0.432	0.956	0.404	0.907
Rubric 14	0.578	0.393	0.971	0.473	0.939
Rubric 15	0.583	0.384	0.967	0.479	0.931

Overall Average

Exact	Adjacent	Exact plus Adjacent	Kappa n Exact	Kappa n Adjacent plus Exact
0.605	0.362	0.967	0.506	0.931

Intraclass Correlation Coefficient (ICC)

The intraclass correlation coefficient (ICC) is a reliability estimate that provides information about both the degree of correlation and agreement between measurements. For edTPA, SAS GLM was used to obtain information necessary for calculating the ICCs following the procedures of McGraw & Wong (1996). The ICC is an estimate of inter-rater reliability and shows the variation between two raters across candidates and is provided for edTPA handbooks with 35 or more double scored reliability submissions. The table also provides the 95% confidence interval (CI), quantifying the stability of the estimate. For the purposes of the table, these ICCs were obtained assuming one-way random effects, absolute agreement, using a single rater/measure.

Note: The submissions used in this analysis had scores reported in 2020, were part of the reliability double scoring sample, and included the 15 national rubrics. Language fields of study were removed as were any fields without at least 30 pairs of candidate scores.

Handbook	N	ICC	95% CI Lower Bound	95% CI Upper Bound
Agricultural Education	24	0.73	negative 0.44	1.9
Early Childhood	309	0.75	0.56	0.94
Elementary Education: Literacy with Mathematics Task 4	1012	0.65	0.52	0.78
Elementary Education: Mathematics with Literacy Task 4	109	0.49	0.16	0.82
Elementary Literacy	595	0.73	0.57	0.89
Elementary Mathematics	548	0.65	0.48	0.82
K–12 Performing Arts	187	0.62	0.25	0.99
Middle Childhood History/Social Studies	38	0.41	negative 0.45	1.27
Middle Childhood Mathematics	68	0.76	0.2	1.32
Physical Education	97	0.57	0.15	0.99
Secondary English-Language Arts	308	0.59	negative 0.26	1.46
Secondary History/Social Studies	305	0.58	negative 0.45	1.27
Secondary Mathematics	197	0.65	0.33	0.97
Secondary Science	237	0.65	0.38	0.92
Special Education	503	0.66	0.44	0.88
Visual Arts	106	0.59	0.18	1.00

Candidate Performance

Overall Scores

The histogram presents the frequency distribution of scores from the 36,063 edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1, 2020, to December 31, 2020.

This represents the distribution of final scores on all complete portfolios scored on five separate rubrics within each of the three major edTPA tasks: planning, instruction, and assessment.

the score distribution of 36,063 edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1 to December 31, 2020. This represents the distribution of final scores on all complete portfolios scored on five separate rubrics within each of the three major edTPA tasks: planning, instruction, and assessment. There are five levels of possible performance for each rubric, with level 3 characterizing "ready to teach" and a total score range from 15 to 75. This figure shows that scores are approximately normally distributed across this range.

Task and Rubric Scores

Summary descriptive statistics and distributions for each task and rubric for the 36,063 edTPA portfolios, in fields scored based on 15 rubrics and submitted January 1 to December 31, 2020, are presented in the following table, including Mean, Standard Deviation, Standard Error of the Mean, and Minimum/Maximum score obtained. *

Task 1: Planning

Rubric	Mean	S.D.	SE of Mean	Min	Max
P01	3.0	0.6	0	1	5
P02	2.9	0.7	0	1	5
P03	3.1	0.6	0	1	5
P04	2.9	0.6	0	1	5
P05	2.9	0.6	0	1	5
Task 1 Total	14.9	2.3	.01	5	25

Task 2: Instruction

Rubric	Mean	S.D.	SE of Mean	Min	Max
I06	3.1	0.3	0	1	5
I07	3.0	0.5	0	1	5
I08	2.9	0.6	0	1	5
I09	2.9	0.6	0	1	5
I10	2.7	0.6	0	1	5
Task 2 Total	14.5	1.9	.01	5	25

Task 3: Assessment

Rubric	Mean	S.D.	SE of Mean	Min	Max
A11	3.0	0.7	0	1	5
A12	3.3	0.8	0	1	5
A13	2.8	0.7	0	1	5
A14	2.9	0.6	0	1	5
A15	3.0	0.7	0	1	5
Task 3 Total	14.9	2.6	.01	5	25

Overall Total

Mean	S.D.	SE of Mean	Min	Max
44.3	5.7	.03	15	75

*Does not include 13-rubric fields (World Language, Classical Languages); includes first 15 rubrics of Elementary Education only.

Modeled Candidate Passing Rates

The Modeled Pass Rates Table reports the percentage of candidates who would have "passed" edTPA at different potential cut scores, within the range of a total score between 35–42, for edTPA assessments with 15 rubrics.

Cut Score	Modeled Overall Passing Rate
35	93.7%
36	92.0%
37	90.0%
38	87.6%
39	85.4%
40	82.6%
41	78.5%
42	73.6%

Performance by Demographic Groups

Teaching Context (School Locale)

The School Locale Table displays mean scores, standard deviations, and submission volumes by teaching placement categories.

School Locale	N	% of N	Mean	Std Dev
City	9,789	33.87	44.85	5.53
Rural	5,266	18.22	44.44	5.42
Suburb	9,170	31.73	45.13	5.33
Town	4,274	14.78	44.54	5.44
Declined to answer	399	1.38	44.54	5.4

Teaching Context (Learning Environment)

The Learning Environment Table displays mean scores, standard deviations, and submission volumes by virtual vs non-virtual learning environment.

Learning Environment	N	% of N	Mean	Std Dev
Non-VLE	26466	91.58	44.90	5.47
VLE	2432	8.42	43.86	4.94

Teaching Context (Student Characteristics)

The Student Characteristics Table displays a set of variables associated with student characteristics in the candidate's placement.

% ELL Students	N	% of N	Mean	Std Dev
<10%	16,599	57.44	44.81	5.38
10 to 25%	4,421	15.30	45.05	5.41
26 to 50%	2,133	7.38	45.05	5.33
51 to 75%	883	3.06	44.94	5.51
76 to 100%	1,263	4.37	44.83	5.96
Declined to answer	3,599	12.45	44.38	5.58

% Students Free and Reduced-Price Lunch	N	% of N	Mean	Std Dev
<10%	3,942	13.64	44.91	5.36
10 to 25%	3,727	12.90	45.12	5.22
26 to 50%	4,181	14.47	45.04	5.39
51 to 75%	3,590	12.42	44.84	5.48
76 to 100%	7,633	26.41	44.69	5.5
Declined to answer	5,825	20.16	44.54	5.53

% Students SPED Eligibility	N	% of N	Mean	Std Dev
<10%	12,463	43.13	44.83	5.33
10 to 25%	7,330	25.37	44.88	5.39
26 to 50%	2,200	7.61	44.81	5.5
51 to 75%	403	1.39	44.1	5.72
76 to 100%	2,101	7.27	45.4	5.72
Declined to answer	4,401	15.22	44.46	5.6

Program Type

The Program Type Table displays mean scores, standard deviations, and submission volumes for each educator preparation program type.

Teacher Preparation Route	N	% of N	Mean	Std Dev
Traditional EPP	25,002	86.52	44.93	5.35
Teach for America	445	1.54	44.48	5.58
Alt — university or college-based program	2,209	7.64	44.1	5.82
Alt — district provider	476	1.65	43.73	6.2
Other	279	0.97	43.1	6.37
Declined to answer	487	1.68	44.68	5.86

Ethnicity

The Ethnicity Table displays mean scores, standard deviations, and submission volumes of each ethnicity group.

Ethnicity	N	% of N	Mean	Std Dev
African American/Black	1874	6.48%	42.97	5.76
American Indian or Alaskan Native	108	0.37%	43.70	5.53
Asian or Pacific Islander	1243	4.30%	44.90	5.14
Hispanic	2407	8.33%	44.73	5.25
White	21559	74.60%	44.99	5.40
Multiracial	921	3.19%	44.81	5.35
Other	299	1.03%	44.68	6.01
Undeclared	487	1.69%	44.68	5.99

Modeled Pass Rates (in %) by Demographic Communities

The Modeled Pass Rates by Demographic Communities reveals the percentage pass rate by gender and ethnicity by cut scores within the range of 35–42.

Gender

Cut Score	All	Not Provided	Male	Female
35	94	94	91	94
36	92	92	88	93
37	90	89	86	91
38	88	86	83	89
39	85	84	80	87
40	83	80	77	84
41	78	76	72	80
42	74	73	67	75

Ethnicity

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	94	89	93	96	93	94	94	93	93
36	92	87	90	95	92	92	93	91	90
37	90	85	89	93	90	90	90	88	88
38	88	81	84	91	88	88	88	86	85
39	85	79	82	88	85	86	86	84	83
40	83	75	81	85	82	83	84	80	80
41	78	69	78	80	79	79	79	76	76
42	74	62	73	76	74	74	75	72	70

Note: Based on 2020 examinees in all states with a total National score based on 15 rubrics

Primary Language

The Primary Language Table displays mean scores, standard deviations, and submission volumes of candidates that identify whether English is their primary language.

Primary Language	N	% of N	Mean	Std Dev
English	27857	96.39%	44.82	5.43
Other	763	2.64%	44.48	5.52
Declined to answer	278	.96%	44.95	5.63

Gender

The Gender Table below displays mean scores, standard deviations, and submission volumes of each candidate identified gender.

Gender	N	% of N	Mean	Std Dev
Not Provided	338	1.17%	44.70	5.75
Male	5985	20.71%	43.75	5.79
Female	22575	78.12%	45.10	5.30

Education Level

The Education Level Table below displays mean scores, standard deviations, and submission volumes of the candidates' achieved level of education completed prior to taking edTPA.

Education Level	N	% of N	Mean	Std Dev
High school/Some college	14616	50.58	44.78	5.28
Bachelor's/Bachelor's plus credits	11732	40.60	44.93	5.52
Master's/Master's plus credits	2416	8.36	44.47	5.91
Doctorate	134	.46	44.43	6.00

Regression Analysis

Regression analyses are used to determine whether variables significantly predict an outcome, and the extent to which these variables explain the differences in outcomes within the sample. To examine the contribution of all demographic factors to the performance of the candidates, a multiple regression model including school context variables, program type, student characteristics, ethnicity, gender, education level, and primary language was run to examine the extent to which demographic factors explain the variability in total edTPA scores. It is important to note that finding that a factor is a "statistically significant" predictor does not necessarily indicate that this factor makes a substantial or meaningful difference in outcomes.

Factor	Variance Explained-R²(%)
Teacher Preparation Route	0.34%
School Locale	0.24%
Gender	0.96%
Ethnicity	0.78%
Primary Language	0.01%
Education Level	0.15%
Length of Placement (weeks)	0.20%
Free and Reduced Lunch	0.07%
Special Education Eligibility	0.13%
English Language Learners	0.02%
Learning Environment	0.25%
Overall Model	3.14%

Additional Information

Performance by Content Field

Average candidate performance for 15-rubric content fields

	N	Total Score Mean	Planning					Instruction					Assessment					Mean by Task
	N	Total Score Mean	P01	P02	P03	P04	P05	I06	I07	I08	I09	I10	A11	A12	A13	A14	A15	P	I	A
All 15-Rubric Handbooks	36,063	44.26	3	2.9	3.1	2.9	2.9	3.1	3	2.9	2.9	2.7	3	3.3	2.8	2.9	3	14.9	14.5	14.9
Agricultural Education	270	45.81	3.4	3.1	3.1	3	3.1	3.1	3	3	3.3	2.9	3	3.2	2.8	2.8	3	15.7	15.2	14.9
Business Education	132	44.40	3.1	3	2.9	3	3.1	3.1	3	2.9	3	2.8	3	3.3	2.8	2.8	2.9	15	14.6	14.7
Early Childhood	2,908	41.52	2.9	2.8	2.8	3	2.8	3	3	2.9	2.3	2.7	2.7	2.6	2.4	2.9	2.8	14.4	13.8	13.3
Elementary Education: Literacy with Mathematics Task 4 (1st 15 rubrics)	7,659	43.74	2.9	2.9	3.1	2.9	2.7	3	2.8	2.9	2.8	2.8	2.9	3.4	2.8	2.8	3	14.4	14.3	15
Elementary Education: Mathematics	679	47.31	3.2	3	3.3	3.1	3	3.1	3.1	3.1	3.2	3	3.3	3.5	3.1	3.1	3.2	15.6	15.4	16.2
with Literacy Task 4 (1st 15 rubrics)
Elementary Literacy	3,163	44.5	2.9	2.9	3	3	2.8	3	2.9	2.9	3	2.7	3	3.5	2.9	2.8	3.1	14.6	14.5	15.3
Elementary Mathematics	2,895	45.12	3.1	2.9	3.2	2.9	2.9	3.1	3	2.9	3	2.8	3.2	3.3	2.9	2.8	3.1	15.1	14.8	15.3
English as an Additional Language	381	46.74	3.4	3.2	3.3	3.3	3.3	3.2	3.1	3	2.7	2.9	3.2	3.2	2.8	3	3.1	16.4	15	15.3
Family and Consumer Sciences	125	43.85	3.1	3	3	3.2	2.8	3	2.8	2.8	2.9	2.8	2.9	3	2.8	2.8	2.9	15.1	14.3	14.5
Health Education	115	41.63	3	2.8	2.8	2.7	3	3.1	2.8	2.7	2.6	2.7	2.8	3	2.5	2.6	2.6	14.3	13.9	13.4
K–12 Performing Arts	1,517	45.39	3.1	3	3.2	3	3.1	3	3	2.8	3	2.8	3.1	3.3	2.8	3	3.1	15.4	14.5	15.4
Library Specialist	43	48.33	3.4	3.7	3.6	3.1	3.3	3.4	3	2.9	3.3	3	3.2	3.3	3	3	3.1	17.1	15.6	15.6
Literacy Specialist	2	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n
Middle Childhood English-Language Arts	461	46.98	3.3	3.1	3.3	3.1	3.3	3.2	3.1	3.1	3	2.8	3.1	3.5	2.9	2.9	3.1	16.2	15.2	15.5
Middle Childhood History/Social Studies	345	45.43	3.2	3.1	3.3	3	3	3.2	3	2.9	2.8	2.7	3.1	3.5	2.8	2.8	3	15.6	14.5	15.3
Middle Childhood Mathematics	598	43.45	3.1	2.8	3.2	2.7	2.8	3	2.8	2.8	3	2.6	3	3.4	2.8	2.7	2.8	14.6	14.2	14.7
Middle Childhood Science	356	44.39	3.1	3	3.2	3	3	3.1	2.9	2.9	2.6	2.6	3.1	3.3	2.9	2.8	2.9	15.3	14.1	15
Physical Education	1,041	40.52	2.9	2.9	2.7	2.6	2.7	2.8	2.9	2.9	2.9	2.4	2.6	2.9	2.4	2.4	2.5	13.9	13.9	12.7
School Librarian/Library Specialist	3	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n	Low n
Secondary English-Language Arts	2,405	46.56	3.3	3.1	3.2	3	3.1	3.1	3.1	3	2.9	2.9	3.2	3.5	2.9	3	3.2	15.8	15	15.8
Secondary History/Social Studies	2,415	45.39	3.1	3	3.1	3	3	3	3.1	3.1	2.9	2.8	3.1	3.4	2.9	2.9	3	15.1	14.9	15.4
Secondary Mathematics	1,638	40.4	2.8	2.4	2.8	2.5	2.6	3	2.5	2.6	2.8	2.5	2.6	3.4	2.6	2.6	2.5	13.2	13.4	13.8
Secondary Science	1,828	42.25	3	2.5	3.1	2.8	2.9	3.1	2.8	2.8	2.5	2.4	2.9	3.4	2.6	2.9	2.7	14.3	13.6	14.4
Special Education	4,257	45.08	3.1	3.2	3.1	3.1	2.9	3.2	3.2	3	3.1	2.7	2.8	3.2	2.7	3.1	2.8	15.4	15.1	14.5
Technology and Engineering Education	60	45.18	3.1	3.1	3	3.1	3	3.1	3	2.9	3	2.8	3	3.4	2.8	2.9	3	15.3	14.8	15.1
Visual Arts	767	50.25	3.9	3.5	3.5	3.4	3.6	3.3	3.3	3.2	3.3	3	3.4	3.6	3	3	3.3	17.9	16	16.3

Average candidate performance for 13-rubric content fields

	N	Total Score Mean	Planning					Instruction					Assessment					Mean by Task
	N	Total Score Mean	P01	P02	P03	P04	P05	I06	I07	I08	I09	I10	A11	A12	A13	A14	A15	P	I	A
All 13-Rubric Handbooks	641	36.48	3.1	3.1	3.1		3	3.1	2.6	2.5	2.1	2.5	2.8	3.1	2.7		2.7	12.3	12.8	11.3
Classical Languages	11	34.64	2.7	2.9	3.4		2.6	3.1	2.3	2.4	1.9	2.5	2.6	3	2.5		2.8	11.6	12.1	10.9
World Language	630	36.51	3.1	3.1	3.1		3	3.1	2.7	2.5	2.1	2.5	2.8	3.1	2.7		2.7	12.3	12.8	11.3

Average candidate performance for 18-rubric content fields

	N	Total Score Mean	Planning					Instruction					Assessment					Mathematics			Mean by Task
	N	Total Score Mean	P01	P02	P03	P04	P05	I06	I07	I08	I09	I10	A11	A12	A13	A14	A15	M19	M20	M21	P	I	A
All 18-Rubric Handbooks	8,138	52.64	2.9	2.9	3.1	2.9	2.8	3	2.9	2.9	2.8	2.8	3	3.4	2.8	2.9	3.1	2.8	2.9	2.7	14.6	14.4	15.2
Elementary Education: Literacy with Mathematics Task 4	7,465	52.29	2.9	2.9	3.1	2.9	2.8	3	2.8	2.9	2.8	2.8	2.9	3.4	2.8	2.8	3.1	2.8	2.9	2.7	14.5	14.3	15.1
Elementary Education: Mathematics with Literacy Task 4	673	56.48	3.2	3	3.3	3.1	3	3.1	3.1	3.1	3.2	3	3.3	3.5	3.1	3.1	3.2	3	3	3.1	15.7	15.4	16.3

Score Distributions by Content Field

Mean scores and distribution of total scores across 15-rubric national content fields

	N	Mean Score	Distribution of Total Score (%)
	N	Mean Score	< 35	35	36	37	38	39	40	41	42	> 42
All 15-Rubric Handbooks	36,063	44.3	6	2	2	2	2	3	4	5	6	68
Agricultural Education	270	45.8	4	1	2	2	0	1	2	3	3	80
Business Education	132	44.4	1	1	2	3	4	3	7	4	5	71
Early Childhood	2,908	41.5	7	2	3	5	5	6	8	9	10	45
Elementary Education: Literacy with Mathematics Task 4	7,659	43.7	7	2	2	2	2	3	4	5	6	68
Elementary Education: Mathematics with Literacy Task 4	679	47.3	1	0	1	1	1	1	1	1	2	91
Elementary Literacy	3,163	44.5	6	1	2	2	1	1	3	4	6	74
Elementary Mathematics	2,895	45.1	3	2	1	1	1	2	3	4	4	78
English as an Additional Language	381	46.7	6	1	2	1	1	2	3	2	5	76
Family and Consumer Sciences	125	43.8	6	2	2		2		6	3	5	74
Health Education	115	41.6	18	1	3	6	3	6	3	6	3	50
K–12 Performing Arts	1,517	45.4	6	1	1	2	1	2	4	5	6	71
Library Specialist	43	48.3	7	5		2				2	5	79
Literacy Specialist	2
Middle Childhood English-Language Arts	461	47.0	6	1	1	2	3	2	3	2	3	77
Middle Childhood History/Social Studies	345	45.4	6	1	1	2	3	3	2	5	4	72
Middle Childhood Mathematics	598	43.4	8	3	3	3	2	3	4	8	8	59
Middle Childhood Science	356	44.4	9	2	2	3	1	1	3	6	6	67
Physical Education	1,041	40.5	14	3	6	6	5	6	8	10	7	36
School Librarian	3
Secondary English-Language Arts	2,405	46.6	2	1	1	1	1	1	2	3	4	84
Secondary History/Social Studies	2,415	45.4	2	1	1	2	1	2	3	3	5	81
Secondary Mathematics	1,638	40.4	16	4	5	5	4	6	7	7	8	38
Secondary Science	1,828	42.2	9	3	3	4	3	5	6	7	7	52
Special Education	4,257	45.1	6	1	1	2	2	2	4	4	6	71
Technology and Engineering Education	60	45.2	7	2	2	3		2	5	5	2	73
Visual Arts	767	50.3	1	0	1	0		0	1	2	2	94

Mean scores and distribution of total scores across 13-rubric national content fields

	N	Mean Score	Distribution of Total Score (%)
	N	Mean Score	< 30	30	31	32	33	34	35	> 35
All 13-Rubric Handbooks	641	36.5	12	4	5	3	3	7	7	59
Classical Languages	11	34.6	18	9			9	9	9	45
World Language	630	36.5	12	4	5	3	3	7	7	60

Mean scores and distribution of total scores across 18-rubric national content fields

	N	Mean Score	Distribution of Total Score (%)
	N	Mean Score	< 40	40	41	42	43	44	45	46	47	48	49	> 49
All 18-Rubric Handbooks	8,138	52.6	4	1	1	1	2	2	1	2	3	3	4	75
Elementary Education: Literacy with Mathematics Task 4	7,465	52.3	5	2	1	1	2	2	2	2	3	4	4	74
Elementary Education: Mathematics with Literacy Task 4	673	56.5	1	0	0	0	1	1	1	1	1	1	1	93

Portfolios Represented by State

Approximate percentage of the total sample each state contributed

State	% of Total Sample
AL	5%
AR	<1%
AZ	<1%
CA	8.4%
CO	<1%
CT	1.6%
DE	<1%
GA	8.5%
IA	<1%
IL	7.2%
IN	1.4%
KY	<1%
MD	2%
MN	4.1%
NC	8%
NE	<1%
NJ	5.9%
NY	10.8%
OH	7.9%
OK	<1%
OR	3.4%
PA	<1%
SC	<1%
TN	6%
TX	1.3%
UT	1.4%
VA	1.3%
WA	6.1%
WI	3.2%
WV	<1%
WY	<1%

Consequential Use by Content Field

Average scores and standard deviations from all states, from states without policy, and from states with policy for 15-rubric content fields

15 Rubrics

Field	All			Non-Policy			Policy States
Field	N	Mean	Std Deviation	N	Mean	Std Deviation	N	Mean	Std Deviation
Agricultural Education	270	45.81	5.69	55	44.36	5.94	215	46.18	5.58
Business Education	132	44.4	4.38	19	42.63	3.83	113	44.7	4.41
Early Childhood	2908	41.52	4.28	1334	41	4.63	1574	41.96	3.92
Elementary Education: Literacy with Mathematics Task 4	7659	43.74	5.26	1358	40.91	6.41	6301	44.35	4.76
Elementary Education: Mathematics with Literacy Task 4	679	47.31	4.62	56	43.73	5.28	623	47.63	4.42
Elementary Literacy	3163	44.5	5.22	322	40.59	5.98	2841	44.95	4.94
Elementary Mathematics	2895	45.12	4.87	210	43.52	5.67	2685	45.25	4.78
English as an Additional Language	381	46.74	7.41	61	44.31	9.42	320	47.2	6.89
Family and Consumer Sciences	125	43.85	5.45	35	40.8	7.56	90	45.03	3.81
Health Education	115	41.63	7.37	38	38.63	6.89	77	43.1	7.19
K–12 Performing Arts	1517	45.39	6.49	283	43.36	7.04	1234	45.85	6.26
Library Specialist	43	48.33	8.98	3	43.67	9.02	40	48.68	8.99
Literacy Specialist	2	Low n	Low n	1	Low n	Low n	1	Low n	Low n
Middle Childhood English-Language Arts	461	46.98	7.55	194	45.02	8.42	267	48.4	6.5
Middle Childhood History/Social Studies	345	45.43	6.71	94	43.91	6.69	251	46	6.64
Middle Childhood Mathematics	598	43.45	5.97	229	41.79	6.78	369	44.48	5.16
Middle Childhood Science	356	44.39	6.36	124	43.07	6.55	232	45.1	6.16
Physical Education	1041	40.52	5.74	86	36.83	6.78	955	40.85	5.52
School Librarian/Library Specialist	3	Low n	Low n	1	Low n	Low n	2	Low n	Low n
Secondary English-Language Arts	2405	46.56	5.05	422	44.18	6.09	1983	47.07	4.65
Secondary History/Social Studies	2415	45.39	4.58	452	43.22	5.32	1963	45.89	4.23
Secondary Mathematics	1638	40.4	5.14	292	38.46	5.17	1346	40.82	5.04
Secondary Science	1828	42.25	5.52	272	38.89	6.44	1556	42.83	5.13
Special Education	4257	45.08	6.07	1064	43.5	6.48	3193	45.6	5.83
Technology and Engineering Education	60	45.18	6.64	7	41.14	8.25	53	45.72	6.3
Visual Arts	767	50.25	6.18	153	47.74	6.11	614	50.88	6.04
All 15-Rubric Handbooks	36063	44.26	5.75	7165	42.02	6.39	28898	44.81	5.44

Average scores and standard deviations from all states, from states without policy, and from states with policy for 13-rubric content fields

13 Rubrics

Field	All			Non-Policy			Policy States
Field	N	Mean	Std Deviation	N	Mean	Std Deviation	N	Mean	Std Deviation
Classical Languages	11	34.64	5.89				11	34.64	5.89
World Language	630	36.51	5.81	82	33.61	5.62	548	36.95	5.71
All 13-Rubric Handbooks	641	36.48	5.81	82	33.61	5.62	559	36.90	5.72

Average scores and standard deviations from all states, from states without policy, and from states with policy for 18-rubric content fields

18 Rubrics

Field	All			Non-Policy			Policy States
Field	N	Mean	Std Deviation	N	Mean	Std Deviation	N	Mean	Std Deviation
Elementary Education: Literacy with Mathematics Task 4	7465	52.29	6.29	1287	48.83	7.79	6178	53.02	5.67
Elementary Education: Mathematics with Literacy Task 4	673	56.48	5.46	53	52.09	5.81	620	56.85	5.26
All 18-Rubric Handbooks	8138	52.64	6.33	1340	48.96	7.75	6798	53.37	5.74

ANOVAs and Post-Hoc Analyses

School Locale

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	4	2002.1958	500.5490	16.97	<.0001
Error	28893	852305.1149	29.4987
Corrected Total	28897	854307.3107

Post-Hoc Analyses

School Locale	Difference Between Means	Sig. at 0.05
Suburb – City	0.27387	***
Suburb – Rural	0.58396	***
Suburb – Town	0.68920	***
City – Suburb	-0.27387	***
City – Rural	0.31009	***
City – Town	0.41533	***
Rural – Suburb	-0.58396	***
Rural – City	-0.31009	***
Rural – Town	0.10524
Town – Suburb	-0.68920	***
Town – City	-0.41533	***
Town – Rural	-0.10524

*** Comparisons significant at the 0.05 level

Percentage ELL

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	1036.0736	207.2147	7.02	<.0001
Error	28892	853271.2371	29.5331
Corrected Total	28897	854307.3107

Percent of English Language Learners	Difference Between Means	Sig. at 0.05
<10% – 26-50%	-0.23898
<10% – 10-25%	-0.23798
<10% – 51-75%	-0.13000
<10% – 76-100%	-0.01618
10-25% – 26-50%	-0.00100
10-25% – 51-75%	0.10798
10-25% – 76-100%	0.22180
10-25% – <10%	0.23798
26-50% – 10-25%	0.00100
26-50% – 51-75%	0.10898
26-50% – 76-100%	0.22280
26-50% – <10%	0.23898
51-75% – 26-50%	-0.10898
51-75% – 10-25%	-0.10798
51-75% – 76-100%	0.11383
51-75% – <10%	0.13000
76-100% – 26-50%	-0.22280
76-100% – 10-25%	-0.22180
76-100% – 51-75%	-0.11383
76-100% – <10%	0.01618

Percentage Free and Reduced-price Lunch Eligibility

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	1152.6149	230.5230	7.81	<.0001
Error	28892	853154.6958	29.5291
Corrected Total	28897	854307.3107

Percent Qualified for Free and Reduced Lunch	Difference Between Means	Sig. at 0.05
10-25% – 26-50%	0.08698
10-25% – <10%	0.21496
10-25% – 51-75%	0.27916
10-25% – 76-100%	0.43036	***
26-50% – 10-25%	-0.08698
26-50% – <10%	0.12798
26-50% – 51-75%	0.19218
26-50% – 76-100%	0.34338	***
<10% – 10-25%	-0.21496
<10% – 26-50%	-0.12798
<10% – 51-75%	0.06421
<10% – 76-100%	0.21540
51-75% – 10-25%	-0.27916
51-75% – 26-50%	-0.19218
51-75% – <10%	-0.06421
51-75% – 76-100%	0.15120
76-100% – 10-25%	-0.43036	***
76-100% – 26-50%	-0.34338	***
76-100% – <10%	-0.21540
76-100% – 51-75%	-0.15120

Percentage SPED Eligibility

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	1505.1403	301.0281	10.2	<.0001
Error	28892	852802.1704	29.5169
Corrected Total	28897	854307.3107

Percent of Students Eligible for Special Education	Difference Between Means	Sig. at 0.05
<10% – 76-100%	-0.56994	***
<10% – 26-50%	-0.05191
<10% – 10-25%	0.01840
<10% – 51-75%	0.73072
76-100% – <10%	-0.51803	***
76-100% – 26-50%	0.05191
76-100% – 10-25%	0.07031
76-100% – 51-75%	0.78263
26-50% – <10%	-0.58834	***
26-50% – 76-100%	-0.07031
26-50% – 10-25%	-0.01840
26-50% – 51-75%	0.71232
10-25% – <10%	-1.30066	***
10-25% – 76-100%	-0.78263
10-25% – 26-50%	-0.73072
10-25% – 51-75%	-0.71232
51-75% – <10%	0.51803	***
51-75% – 76-100%	0.56994	***
51-75% – 26-50%	0.58834	***
51-75% – 10-25%	1.30066	***

Placement Length

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	6	3161.5618	526.927	17.89	<.0001
Error	28891	851145.7489	29.4606
Corrected Total	28897	854307.3107

Length of Placement	Difference Between Means	Sig. at 0.05
21-30 – 31-40	0.51425	***
21-30 – 11-20	0.66752	***
21-30 – 1-10	0.77705	***
21-30 – 41+	0.89937	***
21-30 – 0	2.15717	***
31-40 – 21-30	-0.51425	***
31-40 – 11-20	0.15327
31-40 – 1-10	0.26280
31-40 – 41+	0.38512
31-40 – 0	1.64292	***
11-20 – 21-30	-0.66752	***
11-20 – 31-40	-0.15327
11-20 – 1-10	0.10953
11-20 – 41+	0.23185
11-20 – 0	1.48965	***
1-10 – 21-30	-0.77705	***
1-10 – 31-40	-0.26280
1-10 – 11-20	-0.10953
1-10 – 41+	0.12231
1-10 – 0	1.38012	***
41+ – 21-30	-0.89937	***
41+ – 31-40	-0.38512
41+ – 11-20	-0.23185
41+ – 1-10	-0.12231
41+ – 0	1.25780	***
0 – 21-30	-2.15717	***
0 – 31-40	-1.64292	***
0 – 11-20	-1.48965	***
0 – 1-10	-1.38012	***
0 – 41+	-1.25780	***

Preparation Route

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	5	2893.1767	578.6353	19.64	<.0001
Error	28892	851414.1340	29.4689
Corrected Total	28897	854307.3107

Teacher Preparation Route	Difference Between Means	Sig. at 0.05
Traditional EPP – Teach for America	0.45020
Traditional EPP - Alt – university or college-based program	0.83063	***
Traditional EPP - Alt – district provider	1.19551	***
Traditional EPP – Other	1.82625	***
Teach for America – Traditional EPP	-0.45020
Teach for America – Alt – university or college-based program	0.38043
Teach for America - Alt – district provider	0.74531
Teach for America - Other	1.37605	***
Alt – university or college-based program – Traditional EPP	-0.83063	***
Alt – university or college-based program – Teach for America	-0.38043
Alt – university or college-based program – Alt – district provider	0.36488
Alt – university or college-based program – Other	0.99561	***
Alt – district provider – Traditional EPP	-1.19551	***
Alt – district provider – Teach for America	-0.74531
Alt – district provider – Alt – university or college-based program	-0.36488
Alt – district provider - Other	0.63073
Other – Traditional EPP	-1.82625	***
Other – Teach for America	-1.37605	***
Other - Alt – university or college-based program	-0.99561	***
Other – Alt – district provider	-0.63073

Ethnicity

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	7	7198.8642	1028.4092	35.07	<.0001
Error	28890	847108.4465	29.3219
Corrected Total	28897	854307.3107

Post-Hoc Analyses

Ethnicity	Difference Between Means	Sig. at 0.05
Asian – White	-0.09432
Asian – Multiracial	0.08514
Asian – Hispanic	0.17042
Asian – Native American	1.19252
Asian – Black	1.92343	***
Black – White	-2.01775	***
Black – Asian	-1.92343	***
Black – Multiracial	-1.83829	***
Black – Hispanic	-1.75301	***
Black – Native American	-0.73092
Hispanic – White	-0.26474
Hispanic – Asian	-0.17042
Hispanic – Multiracial	-0.08528
Hispanic – Native American	1.02210
Hispanic – Black	1.75301	***
Multiracial – White	-0.17946
Multiracial – Asian	-0.08514
Multiracial – Hispanic	0.08528
Multiracial – Native American	1.10737
Multiracial – Black	1.83829	***
Native American – White	-1.28683
Native American – Asian	-1.19252
Native American – Multiracial	-1.10737
Native American – Hispanic	-1.02210
Native American – Black	0.73092
White – Asian	0.09432
White – Multiracial	0.17946
White – Hispanic	0.26474
White – Native American	1.28683
White – Black	2.01775	***

*** Comparisons significant at the 0.05 level

Primary Language

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	2	91.9597	45.9799	1.56	0.2111
Error	28895	854215.3509	29.5627
Corrected Total	28897	854307.3107

Gender

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	1	8526.6053	8526.6053	291.75	<.0001
Error	28558	834632.2180	29.2259
Corrected Total	28559	843158.8232

Post-Hoc Analyses

Gender	Difference Between Means	Sig. at 0.05
Male – Female	-1.34252	***
Female – Male	1.34252	***

*** Comparisons significant at the 0.05 level

Education Level

ANOVA

Source	DF	Sum of Squares	Mean Square	F Value	Sig*
Model	3	476.1009	158.7003	5.37	0.0027
Error	28894	853831.2097	29.5505
Corrected Total	28897	854307.3107

Post-Hoc Analyses

Education Level	Difference Between Means	Sig. at 0.05
Doctorate – Bachelor's/Bachelor's plus	-0.50405
Doctorate – High school/Some college	-0.35767
Doctorate – Master's/Master's plus credits	-0.04483
Bachelor's/Bachelor's plus – Doctorate	0.50405
Bachelor's/Bachelor's plus – High school/Some college	0.14638
Bachelor's/Bachelor's plus – Master's/Master's plus credits	0.45923	***
High school/Some college – Doctorate	0.35767
High school/Some college – Bachelor's/Bachelor's plus	-0.14638
High school/Some college – Master's/Master's plus credits	0.31285	***
Master's/Master's plus credits – Doctorate	0.04483
Master's/Master's plus credits – Bachelor's/Bachelor's plus	-0.45923	***
Master's/Master's plus credits – High school/Some college	-0.31285	***

*** Comparisons significant at the 0.05 level

Top of Page

Cut Score	All	Not Provided	Male	Female
35	94	94	91	94
36	92	92	88	93
37	90	89	86	91
38	88	86	83	89
39	85	84	80	87
40	83	80	77	84
41	78	76	72	80
42	74	73	67	75

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	94	89	93	96	93	94	94	93	93
36	92	87	90	95	92	92	93	91	90
37	90	85	89	93	90	90	90	88	88
38	88	81	84	91	88	88	88	86	85
39	85	79	82	88	85	86	86	84	83
40	83	75	81	85	82	83	84	80	80
41	78	69	78	80	79	79	79	76	76
42	74	62	73	76	74	74	75	72	70

Cut Score	All	Not Provided	Male	Female
35	94	94	91	94
36	92	92	88	93
37	90	89	86	91
38	88	86	83	89
39	85	84	80	87
40	83	80	77	84
41	78	76	72	80
42	74	73	67	75

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	94	89	93	96	93	94	94	93	93
36	92	87	90	95	92	92	93	91	90
37	90	85	89	93	90	90	90	88	88
38	88	81	84	91	88	88	88	86	85
39	85	79	82	88	85	86	86	84	83
40	83	75	81	85	82	83	84	80	80
41	78	69	78	80	79	79	79	76	76
42	74	62	73	76	74	74	75	72	70

Cut Score	All	Not Provided	Male	Female
35	94	94	91	94
36	92	92	88	93
37	90	89	86	91
38	88	86	83	89
39	85	84	80	87
40	83	80	77	84
41	78	76	72	80
42	74	73	67	75

Cut Score	All	African American/Black	American Indian or Alaskan Native	Asian or Pacific Islander	Hispanic	White	Multiracial	Other	Undeclared
35	94	89	93	96	93	94	94	93	93
36	92	87	90	95	92	92	93	91	90
37	90	85	89	93	90	90	90	88	88
38	88	81	84	91	88	88	88	86	85
39	85	79	82	88	85	86	86	84	83
40	83	75	81	85	82	83	84	80	80
41	78	69	78	80	79	79	79	76	76
42	74	62	73	76	74	74	75	72	70