September 17, 2012
FROM: Office of Accountability and Assessments
TO: Science Coordinators and Teachers of Grade 5 and 8 Science, and Biology I
RE: 2012-13 Grades 5 and 8 Science and EOI Biology I Assessments
Science testing within the State of Oklahoma has been in a state of transition since the adoption of new academic standards in spring of 2011. The purpose of this memo is to clarify changes which have occurred to the science assessments since the new academic standards were adopted and to communicate the testing plan for the Science 2012-13 testing year. The following summary explains the changes which have an impact upon testing.
A change in academic standards:
- During 2010-11 the Science Priority Academic Student Skills (PASS) standards were revised by committees of Oklahoma teachers and community stakeholders and were adopted by the Oklahoma State Board of Education in Spring 2011. These new science standards, PASS (revision 2011), replaced the science standards which had been previously taught in Oklahoma classrooms since 2002.
- When new academic standards and objectives are implemented, assessments go through a transition period. During this transition time, new test questions are developed and field tested in order to meet the blueprint criteria for alignment. It takes at least one year before the criteria for test alignment to the new standards can be completely met.
- Science assessments administered during School Year 2011-12 contained both operational (scored) items based upon PASS 2002 and field test (non-scored) items based upon PASS (revision 2011).
- Upon receiving the USDE No Child Left behind (NCLB) waiver, Science PASS (revision 2011) standards and objectives were renamed the Oklahoma C3 Science Standards. Currently, Oklahoma C3 Science Standards are comparable to the PASS (revision 2011) standards.
- During SY 2012-13, both operational and field test items will be referenced as the Oklahoma C3 Science Standards (revision 2011).
A change in rigor:
- Under direction from the United States Department of Education (USDE), the State science assessments have continued to require Oklahoma science students to use higher level thinking skills. The OCCT Grade 8 science and Biology I assessments have increased the cognitive demands on students from previous years.
- The following Depth-of-Knowledge(DOK) transition chart illustrates the gradual increase in cognitive demand on the OCCT science assessments:
OCCT Science Assessments DOK Transition
DOK Level/Admin |
Grade 5 Science |
Grade 8 Science |
EOI Biology I |
SY 2010-2011 |
|||
1 |
20%-25% |
10%-15% |
10%-15% |
2 |
65%-70% |
65%-70% |
60%-70% |
3 |
5%-15% |
15%-25% |
15%-25% |
SY 2011-2012 |
|||
1 |
20%-25% |
10%-15% |
10%-15% |
2 |
65%-70% |
60%-70% |
55%-65% |
3 |
5%-15% |
15%-30% |
25%-30% |
SY 2012-2013 |
|||
1 |
20%-25% |
10%-15% |
10%-15% |
2 |
65%-70% |
60%-70% |
50%-60% |
3 |
5%-15% |
20%-30% |
30%-40% |
- For SY 2012-13, the OMAAP science assessment DOK will remain at the 2011-12 level as illustrated below in the OMAAP Depth-of-Knowledge (DOK) chart.
OMAAP Science Assessments DOK
DOK Level/Admin |
Grade 5 |
Grade 8 |
Biology I |
SY 2011-2012 |
|||
1 |
20%-25% |
10%-15% |
20%-25% |
2 |
65%-70% |
65%-70% |
60%-65% |
3 |
5%-15% |
15%-25% |
10%-15% |
SY 2012-2013 |
|||
1 |
20%-25% |
10%-15% |
20%-25% |
2 |
65%-70% |
65%-70% |
60%-65% |
3 |
5%-15% |
15%-25% |
10%-15% |
A change in Achievement Standards:
- The science academic standards revision of 2010-11 resulted in new objectives and skills being added at each assessed level for Grades 5 and 8. Specifically for Biology I, the objective realignment resulted in one less content standard, while other standards gained objectives.
- The academic standards define the content and processes which will be covered on the OCCT and OMAAP tests. A committee of Oklahoma science teachers and science curriculum experts met and revised the OCCT and OMAAP test blueprint. Therefore, the emphasis changed to align with the new Oklahoma C3 Science Standards (revision 2011).
- When the academic content and emphasis of the OCCT and OMAAP Grades 5 and 8 science change, student performance level expectations also change.
- Given the number of changes, the old cut score may not adequately capture student performance. Thus, science standard setting committees will meet following Spring 2013 testing. These committees of content experts will be tasked with (1) evaluating the reasonableness of the current cut scores given the changes, (2) establishing new performance levels as needed, and (3) setting new cut scores for the OCCT grades 5 and 8 science, and Biology I assessments.
What do these changes mean for Oklahoma students and science during SY 2012-13?
OCCT Grades 5 and 8 Science
- Instruction should focus on the new Oklahoma C3 Science Standards (revision 2011) for the 2012-13 school year.
- Spring 2013 Grades 5 and 8 science tests will assess the Oklahoma C3 Science Standards (revision 2011).
- The Oklahoma C3 Science Standards (revision 2011) reflect content changes; therefore, Grades 5 and 8 students will receive individual scores on these tests following the early June standard setting.
- For 2012-13, the test results will be used in calculations for the A-F Report Card.
OCCT and OMAAP Biology I End-of-Instruction (EOI)
- Instruction should focus on the Oklahoma C3 Science Standards (revision 2011) for the 2012-13 school year.
- The 2012-13 Biology I EOI test will assess the Oklahoma C 3 Science Standards (revision 2011).
- Students’ scores will be based on operational items aligned to both the process and content standards and will follow the established 2012-13 test blueprint. Field test items do not contribute to student scores.
- For 2012-13, the test results will be used in calculations for the A-F Report Card.
Optional Re-Test and Winter/Trimester Test Windows (Biology I EOI only)
- Second time testers who received instruction prior to this school year should participate in the Optional Retest Window before the traditional Winter/Trimester Window where they will be administered a test aligned to the prior PASS Biology I Standards (version 2002) and previous DOK levels.
- Students participating in the optional re-test window will receive a performance level score three working days following the close of the Trimester testing window.
- Students enrolled in Biology I for the first time during SY2012-13 will be administered an assessment based on the Oklahoma C3 Science Standards (revision 2011) during the traditional Winter/Trimester Window.
- Students participating in the traditional Winter/Trimester Window will receive a score following the June 2013 standard setting.
- The Office of Accountability and Assessments recommends:
Instructional Year |
Assessment Version |
Availability of Results |
Online OCCT Second Time Test Takers (Students who received science instruction prior to fall of 2012, including those who need a read-aloud accommodation*). |
|
Online – Three working days after the close of the Winter/Trimester testing window |
Online OCCT First Time Test Takers (Students who receive instruction fall of 2012 and thereafter). |
|
Online – late June 2013 |
Paper/Pencil OCCT and OMAAP |
|
Paper/Pencil – late June 2013 |
*Second Time Test Takers who need both a read-aloud accommodation and a performance score prior to June 2013 in order to meet graduation requirements, should take the online version of the test during the retest window. Either a text-to-speech functionality will be available for the online test or a small group read-aloud could be arranged by the Building Test Coordinator. Call the Office of Accountability and Assessments, (405) 521-3341, to find out more information regarding this option.