The questions below were directed to Joyce Zurkowski, Unit Supervisor of Assessments at the Colorado Department of Education, for the purpose of better understanding PARCC and CMAS, the Colorado State standardized high-stakes tests. My original questions appear in red. Ms. Zurkowski’s responses appear in blue italics. I have included additional commentary is shown below Ms. Zurkowski’s responses.
Dear Ms. Zurkowski,
As you may know, I have been working to advise parents on their rights to refuse state standardized tests since I first administered the CSAP test to my fourth grade class in 1997. Given that socio-economic status is the number one correlating factor to test performance, any accountability tied to test scores further institutionalizes inequities in our education system and narrows both curriculum and opportunities for students.
I understand this year there will be some changes to statewide assessments and I would like to be sure the information I share with others is accurate and verifiable. If you could please answer the questions below in a timely fashion, I would appreciate it. Please be advised the responses to these questions will be shared publicly.
In the 2014/2015 school year, what assessments will be required for districts to administer? What is the assessment schedule?
2014 – 2015 School Year Tentative State Testing Windows (http://www.cde.state.co.us/assessment/generalinfo)
|CMAS and CoAlt: Science and Social Studies||12||11/03/14 to 11/21/14|
|CMAS: PARCC Performance-Based Assessment (PBA)*||3-8, High School||3/09/15 to 4/03/15|
|CMAS and CoAlt: Science and Social Studies||4 and 7 (Social Studies)5 and 8 (Science)||4/13/15 to 5/01/15|
|CMAS: PARCC End-of-Year Assessment (EOY)*||3-8, High School||4/27/15 to 5/22/15|
|CoAlt: DLM||3 – 11||4/13/15 to 5/15/15|
|ACCESS for ELLs®||Grade||Tentative Windows|
|Reading, Writing, Speaking and Listening||K-12||1/12/15 to 2/13/15|
|CO ACT||Initial Test Date||Make-up Test Date|
|Grade 11||Tues., April 28, 2015||Tues., May 12, 2015|
|11th Grade Alternate Assessment (ESSU)||Test WindowMarch 30 to April 24, 2015||Score EntryApril 27 to May 8, 2015|
This 2014-2015 Testing windows graph does not include School Readiness assessment (62 pages, mandated by CAP4K) or READ Act assessments.
Also, not included are “local interim assessments” needed to get points on School Performance Framework required for Colorado’s Performance Pay Model, SB191.
Attached is a document that has estimated testing times (provided in this link). PARCC is reviewing testing times based on the field test. It is expected that there will be some reductions for English language arts. Final testing times for spring 2015 should be available by the end of September.
|The 2014 Draft APA Report on Assessment Use in Colorado Districts and Schools listed actual seat time at more than 72 hours for nine and ten-year olds in the fourth grade (pg. 24). While 49 hours is the average amount of time a student spends on state mandated standardized tests each year (this does not include formative or informal assessments), the Graduate Record Exam, GRE, requires only 3.45 hours for adults applying to graduate school. The LSAT, required for entrance into law school, averages four hours. The 2012 READ Act dramatically increased testing for young children in the primary grades between kindergarten and third grade. Testing time has tripled in grades 3-5 between 2012 and 2014. It is also important to note that the congressionally mandated standardized test, NAEP (National Assessment of Educational Progress) is not included in these time estimates. NAEP is administered each year in all 50 states to a representative sampling and has been providing valid and reliable data on student performance since 1969. |
Have these assessments been independently evaluated for validity and reliability? Moving forward who will review these assessments and when?
Both PARCC and CDE have technical advisory committees with assessment development, psychometric, and special populations experts. These types of committees provide guidance and input throughout the development of state assessments. Assessments are developed in accordance with professional standards such as those published by the American Education Research Association. Historically, the federal department of education has required that all states submit evidence of the technical quality of their assessments to panels of assessment experts. Guidance on the types of information that historically had to be provided may be found here:
Colorado’s approval letter for its prior assessment system may be found here:
Documents provided here are dated 2007 and have no relationship to PARCC. They also only relate to the “development” of the test. The truth is that PARCC, like the CSAP, TCAP, and CMAS before it, have NO published independent studies supporting the validity or reliability of the test. This means they are testing kids with tools that have NEVER been tested. This violates all statistical scientific principles for compiling evidenced based research and constitutes experimentation, not accountability. If the measurement tool is invalid and unreliable, then all of the data collected from that tool is invalid and unreliable.
The letter provided by Ms. Zurkowski is dated 2006, written over eight years ago. Still it provides a piece of key information:
“Please be aware that approval of Colorado’s standards and assessment system under NCLB is not a determination that the system complies with Federal civil rights requirements, including Title VI of the Civil Rights Act of 1964, Title IX of the Education Amendments of 1972, Section 504 of the Rehabilitation Act of 1973, Title II of the Americans with Disabilities Act.”
Today’s testing reforms do not have to comply with Federal civil rights requirements. Previous laws passed to ensure equity and justice for children in public education is not included in current testing practices. If you are wondering why testing has led to greater achievement gaps and fewer gains for children of color and those with special needs, here lies your explanation. Testing reforms require equality in outcomes without any regard for the inequalities in opportunity. These testing reforms have shifted scarce resources previously directed at early prevention and intervention towards the singular goal of measurement.
The long bill passed by the General Assembly in 2014 allotted:
According to the 2014 APA Draft study, total direct assessment costs incurred by schools, districts, and the State are up to $130,000,000 million dollars annually (p. 30). Still these direct costs do not include:
- capacity costs (i.e., IT costs such as computer hardware, bandwidth)
- opportunity costs: professional development, IT staff time, managing logistics, managing parent refusals/opt out, or data and reporting (pp 26-28):
While Colorado is adding more tests, they are simultaneously cutting more teachers. According to the Colorado School Finance Project in the two years between 2010 and 2012, Colorado added 18,600 students and subtracted 1,040 teachers.
Several studies have indicated a significant rise in mental illness among youth particularly in the areas of depression and anxiety. Do schools collect any data related to a student’s psychological or mental health? Is data collected related to suicides and suicide attempts?
This is not data collected by CDE.
Colorado has one of the highest suicide rates in the nation. In 2012 there were 41 youth between the ages of 15-19 that took their lives. While suicide has not been correlated to testing, countries like Japan and China who have high pressure and high stakes educational systems have significantly higher suicide rates among youth. Colorado’s suicide rate increased 16.7 percent from 2012 to 2013 alone.
Dr. Gary Thompson, clinical pediatric psychologist, shared the following list gathered from peer review research:
Student concerns correlated to testing:
- Decreased motivation
- Heightened levels of stress
In a study published by Journal of Education and Training Studies, Nicole Makas Colwell, concluded “research has long indicated that test anxiety impairs student performance.”
This may explain why testing reforms have led to lowered student performance. The national average for SAT’s was 505 in the school year 1999-2000 the year before No Child Left Behind was enacted. In 2011-2012, the first class to graduate under high-stakes testing reforms, the national average dropped nearly ten points to 496.
Test reform failures go even further beyond the data. Young people are intrinsic learners; they come into this world naturally curious, with their own questions and a sense of wonder. This culture of high-stakes test reforms has shifted the direction of education. Students will learn and achieve for their own purposes, but they are much less likely to learn and achieve when the outcomes are prescribed and the purposes hijacked. Our education policies have forgotten that these are children, not data sets. They have brief and fragile childhoods and as a community we have a responsibility to honor and protect childhood as a time of joy and discovery. The greatest gains in our education system will be realized when we honor the whole child and approach learning from a place of opportunity, not punishments and sanctions.
Opting Out (4)
Will there be any imposed penalties to districts, schools, teachers, parents or students for test refusals?
Performance ratings are lowered one category when a school or district does not meet the 95% test participation rate in two or more content areas. Participation requires a valid score. There are reasons other than “refusal to participate” that classify records to count as non-participants. Requirements for participation are expected not to change for 2014-15. There are no other imposed penalties to districts, schools, teachers, parents or students at the state level.
According to Colorado Senate Bill 09-163, CDE has the discretion to adjust the calculations as it relates to determining performance ratings, see section 22-11-103(23) and 22-11-204(6)(c) below. As long as schools/districts provide written documentation of parent refusals, schools can appeal any drop in ratings or accreditation.
THE DEPARTMENT, BY POLICY, MAY DETERMINE WHETHER THE SCORES OF ONE OR MORE GROUPS OF STUDENTS ARE NOT APPROPRIATE TO BE USED IN MEASURING THE LEVELS OF ATTAINMENT ON THE PERFORMANCE INDICATORS, AS DEFINED IN SECTION 22-11-103(23) (p. 101).
THE DEPARTMENT MAY ADJUST THE CALCULATIONS SPECIFIED IN THIS SECTION AS NECESSARY TO TAKE INTO ACCOUNT STUDENTS FOR WHOM NO SCORE IS RECORDED ON THE STATEWIDE ASSESSMENTS. 22-11-204(6)(c) (p. 25).
Additional Opt Out resources can be found at my website: https://www.angelaengel.com/high-stakes-testing/resources
What is the process for parents who wish to request a review of their child’s test answer booklets and evaluation? What is the time frame parents can expect the test materials to be provided and who will supply the information?
The process for requesting information to be removed from a student’s permanent file is set by local boards of education and the local district.
Information on accessing and amending records under FERPA may be found at the following link:
Parents should be aware of the trend to collect student’s psychological information under the headings of biometric, psychometric, and psychosocial observations. Programs like Emergenetics are already in the classroom: they are a company specializing in “analyzing, identifying and leveraging the way people think and behave.”
PEARSON has also bought several ADHD diagnostic testing companies designed to measure brain function and behavior. (Many experts are concerned that Pearson will/has embedded this technology in their online tests and curricula.)
Project: BeReady is a personality survey and yet another example of the types of products Education Management Organization that reek of social engineering. According to their sales campaign they want to “use the test and a dashboard that will allow teachers and administrators to view and analyze both individual student and aggregated data.”
The process of removing information or correcting your child’s record is very difficult. Under FERPA a school only has to provide the record for review. If you are concerned about protecting your child’s privacy, your best recourse is limit the data collected and later shared on your child.
I understand the tentative and transitional nature of SB191- Performance Pay. How will a parent refusal to have their child tested affect a teacher’s performance rating in a district that has determined to use state test scores in calculating the performance of the teacher?
Based on state guidelines, local districts/schools determine the contribution of state assessments to teacher ratings. The impact of missing data will vary depending on how many students a teacher has the variance in student ability across the classroom, the weight of the assessments within the evaluation and local decisions on how the missing data will be handled.
|SB 191 was passed during the 2010 legislative session and requires that scores contribute 50 percent of individual teachers’ ratings There is no research that shows that tying teacher pay to students test scores improve outcomes. In fact the most recent scientific longitudinal study conducted by Vanderbilt University, provides the evidenced based research to reverse SB191. |
SB14-165 offers a temporary opportunity for local districts to uncouple state assessments from teachers’ evaluations and base evaluations on professional practice.
A Task Force charged with making legislative recommendations will be meeting until January 2015. You may forward suggestions here: firstname.lastname@example.org
To sign the petition to repeal SB 191 https://www.change.org/p/the-colorado-legislature-repeal-senate-bill-191-linking-standardized-test-scores-to-teacher-pay-and-performance
Please provide a position on the practice of requiring test participation as a condition of a child’s enrollment.
Some districts and some schools are “requiring” test participation as prerequisite to schools’ enrollment. As we know, access to public education is provided in the Colorado Constitution. The Supreme Court has consistently ruled in favor of parents’ rights in decisions to direct their children’s education. Please provide an official CDE position on the practice of requiring test participation as a condition of a child’s enrollment.
Enrollment and student registration protocols and policies are determined by local boards of education and local districts. CDE does not play any role in this process or its enforcement.
|District and school administrators who attempt to coerce or intimidate parental compliance for testing are acting on their own behalf and assuming legal liability. These districts and schools will soon discover that by not accepting parent refusals, which bear no consequences on summary scores, students may intentionally fail the tests, lowering summary scores. As school cultures grow more oppressive, they will be met with greater resistance. |
This is from the Colorado Association of School Boards (CASB) recent comprehensive memorandum regarding the legal requirements concerning state assessments:
“We do not believe districts can force students to take the state assessments over the students’ or their parents’ objections. We also do not recommend that districts prohibit students who opt out of state assessments from returning to school during the testing window.”
The state assessment vendors (ACT, CTB, Pearson, WIDA with the Wisconsin Center for Educational Research) have access to student data. In addition, a list of agreements that have been put into place since May 1, 2014 may be found at the below link:
Vendors included on this list are given access to your child’s personal identifiable information (pii), name, birth date, address and social security number. Listed are: Pearson, TS Gold, Diploma Sender, Department of Corrections, University of Virginia, CEI, CREDO, WIDA, Colyar, National Center for the Improvement of Educational Assessment, Inc, College Board, Amplify and the Colorado Department of Higher Education.
What is missing from the referenced list is all of the vendors that receive data through Federal channels. Also not included are the additional companies which vendors share student’s personal information. For example the Department of Higher Ed shares pii with WICHE, SHEEO and the Department of Labor.
Thank you to Cheri Kiesecker, a concerned Colorado parent, for providing detailed information related to the sharing of your child’s privacy. She has provided responses to the questions on privacy. Select this link for the full Colorado specific privacy brief.
The U.S. Dept. of Education is promoting a Data Driven Education; see their ed.gov report on neuroscience and biometrics of data collection, Promoting Grit Tenacity and Perseverance -see slide 62. Also see U.S. Dept of Ed’s document on Enhancing Teaching and Learning through data mining. The Big Data Project partners with edtech corporations who mine children’s data, with online apps like the “My Data Button.” Edtech companies rely heavily on the collection of meta data, as witnessed by this video of KNEWTON at the White House DataPalooza (Knewton is an edtech company, partnered with Pearson and currently in many Colorado schools, who collects millions of data points per child / per day.)
The Colorado Dept of Ed also partners with Informatica in making and sharing a Golden Record of each child’s personally identifiable data (data follows the child from preschool-k-to college). Watch the Golden Record video from Colorado Dept Ed. No parent has ever been able to access their child’s Golden Record.
Yes; the primary statute is FERPA; please see the resources found at: http://www.cde.state.co.us/cdereval/dataprivacyandsecurity. There is also a corresponding state law that references FERPA, in section 22-1-123, C.R.S.
This past state legislative session had data security legislation passed. Here is a link to HB 2014-1294:
The Definition of a student’s education record is defined here: http://nces.ed.gov/pubs97/web/97859.asp
There are three important laws related to the privacy of children: FERPA (Family Education Rights and Privacy Act of 1974), COPPA (Children’s Online Privacy Protection Act- this applies to children under 13 and online data collection) and PPRA (Protection of Pupil Rights Amendment). FERPA protections were weakened through rule change by the U.S. Education Joel Reidenberg’s testimony at a recent congressional hearing on student data privacy; these three privacy laws are often circumvented AND NEW LEGISLATION IS NEEDED TO PROTECT STUDENT PRIVACY.
If parents surrender health records, they are maintained by the local education agency (LEA). Tests done by the school psychologist for an IEP (including Pearson tests) become education records. Student Information Systems, like Pearson’s Power School or Edupoint’s Synergy, store education records for districts. As such, these businesses are authorized representatives to maintain the data, without parent/student approval.
For state assessment purposes, the state communicates with districts about sharing data with the state-contracted vendors. Districts may enter into their own contracts for their own purposes as well. However, those agreements are between each individual district and the vendor; those do not involve the state.
See the District Guidance at http://www.cde.state.co.us/cdereval/dataprivacyandsecurity
Parents are largely not aware that data about their children is collected and uploaded to Colorado’s P-20 Statewide Longitudinal Database (SLDS) (P-20 means pre-school through college). Colorado Education Data Analysis & Reporting System (CEDAR) that further shares this data broadly with state department and other agencies such as such as WICHE, SHEEO. The SLDS is a permanent record that includes much more than test scores. Over 400 data points are collected; for example, disciplinary and health data is uploaded to the State, who then can share that pii information to outside agencies and third parties. Much of this data is Social and Emotional in the form of photos, video, and behavioral observations /profiles, such as TS Gold. This mandatory preschool program collects information on three and four year olds including social, emotional and behavioral data points-38 different rubrics and much of it observational.
Is there any monitoring or evaluation process of the vendors receiving student data and how that data is used?
Yes; please see resources found at http://www.cde.state.co.us/cdereval/dataprivacyandsecurity
Education Management Organizations (EMO’s) and Edtech corporations stand to make billions of dollars from student data. Meta data (data generated when you are online) is a $3 trillion dollar industry. According to COPPA, children 12 years old and younger cannot have their personally identifiable information collected/shared by ANY online company (such as Pearson), without informed parental consent. If a parent is concerned about their child’s data being collected while logging onto any online app, test, learning game or curriculum, please see this PARENT OPT OUT of Online DATA collection form, referencing COPPA law. http://unitedoptout.com/2014/11/16/urgent-national-update-opt-out-of-all-online-testing-and-online-curriculum-for-under-age-13/
More on privacy can be learned at http://colohub.weebly.com/data-mining.html
I want to thank Joyce Zurkowski for answering my detailed list of questions. It is important to recognize that she is the messenger and not the decider. Education is very dynamic with hundreds of new policies introduced and adopted every year. There is often a great deal of confusion for teachers, students and parents around federal and state mandates as well as district policies. The information shared by school officials can sometimes be outdated or conflicting. I hope this helps to shed some light on the complexities around testing and promote clearer and more transparent policies that ultimately benefit the learners.
If you would like to learn more, please sign up for my newsletters at angelaengel.com.