Data Analysis & Use
Data analysis and use or “data-driven decision making” is a critical aspect of quality service provision from the student level – collecting and responding to formative and summative data and making instructional and service decisions to address strengths and needs – to the school building, agency, district and community, and state level – collecting and responding to data on the effectiveness of programs and processes to make policy, funding, and other systems level decisions.
Collecting, analyzing, and using data in meaningful ways at the student level are important aspects of Transition Planning and a critical component of efforts to increase the likelihood of Graduation. The resources located in this area of NTACT’s website are focused on systems level (schools, districts, community agencies, councils, state agencies) analysis and use of data to improve the quality of transition education and services.
State Performance Plan (SPP)/ Annual Performance Report (APR) Part B Indicator Data Collection, Analysis, and Use
The U.S. Department of Education’s Office of Special Education Programs (OSEP) annually collects data from every State and U.S. Territory on indicators of compliance with the Individuals with Disabilities Education Act (IDEA, 2004) and results of program efforts. Several of these indicators relate closely to the secondary education and transition services for students with disabilities. See the Tree of Influence document, originally developed by the Western Regional Resource Center, for a visual of the relationship of Indicators. The most current guidance on this and all SPP/APR Indicators is available at osep.grads360.org. A PowerPoint presentation overviewing the transition-related Indicators and their relationship is available here: Transition Indicators 101.
The State Toolkit for Examining Post-School Success (STEPSS) is a web-based data-based decision making tool designed to support state departments of education in disseminating and using data related to secondary transition (SPP Part B Indicators 1, 2, 13, and 14) to improve in-school transition programs for youth with disabilities. STEPSS was developed by the National Post-School Outcomes Center, the National Secondary Transition Technical Assistance Center, and the National Dropout Prevention Center for Students with Disabilities in 2013. It continues to be updated and maintained by NTACT. A Facilitator’s Guide for using STEPSS provides additional information on STEPSS. For more information or support regarding STEPSS, please contact Charlotte Alverson, email@example.com
See the Core Data Tools for Dropout Prevention
Indicator B-1is the proportion of youth with disabilities in a cohort who graduate from high school with a regular diploma within four years. An example of this calculation is shown below.
# of cohort members receiving a regular HS diploma by end of the 2012-13 school year
# of first-time 9th graders in fall 2009 (starting cohort) + transfers in – transfers out – emigrated out – deceased during school years 2009-10 through 2012-13
States are permitted to calculate extended-year cohorts that credit youth who took five or more years to graduate. If this is offered, the extended rate is calculated for all students—not just students with disabilities.
Data and performance targets for this Indicator are the same used for reporting to the Department under Title I of the Elementary and Secondary Education Act (ESEA). Previous analysis of State performance on Indicator 1 can be reviewed in the Indicator B-1 Summary.
See the Core Data Tools for Dropout Prevention
Indicator B-2 is the proportion of students with disabilities, ages 14 – 21, who exited high school by dropping out during a particular year compared with the total number of students with disabilities who exited high school during that year. An example of this calculation is shown below.
# of youth (ages 14-21) who exited by dropping out during the 2012-13 school year
# who graduated with a regular high school diploma + received a certificate + reached maximum age + dropped out + deceased during the 2012-13 school year
The data used for this Indicator are the same as reported under Section 618. In recent years, states have been allowed to report their dropout rates using whatever rate they had previously been using. In years past, the majority of states have reported an event rate (single year proportion), followed in frequency by adjusted cohort rates (similar in nature to the graduation rate calculation), the above described OSEP exiter rate, and other leaver/cohort type rates. Previous analysis of State performance on Indicator 1 can be reviewed in the Indicator B-2 Summary.
- Resources for Indicator B-2: Dropout Rate
Summary report on all States' FFY 2011 Annual Performance Report Data for OSEP Indicator B2 - dropout rate for students with disabilities. NDPC-SD
The National Secondary Transition Technical Assistance Center (NSTTAC) developed an Indicator Checklist, in consultation with the OSEP in 2006 and updated it in 2009 and 2012. This checklist is not required, but offers states and districts an OSEP-approved resource for data collection and use.
This form is designed to meet the minimum requirements for collecting and reporting data on Indicator 13 of the Part B State Performance Plan and Annual Performance Report. It allows a school, district, or state to review the data for each item simultaneously across all postsecondary goal areas.
This multiple column form meets the requirements for collecting and reporting data on Indicator 13, allows a school, district, or state to more deeply analyze professional development and program change needs by providing data on each item for each postsecondary goal area.
Student Case Study Examples & Non-Examples
Due to future changes (Optional in 2019 reporting, required in 2020 reporting) in the data collection and reporting for Indicator B-14 with regard to competitive integrated employment, NTACT is currently updating guidance, products, and resources, in cooperation with OSEP. We will post resources here, as soon as they are available and will announce them through our listserv and our technical assistance partners. If you have questions, please submit those via email to firstname.lastname@example.org or contact Charlotte Alverson, email@example.com.
Indicator B-14 are the data collected regarding the percent of youth who are no longer in secondary school, had IEPs in effect at the time they left school and were: (a) enrolled in higher education within one year of leaving high school, (b) enrolled in higher education or competitively employed within one year of leaving high school, or (c) enrolled in higher education or some other postsecondary education or training program; or competitively employed or in some other employment within one year of leaving high school.” (20 U.S.C. 1416(a)(3)(B))
Resources for Collecting Indicator 14 Data
- Branding Your Post-School Outcomes Data Collection Process
- Contacting Hard to Find Youth
- Data Collection Questions Bank
- Data Collection Protocol
- Embedding Data in SLDS
- Indicator 14 Data Dictionary
- Indicator 14 Measurement Table and FAQs
- Indicator 14 Measurement Table and FAQs Presentation
- Instructions for the Response Calculator
- Response Calculator
- Response Rates and Nonresponse Bias
- Strategies for Increasing Response Rate
- Survey Protocol
- Training Interviewers Guide
Resources for Analyzing and Using Indicator 14 Data
- Data Display Template
- Data Display Template Revised Blank
- Multi-Year Trend Data Display
- Trend Data Template Blank
- Trend Data Template Instructions
- Trend Data Template Sample
- Writing Suggestions
- Data Display Template
Provides explanation and instructions for completing the NPSO Indicator 14 Data Display Templates Revised to Include Not Engaged.
- Embedding Data in SLDS
Provides explanation and checklist for embedding Indicator 14 data into the statewide longitudinal data system
- Tips for Parent Centers - PSO Surveys
Provides an explanation of the Indicator 14 Post-School OUtcomes Survey and how parent centers can promote it to school districts and parents
- Tip Sheet for SEAs Engaging Parents and Family Members in Post School Outcome Stakeholder Groups
Provides suggestions for involving family members in stakeholder groups to increase annual response rates for the Post-School Outcome Survey
The State Systemic Improvement Plan (Indicator Part B-17 of the SPP/APR) is “a comprehensive, ambitious, yet achievable multi-year plan for improving results for children with disabilities” and consists of three phases, beginning with the identification of a State Identified Measurable Result (SIMR), submitted to OSEP in April, 2015. NTACT is partnering with the National Center on Systemic Improvement Website for NCSI and the IDEA Data Center Website for IDC to assist States as they select and initially implement improvement activities and develop evaluation plans in phases 2 and 3 of the SSIP. Specifically, NTACT will assist States focused on Graduation or Post-School Outcomes as their SIMR and participate in NCSI's Graduation and Post-School Outcomes State Learning Collaborative. For specific guidance and assistance from NTACT, please contact us firstname.lastname@example.org. For more information about the SSIP from OSEP, visit osep.grads360.org.
The National Dropout Prevention Center for Students with Disabilities originally developed a set of Excel-based data tools to help districts and schools organize, examine, analyze, and share their data that impact graduation and dropout rates. NTACT will continue to update and provide technical assistance for use of these tools, which can support a school team’s work carrying out a root cause analysis of the factors that impact school completion rates. They also can inform the development and evaluation of a local intervention plan. For additional guidance in using these tools, contact Dr. Matthew Klare with NTACT, RiskCalculations@uncc.edu.
- Discussion Guide for the Dropout Data Tools
- Core Dropout Data Tool
- Academics Tool (Middle School)
- Academics Tool (High School)
- Attendance Tool (Middle School)
- Attendance Tool (High School)
- Discipline Tool (Middle School)
- Discipline Tool (High School)
- Graduation & Dropout Data Tool (Middle School)
- Graduation & Dropout Data Tool (High School)
NTACT is charged to assist State Education Agencies, State Vocational Rehabilitation Agencies, and local education and service provider agencies and communities with using quality data to make decisions regarding programming and policies that improve outcomes for students with disabilities. The Evaluation Toolkit, originally developed by the National Secondary Transition Technical Assistance Center is resource to assist educators and service providers to improve programs by determining what is working and not working with specific sample tools and guidance.
Interdisciplinary Team Planning Tool
NTACT assists state and local interagency teams in developing strategic plans to improve secondary transition education and services, using an online planning tool. This planning may include the use of the STEPSS tool, the QI-2, the Dropout Data Tools to inform the planning process. The transitionprogramtool.org includes the capacity to house data from other sources – including some of the data displays for Part B Indicator Data from NTACT, data from the VR State Plan, as well as other sources of data relevant to transition education and outcomes. Transitionprogramtool.org walks teams through a process of a needs assessment through the development of actionable goals including clearly delineated opportunities to measure progress. For more information on accessing the planning tool as a state or local team, contact Dr. Catherine Fowler with NTACT, email@example.com.
Logic Model Resources
- Process Agenda for Logic Model Development
- Participant Agenda for Logic Model Development
- PowerPoint Starter for Logic Model Development Work Day
- Logic Model Activity
- Response Cards for Logic Model Activity
- Logic Model Template
- Logic Model Checklist
- Logic Model Development Evaluation Template
The QI-2 is a self-assessment instrument designed to help determine the most critical needs within a transition program, across 7 transition domains. It is available at www.transitioncoalition.org under "Tools".
The Risk Calculator is an online data-based tool, modeled off of the Dropout Prevention Data Analysis Tools, to examine student level data and design appropriate interventions to increase graduation and decrease dropout risk, accordingly. For further information and to setup an account for the Risk Calculator, please contact RiskCalculations@uncc.edu
- Draft Users Guide
- End User License Agreement
- Required Data
- Hidden Data Fields
- Sample Data Template
- Spreadsheet of Required Data for Tool Use
State Toolkit for Examining Post-School Success (STEPSS)
STEPSS is a web-based data-based decision making tool designed to support state departments of education in disseminating and using data related to secondary transition (SPP Part B Indicators 1, 2, 13, and 14) to improve in-school transition programs for youth with disabilities. STEPSS was developed by the National Post-School Outcomes Center, the National Secondary Transition Technical Assistance Center, and the National Dropout Prevention Center for Students with Disabilities in 2013. It continues to be updated and maintained by NTACT. A Facilitator’s Guide for using STEPSS provides additional information on STEPSS. For more information or support regarding STEPSS, please contact Charlotte Alverson, firstname.lastname@example.org
The National Secondary Transition Technical Assistance Center (NTACT) has developed a tool to help schools organize and track their data related to the various transition activities they provide to their students. This Excel-based tool is organized around major areas from the NTACT Predictors of Post-School Success. Its drop-down menus provide users with a quick means of recording the activities a student has participated in as well as the dosage of each activity that student received. The tool also tracks some of the factors that put a student at risk of dropping out. It generates a printable, one-page summary for each student, which can be shared with parents, teachers, or members of an IEP team/transition team. Questions or for possible customization of the tool, contact: RiskCalculations@uncc.edu.
Vocational Rehabilitation Data
View this PowerPoint presentation for guidance on the use of VR data sources for program improvement. Using VR Data (source from National Capacity Building Institute, Fabian & Neubert, 2015)
ExploreVR is part of the Vocational Rehabilitation Research and Training Center (VR-RRTC) at the Institute for Community Inclusion at UMass Boston. The VR-RRTC is funded by the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) and the Rehabilitation Services Administration (RSA) of the US Department of Education. ExploreVR a web application accessing a range of VR and related data to assist in planning, evaluation, and decision-making. Learn more by visiting ExploreVR.org.
Tell us what you think! Were you looking for something you didn’t find? email@example.com