Evaluate and Reflect

Evaluate and Reflect

Analyze data across the metrics included in the pilot success statement. Co-interpret analysis results with pilot participants, including students, to thoughtfully determine whether the pilot met the established goals. Share elements of the pilot process that were a success to repeat in future pilots. Reflect on challenges in the pilot process to determine how to improve or replace these difficulties to improve future pilots.

Strategies for Evaluate and Reflect

• Analyze the data across the relevant metrics. Determine whether the summative learning outcomes met the success statement. If possible, consider the formative assessment results throughout the school year to better understand the product’s impact on learning. Consider whether the experiences data met the expectations described in the success statement.
• With the district staff, school leaders, educators, and students involved in the pilot, co-interpret the analysis results. Ask participants if the analysis aligns with their experiences and perspectives, and create space for participants to share how the analysis might differ from their experience. Collaboratively determine whether the pilot was successful, and if that means expanding use of the product across more classrooms or schools.
• Learn from pilot participants which components of the pilot process were successful and should be repeated in future pilots. Similarly, learn where participants’ greatest challenges in the pilot process were and determine how to modify or replace those elements to iteratively improve for future learning experiences.