Tuesday, March 3, 2009

Black Box or Glass Box?

Input PD - [transfer to classroom- changes in students]- output student achievement

What is in my [Glass box]?
-Coaching and follow up (Joyce and Showers research)
-Instructional Resources
-Implementation Monitoring-Is there a clear definition of alignment? evidence? data? What have I learned about implementation? What works well? What needs to change?
-Student Assessment
-Examining Student Work

8 Steps for Assessing Impact

What do I expect to learn from this? What is my question? What is the purpose? What type of data will I collect?

PLANNING
1. Assess Evaluability- Is this program ready?
2. Formulate Evaluation Questions- What structure will I use to focus my data collection?
3. Construct Evaluation Framework- What do I need to know? How will I know? What will it tell me? How will I collect the data?

CONDUCTING
4. Collect Data- How will I pilot? Manage? Score? Train collectors?
5. Organize and Analyze Data- How will I display it?
6. Interpret Data- What does the data say?

REPORTING
7. Disseminate Findings-Who are the audiences I need to communicate with?
8. Evaluate the Evaluation- How can future evaluations be improved?