100Kin10 R&D Shared Measures Annual Survey
100Kin10 R&D Shared Measures Annual Survey: Overview & Process
March 2015
Survey Design & Distribution Designed to gather deep, comparative information from our Partners about strategy, context, practices, research, and outcomes Organized to follow the six stages of a teacher’s professional life—recruitment, preparation, hiring, induction, development, and advancement Over 95% of eligible Partners responded, creating a nearly unprecedented body of data from 125+ organizations
2
The Process IMPROVE THE PROCESS Spring 2015+
LAUNCH THE PLATFORM
GATHER DATA
The analysis of the data is yielding TRENDS across the network, significant opportunities for Partners to LEARN FROM and work with one another in new and interesting ways, and deep and specific RESEARCH QUESTIONS.
In early 2015, 100Kin10 will launch an online RESEARCH AND LEARNING PLATFORM that will house the data and become a space that enables partners to learn from and with each other to improve their practice and instigate advancements across the STEM education landscape.
Winter 2015
SummerFall 2014
Spring 2014
CREATE THE CONTENT
A period of open review began with a PARTNER CONVENING in New York City in October 2013; over 100 Partners ENGAGED with and PROVIDED FEEDBACK on the drafts. 100Kin10 (with the assistance of survey expert – and 100Kin10 Partner – WestEd) incorporated all PARTNER INPUT to finalize the questions and build the SURVEY.
ANALYZE DATA
Partners working directly with teachers received the survey in two phases in the spring of 2014. Partners not working directly with teachers received just one phase. For this first year, Partners were asked to respond to the best of their ability with the data they currently collect. OVER 95% OF PARTNERS SHARED DATA.
Fall 2013Winter 2014
Summer 2013
Winter 2012– Spring 2013 100Kin10, working with FSG, engaged Partners in distilling a COMMON FRAMEWORK of the network’s shared measurement system that captures a STEM teacher’s professional life cycle. With participation by 85% OF PARTNERS, we shaped the Framework, which depicts the SIX STAGES OF A STEM TEACHER’S PROFESSIONAL LIFE CYCLE.
SOLICIT PARTNER FEEDBACK
LAUNCH “SHARED MEASURES”
With significant leadership from Partners, we populated each of the framework’s six stages with questions about programmatic processes, components, and outcomes. OVER 30 PARTNERS actively took part in the process by drafting or reviewing the survey’s foundational content.
We anticipate that this will be an annual data collection and learning process. Future versions will reflect lessons learned throughout the 201314 process as WE LISTEN TO FEEDBACK and DEVELOP MORE SOPHISTICATED AND INFORMED surveys. Going forward, our expectation is that all Partners will collect the data necessary to respond to the full survey.
3
Survey Contributors
4
Data Approval Summaries Each Partner received a summary of their data to approve for sharing. A cover page preceded the data, highlighting how the Partner stood out from the crowd during our data analysis and suggesting a few Partners who might be good collaborators (based on indicated challenges or interest areas). 100% of Partners agreed to share their data.
Cover Page
Data Approval Form
5
Enabling Learning from Data: Additional Partner Benefits COLLABORATE TOWARD INNOVATION Going out on a limb and trying something new and promising? With permission, we will connect partners who are experimenting with similar practices or complementary strategies. By taking on these new challenges together, partners can learn more and faster and push thinking across the field.
LEAPFROG PAST COMMON CHALLENGES Struggling with a particularly thorny situation? The data will point toward innovative solutions to common problems. 100Kin10 will host meetings to share new and effective approaches, allowing organizations, the network, and the field to leapfrog innovation.
DISCOVER EXEMPLARY PRACTICES
KNOW THE LANDSCAPE
Interested in staying up to date on emerging best practices or exceptional outcomes? With permission, we will share the work of exemplary organizations, highlighting what is working in the space.
Curious about the state of play in the field? We will aggregate data (none of which will be attributed) around central program practices and results, uncovering which processes and strategies are the most effective and result in the strongest outcomes. 6
March 2015
Survey Design & Distribution Designed to gather deep, comparative information from our Partners about strategy, context, practices, research, and outcomes Organized to follow the six stages of a teacher’s professional life—recruitment, preparation, hiring, induction, development, and advancement Over 95% of eligible Partners responded, creating a nearly unprecedented body of data from 125+ organizations
2
The Process IMPROVE THE PROCESS Spring 2015+
LAUNCH THE PLATFORM
GATHER DATA
The analysis of the data is yielding TRENDS across the network, significant opportunities for Partners to LEARN FROM and work with one another in new and interesting ways, and deep and specific RESEARCH QUESTIONS.
In early 2015, 100Kin10 will launch an online RESEARCH AND LEARNING PLATFORM that will house the data and become a space that enables partners to learn from and with each other to improve their practice and instigate advancements across the STEM education landscape.
Winter 2015
SummerFall 2014
Spring 2014
CREATE THE CONTENT
A period of open review began with a PARTNER CONVENING in New York City in October 2013; over 100 Partners ENGAGED with and PROVIDED FEEDBACK on the drafts. 100Kin10 (with the assistance of survey expert – and 100Kin10 Partner – WestEd) incorporated all PARTNER INPUT to finalize the questions and build the SURVEY.
ANALYZE DATA
Partners working directly with teachers received the survey in two phases in the spring of 2014. Partners not working directly with teachers received just one phase. For this first year, Partners were asked to respond to the best of their ability with the data they currently collect. OVER 95% OF PARTNERS SHARED DATA.
Fall 2013Winter 2014
Summer 2013
Winter 2012– Spring 2013 100Kin10, working with FSG, engaged Partners in distilling a COMMON FRAMEWORK of the network’s shared measurement system that captures a STEM teacher’s professional life cycle. With participation by 85% OF PARTNERS, we shaped the Framework, which depicts the SIX STAGES OF A STEM TEACHER’S PROFESSIONAL LIFE CYCLE.
SOLICIT PARTNER FEEDBACK
LAUNCH “SHARED MEASURES”
With significant leadership from Partners, we populated each of the framework’s six stages with questions about programmatic processes, components, and outcomes. OVER 30 PARTNERS actively took part in the process by drafting or reviewing the survey’s foundational content.
We anticipate that this will be an annual data collection and learning process. Future versions will reflect lessons learned throughout the 201314 process as WE LISTEN TO FEEDBACK and DEVELOP MORE SOPHISTICATED AND INFORMED surveys. Going forward, our expectation is that all Partners will collect the data necessary to respond to the full survey.
3
Survey Contributors
4
Data Approval Summaries Each Partner received a summary of their data to approve for sharing. A cover page preceded the data, highlighting how the Partner stood out from the crowd during our data analysis and suggesting a few Partners who might be good collaborators (based on indicated challenges or interest areas). 100% of Partners agreed to share their data.
Cover Page
Data Approval Form
5
Enabling Learning from Data: Additional Partner Benefits COLLABORATE TOWARD INNOVATION Going out on a limb and trying something new and promising? With permission, we will connect partners who are experimenting with similar practices or complementary strategies. By taking on these new challenges together, partners can learn more and faster and push thinking across the field.
LEAPFROG PAST COMMON CHALLENGES Struggling with a particularly thorny situation? The data will point toward innovative solutions to common problems. 100Kin10 will host meetings to share new and effective approaches, allowing organizations, the network, and the field to leapfrog innovation.
DISCOVER EXEMPLARY PRACTICES
KNOW THE LANDSCAPE
Interested in staying up to date on emerging best practices or exceptional outcomes? With permission, we will share the work of exemplary organizations, highlighting what is working in the space.
Curious about the state of play in the field? We will aggregate data (none of which will be attributed) around central program practices and results, uncovering which processes and strategies are the most effective and result in the strongest outcomes. 6
