Moving Toward Quantitative Evidence--based Science Evidence Policy: Science of Science Policy Developmental Efforts In Theory, Evaluation Methods, and Data Inf ast ct e Infrastructure
Kei Koizumi
[email protected] November 12, 2009 f th for the A American i Evaluation E l ti Association A i ti
An interagency collaboration (16 agencies or offices) with three guiding themes and ten key questions
The SOSP Roadmap p The National Imperative Themes
Theme 1: Understanding d d Science and Innovation
Theme 2: Investing in Science and Innovation
Theme 3: Using the h Science off Science Policy to Address National Priorities
Science Questions 1. 2.
What Are The Behavioral Foundations Of Innovation? What Explains Technology Development, Adoption And Diffusion?
3.
How And Why Do Communities Of Science And Innovation Form And Evolve? What Is The Value Of The Nation’s Public Investment In Science? Is It Possible To “Predict Predict Discovery”? Discovery ?
4. 5 5.
6. 7. 8. 9.
Is It Possible To Describe The Impact Of Discovery On Innovation? What Are The Determinants Of Investment Effectiveness? What Impact Does Science Have On Innovation And Competitiveness? How Competitive Is The U.S. Scientific Workforce?
10. What Is The Relative Importance Of Different Policy Instruments In Science Policy?
Findings Recommendations
3
Science of Science Policy y in the Obama Administration
There is a new charter for the Interagency Task Group to carry through the SoSP roadmap. Science and technology are high priorities in the ARRA, the 2010 Budget, and in planning for the 2011 budget. Openness and transparency are high priorities: data.gov, open.gov and recovery.gov are examples. Evidence--based policy and evaluation are also priorities: OMB Evidence Director Orszag has issued numerous statements, including an October 7 Evaluation memo. Agencies are collaborating to build a new data infrastructure to be able to evaluate R&D investments (STAR pilot).
A Science of Science Policy Community website, with a new version coming soon
See scienceofsciencepolicy.net
OMB / OSTP “R&D R&D Priorities Memo” Memo for FY 2011 Budget (see www.ostp.gov)
OMB / OSTP “R&D Priorities Memo” for FY 2011 Budget
“Agencies should describe the expected outcomes from their research in relation to… practical challenges and cross cross--cutting areas, p providing g quantitative q metrics where possible.” p “Federal agencies… should develop datasets to better document Federal science and technology investments and to make these data open to the public in accessible, useful formats.” “Agencies should develop outcomeoutcome-oriented goals for their science and technology activities, establish procedures and timelines for evaluating the performance of these activities…” “Agencies should develop ‘science of science policy’ tools that can improve management of their [R&D] portfolios and better assess the impact of their [S&T] investments.”
Next Ne t Steps Feedback from the December 2008 Workshop shaped a set of interagency research priorities addressing the scientific challenges confronting the unique science policy analysis needs of Federal agencies: Developing a Data Infrastructure for Science and Innovation Policy; Modeling; Creating an Innovation Framework; Informing and Assessing R&D Investments (workshop in October 2009); and Conducting Outreach to Underrepresented p Populations. p The next workshop in 2010 will be for NSF Science of Science & Innovation Policy (SciSIP (SciSIP)) Grantees: Presentations and Findings from the current Pis; Pis; Keynotes and discussions from practitioner community