Capacity Building in STEM Education Evaluation
A coalition of partners (including ORAU, the American Evaluation Association's STEM Topical Interest Group, and the Google- and NCWIT-originated CS Impact Network) are building a suite of resources, and a community of practice, to address critical needs in the evaluation of STEM education and workforce development initiatives.
We will provide evaluation planning resources, professional development, education, tools, and mentoring, all within a community of practice for STEM evaluation. A central feature of our efforts is an ever-expanding online repository of STEM evaluation resources. This searchable database includes a broad range of resources, such as high-quality instruments, surveys and protocols for conducting STEM program evaluation.
Our efforts are based on an inclusive, broad, and open definition of STEM education and of evaluation within that field. Any contribution is welcome that is related to any field of evaluating education, training and workforce development in science, technology, engineering and/or mathematics.
We define STEM as broadly as possible to encompass computer science, social sciences, health, applied mathematics and sciences, and more. We include educational contexts ranging from integrative STEM education through an interdisciplinary lens, to STEAM (STEM + arts), to efforts focused completely on a sub-field within STEM. We're open to STEM education initiatives in various settings, from medical education to STEM museum learning to computer science/coding activities for youth.
STEM Repository origins
Collaborative work around STEM and computer science program evaluation capacity building began with conversations in a group of CS-focused evaluators led by Google and NCWIT. A parallel effort began in 2012 at the American Evaluation Association annual meeting, and was continued by the AEA STEM Education Topical Interest Group.
Today, these efforts have evolved into robust, active consortia of accomplished evaluators across the country. The resulting CS Impact Network currently has 56 volunteer members, including representatives from 49 organizations and agencies, spanning universities, nonprofits, global for-profit companies and small evaluation firms.
ORAU also continues to build and support relationships in the broader STEM evaluation community and through the American Evaluation Association.
Colleges & Universities
- Arizona State University
- Bucks County Community College (Computer Consortium President)
- Claremont Graduate University
- Harvard University
- New York University
- Purdue University
- Rochester Institute of Technology School of Government - Evidence and Evaluation Hub at ANZSOG
- UCLA, CRESST
- University of Chicago
- University of Colorado, Boulder
- University of Tennessee, Knoxville
- University of Colorado-Denver
- Vanderbilt University
- Yale University
Burdseye View Eval Consulting; Education Development Center; Education Design Consultants; Eval Consulting; Fetterman & Associates; Haynie Research and Evaluation; Kaminsky Consulting; Kapor Center; Meaningful Evidence; RSP Research (formerly Code.org & U Washington); SageFox; SRI International; The Findings Group; Westat
NSF (CSONIC project); YMCA
Better Evaluation; Child Trends; CSNYC; National Girls Collaborative Project/CS OPEN project; NCWIT/K12 Alliance; Oak Ridge Associated Universities
American Evaluation Association STEM Topical Interest Group; Informal Science.org; Innovation Center - St. Vrain Valley Schools; Institute for Advanced Studies; Institute for Biomedical Philosophy; Society of Women Engineers
For information about ORAU’s involvement with the STEM Evaluation Repository, contact Ann Martin at 607.296.5698 or Ann.Martin@orau.org.