Developing and Using Evidence
Establishing standards for evidence is critical for any academic or scholarly community. In DBIR, evidence must both meet high standards for internal validity, and yet also exhibit strong external validity in terms of being useful to or actionable by practitioners.
At different points in the research and development cycle, different types of evidence may be more or less appropriate. As with other aspects of DBIR, appropriate evidence standards need to be negotiated among partners, including perhaps funders and/or relevant policymakers.
-
Poster, Text
Rockwood Makerspace at Multnomah County Library
-
Poster, Text
The Studio at Anythink Libraries: A Case Study in Evaluating Connected Learning in Libraries
Chang-Order, Josephina, Penuel, William R., Wortman, Amanda, Harris, Michael, Van Horne, Katie, Widman, Sari and Melia Repko-Erwin. 2019. The Studio at Anythink Libraries. Irvine, CA: Connected Learning Alliance.
-
Poster, Text
Appendix: Rubric for Analyzing Quality of 3D Assessments
3-D-Assessment-Rubric-public.pdf -
Poster, Text
A Phenomenon-based Assessment System for Three-Dimensional Science Standards: Why Do We Need It and What Can It Look Like in Practice?
-
Poster, Text
Developing a Validity Argument for Practical Measures of Student Experience in Project-Based Science Classrooms
-
Research-Practice Partnerships and ESSA: A Learning Agenda for the Coming Decade
Penuel, William R., and Caitlin Farrell. "Research-Practice Partnerships and Essa: A Learning Agenda for the Coming Decade." In The Social Side of Reform, edited by Esther Quintero-Corrall. Cambridge, MA: Harvard Education Press, in press.
-
Paper
Research-Practice Partnerships: A Strategy for Leveraging Research for Educational Improvement in School Districts
-
Chapter Extended Abstract, Poster
Theories and Research Methodologies for Design-Based Implementation Research: Examples from Four Cases
Russell, J. L., Jackson, K., Krumm, A. E., & Frank, K. A. (2013). Theories and Research Methodologies for Design-Based Implementation Research: Examples From Four Cases. Design based implementation research: Theories, methods, and exemplars, 157-191.
-
Chapter Extended Abstract, Poster
Taking a Societal Sector Perspective on Youth Learning and Development
-
Chapter Extended Abstract, Poster
Towards an Evidence Framework for Design-based Implementation Research
-
Poster
Design Research with Educational Systems: Investigating and Supporting Improvements in the Quality of Mathematics Teaching and Learning at Scale
Cobb_etal_DBIR_AERA.pdf -
Web Link
Learning through STEM-rich tinkering: Findings from a jointly negotiated research project taken up in practice
http://onlinelibrary.wiley.com/doi/10.1002/sce.21151/abstract -
Paper Paywall
Critical design ethnography: Designing for change
Anthropology and Education Quarterly, 35(2), 254-268.
-
Paper Paywall
Rapid ethnography: Time deepening strategies for HCI field research
In Proceedings of the conference on designing interactive systems: Processes, practices, methods, and techniques (pp. 280-286). New York, NY: ACM Press.
-
Text
Script for NCTM Keynote on DBIR and Expanding Opportunity to Learn
NCTM-Script-FINAL.pdf -
Poster, Text
Key Findings of Research on Professional Development in Science 1996-2014
Some_Key_Findings_Related_to_Effective_Professional_Development_in_Science.pdf -
Paper Paywall
Using ethnography in contextual design
Communications of the ACM, 40(7), 82-88.
-
Practical Tool
Developing a DBIR Research Plan
-
Poster, Text
Curriculum Co-Design as a Strategy for Supporting Equitable Implementation of Next Generation Science Standards
Curriculum-Co-Design-as-a-Strategy-for-Supporting-Equitable-Implementation-of-Next-Generation-Science-Standards.pdf -
Presentation
Leveraging Professional Development to Design and Enact NGSS-aligned Materials in Uncertain Policy Contexts
AllenSeverancePenuel_NGSS-PD_v3.pdf -
Poster, Text
Design-Based Implementation Research for Improving Undergraduate STEM Education
DBIR_for_DBER.pdf -
Poster, Text
Design Pattern for Developing and Using Models Handout
HANDOUT_Developing_and_Using_Models_Design_Pattern.pdf -
Practical Tool
Sample Assessment Tasks to Adapt to Design Pattern
HANDOUT_Task_Examples_for_Task_Analysis_and_Modification.pdf -
Poster, Text
Developing Assessments of Science Proficiency: Recommendations from the NRC (2014) Report
Penuel_McLaren_CSSS_Assessment_R.pdf -
Web Link
William T. Grant Foundation Resources Related to Research-Practice Partnerships
http://www.wtgrantfoundation.org/resources/research-practice-partnerships/Research-Practice-Partnerships -
Paper
From new technological infrastructures to curricular activity systems: Advanced designs for teaching and learning
In M. J. Jacobson & P. Reimann (Eds.), Designs for learning environments of the future: International perspectives from the learning sciences (pp. 233-262). New York: Springer.
-
Paper Paywall
Scaling up innovative technology-based mathematics
Journal of the Learning Sciences, 17(2), 248-286. (Paywall)
-
Paper Paywall
Examining teachers’ instructional moves aimed at developing students' ideas and questions in learner-centered science classrooms
Journal of Science Teacher Education, 23(7), 768-788.
-
Paper Paywall
Linking teacher and student learning to improve professional development in systemic reform
Teaching and Teacher Education, 19(6), 643-658.
-
Web Link
North Carolina Translational and Clinical Sciences Institute
http://tracs.unc.edu/learn-about-clinical-translational-research/learn-about-clinical-translational-research.html -
Practical Tool
William T. Grant Foundation Resources for Design and Analysis of Group Randomized Trials
http://www.wtgrantfoundation.org/resources/design-and-analysis-of-group-randomized-trials -
Chapter Extended Abstract
Situated Research Design and Methodological Choices in Formative Program Evaluation
11-supovitz-ready.pdf -
Paper
Practical Measurement