Evaluation: A Systematic Approach
SAGE Journal Articles
Click on the following links. Please note these will open in a new window.
Journal Article 1: Kulik, J. A. & Fletcher, J. D. (2016). Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review. Review of Educational Research, 86(1), 42-78. DOI: 10.3102/0034654315581420
Abstract: This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems.
Questions to Consider:
1. What inclusion criteria were used to conduct the meta-analysis?
2. What were the findings?
3. What considerations for evaluations of intelligent tutoring were noted?
Journal Article 2: Reichardt, C. S. (2011). Evaluating Methods for Estimating Program Effects. American Journal of Evaluation, 32 (2), 246-272. DOI: 10.1177/1098214011398954
Abstract: The author defines a treatment effect in terms of a comparison of outcomes and provide a typology of all possible comparisons that can be used to estimate treatment effects, and assesses the relative merit, worth, and value of all possible comparisons based on the criteria of bias, precision, generalizability, ease of implementation, and cost.
Questions to Consider:
1. What typology of treatment effects does the author provide?
2. How would an evaluator decide which comparison is best to use based on this typology?
3. What are some of the strengths and weaknesses of the different types of comparisons that are presented?
Journal Article 3: Mukherjee, D. & Kable, J. W. (2014). Value-Based Decision Making in Mental Illness: A Meta-Analysis. Clinical Psychological Science, 2(6), 767-782. DOI: 10.1177/2167702614531580
Abstract: In this study, the authors assessed value-based decision making in individuals diagnosed with mental illness.
Questions to Consider:
1. What criteria were used for the two meta-analyses?
2. What were the findings of the first meta-analysis?
3. What were the findings of the second meta-analysis?