American Institutes for Research (AIR) recently released the final report from their independent evaluation of TenMarks Math. The study's findings suggest that TenMarks Math improved average math performance by 0.19 standard deviations on state tests in classes that completed at least one assignment per week during the school year. That translates to an 8 percentile-point gain — from the 50th to the 58th percentile — in the first year of use.
This change implies that a class at the 50th percentile in the state would be at approximately the 58th percentile if it systematically used TenMarks Math during the year.
American Institutes for Research:
The Effect of TenMarks Math on Student Achievement (August 2017)
Impact of TenMarks Math. The graph represents the estimated impact on achievement implied for a class at the 50th percentile of performance on the state's end-of-year assessment. The impact estimate is based on AIR's analysis of test-score trends of classes that completed at least one assignment per week on average on TenMarks Math for a single school year and a matched set of comparison classes that did not have access to the program. The impact estimate found by AIR is represented as the difference between the trajectories of the TenMarks Math and comparison groups.
The study, conducted by AIR, assesses the effect of TenMarks Math on student achievement across 10 states. By including a diverse set of states and multiple measures of student achievement, the study helps ensure its findings are robust and broadly applicable. In order to boost internal validity, the study uses a research design called CITS (Comparative Interrupted Time Series), one of the most rigorous quasi-experimental designs for estimating program effects.
Schoolwide Title 1