AIMSweb Enhancements and Updates

AIMSweb is continuously being refined to enhance your experience with the system. Below are the updates included in this release.

New AIMSweb Default Cut Scores

New AIMSweb default cut scores for 2011-2012 are Now Available in preparation for the release of new nationally representative norms, which are scheduled to be available on September 2nd.  For more information on the new national norms, read our FAQ.

The two new default cut scores that are now provided for each measure are research-based:

•  For reading and math measures (R-CBM and M-CAP), values are based on empirical studies of the prediction of success on state tests. The higher cut score is the one associated with an 80% probability of passing the typical state test; thus, it indicates that the student is on track for success, and it can be interpreted as a target. The lower cut score indicates only a 50% probability of success on the typical state test, and is a warning that the student is at risk. For more information about the research on state test prediction with AIMSweb, please reference the PDF document ‘State Prediction User’s Guide’ available at the bottom of the Training tab under the Downloads section within AIMSweb.
• The higher cut scores for the Early Literacy measures are based on studies of the prediction of performance on AIMSweb reading tests at higher grades. Students performing at or above the higher cut score have a high probability of success in later reading.
• The other cut scores have been set at the same percentile values as the cut scores for R-CBM, M-CAP, and Early Literacy. Across grades, the higher and lower cut scores for R-CBM and M-CAP fall consistently at about the 45^th and 15^th percentiles, respectively (on national norms). Therefore, the cut scores for Reading Maze, M-COMP, Spelling, and Written Expression have been set at those same percentile points
• For the Early Numeracy measures, the higher cut scores have been set at the same percentile as for Early Literacy, which is the 35^th percentile on national norms. The lower cut score for both Early Literacy and Early Numeracy is set at the 15^th percentile, consistent with all other AIMSweb measures.

What does the addition of the new default cut scores mean to you as the user?

If you have already:

• Set up cut scores and Targets based on specific percentile points from Local Norms: The new default cut scores will have no impact on you.
• Set up cut scores and Targets based on customized criteria: You may continue to use these criteria.  You will also be provided with a second set of new “AIMSweb Default” criteria, per the description above.
• Set up cut scores based on specific percentile points pulled from  Aggregate Norms: The Aggregate Norms will be replaced with the introduction of the new National Norms, available September 2^nd. If you have already set up your cut scores using Aggregate Norms, you will need to:
  • Consider whether you wish to keep these cut scores, or:
  • Consider editing them via Report Criteria Setup to correspond to the data within the new National Norms.  If you decide to edit your cut scores, consider the following:
    • Plan to provide updated information to staff, parents, etc.
    • Any previously generated reports may be obsolete once your changes take effect

How are the new National Norms different than the Aggregate Norms?

The new National Norms, available September 2^nd, are based on demographically representative samples that reflect the performance of the national student population at Grades K through 8. The data came from schools doing universal screening, and almost all of the scores were obtained during the 2009-2010 school year.

The National Norms tend to yield a lower percentile for the same raw score than the Aggregate norms. The primary reason for this is that the National Norms are based on the full student population. A second reason is that the National Norms have been constructed using an improved methodology, the “midinterval” method of calculating percentiles, rather than the “top of interval” method.

The table below shows the average size of the difference between National Norms and Aggregate Norms in percentile terms, at three score levels (low, average, and high). In each comparison, the National Norms percentile is lower than the Aggregate Norms percentile. For example, at the elementary grade range, the R-CBM raw score that was at the 50^th percentile on Aggregate Norms is at the 45^th percentile (5 percentile points lower) on National Norms. The differences tend to be smaller at the lower grades, suggesting that the Aggregate sample is more similar to the National sample at that level.

For further information around the method used to collect the new nationally-representative norms, please refer to our Technical Documentation.

Please contact AIMSweb technical support at 866-313-6194 with any questions.