Comments on: Understanding the reliability and validity of test scores https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/ See Every Student. Mon, 13 Feb 2023 22:30:07 +0000 hourly 1 https://wordpress.org/?v=6.4.2 By: Catherine Close, PhD, Psychometrician https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-575 Wed, 31 Aug 2016 14:28:14 +0000 http://rliblog.wpengine.com/?p=318#comment-575 In reply to Linda Schoen.

Thank you for your question. Based on your comment, it seems that you are referencing the grade equivalent scores, also known as GE scores. A GE Score tells you how a student’s scale score compares to the average performance of other students in the nation. As an example, if the student is in sixth grade and they receive a GE score of 7.2, this means that the student’s score is as high as the average score of a seventh grader in the second month of the school year. While that may be indicative of superior performance by the sixth grader, a GE scores does not tell you what the student knows or can do; GE scores simply compare students to other students in a norm group and they shouldn’t be used to show what the student has learned to do.

There are other types of scores that would be relevant for showing the student’s instructional reading level. An example is the Star Reading Instructional Reading Level (IRL) score that gives an estimate of the grade level of written material that the student can most effectively be taught. A Star Reading IRL of 5.0 indicates that the student will most likely learn using materials written at the fifth-grade level.

The following link provides a summary of scores reported in Star Reading and how to interpret them: http://doc.renlearn.com/KMNet/R001316312GB442F.pdf.

I have also written a blog on different types of scores and how to interpret them that you might find useful: https://www.renaissance.com/2016/05/12/giving-meaning-to-test-scores/.

If you still have questions, don’t hesitate to ask us!

]]>
By: Linda Schoen https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-558 Mon, 29 Aug 2016 20:38:56 +0000 http://rliblog.wpengine.com/?p=318#comment-558 I am questioning the accuracy of the star test that provide the grade level the student scored . I’ve seen students score 2-3 years above their current grade level , yet when given reading assessments such as a DRA they are at or below grade level . How accurate are the grade level assigned to the score ? Test almost seems dumbed down to have levels so high . So in return the school takes away services because they say per the star test they are at grade level now . Help

]]>
By: Renaissance Learning https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-110 Wed, 18 May 2016 15:09:37 +0000 http://rliblog.wpengine.com/?p=318#comment-110 Hi Craig, Thanks for your question. Tests are imperfect. As a result, every educational test score contains some degree of measurement error. STAR test scores can fluctuate from one administration to the next for a variety of reasons, which are explained in a document you can access online at http://doc.renlearn.com/KMNet/R001355624GC3A4D.pdf. I’m happy to help if you have any further questions. Catherine

]]>
By: Craig Stoffberg https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-109 Sat, 14 May 2016 01:18:19 +0000 http://rliblog.wpengine.com/?p=318#comment-109 Hi Catherine, thank you for your post. I have recently re-tested two Year 5 students’ STAR Reading test scores. The first student was re-tested a week after the initial test, while the second student was re-tested six weeks after the initial test. In both cases, scaled scores increased raising reading ages by two years respectively. How do I explain these scores considering the doubt of validity that these differences shed?

]]>
By: Catherine Close https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-108 Mon, 20 Oct 2014 18:31:07 +0000 http://rliblog.wpengine.com/?p=318#comment-108 We have summarized the reliability and validity of the STAR assessments in The Research Foundation for STAR Assessments, which can be accessed online at http://doc.renlearn.com/KMNet/R001480701GCFBB9.pdf. See the “Psychometric Properties” chapter on pp. 19-27 for details. Thanks for your question!

]]>
By: R Collins https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-107 Sun, 19 Oct 2014 23:21:48 +0000 http://rliblog.wpengine.com/?p=318#comment-107 Can you tell me what the reliability and validity scores are for your tests at Renaissance Learning (elementary level) please?

]]>
By: Liz Owen, PhD https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-106 Tue, 22 Jul 2014 01:10:24 +0000 http://rliblog.wpengine.com/?p=318#comment-106 Catherine, this is a wonderful, clear explanation of reliability and validity. The first really crystal clear explanation I’ve read, in fact, that boils reliability and validity down to their simple essence without distortion or oversimplification. As a learning scientist and educational data miner, I know this is a very rare phenomenon among academics…and I believe it is a sign of true mastery. In other words, thank you! I look forward to reading more.

]]>
By: Mark L. Davison https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-105 Thu, 17 Jul 2014 15:58:46 +0000 http://rliblog.wpengine.com/?p=318#comment-105 I will use this in our introductory course on measurement.

]]>
By: Catherine Close https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-104 Wed, 16 Jul 2014 13:53:59 +0000 http://rliblog.wpengine.com/?p=318#comment-104 Thank you, Maria. I am happy to hear that this resonated with you and will find its way into meaningful conversations around test scores.

]]>
By: Maria Austin https://www.renaissance.com/2014/07/10/understanding-the-reliability-and-validity-of-test-scores/#comment-103 Mon, 14 Jul 2014 13:31:34 +0000 http://rliblog.wpengine.com/?p=318#comment-103 This is a simple and enlightening article that offers excellent conversation about the reliability and validity of test scores. You found common ground that relaxes the audience and makes us want to learn more about the topic.

I will feel comfortable directing instructors and administrators to the article, which will allow them to gain a depth of knowledge required to use the data effectively.

]]>