Bridge (en)ArchivedApprenNet - Instructors Creating ExercisesHow does ApprenNet's rubric scoring work?

How does ApprenNet's rubric scoring work?

If you set up Peer Review to include our Rubric modality, then you will have access to two Reports: Rubric Review Results and Instructor Rubric Results. The first Report shows Peer Review scores and the second shows Instructor scores. You can also find these scores on the Evaluate page of each Exercise. The following article explains how to read the scores.

Our Rubrics are customizable. As a result, the number of options or answer choices for each Rubric criteria or question can vary. For example, some Rubric options may only include "Yes" or "No" while other options may include a Likert Scale with 3, 4, or 5 options. In order to give an accurate score for each Learner despite variation in Rubric options, we normalize the scores of each rubric question (to learn more about normalization, please review this article). After normalization, each rubric question is worth the same amount, 1 point.

Let's take a look at how this plays out. Assume we have an Exercise set up with 5 Rubric questions or criteria. As a result of 5 criteria or questions, the highest score each Learner can achieve 5. Let's say each rubric question contained 3 criteria and a Learner received the following scores during Peer Review:

  1. 2.6 out of 3
  2. 1.2 out of 3
  3. 2.6 out of 3
  4. 2.4 out of 3
  5. 2.8 out of 3

After these scores are normalized, the points break down as follows:

  1. .8 out of 1
  2. .1 out of 1
  3. .8 out of 1
  4. .7 out of 1
  5. .9 out of 1

The normalized scores are then added together to calculate the total score for the Learner. Here, the Peer Review score is 3.3 out of 5.