All Collections
Analytics
General
Assessment Analytics 2.0: Analyzing Points-Based Assessments
Assessment Analytics 2.0: Analyzing Points-Based Assessments
This article explains how you can use Assessment Analytics 2.0 to analyze Advanced Assessments that use the points grading scale.
Monica Burke avatar
Written by Monica Burke
Updated over a week ago

Using Assessment Analytics 2.0 allows you to take a deeper dive into the performance of assessments that are given in Otus.

This article is written specifically for Assessments that use the points grading scale. If you are looking for details on how to analyze an assessment that uses a standards-based grading scale, click the button below:


Getting Started

  • Step 1: Navigate to the Analytics module. Note - the screenshot above is from within a teacher account. If you are an administrator, the Analytics module is located second from the top.

  • Step 2: Select Assessment 2.0.

  • Step 3: Check the date range.

💡 Tip: The default date range is set for the previous 7 days. If the assessment you are looking for does not fall within that date range, it will not appear in the dropdown menu. For best results, we recommend changing the date range to All Time.

Once you have identified the necessary date range, you can click into the Search Assessment field to see a dropdown list of the assessments that appear within that date range. You can also search using keywords.


Assessment Status Widget

The assessment status widget will show you the overall completion status of the assessment.

On this widget, you will find:

  • The number of students in each submission status; Not Started, In Progress, Turned In (not pictured), and Graded


Performance Breakdown

The performance breakdown allows you to a summary of the results, including the highest score, average score, and average time to complete.

  • The x-axis contains the percentage ranges.

  • The y-axis represents the number of students.

The default display (shown above) is the Overall Performance, which represents all of the students that took the assessment. Each bar represents a 10% range; they are listed highest to lowest from left to right. Hovering over any of the bars will show you the number of students that performed in that range.

Interested in customizing the x-axis? Check out this resources to learn how!

➡️ Other Performance Breakdown Options:

In addition to Overall performance, the performance breakdown can be analyzed in other ways.

  • By Class: If multiple classes took this assessment, you can see the average percentage of each class.

  • By Student Group: If students in your classes have been assigned to district-created groups, you can see the average percentage of each group.❗Note: only district-created groups will be represented here.

  • By Gender: If students have an assigned gender attribute, you can see the average percentage separated by gender.

  • By Grade Level: If students have an assigned gender attribute, you can see the average percentage separated by gender.

  • By Ethnicity/Race: If students have an assigned an ethnicity/race attribute, you can see the average percentage separated by ethnicity/race.

Example of a Student Group performance breakdown:


Question Analysis

Note: This section is only available on Advanced and Simple assessments. If you are viewing a Rubric assessment, this section will be a Rubric Analysis (click here for more information)

The Question Analysis table will show the performance of each individual question on the assessment. You can see this analysis in two forms:

  • Table displaying all questions

  • Individual question

❗ Is the Question Analysis table empty? That indicates the assessment is a + (plus) assessment, which is a grade added directly to the gradebook. Plus assessments do not have individual questions, therefore, the Question Analysis table will be empty.

➡️ Table

The default sort order lists the questions in order. You can change the sort order by clicking on the heading of any column.

Let's analyze the first row of the table to better understand the columns:

  • Question: This is question #1.

  • % Correct Visual Display: 92.32% of the students earned full credit for this question; this shows the percentage of students that earned full credit for the question (dark blue) relative to the percentage that did not (orange).

  • Number Correct: 12 students earned full credit on this question.

  • Number Incorrect: 1 student did not earn full credit on this question.

  • A-D: Since this is a multiple choice, question, the table will show a breakdown of how many students selected each answer. In this example, one student selected A, zero selected B, 12 selected C, and zero selected D.

  • Avg. Score: The average score on this question was a 0.92/1.

  • Q Type: This was a Multiple Choice question

➡️ Individual Question

Clicking on any row in the table will show a more detailed view.

  • You will see the content of the question, along with the answer choices and/or correct answer (if it is an auto-scored question).

  • To the right, you'll see that 7 out of 11 students earned full credit on this question. The doughnut chart shows the percentage of students that earned full credit for the question (dark blue) relative to the percentage that did not (orange).

  • You will see the standard attached to the question under Linked Standards.

  • You can navigate to the next question or go to the previous question by using the arrows in the top-right corner.

  • To go back to the table, close out the individual item analysis by selecting the x in the top-right corner.

➡️ Items with Multiple Questions (Advanced Assessments Only)

Do you see questions that have a decimal in the question number? For example:

This means that these items had more than one question in them. In the example above, Item 13 had two questions; each question is given its own row in the table, so the first question is 13.1, and the second is 13.2. You can see the same situation with Item 14. When you click on the particular question, it will show the item in its entirety to maintain the integrity of the assessment, but the score you see will be for that individual assessment.


Standards Performance

This section identifies all of the standards assessed on the selected assessment, in addition to the mean (average) performance on each standard across all students that have been graded.

  • Hover over the standard title to see the full description of the standard:

  • The performance on the standards is calculated by mean.

  • Select any section of of the horizontal bar chart to see a more specific breakdown of the performance:

  • To see only the students that performed at a certain level, select that level. The example below shows only student that performed in the 41-60% range.

  • Use the breadcrumbs at the top of the screen to return to the previous page:


Rubric Analysis

Note: This section is only available on Rubric assessments. If you are viewing an Advanced or Simple assessment, this section will be a Question Analysis (see above)

For Rubric assessments, you will see a breakdown of the number of students that earned each performance level.

🌟 Coming Soon! 🌟

You will be able to click into each performance range to see which students scored in each. More information to come when this feature is available!


Student Performance

The Student Performance will show the performance of each individual student that was assigned the assessment. You can see this analysis in two forms:

  • Table displaying all students

  • Individual student

➡️ Table

The default sort order is alphabetical by last name. You can change the sort order by clicking on the heading of any column.

Let's analyze the third row of the table to better understand the columns:

  • First and Last Name: The first and last name of the student is Chandler Bing.

  • Submitted: This student submitted the assessment on April 14th, 2023 at 9:44pm. To see the time stamp, you can hover over the date.

  • Points: This student earned 8 out of 16 points.

  • Percentage: This student earned a 52% on this assessment. The horizontal bar is a visual display of their percentage, with the dark blue representing the full-credit earned, relative to the orange.

  • Email: This is the student's email address.

  • Site: This is the school the student is rostered in.

  • Grade: The student's grade level (if assigned).

➡️ Individual Student

Clicking on any student in the table will show a more detailed view of that student. Let's click on the first student, also used in the example above.

  • You will find the student's overall score in the upper-right corner, along with the amount of time it took them to complete the assessment.

  • The table contains details for each question; the score and selection (which can also be considered their answer). Clicking on any row will show you the question and student answer, as well as the correct answer in yellow.


Optional Filters

If you are looking for other ways to filter the data, you can select the filter icon in the top-right corner. After making your selections, select Apply Filters.

This also allows you to see data for archived class - just toggle the "Display archived data in filter" ON.


FAQ & Troubleshooting

Click to see FAQ and troubleshooting details

When I use the filters, the report isn't updating. Why is that?

Make sure you select Apply Filters after making your selections.

Can I pull up data for prior school years?

Yes! Select the Show Filters button in the upper-right corner, toggle ON the "Display archived data in filters" option, then select Apply Filters.

How long does it take for an assessment to appear in Analytics 2.0?

Assessment 2.0 is updated almost immediately. It shouldn't take any longer than 10 minutes for new data to populate. Reach out to our support team if you are having issues locating data!


Related Resources

Did this answer your question?