- User Types
- Any user with access to Explore (Global Admins, Regional Admins, and some Users) can edit an Activity Report. All users can view an Activity Report.
- Available on paid plans (Analyst, CLO, and Enterprise).
- Anybody (both beginners and experts) can use this feature.
The Activity Report provides in-depth analysis of an activity such as a course, video, or assessment. Beyond providing insights on how learners perform, this report can perform advanced question analysis to make sure organizations are asking the right questions in their assessments.
Creating and Editing an Activity Report
Use Explore to create new Activity Reports and to configure existing Activity Reports.
Beyond the typical Explore filters and options, the Activity Report provides options that are unique to the Activity Report.
Select Activity from the report selection menu and then click Activities in the filter menu:
Required: You must select at least one activity for the Activity Report to show data.
Once you've selected an activity, the report will begin to populate with data. If you select more than one activity the report will include all data associated with every selected activity.
Advanced configuration is designed to be used by expert users who understand JSON and the properties of xAPI statements.
Certain settings (like hiding sections or survey mode) are unique to the Activity Report and only configurable in Advanced Configuration. Check out our Advanced Configuration guide for more information.
Interpreting an Activity Report
The Activity Report has a number of sections:
Completions, Incompletes, Successes, and Failures
The Completions, Incompletes, Successes, and Failures chart shows participation data for an activity:
- Completions are people that have completed the activity.
- Incompletes are people that have started the activity but not finished.
- Successes are people that have completed and been successful at the activity.
- Failures are people that have completed but failed the activity.
If your organization is sorted in different groups, you’ll be able to navigate your organization by clicking on group names within the chart. This way, you’ll be able to see how participation data differs across your organization. You can also use the search box at the top of the report to isolate certain parts of your organization.
The Leaderboard shows data for each person that completes your activity. You can see how many times a person completed your activity, if the person was successful, and how long the person spent with your activity, and the average of all the times a the person completed the activity.
The time range shows the last 28 weeks of activity. Blue circles represent activities made by this person related directly to the activity, and grey circles represent activities made by the person that are not related to this activity.
The Scores chart shows the breakdown of how all of your people are performing. Your people are grouped into score ranges, and the chart displays the percentage of your users that fall into each range. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity.
Use this graph to see how the average activity score changes over time. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity. You can also change the size of groupings using the dropdown in the top right corner of the chart.
Completions & Successes
Use this graph to compare completions and successes of your activity over time. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity. You can also change the size of groupings using the dropdown in the top right corner of the chart.
Average Time to Complete per Month
Use this graph to see how the average time spent on your activity changes over time. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity. You can also change the size of groupings using the dropdown in the top right corner of the chart.
In this section, the Activity Report gives you detailed information and insights about each question. Sometimes performance on individual questions is predictive of overall activity performance. Sometimes questions are too easy and everyone gets them correct. This information is surfaced for you so you can improve your activities.
For each question, you’ll be able to see the average time it took people to answer, how people answered, and even view individual answers. If a question has notable insights, they’ll be surfaced with the question results and at the bottom in a section called Question Analysis.
The Activity Report can visualize different types of questions, and depending on the type of question asked, your results will be displayed in a different chart or graph:
In this multiple choice question, the correct answers are highlighted in blue (Golf Example and Tetris Example). Below the chart, you can see that this question is poor at predicting who will do well on the activity. The bubble on the left shows the average time it took to answer the question (57 seconds) and you can view how specific people answered the question with the View Individual Answers link.
In this true/false question, true is the correct answer and most people answered correctly. According to the insights below the chart, this question is poor at predicting who will do well on the activity (probably because it’s an easy question).
Likert scales ask people to choose one answer on a scale. On this Likert scale, most people answered “It’s Gonna Change the World.” You can hover over different sections of this chart to see numbers of people that answered each way, or click View Individual Answers to see how everyone answered this question.
Sequence questions ask users to place items in order. Results are displayed in a grid where the x-axis represents order and the y-axis represents the items being asked to sequence. Each square in the grid contains the number of people that placed the y-axis item in the x-axis number place. In this example, 8 people placed “Tim” first. As the number in a square increases, the square itself becomes darker. The items are placed on the y-axis in correct order, so the diagonal squares will ideally be the darkest. This would mean most people sequenced your items correctly. You can hover over each square with your mouse to get more information.
For matching questions, the correct answers are identified with blue lines and text. The chart to the right of the answers shows the percentage of people that answered each way.
The Question Analysis collects the insights surfaced from each question and shows additional insights: