Interpreting the Program Report
The Program report offers an overview of a pre-defined learning program—like compliance training or new hire training. This guide explains how to interpret the Program report.
- User Types
- Any user can view and interpret a Program report.
- Available on CLO, and Enterprise.
- Anybody (both beginners and experts) can interpret a Program Report.
Program Report Loading Time
Because of the way they process data, Program Reports typically take longer to generate than tabular reports (such as the Leaderboard Report or the Pie Report). Two major factors in Program Report loading time are:
- the number of statements used to generate the report
- the number of steps in the report.
Number of Statements
The time to generate a Program Report is proportional to the number of statements it processes. A Program Report that uses 100,000 statements can typically take close to ten times as much time to load as one with just 10,000 statements. This is different from tabular reports where the difference between 10,000 and 100,000 statements is relatively small due to the way these reports process data.
Number of Steps
The number of steps in the Program Report also has an impact on its loading time. While not as big of a factor as the Number of Statements, each additional step requires additional processing and will increase the time it takes for a Program Report to load.
Program report milestones show what percentage of people have completed a configured interaction or set of interactions. Milestones show different numbers depending on if the report has been configured to expect milestones to be complete in a specific order, or if milestones can be completed in any order. This will be indicated by text below the milestones list.
- “Where are currently enrolled people with regard to each program milestone?” means that milestones are expected to be completed in the order shown.
- “What percentage of enrolled people have completed each milestone?” means that milestones can be completed in any order.
Milestones in defined order
If milestones are expected to be completed in the order shown, then the milestone percentages will show the percentage of people working towards each milestone. This is calculated by subtracting the number of people that have completed the milestone from the number of people who have completed the milestone above.
Please note: This method of calculating milestones only works if people are forced to complete milestones in the defined order. If people can complete milestones in a different order, calculating the number of people working towards each milestone does not make sense and can lead to negative values.
For example, if 10 people have completed milestone 3, but 12 people have completed milestone 4, then the report will show minus two people are working towards milestone 4 because two extra people have completed it than have completed the milestone before.
Milestones in any order
If milestones can be completed in any order, then the milestone percentages show the percentage of people who have completed each milestone.
Advanced Milestones and Program Completions
Advanced milestones are marked as complete once a configured number of milestones within then are completed (by default all the milestones within them have to be completed). The program report’s metric of how many people have completed the program is based on the number of people that have completed all milestones.
The calculation of the number of people who completed a set of milestones can sometimes look inaccurate (when it is, in fact, correct) when looking at completion percentages for the individual milestones. This is because it may be that different people completed different milestones.
For example, in a report looking at 100 people with 3 milestones, where the first milestone has 70% completion, the second has 60% and the third has 50%, you might assume that 50% of people have completed the program. However in fact, it might be that anywhere between 0% and 50% of people completed the program.
It could be that the 50% who completed milestone 3 also completed the other milestones as show below.
But it is equally possible that the 50% who completed milestone 3 were either in the 40% that did not yet complete milestone 2, or the 30% who did not complete milestone 1. In this case, nobody completed all three milestones.
The example below has the same levels of milestone completion as above, but nobody has completed all three. 20% of people did milestones 2 and 3, 10% completed no milestones, 30% completed milestones 1 and 3, and 40% completed 1 and 2.
The overall completion only looks at people that completed all three.