As an xAPI conformant LRS, Watershed can receive data from any xAPI conformant Activity Provider. Many Watershed reports are flexible and you can configure Watershed to display useful visualizations and metrics from almost any xAPI data set. To help you get the most out of your data, we’re working with a number of product vendors to ensure that the data they send is optimized to produce the best possible results in Watershed. We want to help you to configure Watershed reports in the best way possible to display that data.
This guide tells you how to correctly configure and publish Storyline courses and then configure Watershed to get the best results.
- User Types
- Any user with access to the report builder (Global Admins, Area Admins, and some Users) can create reports looking at Storyline data.
- Available on paid plans (Analyst, CLO, and Enterprise).
- Anybody can use this feature.
Configuring and publishing Storyline courses
This section outlines what you need to do within Storyline in order for it to produce the best data for Watershed to work with. If you have existing Storyline courses published without following this guidance, we recommend that you re-publish the courses following this guidance.
Important: Use the latest version
Articulate have made important improvements to their xAPI tracking since Storyline 2.5. We recommend that you updated to the latest version, especially if you are using a version of Storyline prior to 2.5, which was released in May 2015. If you are using any version of Storyline 2, updates to 2.x versions are free. If you are using Storyline 3 or Storyline 360, even better!
See Articulate’s website to get the latest version and for instructions on how to upgrade.
Please note: If you already have important data generated from packages published with an earlier version of Storyline, then updating your packages may mean that the new data takes a different format to the old data and may appear differently in reports. It might not be entirely compatible. Let us know if this is a concern.
Give slides and objects helpful names and identifiers
The names and identifiers you use for slides and objects within Storyline will be reflected in Watershed reports, so it’s important to choose good names. Instead of “Untitled Slide”, give each slide a name. Instead of “Oval Hotspot 4”, name your hotspot according to which part of the picture it’s covering. This is a little extra work, but worthwhile so you know what’s what when it comes to looking at the reports in Watershed.
Complete the LMS course information
When publishing your course, you need to configure it to use “Tin Can API”. This is another name for xAPI. It’s really important that you populate the Reporting and Tracking settings correctly. Here’s how to open them:
- In Storyline, go to the Home tab on the ribbon and click Publish.
- Select the LMS option on the left edge of the publishing window.
- From the LMS drop-down list at the bottom of the window, select Tin Can API.
- Click the Reporting and Tracking button.
The Reporting tab has four settings. Enter a short but helpful Title and a fuller Description. Both of these may be displayed in Watershed reports. Leave the Launch URL as the default (“story.html”) unless you really know what you’re doing or we’ve advised you to change it.
The Identifier field is the most important. This should take the form of a web address without the http:// at the start. We recommend the format [your organization’s website]/xapi/storyline/[unique course id]. For example, if we created an e-learning course titled ‘Using Storyline with Watershed’, it might have the id watershedlrs.com/xapi/storyline/using-storyline-with-watershed-10142015.
Including the date on the end helps to ensure that the id is unique within our organization. We also recommend that you keep a record of the identifiers you use within your organization to avoid using the same one twice for similar courses. Whenever you re-publish a course you should use exactly the same identifier. If you change the identifier, Watershed will treat it as a completely new course.
In the Tracking tab, make sure you choose the settings that are most appropriate for your course. You can now save those settings and publish your course.
Add custom tracking
If you need to make changes to a course after learners have started using it, we recommend that you make a backup of your Storyline project file before making any changes, that you make the changes carefully, and that you test the new version with you reports before releasing it to learners. Deleting and re-creating slides and objects could result in the identifiers of those slides and objects changing accidentally, which could adversely affect your reports.
Test your courses
Be sure to test the tracking of your Storyline courses. In particular, make sure that quiz results are sent to the LRS correctly when the learner fails, then passes the quiz. Some users have reported a potential issue with this on the Storyline forums.
Launching Storyline courses
When you publish a Storyline course, the course does not know who the learner is or where to send the tracking data. The course has to be told this information when the course is launched by a training delivery system, normally an LMS. The training delivery system should handle collecting information about who the learner is, but you’ll need to configure it with your Watershed LRS credentials and endpoint. Exactly where these configuration settings are entered will depend on what system you are using.
See How do I add an activity provider to Watershed? for details of where to find your endpoint and credentials in Watershed. Ask us if you need help configuring your LMS or other training delivery system, or for advice on launching content without an LMS (e.g. from an e-mail, text message or QR code).
Configuring Watershed to report on Storyline data
Data from Storyline courses works well with all Watershed reports, especially the Activity Report, which reports on course completion, success, time taken and score, and provides detailed question analysis.
Some other examples of reports are outlined below.
Time Taken Leaderboard
The Time Taken Leaderboard ranks learners by total, average, fastest, slowest, first and most recent time taken for the course. To set it up, create a new Leaderboard report organized by person using the following measures:
Most Recent Time
Key questions answered: Who was the fastest? Who was the slowest?
The Score Heatmap ranks learners by average, fastest, slowest, first and most recent score for the course.
To set it up, create a new Heatmap Report organized by person using the following measures:
Most Recent Score
Key questions answered: Who scored the highest? Who scored the lowest?
The Completion Leaderboard ranks learners by number of completions, passes and failures.
To set it up, create a new Leaderboard report organized by person and filtered by the quizzes in your publications that you want to report on. Add the following measures:
Key questions answered: Who has completed, passes or failed the most? Who has never completed, passed or failed the course?