Preloaded

As an xAPI conformant LRS, Watershed can receive data from any xAPI conformant Activity Provider. Many Watershed cards are flexible and you can configure Watershed to display useful visualizations and metrics from almost any xAPI data set. To help you get the most out of your data, we’re working with a number of product vendors to ensure that the data they send is optimized to produce the best possible results in Watershed. We want to help you to configure Watershed cards in the best way possible to display that data.

Preloaded, a BAFTA-winning applied games studio, recently developed a cyber-security game for governance, risk and compliance training company Eukleia. In the online game, called Zero Threat, players must protect the data in their network from incoming threats by playing action cards. The game, which simulates the dangers of cybercrime, is designed to encourage positive behaviour by giving players choice and a safe place to practice. Request a demo here.

We worked with Preloaded to add xAPI tracking to Zero Threat so that the game can be launched from an LMS or similar as an xAPI package, or as a stand alone program. However the game is launched, it tracks games starts and completions, turns completed, and cards drawn and played by the learner and the computer opponent. This data is sent to Watershed LRS via xAPI where it can be viewed in a variety of reports.

This guide explains how to connect Zero Threat to Watershed and then use Watershed to report on the data. It has three sections:

Launching Zero Threat from an LMS or similar

The Zero Threat game does not inherently know who the learner is or where to send the tracking data. The game has to be told this information when the course is launched by a training delivery system, normally an LMS. The training delivery system should handle collecting information about who the learner is, but you’ll need to configure it with your Watershed LRS credentials and endpoint. Exactly where these configuration settings are entered will depend on what system you are using.

See How do I add an activity provider to Watershed? for details of where to find your endpoint and credentials in Watershed.

Please note: game events are only tracked when not in tutorial mode. The tutorial mode can be turned off by clicking the option off in About on the front page after launching the game. We recommend that you tell learners about the tutorial and that this mode is not tracked.

Launching Zero Threat as a stand alone game

Zero Threat can be launched as a stand alone game by embedding the LRS endpoint and credentials into the package itself. Learner details are collected by a separate launch.html file, which is the file you should send learners to first when using this mode.

To embed the LRS details in the package, edit the endpoint, key and secret properties of the config object in launch/launch.js.

var config = {
    endpoint: 'https://watershedlrs.com/api/organizations/XXXX/lrs/',
    key: '<key>',
    secret: '<secret>',
    ...
};

Please note: game events are only tracked when not in tutorial mode. The tutorial mode can be turned off by clicking the option off in About on the front page after launching the game. We recommend that you tell learners about the tutorial and that this mode is not tracked.

Reporting on Zero Threat data in Watershed

We've defined 20 different report cards that give insight into Zero Threat data. Since these reports will be the same for everybody deploying Zero Threat in their organization, the best approach is for you to ask us to copy the measures and report cards into your Watershed account, rather than trying to recreate them yourself. We can then work with you to create reports exploring the relationship between Zero Threat activity and performance, and other metrics such as those relating to real world security incidents.

A list of Zero Threat reports is summarized in the table below. Examples of some of these reports have been included in this help guide. Contact info@watershedlrs.com or come and visit us at a tradeshow or conference to see a complete demo of all of the reports.

Report

Description

Zero Threat Stream

An interaction stream of recent game events that can be filtered by learner and/or time period. Useful for seeing the detail of how individuals are interacting with the game.  

Zero Treat Overview

An activity card that includes a leaderboard of learner scores and activity plus an overview of scores, time to complete, completions and successes over time.

Game Drop-outs Analysis

A colorful barchart visualizing the number of times people that progress from launching the game through to winning and how many drop out at each stage: launching, opening the menu, starting the game, completing the game, winning the game. This is presented as a month by month comparison.

See the screenshot at the top of this guide.

Best Scores Leaderboard.

Shows the highest scores and fastest durations for winning attempts at the game by learner.

Best Progress Leaderboard

Shows the highest percent progress through the game achieved by each learner. Winners have achieved 100%. This report is helpful to compare the performance of learners who do not appear on the best scores leaderboard.

Last Scores Leaderboard

Shows the score, duration and percent progress for each learners most recent attempt.

Average Scores Over Time

A line chart showing how average score, game duration and progress change over time.

Has the player experienced all the content?

A heatmap illustrating what proportion of the total possible outbreaks and cards have been experienced by each player. This might be a useful report to display to learners to encourage them to keep playing the game until they have defeated all the outbreaks and played all the cards.

Player Statistics

Whilst the leaderboards look at performance, the Player Statistics heatmap looks at learner activity in the game through nine different activity metrics.

See the screenshot above.   

Player Statistics Correlation

A correlation card exploring the relationships between the various statistics.

Turn Activity Over Time

A line chart showing the occurrence of turn level events such as playing cards and defeating outbreaks over time.

Turn Activity By Turn

The same metrics as a bar chart comparing different turns.

Turn Duration By Turn

Bar chart showing the average duration per turn. Which turns do people spend longer on?

Turn Duration Range

A range chart looking at the shortest and longest times learners spend per turn. Identify which people got distracted part way through the game.  

Turn Data Range

Range chart showing on which turns people lose the most data to the hackers.

Turn Drop Off

Barchart showing which turns most people lose or quit the game.

Threat Cards Usage

Spider chart showing which threat cards (cards played by the opponent) appear the most.

See screenshot below.

Action Cards Usage

Spider chart showing which action cards (cards played by the learner) appear and are played the most.

Threat Cards Over Time

Line chart showing the number of times each individual threat card is drawn and played over time.

Action Cards Over Time

Line chart showing the number of times each individual action card is drawn and played over time.

Zero Threat data can also be viewed in the Essentials dashboard to get a high level view of activity over time, most active people and most popular cards.

Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

If you can't find what you need or you want to ask a real person a question, please contact customer support.