In our last blog post, we introduced our latest series that focuses on findings from our Learning Analytics Research Study—during which we collected and analyzed data to see how real organizations are implementing learning analytics. We're kicking things off by sharing insights from overall Watershed report usage and how certain times of the year can affect learning data and reports of different types and categorizations.
Beware of seasonal data patterns.
In the following example that spans from January 1 to November 13, 2018, you’ll see how seasonal patterns, such as key financial dates, can affect how and when organizations create and use reports.*
In this example, Org 1 uses Watershed to track people who have completed required courses. As a result, managers view reports to see completion statuses for each of their respective teams.
Notice that Org 1 had significantly more overall report views (i.e. Interaction Count) than other organizations, even though Org 1 didn't have a particularly high number of reports in use (i.e., Report Count).
In fact, Org 1 had an average of 172 views per report and had one report with 4,893 views during that same time period. By comparison, others organizations collectively averaged 13.5 views per report.
Recommended Resources
As we look at our report view data throughout this blog series, keep in mind there may be a bias toward this particular example because we have so many report views from Org 1.
In particular, the following image illustrates how the focus on completing required training results in significantly more report views around April (i.e., the end of the financial year) as managers keep track of people overdue for training.
We also noticed that after we identified our 5,713 reports to research, their report views started to decline immediately. This happened in conjunction with a continued increase in overall report views in Watershed (see the following image).
This finding suggests the number of views for existing reports declines over time as new reports are created and viewed—which is a good reminder to maintain and refresh reports as needed.
Actionable Insights
Remember, seasonal patterns are something to be aware of in your own reporting. So, expect numbers to fluctuate. And once your data collection passes the one-year mark, you'll be able to start building a model to project expected seasonal numbers. Here are three actions you can take away from this blog post:
- Make sure managers can view and track the completion status of their team members.
- Expect spikes in activity around key dates and deadlines (e.g., end of the year).
- Don’t let reports go stale. Keep them up to date to ensure stakeholders remain engaged.
Recommended Reading
Up Next: Learning Analytics Categories & Dimensions
Join us next time as we revisit the learning analytics model and review several new categories we’ve identified. You don’t want to miss out, so sign up for Watershed Insights to have the next blog post delivered right to your inbox.
*Disclaimer: All client names have been anonymized.
About the author
As a co-author of xAPI, Andrew has been instrumental in revolutionizing the way we approach data-driven learning design. With his extensive background in instructional design and development, he’s an expert in crafting engaging learning experiences and a master at building robust learning platforms in both corporate and academic environments. Andrew’s journey began with a simple belief: learning should be meaningful, measurable, and, most importantly, enjoyable. This belief has led him to work with some of the industry’s most innovative organizations and thought leaders, helping them unlock the true potential of their learning strategies. Andrew has also shared his insights at conferences and workshops across the globe, empowering others to harness the power of data in their own learning initiatives.
Subscribe to our blog
