Data Denial: The Hidden Risk in Student Engagement

Data on student engagement is available but many faculty still default to personal observation.

The Findings

Despite the availability of data-rich platforms, data from the Time for Class report shows that nearly half of instructors still rely on personal observations to assess student engagement. This is more than those who use LMSs or courseware data. While intuition has its place, this reliance on anecdotal cues can lead to bias and missed opportunities to support students who may be struggling silently.

Instructors

Nearly half of instructors still rely on personal observations.

The Breakdown

“Most of the time faculty are utilizing their own anecdotal sentiments,” said Dr. Zone. “It’s not really based on the platform data.” She added that this ad hoc approach often means instructors are engaging with students based on hearing about it from them, rather than proactively identifying who needs support. “Faculty are doing their best,” she continued. “But they’re often flying blind.”

Catherine Shaw emphasized that intuition is a valuable skill developed over years of experience, especially in face-to-face settings. “[Instructors] can tell when a student seems to not be focusing or when they’re not confident in an answer,” she said. But she also acknowledged that this approach becomes harder to apply in larger or online classes. This is where digital tools can help, by supporting and augmenting some of that human intuition.

Dr. Ford urged institutions to take a more holistic, data-informed approach. “We need administrators to rely less on that personal observation and more about thinking about the whole student,” she said. This includes using sentiment analysis and engagement data to identify students facing motivational or mental health challenges—information that can help faculty intervene earlier and more effectively.

The Takeaway

Relying solely on personal observation to assess student engagement can leave gaps in support and equity. Institutions must help faculty combine their experience with available data to better understand and respond to student needs. To move forward, they should:

Provide training on how to interpret and act on LMS and courseware data

Encourage faculty to use engagement metrics alongside their own observations

Invest in tools that surface early signals of disengagement or distress

Promote a culture of data-informed teaching that supports the whole student

In Practice

How to Combine Intuition and Digital Data to Improve Student Success

Catherine Shaw, Managing Director at Tyton Partners, understands the value of intuition. But she also understands that sometimes all faculty need to take advantage of the digital tools on offer is a bit of direction. In the video below, she outlines a few of her tips:

“They just need a nudge or a pointer to the tools. And there’s a lot of tools out there. So how can we help faculty know where to look or know where to go first? I think making those recommendations would go a long way.”

Catherine Shaw 

Managing Director, Tyton Partners