5 Proven Ways to Spot Fake Engagement in Your Classroom

Duolingo has a problem, and the problem isn’t the one you’d expect. Neuroscientist Jared Cooney Horvath calls it “all engagement, little retention.” Students tap through lesson after lesson, the streak climbs, the app feels alive. Ask them to hold a conversation in the language a week later, though, and the words are gone.
That gap between engagement and thinking isn’t limited to language apps. Horvath’s The Digital Delusion pulls together 398 meta-analyses covering 21,000 studies and lands on an average effect size of +0.29, well short of the +0.40 threshold researchers treat as a meaningful gain. PISA data tell a sharper story: students using computers six or more hours a day scored 66 points lower than non-users, a slide from the 50th percentile to the 24th. TIMSS 2019 found daily computer users 41 points behind in maths and 51 points behind in science, compared with occasional users.
None of that means every app wastes a lesson. So the signs of clicking, not thinking, stay easy to miss in a busy classroom. Edutopia’s Amy Kelly built a five-question audit for exactly this problem. Here’s what each question looks like as a symptom in your own room.
Sign 1: Nobody Can Tell You Why
Watch what happens when a student asks why the class is using a particular app today. If the honest answer is “we always do this on Fridays,” the tool has slipped from a teaching decision into a habit. Kelly’s first question, drawn from UNESCO’s 2023 Global Education Monitoring Report, is blunt: what is this helping students do? Not what does it cover, or what does the timetable say. What does it do for learning, this lesson, for these students?
The fix takes ten seconds. Before you open the app, finish this sentence out loud: “We’re using this because it helps you ___.” If you can’t finish it, neither can your students, and the fifteen minutes probably belongs to something else.
Sign 2: Finishing Fast Is Fake Engagement, Not Learning
A finished activity and a learned one aren’t the same thing, and fast finishers are the first clue. Horvath’s “all engagement, little retention” line describes exactly this pattern: students clear level after level, the badges pile up, and none of it survives contact with a test or a conversation a week later. Kelly’s second question separates completion from thinking, asking whether students analyse, explain, create, discuss, or connect ideas, rather than click and select their way to the next screen.
In practice, the swap is small. Replace “did you finish?” with “what changed in your thinking?” and watch how many students go quiet. That silence is the data you were missing.
The moment the app closes, ask one question that needs an explanation, not a score: “What was the hardest part, and why?” A student who can’t answer probably wasn’t thinking. A student who can just showed you the app worked.
Sign 3: The Room Goes Quiet in the Wrong Way
Some quiet means deep focus. Other quiet means twenty-five students in headphones, each alone with a screen, learning nothing from each other. Kelly’s third question checks whether a tool increases interaction or reduces it, because learning grows through discussion, feedback, questioning, and shared experience with other people, not through a device alone.
By contrast, a well-chosen tool creates something worth talking about. If your students haven’t turned to a neighbour in the last twenty minutes, the screens have taken over a job that belongs to the room.
Sign 4: You Can’t Name What You Skipped to Fit It In
Every block of screen time replaces a block of something else. Horvath’s advice, cited directly in Kelly’s audit, asks teachers to name “what may be displaced along the way”: discussion, hands-on work, sustained reading, handwriting, peer collaboration, productive struggle. None of that shows up on the lesson plan. All of it shows up in what students can actually do six months later.
At the same time, this is the easiest sign to catch, because it only needs one honest question before you add a tech block to the week: what am I trading this for, and is that a fair trade?
“All engagement, little retention.” Horvath’s verdict on lessons that feel alive in the moment and leave nothing behind by Monday.
Sign 5: You Forgot You Still Get a Say
Mandatory platforms and district logins can make tech use feel automatic, like a decision someone else already made. Kelly’s fifth question pushes back on that. Teachers still choose when students collaborate versus work independently, when a conversation replaces a digital response, and when the best move is to close the laptops and step away from the screen entirely.
Even so, that choice only gets used if you remember it exists. The first four signs tell you something has gone wrong. The fifth one reminds you that you’re allowed to fix it.
The Five-Second Version
Before your next tech-based lesson, run it past five questions: What’s the purpose? Thinking or completion? More interaction or less? What’s it replacing? And where’s my decision still mine to make? Five signs, five questions, one habit worth building.
None of this argues for pulling the plug on every app in the building, any more than the AI confidence trap argues for banning AI outright. Singapore and Estonia sit at the top of the PISA tables while running some of the most tech-saturated classrooms in the world, so the device itself isn’t the villain here. Next time, we’ll look at what the PISA headlines actually say about technology and test scores, and what they leave out.
References
- Kelly, A. L. (2026). 5 Questions Elementary Teachers Can Ask to Evaluate Their Edtech Use. Edutopia.
- Horvath, J. C. (2026). The Digital Delusion: How Classroom Technology Is Making Our Kids Dumber.
- UNESCO (2023). Global Education Monitoring Report.






