Los Angeles Unified became the first major school district to stop issuing devices to its youngest students altogether—no screens until second grade—while setting daily and weekly screen-time caps for older grades, blocking YouTube on school devices, and ordering an audit of education-technology contracts the teachers union values at $1.6 billion. That package is less a policy revision than a wager: pull the screens back, and attention and achievement will follow.
At least 37 states and the District of Columbia require districts to ban or restrict student cellphone use in school buildings, making removal the dominant response to smartphone distraction. Yet a large national study of schools adopting Yondr lockable pouches found close to zero short-run improvement in test scores—raising a question the bans themselves aren’t designed to answer: how much academic leverage does the absence of a phone actually provide? The gap between the policy effort and the academic payoff points to a different variable: not whether a device is in the room, but what it is designed to do once it is. For mobile learning platforms, the crucial difference is between interfaces that organize active retrieval, surface knowledge gaps, and represent progress as exam-topic mastery, and those that merely simulate productive effort. For students who rely on phones as their primary study infrastructure, that design quality is what determines whether on-phone preparation closes gaps or simply fills time.
The Right Problem, the Wrong Solution
The concerns driving these restrictions are not vague unease. At a January 2026 U.S. Senate Commerce Committee hearing, expert witnesses told lawmakers that 1-to-1 school devices and other digital tools can undermine learning and children’s mental health. Jared Cooney Horvath, Director of LME Global and a neuroscientist who testified at the hearing, put numbers on it in his written submission: “Unfortunately, studies suggest that less than half of this time is spent actually learning, with students off-task for up to 38 minutes of every hour when on classroom devices.” When testimony places barely half an hour of actual learning inside each school device hour, banning the device feels like the obvious move. It also happens to be the easiest one.
The day before that hearing, organizations including AASA, the School Superintendents’ Association, CoSN, and SETDA sent Congress a joint letter arguing that classroom technology used intentionally is not the same as entertainment screen time. They said digital tools can help differentiate instruction, support special education, and prepare students for the workforce—insisting that supervised, purpose-built software should be judged differently from unsupervised scrolling. Embedded in that argument is a standard the debate mostly left undeveloped: the difference between technology that structures purposeful academic work and technology that simply delivers more screen exposure.
A broad national study of schools that adopted Yondr lockable phone pouches makes that standard impossible to ignore. Across 4,600 of them, the national comparison found test-score effects close to zero on average in the short run, with a small positive estimate for high-school math offset by a tiny negative estimate in middle school, and little evidence that restrictions improved students’ own reports of attention or bullying. An accompanying National Bureau of Economic Research (NBER) working paper, “The Effects of School Phone Bans: National Evidence from Lockable Pouches,” uses national data and a staggered difference-in-differences design to estimate these impacts—strengthening the case that pouch adoption by itself is not a reliable short-run achievement lever on average, even if longer-run effects or implementation differences remain open questions. The inference is narrow but sharp: removing phones changes what students can reach, but it does not automatically create sustained cognitive engagement. That pushes the unresolved question from the letter into the foreground: what would purposeful, learning-oriented design on devices actually have to look like?
The Attentional Architecture Travels with the App
A companion national analysis of schools using Yondr pouches shows how far behavior can move without test scores following in lockstep. In surveyed schools, the share of students using their phones in class for personal reasons fell from 61 percent to 13 percent after pouches were introduced, and many district and school leaders reported better behavior and engagement. Yet the national test-score results indicate that sharply suppressing visible phone use did not produce broad short-run achievement gains on average. The behavior changed dramatically; the learning signal barely moved.
That pattern matters because the attentional competition created by smartphones does not vanish when a student taps into an educational app. Notifications, social feeds, and message threads remain one gesture away, and the device is designed to surface them continually. Experimental work by Stothart and colleagues in 2015 found that simply receiving a cell-phone notification can impair performance on attention-demanding tasks even without picking up the phone, and a 2025 meta-analysis by Chen and co-authors in Computers in Human Behavior reports an overall negative effect of mobile-phone distraction on immediate recall across randomized experiments. The interruption layer that makes smartphones compelling for social use is therefore a standing constraint on any attempt to use them for concentrated study.
A learning app that treats the phone as a neutral delivery channel ignores this constraint. Design choices about pacing, prompts, and feedback either counteract the phone’s pull toward fragmented attention or quietly accommodate it while presenting an academic surface. When design accommodates that pull, the result is coverage—topics touched, time logged, engagement metrics satisfied. When it resists, the result is something actionable: knowledge mapped against the syllabus, weaknesses surfaced, gaps named before the exam does it instead.
The Difference Between Looking Productive and Being Productive
Most mobile products are built around engagement metrics: minutes spent, sessions completed, consecutive-day streaks, badges earned. These are easy to log, easy to visualize, and emotionally rewarding when they rise. For exam preparation, though, they are proxies at best. A long streak says a student has interacted with something every day; it says nothing about whether they can, under assessment conditions, handle the concepts that will actually appear on their exams.
This is the difference between coverage and mastery. Coverage means having touched every topic area, often through brief exposures that a session log can happily tick off. The interface that stops there produces a list of completed lessons, not a picture of readiness; mastery representation demands accumulating performance data by topic and returning it to students in a form that highlights weaknesses rather than papering them over with completion badges.
The gap between engagement signals and real mastery is not distributed evenly. A U.S. Government Accountability Office report (GAO-19–564) notes that lower-income households with school-age children are more likely than higher-income households to rely on mobile wireless access without fixed in-home broadband, and that connectivity constraints can make it harder for students to complete schoolwork. Pew Research Center reporting from 2018 adds that a meaningful share of teens say they cannot always finish homework because they lack reliable computer or internet access. For these students, a smartphone is often the primary infrastructure through which exam prep must happen, not an optional supplement. When access runs mainly through a phone, an app that rewards time-on-task without surfacing gaps risks giving the appearance of progress precisely where targeted support is most needed.
What Diagnostic Design Looks Like in Practice
For mobile exam-prep platforms, three conditions matter: the app demands task commitment through active retrieval, gives feedback that surfaces weak areas, and represents progress as exam-topic mastery rather than activity counts. Evidence reviews of retrieval practice and formative feedback treat these as aligned mechanisms rather than guaranteed outcomes. The practical question for any given app is correspondingly simple: does it mainly tell a student how much they’ve done, or does it show, in syllabus terms, what they can and cannot yet do?
Even well-intentioned platforms have struggled with that distinction. In a support post announcing that “Streaks are going away on January 4, 2021,” Khan Academy explained that streaks could be “demotivating” when learners broke them for reasons outside their control, such as “health, device access, or Wi‑Fi.” Progress framed as an unbroken chain of days had become a goal in itself—one that punished the very students facing access challenges and showed how continuity-based signals can dominate motivation while remaining only loosely tied to readiness.
The Revision Village app—an online revision platform for International Baccalaureate (IB) Diploma and International General Certificate of Secondary Education (IGCSE) students and teachers, used by more than 350,000 IB students in more than 135 countries—structures practice around exam topics rather than session counts. Its performance analytics dashboards draw on data from a syllabus-aligned Questionbank to map each student’s strengths and recurring errors at the topic level, with class-level patterns visible to teachers from the same data. Topic-level gaps, not question counts, become the main progress indicator for smartphone study.
The Variable Was Never the Device
The spread of phone bans, lockable pouches, and technology-contract audits signals that smartphones and schooling are not delivering the attention or outcomes the investment implied. National quasi-experimental evidence on lockable pouches finds near-zero average short-run test-score effects—showing that removing devices from reach is not, on its own, a dependable path to achievement gains.
For students relying on smartphones as their primary study infrastructure—a pattern that skews toward lower-income households, as connectivity and homework-completion data make clear—design quality carries more weight, not less. An app that rewards activity without surfacing gaps delivers the appearance of preparation precisely where targeted revision is most needed. That’s the context in which Revision Village’s diagnostic approach operates: reach matters, but only when the design directs students toward what they still need to work on.
As districts review substantial technology contracts, the meaningful audit isn’t the one Los Angeles commissioned at $1.6 billion—it’s the quieter one at the feature level, where the question is whether an app tells a student what they can’t yet do, or only confirms what they’ve already touched.
