
Do you turn your phone off an hour before bed? Do you feel like you ought to? Have you heard that the blue light affects your brain in some way? Throws off your circadian rhythms?
Youâre not alone. Apparently, AFC Bournemouth football team advises its players to wear orange glasses before bed, to help them get a good nightâs sleep. Even my local IKEA has a sign up in its lighting department warning people off devices before bedtime.
Thereâs a problem though. Thereâs little evidence that turning your phone off does anything. A significant study out last week looked at the sleep habits of 50,000 American children, and found that digital screen time âhas little practical effectâ on childrenâs sleep: each hour of screen use was associated with between three and eight minutesâ less sleep.
For all the claims that reducing screen use is an easy way to improve sleep, itâs not the case.
â[People] go on and on about how tech is the place we can easily intervene to bolster sleep,â Andrew Przybylski, the author of the study, told me. âBut if the difference between an eight-hours-screen-time-a-day teen and a zero-hours-a-day teen is less than 30 minutesâ sleep, then weâre barking up the wrong tree.â
There have been other studies. But theyâre usually looking at 15 people, or 25, or some other tiny number, and have almost no statistical validity. And even then, they are usually over-hyped.
One 2015 study looked at the use of e-books before bed, and declared ominously that e-book users âtook longer to fall asleep and had reduced evening sleepinessâ than non-users. But when you look at the details, the study found that people who read an e-book for four hours immediately before bed for five nights in a row fell asleep, on average, 10 minutes later than people who read a normal printed book.
This is not the stuff of a societal plague. Russell Foster, a professor of sleep science at Oxford, told me that while the findings were statistically significant, they were âbiologically meaninglessâ.
Itâs all part of a wider problem with our attitudes to tech, and to social psychology research in general. Small links are blown out of all proportion, and extrapolated from mildly interesting scientific finding to major lifestyle or societal intervention.
The key thing to note here is that when scientists say some finding is âstatistically significantâ, they donât mean that itâs important. They just mean that itâs probably not a fluke. If you give 1,000 randomly selected people a copy of Ă La Recherche du Temps Perdu and 1,000 people a copy of Jaws, and find that every single person who read Proust fell asleep faster, then youâve got a statistically significant result: itâs very unlikely that would happen by chance. But if they only fall asleep one minute earlier, then you have a tiny âeffect sizeâ. Itâs real, just not very important.
Finding a statistically significant result is interesting from a scientific point of view: it means that one phenomenon may be linked to another. (Or it may not. Because the bar of âsignificanceâ is set very low, and because there are simple tricks you can do to make your results look more significant than they are.)
But from the point of view of someone trying to navigate the world â say, to decide whether or not their child should use phones before bed, or play violent video games â itâs no use at all. What you want to know is the âeffect sizeâ.
Too often, though, we (the media, and scientific journals) treat statistical significance as important in its own right. A study last year found that social media use was linked to a rise in teen suicide and depression, which doesnât sound great, and was widely reported. The findings appeared statistically significant, so people started talking about how to reduce social media use.
But quite apart from the fact that it couldnât show causation (perhaps depressed teens spend more time on their phones), the effect size was tiny. As Amy Orben, a colleague of Przybylskiâs at Oxford, wrote in a blog post, social media use âonly explains 0.36% of the covariance for girlsâ depressive symptomsâ, and only 0.01% of boysâ. Even if the effect is real, the impact on depression of banning social media would be negligible.
Relatedly, research often finds that people who have played violent video games are more likely to behave more aggressively in laboratory situations: more willing to blast people with uncomfortable levels of noise, or to give them painfully hot chilli sauce, two common proxies for real-world aggression. But this (possibly) statistically significant finding, that people are more likely to behave somewhat unpleasantly for a brief period in the lab after playing Call of Duty, is extrapolated to video games being to blame for real-world school shootings.
Away from tech, the much-hyped educational theory of ‘growth mindset’, where children who are praised for hard work rather than praised for cleverness do better in life, because they believe their abilities can grow rather than being fixed, has been declared a ârevolutionâ and introduced to hundreds of UK schools. But, again, the statistically significant effect is tiny.
Media over-hype isnât solely to blame. Often the scientists and journals, keen to make an impact with their research, will leap onto a statistically significant finding and shout it from the rooftops, not bothering to explain that the effect is miniscule.
It’s not that there’s nothing to worry about. Foster says that there is evidence that some teensâ excessive phone use is delaying sleep â not through blue light or circadian rhythms, but just because theyâre staying up chatting and think the social gain is worth the loss of sleep. And it may be that while the average effect is small, a few people suffer badly: an âaverageâ delayed sleep onset of eight minutes could mean nine people falling asleep as usual and one person staying up for an extra hour and 20 minutes. If you want to stop using your phone before bed, go right ahead and do it.
What we shouldnât do, though, is engage in a sort of moral crusade against digital technologies, like a modern-day Temperance Society campaigning against the demon drink. I understand the temptation: the world really is changing fast. It’s barely two decades since mobile phones became commonplace and now everyone’s live an ever-increasing fraction of their lives online through them. Wariness is understandable.
But technophobic scaremongering, on the other hand, is making things worse. It is filling the world with false information, and making everyone a little bit stupider.
Join the discussion
Join like minded readers that support our journalism by becoming a paid subscriber
To join the discussion in the comments, become a paid subscriber.
Join like minded readers that support our journalism, read unlimited articles and enjoy other subscriber-only benefits.
Subscribe