X Close

Is Instagram really bad for teenagers? The quality of the company's secret research into mental health is abysmal

Is social media really damaging for teenage girls? Photo by Oli Scarff/Getty Images

Is social media really damaging for teenage girls? Photo by Oli Scarff/Getty Images


September 22, 2021   6 mins

In 1999, the United States government filed a truly enormous lawsuit. Their adversaries were nine tobacco companies. Citing a law normally invoked in cases involving the Mafia — the Racketeer Influenced and Corrupt Organisations Act — the government alleged that Big Tobacco had engaged in a giant criminal conspiracy over the entire latter part of the 20th Century. The companies knew, alleged the prosecutors, that smoking was harmful, causing lung cancer among many other diseases — indeed, they’d even proved it, in their own secret research, which dated back to the 1960s. But they had apparently gone to extreme lengths to keep that evidence under wraps, all the while using PR tactics to deliberately confuse the general public about the dangers of smoking.

Has the same thing just happened all over again? In what’s been portrayed as a shock revelation — with lots of accompanying outraged commentary — the Wall Street Journal last week informed its readers that “Facebook Knows that Instagram is Toxic for Teen Girls”. The Journal’s reporters had gotten their hands on some internal research done by Facebook, which owns Instagram. The conclusions, which had been kept private, are pretty scary: being on Instagram is making the site’s younger users begin to worry about how attractive they are, making one fifth of them feel worse about themselves, and exacerbating mental health problems. In the Journal’s exposé, the US Senator Richard Blumenthal and the psychologist Jean Twenge are quoted drawing a direct analogy from Big Tech to Big Tobacco: both have covered up research that their product, aggressively marketed to young people, is causing harm.

But the parallel doesn’t work. The research mentioned in the judge’s decision from the Big Tobacco case — which the nine companies lost in 2006 — was impressively extensive. It included experiments where cigarette tar was painted onto the backs of mice, causing tumours; a study of the effects of smoking during pregnancy on birthweight; studies on rats and rabbits exposed to tobacco smoke who developed tumours, emphysema and a whole panoply of other lung diseases; and studies that varied the strength of cigarettes to see if different “doses” led to different symptoms in humans.

Compare that to what’s in the “Facebook Files” (which, by the way, include leaks about several other topics, like the effect of social media on political debate, democracy, and human trafficking). The only evidence we’ve seen thus far is from surveys — teens filling in questionnaires about the effects they thought Instagram had on their wellbeing and mental health. The Journal also mentions larger studies, which link measurements of time spent on Instagram with survey responses, but no details are provided.

So, it would be as if Big Tobacco had sent a questionnaire to smokers, asking whether or not they’d gotten lung cancer, and whether they thought it was down to their smoking habit. If that was all we had, it would hardly be worth writing home about (or, indeed, in the Wall Street Journal): surveys might be an interesting spark for further research, but they’re a million miles from conclusive evidence.

“Correlation is not causation” is simultaneously the most hackneyed phrase and overlooked rule in science: although everyone’s heard it, people writing about studies — journalists and even the scientists themselves — routinely portray purely correlational or observational research as if it was an experiment testing the effect of one thing on another. This is the source of exciting headlines about how being optimistic makes you live longer, or that being more materialistic makes you depressed, or that drinking diet fizzy drinks makes it harder to lose weight — but no useful insight into the causes of health issues. In the Instagram case, the fundamental problem is that we don’t know whether more time spent on Instagram made the teen’s mental health worse, or — an equally-plausible opposite hypothesis — whether teens with worsening mental health for other reasons tended to spend more time on Instagram.

Asking people to introspect on the causes of their own mental health is hardly a reliable way of getting to the truth, given how much is going on in any one person’s life that might positively or negatively affect their wellbeing. Those who identify Instagram as the source of their sorrow could simply be mistaken — as could the vast majority of survey respondents, who said that Instagram either made them happier or had no effect on their mental health. So the headline splash of “Facebook Knows Instagram Is Toxic For Teen Girls” should, at the very least, have been: “Facebook Thinks Instagram Is Toxic For Some Teen Girls” — with a subheading: “On the Basis of Asking Those Teen Girls For Their Opinion”.

Perhaps the fury sparked by the Journal’s story would’ve been more justified if the research we do have in the public domain conclusively suggested Instagram — or social media in general — really is causing harm. This was certainly the case for tobacco: even without Big Tobacco’s covered-up internal research, there was plenty of convincing evidence available in the scientific literature to show the harms of smoking, even before the 1960s. A classic paper from 1959 (reprinted fifty years later) shows just how far researchers had gotten: they used different lines of converging evidence — population surveys, lab research, chemical studies — to demonstrate that smoking, beyond a shadow of a doubt, caused cancer.

But, in contrast, the research on the effects of social media on wellbeing is radically more uncertain. The psychologist Jonathan Haidt and the aforementioned Jean Twenge — both strong proponents of the social-media-causes-harm theory — have put together a useful document summarising the available evidence on the question. And that evidence is something of a mess: an array of correlational studies of widely-varying quality — but all suffering from the same shortcomings as Facebook’s survey research — sits alongside a set of experimental intervention studies, where researchers have, for example, had randomly-chosen participants limit their social media usage and observed the effect on their mental health.

That latter kind of research has mixed results: Haidt and Twenge note that eight of thirteen studies showed a statistically significant improvement in mental health after social media use was limited. But science isn’t democratic: we don’t count studies like votes, since not all studies are equal in their quality — or even necessarily comparable. In this case, some were in undergraduate students and some were in a wider adult age range (few, if any, included teens of the age that people are now concerned about); they used a variety of different methodologies; and looked at a variety of different social media sites.

Of course, the question of whether Instagram (or social media in general) makes teens unhappy is a lot harder to answer than whether smoking causes lung cancer. The effect of smoking is notoriously massive: smokers are by some estimates between 15 and 30 times more likely to get lung cancer than non-smokers (all research is like looking for a needle in a haystack, but the smoking-cancer researchers were looking for a needle the size of the one on top of the Empire State Building).

The effect of social media, for the average user at least, is likely to be far, far smaller. That doesn’t mean it’s not important, but it does mean it’s much harder for researchers to find. Those testing for subtle effects on mental health have the unenviable task of teasing apart an incredible amount of noise — people’s general mental health; the daily fluctuations in their mood; how we even reliably measure happiness in the first place — to find what might only be a modest signal.

But Big Tech ought to see the current furore — the backlash against them keeping their research secret — as an opportunity to do some better science. They’re in control of the platforms: they could run all sorts of useful randomised experiments on social media use, with huge samples of willing participants, who they could follow-up across months or years to assess their mental health. Given the potential conflicts of interest involved, such research would have to be ultra-transparent, and would preferably be done in collaboration with neutral, non-industry-linked academics. But of course, who’s to say that such research hasn’t already been done covertly by Facebook and others, and just hasn’t yet been leaked to the Wall Street Journal?

And that, of course, is the real issue: we are suspicious of Big Tech — and, in many ways, rightly so. It was the industry’s secrecy, not the quality of its evidence, that drove this particular story. The fact that Facebook have been hiding something from us has made commentators overlook the obvious limitations of the company’s research — Haidt and Twenge, for example, updated their document with the “Breaking news” that the Facebook survey had been leaked, despite knowing that survey studies are worth relatively little. Still, drawing comparisons to Big Tobacco’s conspiracies is ultimately facile, even if it gets the blood pumping.

Nobody comes out of this story looking good: not the secretive social media giants, nor the journalists exaggerating harms for attention, nor the scientists who’ve generally failed to provide us with a good evidence base. If they could all work together, of course, we might get some answers; but given their radically divergent motives, we might be asking the same questions for a while.


Stuart Ritchie is a psychologist and a Lecturer in the Social, Genetic and Developmental Psychiatry Centre at King’s College London

StuartJRitchie

Join the discussion


Join like minded readers that support our journalism by becoming a paid subscriber


To join the discussion in the comments, become a paid subscriber.

Join like minded readers that support our journalism, read unlimited articles and enjoy other subscriber-only benefits.

Subscribe
Subscribe
Notify of
guest

8 Comments
Most Voted
Newest Oldest
Inline Feedbacks
View all comments
Lesley van Reenen
Lesley van Reenen
3 years ago

Maybe then another article on big tech’s malign censorship and ‘fact’ checking. If they aren’t capable of deciding that Wuhan could have been the source of the Covid lab leak, then they are certainly not responsible enough to be conducting any experiments.
Let’s say it like it is – the whole show is linked into money and political affiliations.

Jon Hawksley
Jon Hawksley
3 years ago

We have a “free” internet because it is driven by advertising revenues. The big companies will respond to laws but imperfectly and there are plenty of other sources of information. What is needed is for users to take responsibility for choosing the sources they go to and learning to distinguish between information that adds to their life and information that is destructive. Children need to be taught how to do this. In particular they need to learn that they are the product of how they use their minds and bodies, for better or worse, the opinions of others are rarely relevant, or helpful, and looks only contribute 1 per cent to what they are.

Edward De Beukelaer
Edward De Beukelaer
3 years ago

Very good article.
Just one thing I would like to point out is the following phrase in this article:  ”but no useful insight into the causes of health issues.”
We very much work on the assumption that we can find all causes of illness and that if we cannot ‘prove the cause’ or ‘explain the mechanism behind it’ it does not exists. This is a major issue in medicine and cause huge misery for many patients.
Observational studies are likely much more valuable that we give them credit for. Of course, they do not stand up in trials very much. But what is important: stand up in trial with your medicine, or do the best for a population. Very different approaches with very different outcomes…
Time for medicine to wake up (some are waking up luckily)…

Norman Powers
Norman Powers
3 years ago

Surely insisting that any such research be done fully in public, and especially in collaboration with social scientists, is simply a fast way to kill all such research by companies into their own products. Nobody is going to voluntarily sign up to work with academics on such a task given their tabloid-esque chasing of non-replicable but high impact headlines, and the minimal efforts they put in to ensure accuracy of their results. As for neutrality, well, I think their supposed neutrality is a farce: they are as profit driven as Facebook is, except they count their profit in citations and ambiguous groupthink driven “reputation”.
No, we should encourage companies to do such research on their own products, because actually Facebook don’t want their products to cause mental health problems. That should be obvious. If Instagram makes people feel depressed then some large proportion of those people will just stop using it and that will cause them to make less money. And thus if their research proves there is a link, and that there is a fix, then we can assume they’ll want to implement that fix unless it’s something absurdly OTT like “shut down the whole site” (which is the kind of fix I’d expect social scientists to propose).

Barry Stokes
Barry Stokes
3 years ago

This was all being explored much earlier than the late 1950s. ‘In 1939, German scientist Franz Muller presented the first epidemiological study linking tobacco use and cancer. In 1943, German scientists Eberhard Schairer and Erich Shoniger at Jena University confirmed this study and convincingly established for the first time that cigarette smoking is a direct cause of lung cancer.’ German doctors also coined the phrase ‘passive smoking’. See The Atlantic magazine, July 9, 2014.

Neil MacInnes
Neil MacInnes
3 years ago

The problem is not Instagram.
It’s people, in this case kids, comparing themselves to other people on Instagram and believing that, somehow, they come up short.
We had the same story with the movies, tv, fashion & glamour magazines etc, in fact anywhere that people can go and see other people who are better looking, sexier, cleverer, stronger, faster, more skilful etc etc etc than they are.
The only comparison that is guaranteed to make people feel better about themselves is with politicians.
Bring back Trump, that comparison made everybody feel great.

LCarey Rowland
LCarey Rowland
3 years ago

We know intuitively that tech-enabled communication is inferior to (real)face-to-(real)face community. The adults in the (world)room ought to take responsibility for the mental welfare of their children, rather than conceding parental authority to Facebooboo, Instadrug or any other artificial intelligence.

Michael Coleman
Michael Coleman
3 years ago

Excellent piece. Ritchie never disappoints.
Suppose high quality and high powered (statistically) research finds a small detrimental effect (which is likely). The magnitude of the effect will have to be compared relative to all the other negative potential influences in young girls lives (movies, videos, etc.) . It seems that negative potential influences are inevitable and thus the only resource for parents is to emotionally prepare the girls for the onslaught (other than sending them to convents)