Sample testing devices used in diagnosing the coronavirus are checked on a production line in South Korea (Photo by ED JONES/AFP via Getty Images)

We need antibody testing. Everyone agrees with that â the question is how it can be done.
There are two main kinds of test for Covid-19: PCR tests which tell us who has the disease right now; and antibody or serological testing, which can tell us whoâs had it in the past. The Government wants to build testing programmes that can give a reliable answer from a pinprick test in under 20 minutes.
Iâve been banging on about antibody testing in recent pieces. Itâs vital for understanding how far the disease has spread throughout the population; without knowing that, we canât know how deadly it is, or exactly how alarmed we should be.
But other people have been making another point: that if someone has already had the disease, then â hypothetically, hopefully â they ought to be immune to getting it again. If theyâre immune to getting it again, they canât spread it, so they should be allowed back out into the world, to help get the economy started again.Â
This is the idea behind mooted âimmunity passportsâ for people whoâve tested positive. Tony Blair seems to be talking about something similar when he writes, in the foreword to a report for his Institute for Global Change, that unless we can âtrack who has the disease and who has had itâ, we will remain locked in a situation âin which everyone has to be isolated so that we donât miss the small number of cases which need to be isolatedâ.
Immunity passports sound like a good idea. But I wanted to sound a note of extreme caution. I think antibody testing is absolutely vital â for understanding the spread of the disease, at a population level. But using it to establish individual immunity is very different and potentially much more dangerous.
Letâs assume that people who have had the disease really are immune. Now, imagine that you have a test that is 95% accurate â that is, if you use it on someone who has had the virus, itâs 95% likely to say they have had the virus; if you use it on someone who hasnât, itâs 95% likely to say they havenâtâ. The US FDA has just issued emergency approval for a test with reported numbers pretty much like that (to be precise, 94% and 96% respectively).
So you are given the test, and it comes back positive. How likely is it that youâve had the disease?
The answer, for the record, is not 95%. The answer is: you donât know. Unless you know what percentage of people in the population have had it, then you simply donât have enough information to answer the question.
Letâs look at why. Imagine that 3% of people in this country have had Covid-19, which probably towards the upper end of most reasonable estimates at the moment. Now letâs imagine that you test a million people, completely at random.Â
Of those million, about 30,000 will actually have had the disease. Your test will correctly identify 28,500 of them. And 970,000 people will not have had the disease. Your test will correctly identify 921,500 of them. So there will be about 1,500 people who are wrongly told that they havenât had it, and who are forced to remain in unnecessary isolation. Thatâs bad. But itâs not the real problem.
The real problem is that 48,500 will be told they have had the disease and are now immune. That outnumbers the true positives by almost two to one. If you issue immunity passports on this basis, barely a third of the people you give them to will actually be immune. âThereâs nothing peculiar about this statistically,â Kevin McConway, an emeritus professor of statistics at the Open University, told me. âItâs just Bayesâ theorem.â The likelihood of you having had Covid-19, if youâve had a positive test, depends not just on the accuracy of the test but on the prevalence in the population youâre looking at.
This is a huge problem in diagnostic screening for other diseases, such as cancer and dementia, and can mean that screening tests do more harm than good. Itâs why there are follow-up tests. With Covid-19, the concern is that if you just test the same person twice with the same test, thereâs a good chance itâll get it wrong for the same reasons.
This is not to suggest that immunity passports are impossible. For instance, McConway points out, it would be possible to narrow the group youâre testing, so that it contains more people whoâve probably had the disease. It might be, letâs imagine, that people whoâve had the main symptoms of the disease â a persistent dry cough and a high fever â are 60% likely to have had it. So you ask people if theyâve had those symptoms, and you test a million people who have.
In that case, your million tests would send you back 570,000 true positives and only 20,000 false ones; you could be 97% confident that a positive test was correct.
Of course, some tests will eventually be better than 95% accurate â some of those in development claim 100% specificity (that is, they never give false positives). If thatâs real, great, although I agree with McConway when he says that no test can be literally perfect.
And this blog post by Sir John Bell at the University of Oxford explains the difficulties of making an antibody test for a new disease: you need something that can be rapidly rolled out to millions of people; you need to validate it on people who you know tested positive on a PCR test, at least 28 days ago, to check for false negatives; and you need to test it on blood taken from people before the outbreak, so you can check for false positives.Â
The Oxford post says âSadly, the tests we have looked at to date have not performed well. We see many false negatives (tests where no antibody is detected despite the fact we know it is there) and we also see false positives.â None of those tests have reached the standards that they and the Medicines and Healthcare products Regulatory Agency have agreed.
This does not mean that antibody tests are of no use! Far from it â antibody tests are essential. If you have a well-validated 95% accurate test, you canât confidently say that any individual is or isnât immune â but you can use it to get a sense of how many people have the disease. The more people you test, the more accurate an answer you can get; tens or hundreds of thousands of tests would give you quite a precise estimate with quite narrow confidence intervals.
That would, as I keep saying, give you much more information about the disease itself. But it would also give you a better chance of using antibody tests for immunity passport purposes. As weâve seen, if you donât know the prevalence in the population, you donât know what a positive test means for the individual. But if you knew that some high percentage had already had it, and were able to narrow it down further by asking about symptoms, and then could use a highly accurate test, then you could start to get towards the sort of precision we need; where you might be able to let people out into the streets again.
In the end, thatâs going to be a horribly cold-blooded calculation. If you let people out when theyâre 90% likely to be immune, that means one person in 10 is going to be at risk of getting and spreading the disease. Is that risk a price worth paying for reducing the real costs (economic, social, physical, mental) of isolation? I donât know and Iâm glad I donât have to work it out. But someone has to. And theyâll have to start by getting a reasonably effective test, and testing hundreds of thousands of people, to see how many of us have had it.Â
Â
Join the discussion
Join like minded readers that support our journalism by becoming a paid subscriber
To join the discussion in the comments, become a paid subscriber.
Join like minded readers that support our journalism, read unlimited articles and enjoy other subscriber-only benefits.
Subscribe