What did The Royal Society peer-reviewer say about the new Torgerson et al (2025) paper?

Professor Paul Torgerson


The peer-reviewer of the new scientific paper, Torgerson et al 2025,  published on June 11th is the Director of Biomathematics and Statistics Scotland (BIOSS). The paper is concerned with analysis of the Ranomised Badger Culling Trial (RBCT). Below, you can see the text of the review together with the authors responses, as addressed to the editor.  Also highlighted (bold italics) are a few points that seem particularly important & difficult to disagree with, even if you don’t understand statistics. It should be noted that the two reviewers of the Mills et al. (2024) papers that Torgerson et al. is rebutting, declined to submit a review of the new Torgerson paper. In other words, they praised the two Mills et al papers, recommended them for acceptance, but declined the opportunity to defend their decision by explaining their thinking on Torgerson et al (2024 & 2025). They remain anonymous, which is interesting from an integrity perspective.

These communications are available from a link (Review History) on the online paper.

Torgerson: The reviewer has made a number of comments. We have addressed these where necessary and made some amendments to the text. We would also like to thank the reviewer for these helpful comments which we hope have improved our manuscript.

Reviewer: Comment. Overall it seems there is strong disagreement over competing data analyses on what is already a highly contentious issue, which has significant implications in terms of ecology and agriculture. I have been asked to comment on one small part of the ongoing discussion, which I will do – however, my overall, strongest recommendation is that, given the importance of the underlying issue (both scientifically and politically) that a proper investigation be conducted to establish an agreed position involving all parties. A continuing to-and-fro among different sets of authors – each, I am sure, well-meaning in their own ways – serves little purpose, and there are better, more efficient and effective ways of resolving disagreements than in the pages of an academic journal.

Torgerson: The underlying issue (mass culling of largely healthy badgers across much of England and in Ireland) is the result of the original analysis by Donnelly et al, first published in Nature in 2006 and papers derived from that, and subsequent analyses. Although the merit of the analysis has been questioned, only by having alternative data analyses published in peer reviewed journals is it possible for the UK Governments to consider amending the policy. Nevertheless, we have contacted Donnelly et al previously in an attempt to meet and to find common ground, but our attempts were rebuffed. In order to give the reader a clear idea of the applied implications of both our re-evaluation and the peer review comments, we have added some text to the conclusions: “Accordingly a very substantial number of publications that rest extensively or completely on RBCT statistical analyses may require major qualification or retraction. The justification for lethal control of badgers to-date appears to have been based upon basic statistical oversight.” Also there is a reproducibility crisis in science. Therefore it is important for these issues to be published as we believe they provide an exemplar of a major driver to the reproducibility crisis and misdirection of disease epidemic management.

Badger Crowd Comment: A scientific seminar and evening presentation on the work of Paul Torgerson and his team (then a pre-print) was organised in Oxford in November 2024 in order to allow debate with the RBCT scientists. All declined the invitation. DEFRA and APHA sent no representatives. Natural England sent one staff member but gave no feedback. Badger Crowd very much welcomes the reviewers suggestion to hold a “proper investigation…to establish an agreed position involving all parties.”

Reviewer: Comment 1) Section 2.1. I agree with the authors of the current contribution here that use of an offset here is likely a requirement, and that the comments from the Mills et al. (4) are naïve at best – it isn’t helpful to think of an offset as equivalent to setting a regression coefficient to 1.0, as of course the issue is that this is a log-linear scale and the point is that (under the Poisson) we assume proportional rates. I agree that it does not seem to make sense that the herd breakdowns vary only very slightly (the parameter value of 0.04) with the number of herds, although I would caution here only that it is possible some other variable/term in the model might be related to the number of herds, hence suppressing the parameter value (when including number of herds as a regression term rather than as an offset) owing to collinearity.

Torgerson: This is quite possible, and the collinearity is likely to be between the co variates of “triplet” and “baseline herds at risk”. Hence the motivation to explore the results of models where triplet was removed (which always resulted in a considerable reduction in AICc). Although it is not clear if the reviewer required a response to this statement, we have inserted the following text into the manuscript “The removal of “triplet” may remove any hidden effects possibly due to collinearity with number of herds, as well as substantially reducing the number of covariates and hence largely eliminate the issue of over fitting.”

Reviewer: Comment 2) I have personally written (Brewer et al, 2016 – https://doi.org/10.1111/2041-210X.12541 ) about the dangers of relying on the theoretical distinctions between AIC/AICc and BIC, so it should be no surprise that I share the current authors’ suspicions on the preference expressed in Mills et al. (4) for BIC. Also, why are the AICc values for Models 1 and 3 so much higher than the null model in Table 1? Is this just a feature of the small-sample correction? Otherwise I would not expect this at all (if I’m understand what the null model is, correctly); in the absence of other explanations here, given the high number of parameters in models 1 and 3 I would suspect poor model fitting with inflated variances due to collinearity. So, I agree with the current authors here, on the basis of the evidence in front of me (Sections 2.2+2.3, Table 1, supplementary material).

Torgerson: This issue is well taken. This was part of our arguments. Although perhaps not completely clear. We have edited the relevant text which now reads “Brewer et al (16) have written about the dangers or relying on theoretical distinctions between AIC/AICc and BIC. Nevertheless, Mills et al. (4,5) state “…a wide array of statistical techniques and study periods allows us to make robust conclusions regarding the effects of proactive badger culling which are informed by consistent scientific evidence from trial data, irrespective of which approach to statistical inference is taken.” This is demonstrably untrue. The analysis of “confirmed breakdowns” (OTFW) show that results are highly dependent on the approach to statistical inference and information criteria used. However, absence of any cull effect on the incidence of bTB, when total breakdowns are considered, is robust, irrespective of statistical method.

Reviewer: Comment 3) The discussion on Bayesian models claims that the authors of Mills et al. (4) made coding errors. I do feel that then Mills et al. should be able to examine and (if relevant) correct these errors, and formally issue a correction in the pages of the journal. Otherwise, I don’t feel I have sufficient information to comment further here.

Torgerson:  Here the reader needs to refer to both the coding on GitHub, which is where Mills et al have made their statistical code available and the code we have given in the supplementary material. We give an example here.
In Mills et al, they claimed an offset was used with the following R code:

rs1aB←stan_glm.nb(Incidence~Treatment+log(hdyrsrisk),+log(Hist3yr), offset = log(hdyrsrisk), prior_intercept=normal(0,10), prior=normal(0,10), data = rbctconf, refresh=0)
Here you will note (in red) that log(hdyrsrisk) appears twice in the code, both as an explanatory variable and an offset. The effect of this is to shift the parameters of log(hrdyrsrisk) by a value of 1, whilst other parameter values remain unchanged, thus effectively having no offset.
The correct code if a parameter value is to be fixed as an offset is:
rs1aB<-stan_glm.nb(Incidence~Treatment+log(Hist3yr), offset = log(hdyrsrisk), prior_intercept=normal(0,10), prior=normal(0,10), data = rbctconf, refresh=0) or alternatively:
rs1aB<-stan_glm.nb(Incidence~Treatment+offset(log(hdyrsrisk))+log(Hist3yr), prior_intercept=normal(0,10), prior=normal(0,10), data = rbctconf, refresh=0)
We refer the reader to our supplementary material where it is fully explained together with the other errors in the code of Mills et al.

Reviewer: I agree with the current authors’ concerns on the statistical audit. I would go so far as to say that, given the important of the topic of this discussion, any audit should be carried out openly and transparently.

Torgerson: We have added short text at the end of section 4 “ It is important that trials include an audit that is open and transparent.”

Reviewer: Comment 5) Section 5 on the neighboring area study – again, from what I can see here, I would broadly agree with the concerns of the current authors.

Torgerson: No response required

Reviewer: Comment. 6) To clarify; I have no issue with the modelling of counts, as the use of a Poisson-form log-linear model is, in effect, modelling rates. To be more precise, I would suggest that the problem is not that Mills et al. (4) modelled counts, but that they did not properly scale those counts by use of an appropriate offset – and again, I am saying this on the basis of the evidence of the current work (only).

Torgerson: Here the reviewer appears to be agreeing with our approach by using the offset. But for clarity so readers can see the derivation of the offset (in the Poisson log-linear model) in our previous manuscript where there derivation is explained. Thus we have inserted the text “The mathematical derivation of the offset is explained in our previous manuscript on this issue (3).”

Reviewer: Comment. 7) Finally, I would like to address the quotation from Donnelly (16): “the suggestion of requiring independent replication of specific statistical analyses as a general check before publication seems not merely unnecessary but a misuse of relatively scarce expertise”. The point to me here is not that work should be “replicated” as such, but that work should be verifiable. The authors of Mills et al. (4) have apparently made their work – at least that related to the 2024 journal papers – available openly, and this is the key; openness and transparency are vital. I would even go as far to say that, in such a contentious area as this, it is naïve to imagine that a single analysis by a particular group of scientists should be seen as sufficient.

Torgerson: Yes we agree, which is one of the issues with the original RBCT proactive cull statistical findings published in 2006, which was led by Donnelly: it was a single analysis by a particular group of scientists, and the Mills et al papers are also led by Donnelly et al. We think this is obvious and it should be verifiable. Nevertheless we have modified the text surrounding the quotation of Donnelly (16). It now reads: The position of Donnelly (17) that “the suggestion of requiring independent replication of specific statistical analyses as a general check before publication seems not merely unnecessary but a misuse of relatively scarce expertise”, needs revisiting. This case underlines the need not only for rigorous checks of statistical analysis but also validation of the statistical models and assumptions used within submitted manuscripts to verify them.

Badger Crowd Comment: For the last 6 months, Sir Charles Godfray and his ‘expert’ panel have been reviewing badger cull and bovine TB science published since 2018. Godfray was involved in the RBCT audit, the 2013 restatement of badger cull science and the 2018 science review. In other words, the single analysis (Donnelly 2006) that has supported the badger cull policy is being reviewed by (largely) the same ‘particular’ group of scientists who have been associated with the work for nearly 20 years. Donnelly herself has been ‘recused’, but has been replaced by another Oxford statistician from the same department. There is no outside scrutiny, and there is a case that there has been no “proper investigation ….to establish an agreed position involving all parties” as recommended by the peer reviewer. A proper investigation would be free from conflict of interest. Defra have refused to address this issue over the last six months.

In case you missed the point of all this, the new Torgerson paper shows how for multiple reasons that there is no evidence that culling badger delivers a disease benefit of bovine TB control in cattle herds. The current ‘closed shop’ of science at DEFRA has fallen flat in the past and should not be allowed to continue. They are selecting the scientists and science that they want to suit a civil service agenda and they don’t want to admit that they have been wrong for very many years. It is a flagrant example of policy driven science. And everybody is losing out because of it: the public (because of the enormous costs of policy), the farmers (because it is a policy that can never achieve its aims) and the badgers – because they are being inhumanely killed in huge numbers. 

This intolerable situation cannot be allowed to continue. Badger culling must stop now, and an independent investigation or inquiry must be set up.

Bovine TB roundup 2024

Everything changes but stays the same?

2024 has been a remarkable year, where it seems that better awareness of the bovine TB scandal is emerging. Yet institutional forces struggle to grapple with poor science, the embarrassment of failing policy and the need for decisive steps to overcome decades of oversight, dogma and vested interest.

In February, DEFRA’s Animal and Plant Agency (APHA) published a controversial paper (Birch et al.) in Scientific Reports that the DEFRA Minister Steve Barclay trumpeted immediately as showing that badger culling since 2013 was ‘working’ (see here). The journal  and the authors refused to change a misleading abstract that implied this, despite the paper stating twice (on careful reading) that the observed overall reduction in bovine TB over the study period could not be attributed to badger culling. All disease measures implemented, including more frequent cattle testing, were analysed together with no control. Basically the analysis is just a time period study, as pointed out in Prof David Macdonald’s earlier comments on the draft paper (see here) for work already labelled as policy-led science (see here).

DEFRA’s tactics appeared to be to try to justify badger culling in order to reverse the ‘phasing out’ of badger culling by the 2020 ‘Next Steps’ policy. This was perhaps also addressing the High Court’s expectation, stated 5 years previously, that policy should ‘adapt and learn’ from the results of Supplementary Badger Culling. The DEFRA plan, as revealed on 14th March, was to introduce something called ‘targeted culling‘ (see here), which was in reality a rebranding of epidemiological culling as carried out in the Low Risk Area (‘LRA Culling’) of England since 2018, including in Cumbria, south of Penrith. In this and a further cull area in Lincolnshire, culling of 100% of badgers in a core area and beyond was permitted over three or more years, with some badger vaccination afterwards.  DEFRA refused to comment on a detailed report (here) documenting its epidemiological failings and its continuing clumsy approach to investigating sources of infection. Even now new breakdowns are happening in the Cumbria Area 32 due to unwise cattle trading and persistent infection.

The March 2024 DEFRA plan was to allow extensive culling into the future across England at the discretion of the Chief Veterinary Officer, potentially under a general licence, further negating provisions of the Protection of Badgers Act 1992. It looked like Defra were trying to put a policy in place before a General Election, to commence in autumn 2024. The DEFRA plan looked like a normalization of widespread  badger culling into the future. Likely to further stimulate illegal badger culling that is now reported to be rife in some bovine TB areas.

Problems for Defra came from two important interventions. A prompt Freedom of Information request to determine Natural England’s reasons for continuing the licensing of  Supplementary Badger Culling (extension from 4 to up to 9 years of culling) resulted in disclosure of their weak scientific justification (see here). Secondly, legal complaints that the five week consultation period was too short to evaluate the APHA paper and the government’s somewhat confusing interpretation of it, resulted on 19th April, in an extension by 3 weeks of the consultation period, to 13th May (see here).


A pre-action protocol letter for Judicial Review regarding the March proposals to ‘evolve the badger control policy’ was lodged on 16th May (see here). The legal challenge was to the consultation itself, arguing that it was :

  • Misleading and provided inadequate information regarding badger culling efficacy
  • Failed to provide information on potential ecological impacts of the policy
  • Lacked meaningful information on economic impacts of the policy

Ultimately, the consultation fell victim to the announcement by Prime Minister Rishi Sunak on 22nd  May of a General Election on 4th July. This  froze consideration of the consultation responses  until after the election. The Labour Party manifesto for the 2024 General Election was published on 13th June, and stated its intention to end “ineffective” badger culling, as previously pledged during the 2019 general election. Labour had been keeping very quiet about its position on culling in the months leading up to the election. Presumably this was a tactic to placate the farming vote which was needed before Reform UK Party decided to stand. It appeared to have agreed to keep some badger culling going as a part of a back-room deal with the NFU, a fix that was later exposed by reliable sources (see here). 

Meanwhile in Wales, Deputy first Minister of Wales Huw Irranca-Davis in a statement in the Senedd on 14th May 2024 (see here) articulated the superior progress on bovine TB being made in Wales without badger culling: 

“But just to be clear, from 2012, which is the year before badger control policy in England, to 2023, on the latest published data, the herd incidence in England decreased from 9.8 to 7.3; it was a 26 per cent decrease. In Wales, over the same period, herd incidence decreased from 10 to 6.8. It’s a 31.3 per cent decrease. I simply put that on record—those are Department for Environment, Food and Rural Affairs figures, by the way—to say that we are doing things differently in Wales, in line with our programme for government, but we’re also succeeding in many ways.”

Labour’s landslide victory on 4th July heralded a further rollercoaster of events. Within six weeks it announced that the new government did not intend to pursue the policy of ‘targeted’ culling, making the key legal challenge to the consultation unnecessary. Instead it planned to work on a “refreshed bovine TB control badger strategy”.

An important new extensive re-evaluation of the Randomised Badger Culling Trial was published in Nature Scientific Reports by Prof Paul Torgerson with others, on 15th July, shaking the foundation stone of Government policy since 2011. It provided further and highly extensive evidence that the role of badgers in bovine TB in cattle was fatally misconstrued, and the problems had not been spotted over 20 years ago (see here).

Throughout 2023 and 2024 the Oxfordshire Badger Group (OBG), with support from others, had tried to initiate discussion of the RBCT design and findings with Oxford University, but reported a wall of reluctance or silence. Around 7,000 badgers have been shot in Oxfordshire so far. On 18th July OBG presented a petition with over 50,000 signatures to Oxford University School of Biology in central Oxford. OBG called on Oxford University to own what it called “Your Bloody Science” and asked them to “Speak out against badger extermination”, (see here). There was apparently no meaningful contribution to the debate from the Oxford RBCT scientists. Also in July, Betty Badger (AKA Mary Barton, a member of the Herts and Middlesex badger Group) marked her marathon 8 years of protesting badger culling outside Defra’s main London office (every Thursday), switching attention towards the broken promises made to her over the previous year that she “wouldn’t  be standing there after the election” (see here).

On 21st August two new papers were published by Mills et al. in Royal Society Open Science, largely repeating the analyses in Torgerson et al 2024, but coming to a different conclusion (see here & here). Further concerns by Torgerson et al were preprinted on September 20th in BioRxive (see here) and the matter will continue into 2025.

On 23rd August, the BBC2 documentary ‘Brian May – The Badgers, the Farmers, and Me’ was aired, illustrating how the badger cull policy implemented since 2013 has failed farmers completely (see here).

There followed a tirade of rather ill-founded and rushed accusations and complaints by multiple members of the usually secretive BTB Partnership (see here) on X (formerly Twitter), presumably reflecting the collective tribal response of government hirelings. The documentary showed how, following the cull, rates of bTB infection and consequent numbers of cattle slaughtered are in some areas no better than they were in 2013, and in other areas they are worse than ever. See here and the graph below for Gloucestershire cull area 1 that is central to government (APHA) publications; they tell the story. The real culprit, as exposed by leading cattle vet Dick Sibley, is the limitations of the standard SICCT and Gamma testing procedure and constraints over using newer tests to detect the hidden disease reservoir in herds. The work from the Save Me Trust supported case study farms in England and Wales and all pointed in one direction – the misunderstanding of disease control needs by the Government professionals and contractors in charge. Farmers in south west England were beginning to recognize how far away from real solutions the Government and their representatives have been taking them. Both with the trading of herds not properly freed from bTB infection, and the false narrative around badger transmission. The documentary represents the most decisive moment in bovine TB control since the epidemic was created nearly 25 years ago following a long period with lax testing.

Fact: Badger culling has made no visible difference to the number of annual bTB incidents  in the 2013-2021  ‘pilot’ cull area in Gloucestershire. Note 2024 has now reached 26 incidents as of 4th December.


On 30th August,  intent to refresh the bovine TB control badger strategy was announced:

“Government to end badger cull with new TB eradication strategy”,

although only in relation to a bit of proposed tinkering around with badgers, as follows:

  • A new survey starting in December 2024 to try to estimate cull impacts. This will be a sample of signs of sett activity in culled areas and conclude generally that badgers are highly mobile and recolonise quickly, but give no reliable indication of numbers.
  • Surveillance of the prevalence of bTB in found dead or culled badgers and deer. To show, as expected, and previously shown, that bTB remains in wildlife when the general countryside remains infected by infected cattle trading, and afterwards for several years. This seems to be aimed at somehow informing further misguided culling and vaccination efforts, based on outmoded thinking.
  • Establish a new Badger Vaccinator Field Force: As Defra fall  even further and hopelessly behind its badger vaccination targets of 2023 and now 2024, accelerating potential future costs, this ambition looks as futile as it is a pointless exercise. No one thinks it can work, no one wants to do it, no one wants to pay for it. There is no evidence it can contribute.
  • Badger vaccination study to rapidly analyse the effect of badger vaccination on the incidence of TB in cattle: There would be nothing rapid about this and for it to have any value would be a long term, hugely expensive exercise, with controls. The flawed anticipation is that it will “give farmers greater confidence that doing so will have a positive effect on their cattle.”  This just illustrates how misguided and out of touch the same-old Defra/APHA staff and advisors remain.

This was very disappointing to say the least. And whilst there was a clearly stated intention to stop culling badgers, shockingly that would not now happen before the end of the current Parliament (2029), leaving the door open for culling to continue with the next Government. The plans proposed five more years of badger culling and to everyone’s disbelief, even a new cull area in Cumbria north of Penrith. Where unwise cattle trading has created a small number of breakdowns in a zone called Hotspot 29: around 1,000 mostly healthy badgers are to be shot over a wide area (see here and below), with hundreds shot this autumn. It was almost as if Defra/APHA staff wanted to appease the NFU with a “badger culling business as usual” promise no matter what independent reports or the new politicians said. Such is the grip of vested interest on civil servants.

Hotspot 29. Herd breakdowns 2013-2024. Note in 2020 due to covid restrictions, cattle testing was suspended. This resulted in increased trading of diseased cattle and further infections in subsequent years. In 2022 many new enhanced tests began to address the 2021 increase in the area, with the APHA/CVO epidemiological mistake of blaming it on badgers. It is what the 2018 LRA policy calls a ‘precautionary’ measure, and is the travesty of a failed policy that Labour now perpetuates, despite promising not to. There has been a further breakdown in December 2024 making 8 breakdowns.

And so in September, the badger culling season under a Labour administration got into full swing in the High Risk, Edge and Low Risk Areas of England for a 12th year, to kill (often in a cruel way) around 15,000 more mostly completely healthy adult and cub badgers. This will bring the total reported killed since 2013 close to the 250,000 mark.

On 24th October APHA’s “Year End Descriptive Epidemiology Reports” for  Bovine TB control were published online for the Edge Area counties of Berkshire, Buckinghamshire, Cheshire, Derbyshire, East Sussex, Hampshire, Leicestershire, Northamptonshire, Nottinghamshire, Oxfordshire and Warwickshire. Progress is no longer on target for any of these areas, apparently due to inadequate funding for disease control following Brexit cutbacks (see here and here).

Published on 25th October, Science and Politics, a book by by Ian Boyd  appeared to try to distance the author (Defra Chief Scientific Advisor 2012-2019) from his pivotal role in convincing farmers that badgers needed to be culled (see Boyd’s conceptual model below). His role in encouraging the badger cull roll-out  was exposed in court copies of internal Defra emails in 2016. This, despite his self-confession on Civil Service tribalism, having maneuvered in the ‘golden cage’ to deliver ‘Boyd’s cull’ (see here). 

Ian Boyd’s Conceptual model on why badger culling is essential


As the year wound down, the Oxfordshire Badger Group supported a scientific seminar, in Oxford, delivered by Prof. Paul Torgerson on 18th November: key RBCT academics together with Defra & APHA officials were invited to discuss the science and statistics but all declined. 

Baroness Bennett of Manor Castle (Natalie Bennett) hosted a special meeting on Government bovine TB policy at Millbank in Westminster on 19th November, with presentations by Prof Paul Torgerson and veterinarian Dick Sibley. The meeting was well attended from the Lords and Commons, but all Defra and APHA officials and staff invited to attend declined the invitation (see Vet Record: here).

On 28th November,  the Northern Ireland Chief Veterinary Officer Review of Bovine Tuberculosis in Northern Ireland (prepared by cattle breeder Brian Dooher) (see here) was published in advance of publication of a consultation document over policy expected in the spring. This followed the fiasco over the last consultation, where the economic case was not made available and the consultation was determined invalid by the courts thanks to a NI Badger Group/Wild Justice legal challenge. BTB is getting worse in NI and badger blame rhetoric has reached fever pitch, based in part on misuse of the February APHA paper, and DEFRA’s position claiming that badger culling can be shown to work.  DAERA and independent advisors will need to be sure to produce an accurate document this time if the previous failure is not to be repeated, as sadly looks increasingly likely.

On 3rd December, Rob Pownall of Protect The Wild launched a parliamentary petition to end the English badger cull. Standing at around 30,000 signatures at the time of writing, the petition calls for “an immediate end to the cull and the implementation of cattle focused measures to control bTB, rather than what we see as scapegoating wildlife.” As the petition points out, research that has been “peer reviewed and published, shows no evidence that culling badgers reduces confirmed bTB in cattle. Over 230,000 badgers — many healthy — have been killed, disrupting ecosystems without solid scientific justification”. Please add your name to this petition here.

On 13th December Tom Langton delivered a presentation entitled “Veterinary Science, Uncertainty and Politics: TB and wildlife” at the Annual Veterinary Public Health Conference held at Vetsuisse Faculty at Zurich University. This looked at the flawed assumptions made back in the 1970’s that led to badgers being wrongly labelled as a ‘self-perpetuating bTB reservoir‘, on to field trials that tried to show a ‘bTB perturbation effect’, and statistics chosen to ‘prove‘ this as a way to stop culling. And the uncertainty, peer pressure, confirmation bias and reputational defence that has followed on as a consequence. 

What can be expected in 2025? Difficult to say, but with a Labour government now in charge, we have to hope for at least some meaningful dialogue on the scientific, financial and ethical considerations that have just not been heard over the last 12 years. We are looking for more than the ‘same-old’ broken policy and tired old arguments.

Thanks again to the hundreds of active supporters who have generously helped to fund legal work and provided information, analysis and support in so many ways this year. You have surely contributed towards seeing off widespread targeted culling this year. Next year we will continue to demand rapid change in approach to bovine TB policy, a change that is scientifically evidenced, and that will, at last, start to benefit farmers, cows, badgers and the public.  This change must start with meaningful dialogue.

 

 

 

 

 

New scientific paper shows that the badger cull was never going to work

This website has been reporting on the legal challenges to the badger culling policy and licences, and the science that has supposedly supported it since 2019. Over that time, there have been many jaw-dropping moments; government interference in peer-reviewed science, government scientists getting their data wrong in published letters, Natural England claiming that culling has no effect on ecosystems and then desperately covering their tracks in the courts. The list goes on, and the story that has unfolded remains  truly shocking.

Professor Paul Torgerson, Chair, Veterinary Epidemiology, University of Zurich

But an even more dramatic sequel to this long-running saga is the new scientific paper published this week in Scientific Reports by Professor Paul Torgerson and colleagues including Badger Crowd’s Tom Langton. We will be posting a video presentation that will put this new work into context and demonstrate the massive impact that it should now have on Government bovine TB policy.

Why is this new study so important?

Because the government badger cull policy rests all but entirely on the conclusions from the Randomised Badger Culling Trial (RBCT). It is the science that DEFRA has used in court to defend their decisions to experiment with culling. The study is the original  peer-reviewed science that claims badger culling can reduce bTB in cattle; many subsequent studies are derivative from it, use the same flawed methodology, or suffer heavily from confirmation bias. I.e. they are subjective opinion that fails to prove that culling badgers causes disease reduction. However, benefits are claimed from culling when any benefits are, in reality likely from cattle measures. This is because such benefits are “predicted” from the results of the RBCT.

What does the new study say?

The new study re-examines data from the RBCT experiment using a range of statistical models. It concludes that most standard analytical options did not show any evidence to support an effect of badger culling on bovine TB in cattle. The statistical model selected for use in the original study in 2006 was one of the few models that did show an effect from badger culling. However, various criteria suggest that the original model was not an optimal model compared to other analytical options then available. The most likely explanation for the difference in result from the different analyses is that the RBCT proactive cull analysis ‘overfitted’ the data and used a non-standard method to control for disease exposure. The result is that the original model had a poor predictive value, i.e. it was not useful in predicting the results of badger culling. The more appropriate models in the latest study strongly suggest that badger culling does not bring about the disease reduction reported.

How might the RBCT scientists defend their decisions?

  1. The RBCT was a pre-planned analysis i.e. data was analysed in the way they said it would be before they started the trial, so it can’t be questioned.  This is not the case. There was a loosely described plan to compare rates of disease between culled and unculled areas. Their published analysis in fact compared counts of disease between culled and unculled areas. Would the conclusion of the RBCT analysis have been different  if incidence rates had been analysed correctly? Yes it would. Even if the data had been analysed according to any ‘pre-plan’, this would not preclude subsequent re-analysis using correct and more appropriate methods, except you might not do it if you believed rates had been used as was suggested in the paper.
  2. There is nothing wrong with using the model to calculate the number of herds (exposure). There may be circumstances in which a model may be sensibly used to calculate exposure. However, the original model used suggests that bTB herd incidents (a standard measure of new disease) is independent of the number of herds in a study area. That is, if the number of  herds in an area is doubled, the incidence does not change. This is not credible. Not least because the RBCT report (Table 5.4) showed that breakdowns doubled in cull and control areas over the period of study.
  3. You are just model dredging; i.e. you are just picking out the model that says what you want. The new study re-examined RBCT data using a range of statistical models (22 in total). Most of these show no evidence to support an effect of badger culling on bTB in cattle. The statistical model chosen by the RBCT study was one of the few models that did show an effect, but when tested in an accredited way, it is not an optimal model. The new paper is not guilty of  “model dredging”, it is the result of an attempt to find a robust analytical method that could support the claims of the RBCT

Why has this not been picked up before?

It does seem remarkable that the original RBCT a) got through peer review, and b) has not been challenged since. One reason might be the rather casual use of the words ‘rate’ and ‘count’ in the original paper, which implies that rate has been used in the model, whereas in fact an epidemiologically non-standard method was used to calculate a rate. Supplementary information in the original paper showed standard calculated ‘rates’ and the assumption could have been made that these were what was used in the model. They were not.

Interestingly, in the journal Biostatistics in 2010, two authors of the 2006 paper discussed approaches to using a range of statistical methods on a data set to compare their performance, and the choosing of a planned statistical approach that best complimented the subject matter.  They proposed that selection of a specific statistical approach may involve ’subtle considerations about the interplay between subject-matter and statistical aspects and the detailed nature of the data and its compilation.’ And with respect to the peer-review of results, they contend quite boldly: ‘the suggestion of requiring independent replication of specific statistical analyses as a general check before publication seems not merely unnecessary but a misuse of relatively scarce expertise.’

This may go some way towards understanding how problems with the original analysis were not picked up for such a long time. And it goes some way to explaining why there is such a reproducibility crisis in science.

The paper is open access. You can read it here.