[deleted]•

No idea what the point of this article is.

Absolute risk is affected by exposure - we can pretty much assume everyone is going to be exposed to COVID at some point, but obviously the exposure during the trial period is small, so absolute risk (and absolute risk reduction) is small.

25
NotAnotherEmpire•

Yeah, this is a meaningless metric for a pandemic vaccine. The susceptible population is "all," the virus will circulate indefinitely, and it wasn't particularly avoidable by behavior even before the more transmissible variants.

Given sufficient timeline, probability of being infected approaches 1 with COVID.

ARR cost-benefit is relevant if it is a disease that is not circulating in a population, or if exposure is otherwise manageable. Smallpox is eradicated so even though the vaccine is why that is the case, it is no longer used outside the military. Ebola does not live in continental Europe. That sort of thing.

11
Bluffwandering•

I have fair statistical analysis abilities at best so forgive me if this is completely off the mark. But, with the diminishing returns of the current vaccines, the relative risk reduction will likely be shrinking, will it not?

1
PartyOperator•

What a strange article. The absolute risk reduction is almost entirely a function of the disease attack rate during the trial. Given a very large trial and highly effective vaccine, it would be unethical not to report efficacy results at a very low attack rate (hence absolute risk reduction).

There's no reason to think the absolute risk experienced during the early part of the trial is in any way relevant to people subsequently receiving the vaccine, so drawing attention to this as if it's meaningful would be misleading. Finally, it's easy to calculate from data that was published at the time, and indeed was a source of some confusion when the initial results were first discussed. This is the kind of statistic that's easily used in bad faith but adds very little real understanding.

16
[deleted]•

Yep, all of this.

7
evanc3BSc - Mechanical Engineering•

I see this author's point. It maybe makes sense, and seems ethical, to report this number.

But I can also see why the vaccine manufacturers left this off when the reporting results that would be viewed by the general public.

My first impression (as a non science person) was that the 0.7% ARR from pfizer is very small. But crunching the numbers using the method in the paper, I get the CER as 0.007457 and the EER as 0.0003468 (which I didn't even see in the paper?). So, maybe obviously to many people, that was still about a 95% reduction in risk.

How many people would have looked at the 1.1% reduction in Moderna and assumed it was a much better vaccine because it decreases your absolute risk by 50% more (when the relative risk is actually slightly lower)?

Once again, as a non-scientist, I am much more interested in seeing that my risk is 5% of an identical unvaccinated person. If I see 0.7% without a reference point I'm thinking "well is it from 3.7% -> 3.0%, or 0.73%-> 0.03%". For me, and most people out there, it is not intuitive.

Edit: spelling and grammar (I'm an engineer)

7
bullsbarry•

It's not intuitive and it's misleading when you're talking about small risk of catastrophic events.

4
[deleted]•

The absolute risk calculation he does only applies over the duration of the trials. In reality, the vaccine effects last many, many times longer; given that almost everyone will probably end up getting exposed to COVID at some point, the absolute risk reduction will approach the relative risk reduction.

The author is either being rather silly or deliberately misleading. Their publication record contains similar silly papers, so I’m not sure which it is…

10
playthev•

I've made this comment before, absolute risk reduction is important, not as a static value, but it can be used to compare between different groups after vaccination.

ARR of vaccination (in preventing any infection, not just severe) would be a lot smaller or even zero in individuals who have already recovered from Covid.

ARR in preventing severe illness would be much smaller in children compared to adults as they have a much lower baseline risk of severe Covid. This ARR would thus be relevant in making decisions about mass vaccination of children.

6
AKADriver•

Agreed. This paper is abusing the concept to make vaccines look useless, but it does become important when we look at specific scenarios like that.

8

ARR of vaccination (in preventing any infection, not just severe) would be a lot smaller or even zero in individuals who have already recovered from Covid.

It still makes more sense to use RRR in this case. All the studies examining reinfection are reporting RRR and in general it appears to be true that being previously infected makes the RRR of vaccination much lower. I do not see why you would find ARR a better measure in that case. If the vaccine provides no additional benefit the RRR will be zero too.

ARR in preventing severe illness would be much smaller in children compared to adults as they have a much lower baseline risk of severe Covid. This ARR would thus be relevant in making decisions about mass vaccination of children.

This is true to an extent but still falls victim of the unfixable issues inherent to ARR - most notably that it is a function of time and exposure. That’s just what absolute risk reduction is. Reporting an ARR of 1% doesn’t mean anything at all, unless it also includes the level of infection and timeframe. 1% ARR during a 3 month peak of a pandemic is hugely different from 1% ARR during a 2 week trough.

0
playthev•

I mean you can strictly report RRR for the intervention, then report baseline risk ratios between different groups for the event you are measuring and let the reader make the inference. But I think reporting ARRs for different groups makes it easier to see this. Of course ARR is always going to be linked with incidence rate in that particular study and not actually worth mentioning in isolation.

2
AutoModeratorMOD•

Please read before commenting.

Keep in mind this is a science sub. Cite your sources appropriately (No news sources, no Twitter, no Youtube). No politics/economics/low effort comments (jokes, ELI5, etc.)/anecdotal discussion (personal stories/info). Please read our full ruleset carefully before commenting/posting.

If you talk about you, your mom, your friends, etc. experience with COVID/COVID symptoms or vaccine experiences, or any info that pertains to you or their situation, you will be banned. These discussions are better suited for the Daily Discussion on r/Coronavirus.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1
[deleted]•

[removed]

1
InInteractionOP•

Abstract

Relative risk reduction and absolute risk reduction measures in the
evaluation of clinical trial data are poorlnderstood by health
professionals and the public. The absence of reported absolute risk
reduction in COVID-19 vaccine clinical trials can lead to outcome
reporting bias that affects the interpretation of vaccine efficacy. The
present article uses clinical epidemiologic tools to critically appraise
reports of efficacy in Pfzier/BioNTech and Moderna COVID-19 mRNA
vaccine clinical trials. Based on data reported by the manufacturer for
Pfzier/BioNTech vaccine BNT162b2, this critical appraisal shows:
relative risk reduction, 95.1%; 95% CI, 90.0% to 97.6%; p = 0.016; absolute risk reduction, 0.7%; 95% CI, 0.59% to 0.83%; p < 0.000. For the Moderna vaccine mRNA-1273, the appraisal shows: relative risk reduction, 94.1%; 95% CI, 89.1% to 96.8%; p = 0.004; absolute risk reduction, 1.1%; 95% CI, 0.97% to 1.32%; .00nreported absolute risk reduction measures of 0.7% and
1.1% for the Pfzier/BioNTech and Moderna vaccines, respectively, are
very much lower than the reported relative risk reduction measures.
Reporting absolute risk reduction measures is essential to prevent
outcome reporting bias in evaluation of COVID-19 vaccine efficacy.

1
[deleted]•

[removed]

1
[deleted]•

[removed]

1
Bluffwandering•

https://gut.bmj.com/content/early/2021/04/01/gutjnl-2021-324689

"Relative risk rather than absolute risk reduction should be preferred to sensitise the public to preventive actions "

Short article that helped my understanding to focus more on relative risk

1