Applying Bayes Factors
TL;DR: There is a box with 6 red balls and 5 blue balls. You will blindly take out 3 balls from the box without replacing them. After removing them, you look and see the colors: 2 red and 1 blue. (Using the likelihood ratio method) what is the probability the first ball was red?
I'm currently going through Brilliant's applied probability course and I encountered this problem about when the most recent 3b1b video The medical test paradox: Can redesigning Bayes rule help? came out.
I thought it would be nice to try to apply the likelihood ratio approach to the problem that Brillant gives, but I have gotten stuck.
The question is:
There is a box with 6 red balls and 5 blue balls. You will blindly take out 3 balls from the box without replacing them. After removing them, you look and see the colors: 2 red and 1 blue. What is the probability the first ball was red?
Here's how far I've gotten. Hidden in case you want to try first.>!Start with your base odds of 6:5 that red was first to be drawn. !<
!Then I calculate the probability that red was first given the 2 red 1 blue information. There are 2 ways out of 3. In other words: !<
!P(R_1 | {R, R, B}) = 2/3!<
!Then I find the false positive rate, which I think is P(R_1 | NOT{R, R, B}). Since the other sets I could have drawn are RRR, BBR, and BBB, I have a 100% probability of R being first in RRR, 1/3 in BBR, and 0% in BBB. That's a total probability of 4/3, so therefore: !<
!P(R_1 | NOT{R, R, B}) = 4/3!<
!Now divide the two to get 1/2 and multiply by the base odds 6:5 to get 3:5 (3/8). !<
However, Brilliant gives the answer as 2/3. Where am I going wrong?
Posted Jan 4, 2021, 12:52 AM UTC
P(R1 | {R,R,B}) is actually exactly what you need here, and is 2/3.
(Also P(R1 | NOT{R,R,B}) doesn't matter, but can't ever be equal to 4/3 which is greater than 1).
But if you wanted to apply the Bayes factor here, the formula would be
O(R1 | RRB) = O(R1) * P(RRB | R1) / P(RRB | Not R1). (and you can see that you got it the other way around)
O(R1) is 6:5 as you identified.
P(RRB | R1) is 2*(5/10)*(5/9) = 5/9, as there are 5 red and 5 blue remaining, and you need one of each (in whatever order).
P(RRB | Not R1) is (6/10)*(5/9) = 1/3, as there 6 red remaining, and you need two consecutively.
The factor is thus 5/9 / (1/3) = 15/9 = 5/3, so the new odds become 6:5 * 5/3 = 6:3 = 2:1, which is exactly a 2/3 probability.
How would you do it from the other direction? It should be possible to start with the odds of red being first given the draw RRB. I.e the O(R1) = 2:1 and then update in such a way that it remains unchanged after incorporating the information about the distribution in the box (your Bayes factor should be 1).
How would that be done?
u/TheShirou97 Wondering if you saw this. Still curious about your answer
Yes, sorry, I definitely saw it but I couldn't really make sense of the conditional probabilities in the formula, so I eventually gave up and did not answer.
The catch is that Bayes factors, like any other formula, are a useful tool when the givens of a problem are set up in a specific way, otherwise even if the formula does still hold, you do not get anything from it.
Do you know what exactly causes it to no longer apply in this case?
I just find it deeply dissatisfactory to not know how to recognize the conditions where it applies and fails to apply
\
Ok, further questions.
Why is P(RRB | Not R1) = (6/10)*(5/9)? Why wouldn't it be (5/11)*(6/10)*(5/9) since we need to incorporate the probability that Blue gets chosen first? Is it just because we have fixed blue as the first one and then we need to know the probability of filling out the rest?
As for P(RRB | R1) = 2*(5/10)*(5/9) is the multiple of 2 due to the two possible orderings of R and B? If so, why do we take those into account but not the two possible orderings of R in P(RRB | Not R1)?
First question: basically yes.
Second question: in that case it's really (5 reds out of 10)*(5 blues out of 9) + (5 blues of out 10)*(5 reds out of 9). In the other case you have no choice about the order since it's red->red.