Applying Bayes Factors

TL;DR: There is a box with 6 red balls and 5 blue balls. You will blindly take out 3 balls from the box without replacing them. After removing them, you look and see the colors: 2 red and 1 blue. (Using the likelihood ratio method) what is the probability the first ball was red?

I'm currently going through Brilliant's applied probability course and I encountered this problem about when the most recent 3b1b video The medical test paradox: Can redesigning Bayes rule help? came out.

I thought it would be nice to try to apply the likelihood ratio approach to the problem that Brillant gives, but I have gotten stuck.

The question is:

There is a box with 6 red balls and 5 blue balls. You will blindly take out 3 balls from the box without replacing them. After removing them, you look and see the colors: 2 red and 1 blue. What is the probability the first ball was red?

Here's how far I've gotten. Hidden in case you want to try first.>!Start with your base odds of 6:5 that red was first to be drawn. !<

!Then I calculate the probability that red was first given the 2 red 1 blue information. There are 2 ways out of 3. In other words: !<

!P(R_1 | {R, R, B}) = 2/3!<

!Then I find the false positive rate, which I think is P(R_1 | NOT{R, R, B}). Since the other sets I could have drawn are RRR, BBR, and BBB, I have a 100% probability of R being first in RRR, 1/3 in BBR, and 0% in BBB. That's a total probability of 4/3, so therefore: !<

!P(R_1 | NOT{R, R, B}) = 4/3!<

!Now divide the two to get 1/2 and multiply by the base odds 6:5 to get 3:5 (3/8). !<

However, Brilliant gives the answer as 2/3. Where am I going wrong?

Posted Jan 4, 2021, 12:52 AM UTC

1211
TheShirou97•

P(R1 | {R,R,B}) is actually exactly what you need here, and is 2/3.

(Also P(R1 | NOT{R,R,B}) doesn't matter, but can't ever be equal to 4/3 which is greater than 1).

​

But if you wanted to apply the Bayes factor here, the formula would be

O(R1 | RRB) = O(R1) * P(RRB | R1) / P(RRB | Not R1). (and you can see that you got it the other way around)

O(R1) is 6:5 as you identified.

P(RRB | R1) is 2*(5/10)*(5/9) = 5/9, as there are 5 red and 5 blue remaining, and you need one of each (in whatever order).

P(RRB | Not R1) is (6/10)*(5/9) = 1/3, as there 6 red remaining, and you need two consecutively.

The factor is thus 5/9 / (1/3) = 15/9 = 5/3, so the new odds become 6:5 * 5/3 = 6:3 = 2:1, which is exactly a 2/3 probability.

3
vougesterOP•

How would you do it from the other direction? It should be possible to start with the odds of red being first given the draw RRB. I.e the O(R1) = 2:1 and then update in such a way that it remains unchanged after incorporating the information about the distribution in the box (your Bayes factor should be 1).

How would that be done?

1
vougesterOP•

u/TheShirou97 Wondering if you saw this. Still curious about your answer

1
TheShirou97•

Yes, sorry, I definitely saw it but I couldn't really make sense of the conditional probabilities in the formula, so I eventually gave up and did not answer.

The catch is that Bayes factors, like any other formula, are a useful tool when the givens of a problem are set up in a specific way, otherwise even if the formula does still hold, you do not get anything from it.

1
vougesterOP•

Do you know what exactly causes it to no longer apply in this case?

1
vougesterOP•

I just find it deeply dissatisfactory to not know how to recognize the conditions where it applies and fails to apply

\

1
vougesterOP•

Ok, further questions.

Why is P(RRB | Not R1) = (6/10)*(5/9)? Why wouldn't it be (5/11)*(6/10)*(5/9) since we need to incorporate the probability that Blue gets chosen first? Is it just because we have fixed blue as the first one and then we need to know the probability of filling out the rest?

As for P(RRB | R1) = 2*(5/10)*(5/9) is the multiple of 2 due to the two possible orderings of R and B? If so, why do we take those into account but not the two possible orderings of R in P(RRB | Not R1)?

1
TheShirou97•

First question: basically yes.

Second question: in that case it's really (5 reds out of 10)*(5 blues out of 9) + (5 blues of out 10)*(5 reds out of 9). In the other case you have no choice about the order since it's red->red.

1
Cenamdere•

Let's start with choosing the balls and applying probabilities to them, of which we can ignore the scenario where we get 3 reds or 2/3 blues.

P(R1)=6/11 and P(B1)=5/11

P(R1R2)=6/11*5/10=3/11, P(R1B2)=6/11*5/10=3/11, P(B1R2)=5/11*6/10=3/11

P(R1R2B3)=6/11*5/10*5/9=5/33, P(R1B2R3)=6/11*5/10*5/9=5/33, P(B1R2R3)=5/11*6/10*5/9=5/33

Thus, the probability for P({R,R,B})=5/33 + 5/33 + 5/33 = 5/11

However, we want the probability that red was chosen first for the case of {R,R,B}, so we add up P(R1R2B3) and P(R1B2R3) and then divide it by P({R,R,B}) to get (5/33 + 5/33)/(5/11)=2/3.

It's best to consider a probability tree when answering this type of question, especially considering the method you used led to a impossible scenario of a probability being equal to 4/3. (0<=P(x)<=1)

1
vougesterOP•

Wow, thanks so much. Give me a bit to digest this.

What is a probability tree?

1
Cenamdere•

Exactly what you might think it would be. Using our example here, at the beginning we can choose either a red ball or a blue ball. Therefore, there are 2 branches that form when we make the choice. Let's argue we choose the red ball first, then from the branch we made for the choice of the red ball, we repeat the process again choosing either the red or blue ball, of which we update the probability based off of our previous choices, such that now there would be 5 red balls, not 6. It's that updating in information that's necessary when using a Bayesian approach to probability and a probability tree is a nice way of dealing with that.

1