The reader might wonder about the relation between the previous post and my discussion of Arman Razaali. If I could say it is more likely that he was lying than that the thing happened as stated, why shouldn’t they believe the same about my personal account?

In the first place there is a question of context. I deliberately took Razaali’s account randomly from the internet without knowing anything about him. Similarly if someone randomly passes through and reads the previous post without having ready anything else on this blog, it would not be unreasonable for them to think I might have just made it up. But if someone has read more here they probably have a better estimate of my character. (If you have read more and *still* think I made it up, well, you are a very poor judge of character and there is not much I can do about that.)

Second, I did not say he was lying. I said it was more likely than the extreme alternative hypothesis that the thing happened exactly as stated *and* that it happened purely by chance. And given later events (namely his comment here), I do not think he was lying at all.

Third, the probabilities are very different.

## “Calculating” the probability

What is the probability of the events I described happening purely by chance? The first thing to determine is what we are counting when we say that something has a chance of 1/X, whatever X is. Out of X cases, the thing should happen about once. In the Razaali case, ‘X’ would be something like “shuffling a deck of cards for 30 minutes and ending up with the deck in the original order.” That should happen about once, if you shuffle and check your deck of cards about 10^67 times.

It is not so easy to say what you are counting if you are trying to determine the probability of a coincidence. And one factor that makes this feel weirder and less probable is that since a coincidence involves several different things happening, you tend to think about it as though there were an extra difficulty in each and every one of the things needing to happen. But in reality you should take one of them as a fixed fact and simply ask about the probability of the other given the fixed thing. To illustrate this, consider the “birthday problem“: in a group of 23 people, the chance that two of them will have the same birthday is over 50%. This “feels” too high; most people would guess that the chance would be lower. But even without doing the math, one can begin to see why this is so by thinking through a few steps of the problem. 22 days is about 6% of the days in a year; so if we take one person, who has a birthday on some day or other, there will be about a 6% chance that one of the other people have the same birthday. If none of them do, take the second person; the chance one of the remaining 21 people will have the same birthday as them will still be pretty close to 6%, which gets us up to almost 12% (it doesn’t quite add up in exactly this way, but it’s close). And we still have a lot more combinations to check. So you can already start to see that how easy it will turn out to be to get up to 50%. In any case, the basic point is that the “coincidence” is not important; each person has a birthday, and we can treat that day as fixed while we compare it to all the others.

In the same way, if you are asking about the probability that someone prays for a thing, and then that thing happens (by chance), you don’t need to consider the prayer as some extra factor — it is enough to ask how often the thing in question happens, and that will tell you your chance. If someone is looking for a job and prays a novena for this intention, and receives a job offer immediately afterwards, the chance will be something like “how often a person looking for a job receives a job offer.” For example, if it takes five months on average to get a job when you are looking, the probability of receiving an offer on a random day should be about 1/150; so out 150 people praying novenas for a job while engaged in a job search, about 1 of them should get an offer immediately afterwards.

What would have counted as “the thing happening” in the personal situation described in the last post? There are a number of subjective factors here, and depending on how one looks at it, especially depending on the detail with which the situation is described. For example, as I said in the last post, it is normal to think of the “answer” to novena on the last day or the day after — so if a person praying for a job receives an offer on *either* of those days, they will likely consider it just as much of an answer. This means the estimate of 1/150 is really too low; it should really be 1/75. And given that many people would stretch out the period (in which they would count the result as an answer) to as much as a week, we could make the odds as high as 1/21. Looking loosely at other details could similarly improve the odds; e.g. if receiving an interview invitation that later leads to a job is included, the odds would be even higher.

But since we are considering whether the odds might be as bad as 1/10^67, let’s assume we include a fair amount of detail. What are the odds that on a specific day a stranger tells someone that “Our Lady wants you to become a religious and she is afraid that you are going astray,” or words to that effect?

The odds here should be just as objective as the odds with the cards — there should be a real number here — for reasons explained elsewhere, but unfortunately unlike the cards, we have nowhere near enough experience to get a precise number. Nonetheless it is easy to see that various details about the situation made it actually more likely than it would be for a perfectly random person. Since I had a certain opinion of my friend’s situation, that makes it far more likely than chance that other people aware of the situation would have a similar opinion. And although we are talking about a “stranger” here, that stranger was known to a third party that knew my friend, and we have no way of knowing what, if anything, might have passed through that channel.

If we arbitrarily assume that one in a million people in similar situations (i.e. where other people have similar opinions about them) hear such a thing at some point in their lives, and assume that we need to hit one particular day out of 50 years here, then we can “calculate” the chance: 1 / (365 * 50 * 1,000,000), or about 1 in 18 billion. To put it in counting terms, 1 in 18 billion novenas like this will result in the thing happening by chance.

Now it may be that one in a million persons is too high (although if anything it may also be too low; the true value may be more like 1 / 100,000, making the overall probability 1 / 180 million). But it is easy to see that there is no reasonable way that you can say this is as unlikely as shuffling a deck of cards and getting it in the original order.

## The Alternative Hypothesis

A thing that happens once in 18 billion person days is not so rare that you would expect such things to never occur (although you would expect them to most likely not happen to you). Nonetheless, you might want to consider whether there is some better explanation than chance.

But a problem arises immediately: it is not clear that the alternative makes it much more likely. After all, I was *very* surprised by these events when they happened, even though at the time I did attribute an explicitly religious explanation. Indeed, Fr. Joseph Bolin argues that you should not expect prayer to increase the chances of any event. But if this is the case, then the odds of it happening will be the same given the religious explanation as given the chance explanation. Which means the event would not even be *evidence* for the religious explanation.

In actual fact, it is evidence for the religious explanation, but only because Fr. Joseph’s account is not necessarily true. It could be true that when one prays for something sufficiently rare, the chance of it happening increases by a factor of 1,000; the cases would still be so rare that people would not be likely to discover this fact.

Nonetheless, the evidence is much weaker than a probability of 1 in 18 billion would suggest, namely because the alternative hypothesis does not prevent the events from remaining very unlikely. This is an application of the discussion here, where I argued that “anomalous” evidence should not change your opinion much about anything. This is actually something the debunkers get right, even if they are mistaken about other things.