Madelyn Goodnight / Investopedia A probability distribution is a ... or experiments increases, the average of the results obtained approaches the expected value or true probability.