A probability distribution is an assignment of probabilities to possible occurrences (often represented by discrete or continuous random variables). A symmetric probability distribution has the property where occurrences “equidistant” from some value, represented by the distribution, share the same probability.
Usually, symmetry occurs as a result of a singular mechanism producing different looking outcomes. Exploring the underlying properties or mathematical frameworks can be very insightful.