It is very advantageous to represent various probability distributions by respective standardized variates with zero mean and unity variance, as well as the normal distribution. Then, useful figures and tables on them can be prepared, and a probability distribution can be compared numerically and visually with the others based on the same standard. Some figures are shown for distributions commonly encountered in structural reliability. Characteristics of these distributions are briefly presented and the characteristic value defined by the normal distribution in the limit state design is discussed on validity of its use for the other distributions.