Abnormal sperm count may suggest a male infertility problem. For example, if the sperm count is very low or very high there is a likelihood of being less fertile. The acidity of the semen and the presence of white blood cells (suggesting infection) may influence fertility.
Sources
MedlinePlus - Semen analysis