Yes, lifestyle factors can significantly impact male fertility. Poor diet, lack of exercise, stress, and exposure to toxins can all affect sperm quality. Histological studies can sometimes reveal lifestyle-related damage to the testes and epididymis.