I've had infertility issues until I cleared myself of a recurrent chronic yeast infection, and it was only after I've been clear that I was able to get pregnant. I'm not really sure of the reasons, maybe it was just a coincidence, but from what I hear the unbalanced vaginal flora makes it more difficult for the sperm to reach the uterus.
You should treat your yeast infection before you get pregnant anyway because if you have a yeast infection you will not be as healthy. You do not want to go on a strict diet while you are pregnant, nor do you want to take antifungals like fluconazole, imagine the damage that does to you, why pass that onto your baby. your baby can also catch the yeast infection through you, and have problems in his/her life.
It's just not worth the risk of it, and I would get rid of it by any means possible.