Literally hundreds of research papers on these topics with strong indications of the estrogen effects from food can have a negative impact on male reproductive tissues responsible to the production of Testosterone.
Here's a recent article from February:
"The results also imply that changes in adipose tissue metabolism occasioned by exposure to dietary estrogens, and perhaps other estrogenic agents, possibly contribute to deficiencies in reproductive capacity attributed to these compounds."
Toxicol Lett. 2012 Feb 25;209(1):78-85. Epub 2011 Dec 3.Regulation of adiponectin secretion by soy isoflavones has implication for endocrine function of the testis.
Pfaehler A ,
Nanjappa MK ,
Coleman ES ,
Mansour M ,
Wanders D ,
Plaisance EP ,
Judd RL ,
Akingbemi BT .SourceDepartment of Anatomy, Physiology and Pharmacology, Auburn University, Auburn, AL 36849, USA.
Amy Perkins, MS, TS (ABB)
Laboratory Supervisor
Arizona Andrology Laboratory & Cryobank
International Center for Vasectomy Reversal