The foods that are most likely to do so include yogurt, cheese, grains (crackers, rice, bread, pasta, cereals), alcohol and chocolate. These foods lower testosterone by increasing the activity of an enzyme, aromatase, which converts testosterone into estrogen.