When Diversification Helps and When It Hurts