Increased odds of survival too. I'd argue that human success as an organism is due in no small part to our ability to adapt, respect and value differences in thought, action and character.
Is cultivating diversity over strict conformity not an ideal? Setting ideals is acceptable to me, so long as we are willing to change when any aspect of human societies is or becomes maladaptive to our continued survival, flourishing and well-being. Having an ideal is one thing, the modal quality of the actions we take in order to reach that ideal is where we should really focus our efforts. That does not mean we should not scrutinise every ideals in terms of practically, logistics and possibility.
I'm glad you brought up harm; a banker can harm, a baker can harm, a biologist can harm. However this is more down to an individuals moral psychology/moral intent than there being anything inherently wrong with those occupations.