Yes, the world would be a better place without religion.
Although I think religions were fabricated in a way to organize a structure of how to behave with others with its codes of morality, differentiating between right and wrong, it did more damage by creating this sense of “us” versus “them” (“our beliefs” versus “their beliefs”) and causing more division and fights amongst people of such divisions, instead of fulfilling its original purpose: to create a sense of unity by making people aware of how to do “right” by one another.
On a more personal note, life isn’t the dichotomy as we choose to view it. I’ve never been one to believe in “that is wrong, and because that is wrong, then this is right, and it’s the only right way to do it right”—and quite frankly I never even understood people who insist on thinking in such a way. Why is that the only “right way” to do something, the only way to live?
There are too many different kinds of people, too many different ways to handle a single situation, for there to be a religion that would suit all.