How can adultery be a sin?

The thing is, in primitive times there was no concept of marriage. It did not exist, in fact monogamy wasn't even a widespread virtue until some hungry kings decided to make it illegal to have more than one wife, or to step out on that wife, because they wanted to horde all of the women for their own harems.