I'll agree with the others, only a few times in life do you come to a fork where deciding which one to take is a grave decision...this is one of those times. There are pros and cons to both paths, and I think you know what they all are, better than we ever will. From the age range I'm guessing you to be in too, age becomes a factor too. Time is flying by, so starting over may be harder now than before. Or, in some ways, it may be easier too.
I think it comes down to this - trust. Can you see yourself ever trusting him again? Not right away of course, but ever. If the answer is no, then the next question is are you ok living with that? If that second answer is no too, then I think the path is clear. Assuming you get past that hurdle, then the next question is are you ok going back to the way things were between you two sexually? If the answer to that is no, then you are just setting yourself up for resentment. Suffering through that again for a while when you are trying to make things work, that's to be expected. But if it goes on, the resentment will start to creep in and that will start to undermine anything you may have started building back.
It's a tough place to be, and we're sorry you are having to go through this. No matter how much he tries to shift blame, it's totally not your fault, always remember that and draw strength from it. Good luck.