He is a jackass, why do you even care if he's mad at you? Unless you feel he may physically escalate this I say, fuck him. You have to think...someone that goes through the trouble to pretend to be a couple, then actually go out to meet a real couple and then try pull off a rouse like this has to have a few screws loose upstairs.
I tell funny stories all the time about dates gone wrong. We had a guy after us for 2 weeks about a cheap $5 pair of sunglasses. He was really going overboard on the demands for the return of his glasses it's still one of our favorite stories to swap with other couples.
There is this nice little button on Swing Lifestyle, when you are looking at his profile that says 'report' and it's anonymous. I'd report the guy as a single meeting people under false pretenses. You would be providing a service to all the other people who's time he is going to waste in the future.