Wife86, I'm sorry the night turned out so poorly.
There are potential explanations for your husband's reaction, but it's hard to know what's going on without being able to speak with him. You're facing the same hurdle of course.
Wild guesses; your husband didn't expect you to have as good of a time as you did. He might feel like he's lost something with you, and doesn't feel like he can ever please you again the way you were. There might be some deep seated jealousy exposed within himself that even he didn't know about beforehand. It might be that now that he's seen you having sex with someone else, he can't unsee it..and it keeps flashing back in his mind, like a small form of PTSD.
I would strongly consider counseling to help work through this. He might not want to go, but at least have him go with you. This has to be talked out. It might take time, even a lot of time, but patience is key.
For some people, swinging is just something that can not work. That's ok. It doesn't make him broken, or somehow less. Get back to being just the two of you, and stay with that. That doesn't mean we don't welcome you here to talk with us! Please do. If you have questions, we'll try our best to answer and help you through.