First thing I would do is put a hold on swinging until you two can get back on track with communication! Not sure why if you had a problem with what happened with this guy you chose to play again with him so soon? Taking a break should not be an issue if you two truly love each other and are committed to your life together.
As far as rules being broken that is not cool, but at the same time some rules are pretty hard not to break. No kissing is one I will never understand. Without it there is no sex for the two of us. Don’t believe it is any more intimate then putting your mouth on someone’s sex organs. If people are not aloud to fully enjoy their sexual experience’s with others what is the point of doing it?
Insisting on condom use is legit and should be followed. It is both of you that have a chance of a lifelong STI if one of you is careless.
As already said drinking can be a problem and makes people do stupid things. Maybe best to avoid it if you can’t control it.
Do you need to have sex with others atm or do you need to be in a stable loving relationship?