From the male perspective, there is a massive difference in intercourse with a condom and without a condom. There were times back in college where I passed on sex because I had to wear a condom. I couldn't feel anything so why bother. There are very thin condoms these days where you'll at least feel the warmth but the friction is still significantly different.
With that said, we always use condoms when we play in the lifestyle.