As you two know, we're the same way. Just don't have the amount of free time as we'd like to go out often so we take advantage when we actually can arrange a night out.
To the OP, if the vibe wasn't right on the first meet, why do you think it would be different the second time? If you have the opportunity to meet up again, it wouldn't hurt. For us it isn't worth the time and money to go out with a couple if the vibe wasn't right. The way you wrote about it, I don't understand how you think it would be better on a second meet.
And we've found the 4-way match is very difficult to get. Our approach is 'are they attractive?'...'are they relatively fun to be around?'...let's get naked. I don't want to hear about their lousy job. I don't want to hear about their politics. I don't want to hear how the woman doesn't like her thighs/boobs/whatever. I want some laughs during dinner. I want general flirting, smiling...just fun. If they're uptight, the naked time will likely be awkward. Again, we want to have fun. Naked fun.