Very fair. I've just seen a lot of posts here and elsewhere in recent months that, I think, reflect people who are jumping in very quickly out of post-pandemic excitement.
I know for Mrs. E, she was worried about me being exactly that person: the one who regrets seeing what I was asking to see and wouldn't feel the same after or be able to get over it. I could speak for myself because I was very confident I would not be.
Women, too, can have doubts about male enthusiasm for swapping and hidden meaning. "Are you not jealous because you don't love me", "are you trying to get rid of me", "are you just interested in watching me with another man so I won't be able to say no to another woman", etc.
I think OP is speaking for himself here that he definitely has doubts. That's OK. It's completely fine for him and his wife to move very slowly, talk about what they experience, and then move further if they both wish.