My knee jerk reaction was no, of course it's not swinging...
Then reading and thinking about it, swinging can be whatever you make it. Whether one spouse sits at home watching television, knitting or whatever while the other spouse is getting their fill of hot sex. If they both agree and are honest about their actions, I don't see why they can't call it swinging.