I think it can be okay, depends on who is doing the grabbing/slapping and what the relationship is.
When I was a kid, I'd get a playful slap on the rear from parents or siblings and I'd do it back. Actually, we still do it as adults, rarely, but it does happen. However, if it was a stranger or...