Certainly. I'm not saying soap is bad by any means. It's a tool for bathing just like any other. Not using soap to wash your body doesn't imply unhygienic anymore than not using a scrub brush makes you unhygienic.

What matters is that you wash regularly, get rid of grime, dirt, excess oils and dead skin buildup.
There's many paths to hygiene. For most people, the one with soap is the easiest and the only downside is "now moisturize".

Persistent advertising from cleaning product companies since the 50s have heavily pushed a level of cleaning and perfuming well beyond what's actually necessary for hygiene.
My body wash company would like me to use a silver dollar sized portion. I get better results from a dime sized portion and a moderate firmness silicone brush.