I just took some Zigbee buttons and stuck em on the wall. I rent though, so I can't mess with the wiring. Works well. I have Zigbee bulbs so I just put little 3D printed covers on the real switches to keep the power going to the smart bulbs.
But can't you get a smart switch with physical controls? What tech do you use to control your lights/switches/relays? Zigbee? WiFi? Matter/Thread?
I'd do something like this: https://a.co/d/022pOcJo if I could. (Not recommending this brand... Didn't research it.)
WiFi ones exist too but I wouldn't want to permanently install WiFi smart home stuff. If you're going this far invest into a Zigbee or Matter over Thread radio. It works great with Homeassistant.