Fix Rubber Contact Buttons With a Pencil (Logitch Harmony 650 Remote). I did something similar but I used some (kinda dried up) wire glue, the important part is get something conductive on the contact point of the button.

I've actually gone one better and just implemented an IR remote in Home Assistant with a physical switch I can just flick to turn everything on and off (more advanced stuff still needs a remote).