I own and use a lot of camera’s and I think for what you have described you are needing, I would recommend the Sony RX100 or the MK2 version with the flip screen. The image quality is fantastic and it is small, easy to use.
I used to Carry it everywhere with me, but I now take a Ricoh GR 2, it is easier to slip in a pocket but is a fixed lens so no zoom. I mainly use it in black and white mode and it is stunning. Take it everywhere, even when I have my X100 F with me.