Yes completely bonkers.
Swapping out your main daily wearer (which translates to the watch you like the most) for something you are not 100% on is not a good way to go.
Never mind that Rolex hold value whereas white faced Panerai tend not to (at all)....