I take this as a sign of having too much money tied up in a watch. If I’m scared to wear it, it means it’s too expensive.
I know there may be other reasons for others but I find I wear my least expensive watches most often and I don’t worry about knocking them (too much)