I think you're right which is why certain G-Shocks (and no doubt other radio controlled watches) have a feature that re-aligns the hands every so often.