I think with £5m plus I'd give up work, possibly. Less than that and I'd probably still just do what I do. If I had a spare £1m-£2m in cash, I'd just use it in different businesses anyway - so more work!
Im not 100% sure it's all about the money, but keeping yourself occupied doing something you enjoy. Far too many people don't know what to do with themselves when they retire.