That's not quite true, you need to have a TV license if you are watching live TV, i.e. as it's broadcast. You don't need a TV license if you are watching other stuff, i.e. Netflix.
I know a couple of people who have stopped their TV licnese, and you should see some of the letters they get from the TV licensing people, they really don't like it. They are threaning them almost like the mafia, but there is nothing they can do, as long as they stay within the law they don't need a TV license.