So why do you think you have more right to park there than him and he should move to accommodate you?
If there are that many in the neighbourhood chances are someone else will capture the space before you.
But at least you’ll have the satisfaction of ensuring he can’t park outside his own house I suppose…..