I think the difference between him and Joffrey is that the latter was an utter coward whereas at least Bolton has some balls and will actively take part in the fruits of his sadism. With regard to the balls, the future of that remains to be seen. I suspect a certain victim of his may be back for some stone cold vengeance at some point.