I guess you don't believe that with great power comes great responsibility. It seems to me that line of thinking that having control over other peoples lives doesn't require responsibility. That is the real problem here.
Judges, police, politicians all are very different from those of us not giving the power over others lives. You should expect them to behave accordingly or expect that they be locked away in prison or executed. Just like they do to other people often times wrongfully.
With great power comes great injustice. This is a fact of human existence. All the bullshit about "responsibility" is just window-dressing for the arbitrary domination of human beings.
"Control over other people's lives" is the problem. Occasionally those who obtain that control use it only in benign fashion, but such conduct is exceptional.
Judges, police, politicians all are very different from those of us not giving the power over others lives. You should expect them to behave accordingly or expect that they be locked away in prison or executed. Just like they do to other people often times wrongfully.