Based on the existing elected and appointed panels, I don’t think we can trust that to act in the interest of justice all the time.
I wish we had something like an express vote of no confidence giving a majority of a quorum of citizens the power to remove any federal employee. They should need a quorum of signatures to trigger a vote at all to help prevent abuse. Like a fourth branch of government.
The current system of judges choosing if they are biased or not is obviously broken, you’re absolutely right about that.