Any two justices may dismiss any such constable from his office, and upon such dismissal all powers, protections, and privileges vested in such constables shall cease.