The erosion of public confidence in the judiciary's independence would ultimately lead to instability and remedying it would be a protracted and arduous task, warned the Sultan of Perak today.