Former Federal Court judge Gopal Sri Ram said today that the judiciary has failed in its duty to defend minority rights.