Newly-appointed Chief Justice Zaki Azmi has pledged to act against a “small” number of judges who have failed to perform their duties.