Former minister in the Prime Minister's Department Zaid Ibrahim has failed in his bid to challenge the Hulu Selangor by-election results.