The main contractor appointed to build the new Istana Negara (National Palace) is not fit to handle the multi-million ringgit project, said parliamentary opposition leader Anwar Ibrahim.