The situation in flood-hit Pahang has worsened, with more than 20,000 people evacuated to relief centres while a man and his son are feared to have drowned.