Home Minister Hishamuddin Hussein today said there is no reason for the government to retract its appeal in the on-going ‘Allah' case, despite having admitted regret that the decision to ban the use of the name by non-Muslims will "haunt" his ministry.