Shafie Apdal's Semporna Umno division has retracted its invitation to party president Najib Abdul Razak in favour of his deputy Muhyiddin Yassin.