A group of Pahang residents has urged Australia's Lynas Corp to "pack up and leave" Malaysia and abandon plans to build a rare earth refinery in Gebeng, near Kuantan.