Followers of a Philippine sultan who crossed to the Malaysian state of Sabah this month will not leave and are reclaiming the area as their ancestral territory, the sultan said Sunday amid a tense standoff.