About 100 armed men holed up in a village in Sabah are refusing to leave, saying they have links with the Sultanate of Sulu in the Philippines which has a historic claim over the northern tip of Borneo island.