The police have warned the public not to assemble outside Istana Iskandariah in Kuala Kangsar, Perak, this afternoon.