Prime Minister Najib Razak will make an historic visit to Batu Caves on the eve of Thaipusam, which falls on Saturday.