Police need to investigate further the recent church attacks before making any arrest as they have to ensure that the suspects really committed the offence, says Home Minister Hishammuddin Hussein.