The government has to exercise caution in handling issues pertaining to manipulation of religion to avert bigger implications, Home Minister Hishammuddin Hussein said today.