Changing the public's perception towards government agencies is not an easy task and cannot be done overnight, said Prime Minister Abdullah Ahmad Badawi today.