Umno Youth deputy chief Khairy Jamaluddin's warning that there were limits to freedom has been ticked off by a prominent think-tank.