The Universal Society of Hinduism has expressed unhappiness over the destruction of an ancient temple in Bujang Valley, Kedah.