Thailand's premier has announced an inquiry into the death of 78 Muslim protesters who were rounded up by troops and crammed into trucks, amid international protests and fears of further violence in the tense region.