Information, Communications and Culture Minister Rais Yatim has been lambasted for saying that only Mandarin and English were spoken at an official function he attended in Penang.