It is irresponsible for Women, Family and Community Development Minister Shahrizat Abdul Jalil's family to question the semantics employed by the auditor-general, said Ipoh Timor MP Lim Kit Siang.