Those responsible for construction defects in government-owned buildings must be brought to book said Opposition Leader Lim Kit Siang.