The Finance Ministry admitted that the implementation of Goods and Services Tax (GST) has caused some businesses, especially those owned by the elderly, to close shop.