Malaysia will not have a balanced budget in 2006 but the government will gradually reduce the deficit, Prime Minister Abdullah Badawi said today at a briefing on Budget 2005 which he had tabled in Parliament last Friday.