The total freedom for voters to change their addresses and voting constituencies should be restricted or else it would jeopardise our democratic system, warned the Election Commission (EC).