Penang Opposition Leader Azhar Ibrahim will not attend the rights and privileges committee hearing over an accusation that an entry in the state assembly's Hansard had been "manipulated".