Former Gerakan president Dr Lim Keng Yaik is quitting his position as party adviser because he was not consulted on the leadership crisis in Penang.