Pakatan Rakyat leaders brushed aside speculations of PAS leaving the opposition alliance for Barisan Nasional and stressed that the talks the Islamic party had with Umno were not a "cause for concern".