Several MIC leaders are quietly worried that party president S Samy Vellu has become a liability and should be replaced soon.