Veteran lawyer Karpal Singh said attorney-general Abdul Gani Patail had not given him the fiat to prosecute lawyer VK Lingam over a controversial video clip.