To the man on the street, it would appear that Khairy Jamaluddin Abu Bakar's descent in influence is just as fast as his ascent during the era of the fifth Prime Minister Abdullah Ahmad Badawi.