The Penang BN Youth has accused Chief Minister Lim Guan Eng of being "afraid" to attend a dialogue on public housing in front of Taman Manggis today.