Four Palestinian children were killed and one was critically wounded on a Gaza beach on Wednesday by a shell fired by an Israeli naval gunboat, a Palestinian health official said.