A steady exodus of Indonesian workers from the palm oil industry in Sabah for better wages back home has local planters increasingly worried.