I had trouble with the chalk flaking off also. I switched to Carb- Othello pencils.
A bit price , they have lasted a while. Just rub the pencil tip on sandpaper over
water, swirl and voila ! beautiful and no flaking. We have done this at our Art
Fair with great results!