If your tablet keeps writing after you lift of the page, there might be something caught in your pen sensor.
Take out the nib (plastic point that writes on the tablet) – pull it out with your teeth, and hit the pen point down on a table – then it should be ok.