Quite possible culprit is thermal transfer to the heatsink too. I've seen occurrences of thermal patches badly (or not at all) applied on the die. Five of the 8 PC laptops I owned suffered from that, and a cleanup + proper thermal paste cured it on three. The two others simply had bad design and just could not get the heat out for some reason.
1. you are doing some computationally heavy task or 2. your fan may be faulty
Simple as that.