The surface of the sun is only 5000°. The upper limit for red dwarves is just slightly above 3000°, so temperature would actually not be a problem.

Though gravity would still be an obstacle.