It has been answered by WOTC at some point that Inspirationpoints are to be considered refreshed "after the character has a few minutes to catch his/her breath", so out of combat it seems to me you can consider them self-replenishing.
Also, just break down the task you are doing in single challenges a.k.a. "encounters" and you should be fine anyways.