Well, your combat ability will take a nosedive by mid levels factotums really rely on font of inspiration to not run out of stuff to do in combat after the first round.
You can probably still manage if you make good use of its SLAs, but it'll be quite a bit trickier.