I wouldn't extend your issues with Phantasmal Force to control spells in general.

Illusion spells have a reputation for being very DM dependent and excelling primarily with players who can come up with useful and creative applications on the fly. (And just because someone has trouble thinking quickly enough to catch good uses of them in the moment doesn't mean they're unintelligent, either. People's brains work differently.)