Sure, but the opposite doesn't work either. 4E went mostly with "feats povide numerical bonuses, not options", and most feats there aren't exciting either. Although a +4 to initiative isn't worthless, it isn't very cool either.
I don't like the notion of splitting between "combat" and "utility" feats or powers, because that implies that the latter don't work in combat and the former don't work outside combat. You end up with two non-compatible subsystems, and that's just weird.