Not completely, I think. A lot of casters (if only by virtue of their players) tend to cast the same spells over and over again. Why should a blaster sorcerer who keeps casting Fireball and Scorching Ray over and over again have the same difficulty finding spell components as a wizard who uses a different spell for each of his slots?
Put another way, can I just buy a bag of bat guano specifically instead of buying a "general spell component pouch"? That way, I could cast Fireball as much as I want, and then use the general spell component pouch for my other random spells.