That probably wouldn't be much of a problem for fiber reinforced concrete, since it's fairly alkaline. Likewise plastic building siding would probably still last longer than, say, wood siding does now. Which is to say a very long time.
The existence of common microorganisms that digest a type of material typically only matters in composting-like conditions.
PLA, the now-common corn-based biodegradable plastic, lasts quite a while outdoors in open air. If you compost it, however, it degrades about as fast as a very dense wood.
(Edit: the post originally said PVA, but that was a typo.)