I don't think there are swordsmen who can really challenge Zoro other than Mihawk and perhaps Shanks (and I seriously doubt he will cross swords with him), I am pretty sure Zoro's future enemies will have other kind of abilities, perhaps even being stronger fruit users perhaps even Logia types (of all his enemies the only one I recall being a Devil fruit user was Mr. 1, though I may be wrong)