Hmm....While I can see what why you might come to conclusion, we're not making an unarmed attack here, because we aren't making an attack.
The closest equivalent action to a general touch attack would be a spellcaster delivering a touch spell (as a touch spell may be delivered on a round other than the one it is cast in, so the touch attack would be standalone), which as you listed does not provoke an attack of opportunity.
Personally, I'm blaming the confusion on the overuse of the word "attack" in the rules.