One thing you forgot- who in the right mind would you go in to viking land in civil war, other than refugees and criminals, nord who wanted to fight for stormcloaks, Or in breton case
Spoilera nobleman escaping from his/her own deadly court.
So they have justification for arresting you in the first place.