I think It is as much culture conflict as language barrier. No easy solutions in that regard sadly. You can try using things like babble-fish to translate in the written format.
I can say this as someone with hearing issues, If and If i just wished to limp by in social situations, I just nod my head, smile and say yes. I suspect that could be a crutch in language situations as well.