I thought it was the kind of charmingly simple thing that Cap would say there. He isn't super religious, but he isn't atheist either.
Also, if your reaction to somebody casually bringing up their faith is "I want to smash him in his face" then you probably shouldn't be throwing stones about religious intolerance.