Civ screen only tells you if you've meet them. There are 2 ways you can find out if you really have goblins. First, backup your save file, abandon and then check to see if there are goblins when you try to start a new fort in the same spot. The other is to wait until your first ambush or snatcher.