Currently there is no way to preview all of the avatars like that, sorry. The issue is likely to change in the near-ish future.

For now click on "Quick Links" then "My Profile" to open up your public profile, then change your avatar in a different window and refresh your profile to see what it looks like.