Well, it depends what you're trying to do, really. VB is probably the simplest for making a quicky windows app, for instance. Standard grey boxes, things like that. A solid choice if you're making say, a drug wars style game that's low on graphics, but you want it to still be a windows app instead of command line or w/e.

C# is probably among the easiest for 2d graphics thanks entirely to XNA.

Certain specialized apps like RPGmaker will be easier...but only for specific styles of game. If your game concept fits into such a slot....by all means, take advantage of it. It just doesn't work for all game concepts.

Honestly, the key is mostly picking a good, simple concept to start out with. Lots of retro games have such a thing...possibly with additional options built around it. So, cloning a retro game is a great starting place. Typically low graphics required, relatively simple gameplay.