I'd say "let alone" in this context means something akin to "don't even consider" or "don't even talk to me about", as in, "leave (let) [the idea of doing B] alone".

"I can't walk, don't even talk to me about running" would be the phrase that makes sense.