"Not to be reckoned with" is perfectly grammatically appropriate. No mistake there.