Quote Originally Posted by druid91 View Post
Buy them from merchants.

Though the best way is to get the black-star. Then just soul trap a bandit.
You can mine soul gems as well. There's quite a few veins (along with everything else) in Blackreach.