Quote Originally Posted by Verble View Post
Use your level 4 ASI or take it with Variant Human.
Agreed. There's nothing wrong with delaying Charisma progression to take something you like, especially if battles aren't deadly in the campaign.