Current Super Saiyan Goku is not at the level of Gods unlike Super Saiyan Goku back when fighting Beerus. It's not ridiculous, he wouldn't have lost strength or got weaker.

His Base and Super Saiyan form were boosted up to God level at the time because the power of Super Saiyan God was running through those forms.