If it's spiky rather than consistent, the simplest, yet often overlooked reason could be that you're gaming on WiFi, instead of through an ethernet cable.