Audio devices screwing me over

As of right now I have a headset that is mildly broken, but I am buying a new one sooner or later hopefully. One of my neighbors a long time ago gave me a pair of steelseries headphones, since my headset that I currently am using it broken I wanted to see if they worked.

They ruined everything. I don't like the headphones because they are way to complicated to set up, but now whenever I want to use my old headphones. The sound device is always set as the steelseries headphones and mic. Even if I disable them and remove them, THEY STILL COME BACK!

Please can someone help me, this problem has gotten far too annoying. I just want to remove the sound device so that whenever I open windows 10, it is my normal sound device.