So I was interested to see what my PC benchmarks were and found that my video card was running about 4x slower on the benchmark than others with the same card. I tried uninstalling and reinstalling the latest Nvidia drivers but still got the same result.
I decided to do something that I had written off as bunk a long time ago: Display Driver Uninstaller
I had heard others say that they did this and removed all of the old drivers and then reinstalled and saw massive improvements on their video card. I figured at this point I had nothing to lose. Well, I'll be damned it worked. I started getting just a bit above the average benchmark so a 4x improvement. Why it works, I have no idea. Seems like a failing on the video card companies though, because having old drivers on my computer shouldn't cause a decrease in performance.
I run on my TV so I cap FPS at 60 anyways but in games were I was dipping into the 40s range, they run at 60 all the time now and never skip a beat. Except for Path of Exile because they have shitty code but meh. But yeah nice to have things working as they should.