Soooo, kinda dumb epiphany :

Turns out I don't suck at 16-bit baseball games, I suck at FIELDING in 16-bit baseball games

Note to self, Keep Auto Fielding ON.