I play my Strat through a Top Hat and a LSS for stereo with a Fulltone TTE and you know what? I absolutley love my $125 Roland Cube (w/ phaser & reverb) when I play with headphones. Like you said it's "me." Being a huge Steely Dan fan for years (yeah, I'm an old guy), I learned that often...
