Why isn't Virginia considered a southern state culturally?

I used to live in Maryland, right across the Wilson bridge from Alexandria. I know what you are talking about. There is a big difference between Northern and Southern Virginia. I mean think about it they annexed West Virginia as well. Really all your missing is East Virginia and your set.