I've dated men from 4'8 to 6'6 so I thought I'd weigh in with my perspective on the differences. Personally, height isn't an issue for me. I'm more attracted to a good smile and nerdy, skinny types of guys. I'm only into guys who are pretty sure of themselves and don't take things to seriously so I have never dated anyone who had issues about their own height. The first guy I hooked up with was 5'1 and was a total jock, professional gymnast he never brought up his height and was extremely confident, that was really what attracted me to him.
He was pretty muscular so I never felt like he was smaller than me. The guy who was 4'8 was pretty shy, insecure. Never wanted to go out and even though he never mentioned and was pretty uncomfortable about being short. I think he was more into the idea of being with me because I was only slightly taller than him, so he tried to make it work for the wrong reasons. Funny thing is a girl he knew was really into him but she was 6' and a bigger girl so he never "found her attractive".
He was a classic "Nice Guy". He did have a pretty huge dick tho. Really funny guy, really easy going. We started dating after partying so much together. He seemed pretty confident at first but turned out to be pretty depressed. Had a lot of issues but I don't think his height had anything to do with them. I ended up leaving over drug use. Overall I'd have to say that the shorter guys I have been with have always better at sex. I've also noticed that shorter guys tend to have nicer cocks for some reason.
They may have been short in height but not in the pants. I also know about 3 beautiful girls 6' girls who have had their heart broken by shorter guys. I personally don't really see heightism against men around me.
Anyways I hope that gives some perspective for guys who are hard on themselves about dating.