The hardest part of dating as a man (who isn't super duper model-tier hot) is keeping the woman on board long enough that she gets to see your charm, and humor and positive points.
Personality DOES count, but it's a moot point when most women will ghost or dismiss you LONG before you get a chance to show what a charismatic, fun person you can be.