Then that's it, if he doesn't accept you, then move on. There's no point in being stuck on one guy who won't like you back. As difficult as it may seem, its the better choice if you do get rejected.
If he hates you, all you can do is hope that maybe you two can be friends. If a bf/gf relationship fails, friendship tends to help out. It happened to me and my ex :/