will try to tell him that I'm not avoiding him, but still scared he won't be entirely convinced...

Try turning the tables and asking him out.

...or try saying yes...if you say things like 'the timing isn't right' then I ask what if it IS right for him. To quote Toto...'love isn't always on time.' I might remind you that you are not in a movie and he will move on.

Time is relative to the observer. You don't like him because you would make the time. Honestly you like the him wanting you than the disappointment of losing the dance. Keep him on that leash and tell yourself he's the worst.

so y dont you tell him then?