Welp, I'm not a relationship whisperer, and I don't know anything about your actual situation either...
...but maybe a safer bet could be for you to just initially try and get more excuses to hang out together, without really asking that person out... And if they seem like they're not really into that, well in this case you would have a probable signal that they might not be into you, thus letting you back off without worrying about reputation?