Yes, you have the right to be chilly if you are having difficulties avoiding falling in love with someone. You have to shatter those boiling feelings like an ice. Experiment with it. Try not to notice him, don’t pay attention to him, talk to others, and don’t give a hoot about what he thinks.
That is, show some kindness and don’t pulverize the man, but also don’t indulge him. If he has the right to be treated with reverence, but every time you address him, you end up staring into one other’s eyes having a meaningful debate, you need distance and you should be snobbish, regardless of how difficult it is.