I'm afraid I will have to defend myself from my male best friend, please give me some advice

I (F20) was super close to my male best friend (M21) during high school. We were like siblings until we graduated. One night he decided to confess his love for me and of course I told him that I'm not interested and I see him as a brother only. He accepted it at first and I thought he would never mention that topic again. I invited him on my birthday last year, he got drunk and he kept on saying how he won't ever meet someone like me - in front of my parents. I got offended a little bit but I guess he said that because he had too much drinks. When we decided to see each other again, I put on some random perfume and he told me I smell good. I said thank you but he pulled me closer ( without my permission ) and he quickly put his nose on my neck to smell it. Each time he asked me if I have met someone new in college he would stop smilling and when I say no his mood significantly improved. When he hugs me, he hugs me so tight and I let him because he keeps on saying how he missed me a lot. When he was about to leave for a foreign country for work he hugged me for like 10 times. I kept quiet because I didn't want to ruin his mood. My parents like him but my brother can't stand him. To be honest, I love him too but I miss the times where he used to call me "his sister". I''m just afraid he won't be able to control himself one day, I feel like he keeps forgetting what I told him when he said he's in love with me. Please, give me some advice. I seriously don't know what to do.