Am I wrong for this?

I took a batch for 3 people. I already shopped and headed to the first customer. It was to some condo community with 15 buildings with a front gate security. Front gate security requested me to hand over my ID or license in order for him to give me a key for me to open the buildings main entrance door where customer lived (so I can bring it up to his apartment door). Reason he asked for my ID because he said drivers before had taken the keys without giving it back so security office put up a sign saying (ID for the 🔑) I refused to give my ID because this is not a government building or anything like that this is a normal building and I don’t trust giving my license to anyone unless is the law. I told security let me reverse and let me call instacart support. Customer didn’t want to come to the gate (which is understandable). Instacart put me in a 3 way with me and instacart agent and customer. Customer told me to just give my license I said no , I’m not required by law this is not a government building I shouldn’t have to give my license . He asked to cancel his order. It was $100+ worth of goods. Instacart canceled the order and I moved on to the next one. Am I wrong for not giving my license? security rules are not fair . Is not my problem that the buildings are set up like that