Was shouted at by the bus driver

Me and my friends were standing inside of the bus and it was a pretty crowded. Suddenly, the light for the stop button lit up and the doors flew open and no one came down. This happened again at the next station and the driver shouted and cursed at us. We didn't understand chinese but from his voice, he was really angry and signalling us to go down.

I think we were the only people who are tourists, or at least looked like one. A very bad experience for our first day in Taiwan

Edit: We were standing in the middle and we are just 4 people. None of us were near the stop button since we were scared that we might hit it. None of us actually hit the red button tho so....