Playing while there's a competition on

I'm still relatively new to golf and not quite clued up on everything yet. Went to my local course this morning for a casual round and when I got there noticed there was quite a few foursomes out on the course. Paid for the round and the starter didn't mention anything about there being a comp on. I teed off and managed a few holes relatively quickly then I was caught behind two foursomes and Infront of a couple. I just wait at the tees until about the 12th and one of the guys walked over and, without sounding like a douche basically told me I should go back to the front and play a few holes to finish my round there.

I played out the 13th then headed over to the 7th where it was quiet. Had I knew there was a comp on I wouldn't have teed off at that time tbh. I was playing fairly well so it wasn't as if I was holding anyone up, was actually hanging around waiting on the guys infront alot. Did I do the right thing going back to the quieter holes or should I have just played out my round? And in general going into the summer is it better to go in the afternoon on Saturdays? Cheers