Toyota Dealers Keeping My Keys

So I've been to 2 Toyota dealers now and both times I've went, I got my trade appraised and they came up with a ridiculous price. I declined and asked for my keys and they come back with a slightly lower price. I said we're not going to meet and ask for my keys again.

They bring the used car gm. He just tells me useless garbage (I've been here for 2 hours already and they still have my keys) and he says he "might" be able to make what I'm asking. At this point, I don't want to give them any money, they've held my keys for hours and they won't give them back. Am I really the "bad guy" for leaving even if he did get the price I wanted 2 hours ago?

This guy literally said, "I'm not trying to keep you hostage" and proceeds to keep my keys. Are there any better experiences like Echo Park or somewhere else?