Why do so many people complain about filing their taxes?

Honestly, it seems like a very common complaint that people have to deal with filing their taxes, but I've never gotten why people act like it's a huge undertaking, even in years I've had multiple jobs and moved between states it's never taken more then an hour, and I've always been able to anticipate if I'd have to pay anything for extra income. Is it significantly harder and more complicated if you own a house or have kids? I just don't understand why everyone acts like it's a horrible process