What is the downside of using very long, random passwords, and just requesting a password reset via email everytime I need to log into a service?

This way, every single password I use is unique, and I have no problem with them being leaked. I would not need to remember them, so I would not need to store them anywhere. I would just need to maintain access to my email with a password that I really remember.

What are the downsides of this? To me, it seems like a good idea for services I only want to use once or twice. Is it just that I risk losing access to everything in the event that I can’t access my email?