Removal

I know I've seen this posted in this sub reddit before. But I'm curious if anyone has a similar experience. In February I am looking to get my IUD removed and try for pregnancy. How long on average should it take? I'm a little nervous as my sister had one put in after her first kid, and when she got it removed (about 5 years ago) she hasn't been able to get pregnant. She told me I should get it removed or I'll be like her and basically become infertile. So I guess my question is: has anyone else struggled getting pregnant after the mirena? Specifically anyone who has gotten one before having kids?