How do you clean this?

I've heard some people say to use soap and water on a rag, but there's no way to rinse it off, so that's going to leave soap residue. I bought a steam cleaner but that doesn't get it done either. What is the proper way to go about this?