Why are villagers ALWAYS near me when terraforming 😭

My villagers like NEVER SHOW UP. But when I’m terraforming…..

They are all of a sudden like: “ mhhh were ahould I sit? I have so many pretty places to choose from! But let’s go to the place where she is trying to build something! 😃” I HOPE IT IS NOT JUST ME