I don’t mind chatting it up with neighbors but I get where you’re coming from. Which is why when I run into a neighbor, I keep it cordial and short. If they want to keep talking, that’s fine, but at least I’m not the one talking the ear off somebody who doesn’t want to listen. lol
Unfortunately, though, you’re going to run into this, just like you’ll have loud, unruly neighbors at some point. You can tackle this problem head-on by telling them you want some quiet time, staying in your RV if you notice them out, asking to be moved, etc.