gotta solve the banditry problem first. conflict rp will lead to a settlement finding walls more and more a necessity. brandybrook is about the only example of a non-walled settlement that functions, because the only purpose of raiding brandybrook is to raze and terrorize. it’s hardly even worth it, and it’s just a bit toxic. any other settlement though, they have militaries and – typically – a reason to raid.
unfortunately when the server has a multi-life rule in effect where you die and respawn, there is no risk of death, and therefore walls will always exist because bandits will incessantly return. but that’s a whole other argument which effectively nullifies this one without the other being solved first.