Are there any mods that can help to address this?
The mods that just straight-up remove walls make the game too easy as minor settlements are completely defenseless, their garrisons are puny.
What would be best is a mod that removed walls from the minor settlement garrison building but also gave them bigger default garrisons.
I don't want to change the garrisons of major settlements, though. They're already a complete chore to siege.