Yes, but my defense is so that every building has at least one cannon within reach too. Most of them have two , or a cannon and gun tower.
FWIW, I used wall pieces to simply extend the area I occupy. If nothing else, it forces an attacker to spend time crossing empty space that could otherwise be used to attack. I'm thinking about moving my mines and distilleries out from my core as "decoys" to further slow an attacker down from reaching my warehouses and lodge. (I generally my mines and distilleries cleaned out, so there's no substantial loss of resources when I'm attacked.)