So I noticed that in the game the tavern is what limits the max number of soldiers, but I feel it should be the ship because how can 100 people fit in a small ship yet a big ship not be able to carry 30 people