There are many ways to get an advantage without using military force against someone who is primarily an aggressor. There is a defensive tree that generally have more powerful attacks than an aggressor who attacks a fortified unit within a fortress or free standing wall. In fact, this was a huge problem in Civilization 4. Ever tried using a Tank against Longbowman? Yeah, the Tank fucking loses.