It is a great risk in the early game before talismans to take 75 aggressiveness (lowest value). Also, if the talisman is knocked out but the rest of the ship is intact- a relatively common occurance- you now have essentially 0 chance to hit.
It is all a matter of play style. Some people do not like the risks of 75 agg, some are willing to take them.