When the zombies attack.

[Human No More]

You don't want to carry more than three weapons as a maximum. There are too any considerations such as bulk, weight, ammo use for guns. 2 guns and a close combat weapon works though, or even a backup close combat weapon, but don't overload yourself unnecessarily, stamina and speed are VERY important in evading zombies.