Figurative extension of the literal origin in baseball, where either three strikes or four balls retire the batter.
three strikes and you're out
