What If the Galactic Habitable Zone LIMITS Intelligent Life?