We Follow Directions In A Language We Don't Speak