It seems you have asked and answered your own question.
I have heard it estimated that playing a musical instrument well is 95% mental and 5% physical. My suggestion is to work toward the goal of becoming a "musician" and not just a "sax player".
John