Until you are able to live without anxiety medications, it is likely you will continue to have erectile/libido issues. There's really no way around it. Supplementing hormones is a very, very bad idea, a last resort, and should ONLY be undertaken with the monthly supervision of an endocrinologist who monitors 6-8 of your hormone levels. You absolutely cannot treat one without watching the balance of the others.
As for being diagnosed with low T, what test did they conduct to determine this? Blood test or saliva test? If the former, you've gotten erroneous information. A saliva test measures 3x more accurately than a blood test, because it measures three factors, not just one isolated one.
Asking what relationship one hormone has to libido is like asking what one body feature has to do with attractiveness. Your hormones are NEVER in isolation. Libido is modified by over a dozen factors, including several hormones. The most dramatic effect on libido is fatigue. If you don't have extra energy, you won't have any libido. Understand that testosterone only affects libido in a limited way. Your body does not use your brain to govern libido. If your body does not feel safe, rested, energized, (read as when your body is stressed) it shuts down your reproductive system because it interprets those environmental conditions as unsafe for reproduction and raising of an infant. Chronic stress, anxiety, fatigue, etcetera will have a more dramatic effect on your libido because your physical/emotional state indicates your environment is not safe/nurturing, and therefore you shouldn't have children. It has nothing to do with sex appeal. It has everything to do with procreation. Your body is not listening to your psychologist.