I had some similar concerns before starting TRT three years ago. Couple of things to consider.
Genuine low-t affects more than just your libido and triathlon results. It can cause anxiety, depression, fearfulness, and in general make a mess of how you look at things. It can make it hard to concentrate and think things through. My total T was 142, I had just about every bad symptom of low T you can have, and I still wasn't sure it was a good move because what if the supply gets cut off or what if the world blows up or I lose my health insurance and can't afford it or whatever.
That was the low-T talking. But then I finally asked myself: if you are suffering from the effects of really low T, what's going to happen to you if you go on TRT and it gets taken away? When it does you're going to suffer the effects of low-T.
Here's the kicker: within a couple weeks I stopped freaking out about everything and having panic attacks and worrying and second guessing everything. I thought it was just my neurotic personality, because I was that way about everything for 20 years (it started about the same time I lost my ability to concentrate and stopped getting morning wood). It wasn't. It was my hormones.
Now, that's my own case. I was really, really low, and it affected me badly. In my case, I just didn't have that much to lose. For me, the fact is, even if I am now completely shut down, I wasn't all that far from that before anyway.
TRT has been a godsend for me. But, that said, they totally overmarket this stuff, and try to sell it as the fountain of youth to guys who probably could solve their problems with a decent diet, some strength training and a little less booze. I don't know if you need it or not. If I could get myself where I need to be without exogenous sources, I'd definitely prefer that. In my case, though, I was doing just about everything right (the strength training wasn't accomplishing much ...) and I was still a wreck. So I had nothing really to lose