I don't even think he has much of a point anymore due to the inactivity. Not at heavy weight with one fight against someone with little wrestling skills and after he lost his last fight at LHW to Reyes (who is probably not among this "absolute toughest competition"), no matter what the score cards said. Other unproven champions get stripped all the time when they're injured.
Why should we believe that he is the exciting guy at HW and presumably past his prime. The last time he beat a legend was 6,5 years ago in another division (Cormier) – and it was overturned due to doping!
So yes, in a literal sense he is right of course, he fought legends and Aspinall didn't. But I'd rather watch Aspinall v Stipe for the title with Jones stripped than Jones v Stipe and I think it would be more deserving as well. So I don't think he has much of a point in any practical sense.