what are the downsides of a diagnosis?

im pretty sure im autistic, or at least neurodivergent in some way. i think getting tested would give me some peace of mind and validation, but it's not extreme to where i would need extra help. so i dont really need to be diagnosed if itll just make my life harder. i heard that if diagnosed, you have to take your driving test every year which sounds like such a hassle. are there any other downsides of a diagnosis i should know about? specifically for the us / california. getting a diagnosis would feel validating but maybe its not worth pursuing for me.