I would assume any wizard worth their salt would spend quite a bit of time fishing and doing nothing but smoking their pipe while they lazily watched their rod for a bite.
I would want something that isn’t going to get in my way when casting or reeling. Like having extra fabric catch on your arm or trip you up. Also I don’t want to be getting bait and shit caught in all that fabric. The hat is a good idea, with the brim to protect from the sun, but the pointed top seems too heavy, so when you have to lean over it might fall off, or poke into the shit you are working with, like your tackle box. And then if you ever had to actually go in the water, lol good luck with that.
So you would probably be better off with jeans and a t-shirt.