Yeah and y'all aren't even that far north. Ours is far closer to 4:15 PM than 4:30 PM at this point and in December it gets to something absurd like 4:23 PM. Of course, people further North will laugh at this and say "sunset was 2 months ago" at that point.
This is a good picture showing how different places experience different sunrise/sunset times.
Most just think that it has to do with being north or south but it also has to do with left or right depending on the location in the certain time zone.